Tuesday, October 27, 2009

Benchmarking the Asus UL30A (and other PCs)

ul30a bench

I'm not a big fan of benchmarking tests like PCMark and 3DMark because I don't feel like they give the average user a good idea of how a PC will perform in real-life scenarios. Over the past two years, this hasn't been much of an issue because most of the laptops I've reviewed have been netbooks with Intel Atom N270, N280, or Z520 processors. In other words, they all performed pretty much the same.

Sure, there was the occasional Intel Celeron or VIA Nano chip thrown in for good measure. But for the most part, if you picked up a laptop with a 12 inch or smaller display for under $500 between 2007 and mid-2008, odds are it had an Intel Atom CPU. So I didn't have to work that hard on the performance section of my laptop reviews.

Well, the times, they are a-changing. Soon Intel will launch its updated Intel Atom platform and it's likely that we'll start to see machines with Intel Atom N450, D510, and other chips hit the market. But more importantly, Intel is promoting its Consumer Ultra Low Voltage (CULV) platform for 11 to 12 inch thin and light laptops. AMD has its NEO line of processors. And we're well past the days when a processor's clock speed could tell you all there was to know about its performance.

So in order to help keep track of the new systems with processors like the Intel Core 2 Duo SU7300, Intel Pentium SU4100, Intel Pentium SU2700, Intel Celeron 743, and AMD Neo MV-40, I've put together a list of common CPU-intensive tasks that you might expect to do on a portable laptop. This includes transcoding audio and video files, copying a large number of files from one directory to another, and creating a zip file.

I've already used this method to test the performance of the Acer Aspire 1410 laptop (with Windows Vista Home Premium and a single core Intel Core 2 Solo SU3500 CPU), and HP Mini 5101 netbook.

But since I probably won't be able to test every single netbook and ultraportable laptop released over the next few years, I wanted to make my benchmarking tools available to the public. And it occurred to me that some of the files I was using in my tests were copyrighted and shouldn't be distributed. So I've put together a new set of benchmarking tools which are available for download here.

Today I have results for the Asus UL30A, a 13.3 inch laptop with an Intel Core 2 Duo SU7300 processor.

The test consists of 4 parts:

  1. Using VirtualDub to transcode the testvid file to XViD format using direct stream audio and the default video compression settings
  2. Using WinLAME to transcode the testaudio file to MP3 using the default setting for High Quality audio
  3. Copying the entire contents of the folder to a new folder
  4. Using 7-Zip to package the contents of the entire folder into a ZIP file using the default ZIP settings

The Liliputing Benchmarking tools are available as a 453MB ZIP file. When you uncompress it to a folder you should have 2186 files that take up about 478MB, including the XViD codec, VirtualDub, and WinLame.

Here are the results for the Asus UL30A:

  • Audio transcoding test: 32 seconds to transcode a 13:24 WAV file to MP3
  • Video transcoding test:  3:22 to transcode a 4:34 file
  • Folder copy test: 10 seconds to copy and paste 2186 files totaling 478MB
  • Folder zip test: 1:02 to create a 453MB ZIP file containing 2186 files

Just for comparison's reference sake, here are the results of the first batch of tests I ran on the UL30A, using the same set of files as I used when testing the Acer Aspire 1410 and HP Mini 5101:

  • Audio transcoding test: 1:13 to transcode a 30 minute WAV file to MP3 (The same task took 1:10 on the Acer Aspire 1410 and 2:30 on the HP Mini 5101)
  • Video transcoding test: 1:54 to transcode a 2 minute AVI video to XViD (2:41 on the Aspire 1410 and 4:02 on the HP Mini 5101)
  • Folder copy test: 30 seconds to copy 3100 files totaling 832MB (54 seconds on the HP Mini 5101)
  • Folder zip test: 1:44 to ZIP 3100 files (4:11 on the HP Mini 5101)

The results should be fairly similar for the Asus UL20A, which has virtually identical hardware, but a smaller 12.1 inch display. But I'll be curious to see how other laptops with the SU7300 processor stack up against the Asus UL30A… not to mention all those other machines with different processors.

Thanks to psydeways for the idea of making my benchmarking tools public!

Post from: Liliputing

Benchmarking the Asus UL30A (and other PCs)