Between the Lines

Larry Dignan, Andrew Nusca and Rachel King

Benchmark showdown: High-end Android smartphones

By | September 16, 2010, 5:15am PDT

If you think that all 1GHz Android smartphones are equally quick, think again. ZDNet Germany’s Christoph H Hochstätter shows that the performance of CPUs, RAM, flash and GPUs varies widely.

The basic specification of all high-end smartphones is pretty standard: a 1GHz ARM processor; a 3.5in. to 4in. display with a resolution of about 480 by 800 pixels; 3D graphics acceleration; and around 512MB of RAM.

Internal flash memory varies widely though, from 512MB up to 32GB in Apple’s iPhone 4. Android devices from HTC currently have 512MB of internal flash, while Samsung goes up to 16GB. Expansion via external SD cards is generally available for Android phones.

Another distinguishing feature is the camera: some smartphones have a front-facing camera (for making video calls) as well as the usual rear-mounted unit. An LED flash may or may not be present. All this adds up to big differences in picture quality.

What’s not evident from the smartphone manufacturers’ specifications is the fact that there are significant performance differences. Fortunately, these are clearly measurable.

ZDNet Germany uses Aurora Softworks’ Quadrant Professional test suite for Android smartphones. In addition, we use Rightware’s Browsermark, a browser benchmark specifically designed for Javascript-enabled smartphones.

Topics

25
Comments

Join the conversation!

Just In

RE: Benchmark showdown: High-end Android smartphones
fkengun 30th Nov
As I known, the pipeline depths in Cortex-A8 and Scorpion are both 13. Here is the proof. www.qualcomm.com/documents/files/linley-report-dual-core-snapdragon.pdf
0 Votes
+ -
Is this really a good thing?
tk_77 16th Sep 2010
I'm not a big fan of Android, but I still see it as a major step up from what was the norm for smartphones before the iPhone. I see the advantages over the iPhone in the perceived "freedom of choice" that it has.

However, with the different OS revisions that will always be in the wild, and the different hardware, is this really a good thing? I'm asking a serious question here.

I see the iPhone as successful because it is more of an appliance like device, like a console. Other then storage size (which has no affect on actual performance), all "current" iPhones are the same.

It's not necessarily the amount of power that your hardware has, its about what the developers are forced to deal with. Give a developer a single device with specific specification and they will (assuming they are good) build the best product they can for that device, or at least try to. This has worked well for consoles. For the most part, an Xbox 360 is an Xbox 360... the PS3 is a PS3, and the Wii is a Wii. There might be some changes as revisions increase but for the most part they are the same. When you buy a game for a PS3 you don't have to see if you have a PS3 or a PS3 Galaxy Incredible.

Now, if developers build apps for the lowest end device, then everyone can be assured the app will run well. Of course, then why have a more powerful device? If apps will only run well on a faster cpu or better memory, then how do you deal with those that have a slightly lower end model?

Of course this really only matters in real world use. If all the devices have different components, and the benchmarks tell you that one does X points better then the other, it only really matters if that translates to real world use (which benchmarks don't always do).

These are just some thoughts. None of this may matter, and the Android market may just automatically deal with it. Everyone I know with an Android phone pretty much treats it like any other phone with great web browsing capabilities and a couple games. So the difference in specs might turn out to really be a non-issue. (In which case, does it just add to confusion as to which device to get when it doesn't really matter? I don't know).
@tk_77

I think there are two issues here.

First, most iPhone users are able to upgrade to the latest OS. That's something that Apple has done really well and kudos to them. This is something Google simply has to address. But in spite of this, there are still fragmentation with iOS. The original iPhone and iPhone 3G can't get multi-tasking. 3GS doesn't get HDR. iPads don't have 4.0 and iPhone apps have to be coded for the larger size (not by just scaling, but really utilizing the extra space). The problems on Android are no different. And neither really is a huge problem for good developers. They should be easily able to handle multiple screen resolutions, hardware and software capabilities by coding to the APIs and gracefully degrading when hardware/software features are not available.

The second issue is of having different hardware at the same OS version - which is what this article is about. IMO, this is a huge advantage for the Android. Manufacturers are going to differentiate themselves using hardware and consumers win because they get to pick the phone that delivers most of the features they are interested in. eg. the Samsung Galaxy S with its awesome display, DLNA and 3D performance will appeal to people leaning more towards a media phone. The T-Mobile G2 will appeal to someone who prefers a keyboard and a stock UI. I think these are wonderful choices and this is where Android completely outshines the iPhone. Remember that these are all phones running the same OS and so have access to pretty much every app in the Market for that version.
0 Votes
+ -
Not to mention...
DevGuy_z 16th Sep 2010
@os2baba
Replaceable battery. Upgradeable flash memory.
0 Votes
+ -
And . . .
jorjitop 16th Sep 2010
@os2baba

on Android you get integrated Google spyware. Some fools think that is an advantage.
@jorjitop

with iOS4 you get the odd integrated fanatical zealots complete with tinfoil hats, totally dismissive of even good competition, deceiving themselves into thinking that mindset is an advantage.

Dude; don't spoil it for all the non-fanatical iOS4 folk out there.
@tk_77
Multiple OS in the wild....this is not an issue. Their paradigm is no different than PCs. There is XP, Vista, win 7 in the wild. Its not an issue. There are multiple PC vendors, it is also not a problem.

At this moment in time, there is a huge difference between android 1.5 and 2.2 but thats because the OS is still relatively immature. And since people buy new phones more frequently than computers, they will catch up easily. Plus, its much easier to upgrade mobile OS. So this time next year, this won't even be a significant issue.
0 Votes
+ -
Plus their are a lot of options
kwabinalars 16th Sep 2010
in the market. I have a mid range Android (MyTouch Slide). As of yet I haven't found a single program that won't run on my phone. I have read in review columns a few that don't (usually the Evo). However, there is almost always another program that does the same thing that WILL run on the other platform. So far I've been able to find something to do what I want for my phone and to date I haven't opened up my wallet once to do so (I try to pay attention to ads and click on them from time to time thus supporting the developers of said free stuff).
I read something every day talking about how "fragmented" the Android system is. I say a better word would be consumer friendly. Android provides to consumers what Microsoft has - an OS that works with a lot of hardware options. The next step is for Google to come up with some way for the user base to self-upgrade with some kind of installer kit that has a wide range of hardware drivers for the various devices, thereby bypassing the ridiculous manufacturers waiting period for these updates.
0 Votes
+ -
@tk_77 You are a little off with consoles. The Xbox 360 has multiple levels of processor speeds that you can buy. Granted you don't have to worry about which one you have to see if you can play a game. The PS3 may not have seperate levels but earlier versions were backwards compatible with PS2 games whereas newer versions do not. Plus you can load a Linux OS on the PS3 in order to play games you wouldn't normally be able to. Off the topic of the article I know but wanted to clarify.
0 Votes
+ -
@tk_77

Also consider that if every Android phone had the same performance, that would necessarily mean that every Android phone would use the exact same components.

Apart from reducing competition amongst manufacturers, it would make the platform more vulnerable to component shortages. For instance, when Samsung suffered from AMOLED shortage, HTC and Motorola who bought these displays could switch over to LCD screens. If the platform required AMOLED screens for the sake of uniformity, it would have hurt sales.
0 Votes
+ -
see as single page?
ChazzMatt 16th Sep 2010
Please? Most websites have that feature, to "print" as a single page or view as a single page. I HATE having to click through SEVEN two-paragragh pages.
0 Votes
+ -
@ChazzMatt
Just hit 'Print'. Please use some creativity instead of HATE. happy
0 Votes
+ -
@ChazzMatt The reason for spreading an article over seven pages is to increase the number of page hits and the number of ads served. Just be happy it is not fourteen one-paragraph pages.
0 Votes
+ -
Where does the Evo fit in this?
tsrich 16th Sep 2010
maybe I missed it in the article, but where does the Evo fit in to this comparison?
0 Votes
+ -
@tsrich That was my first question as well. I just read an article on ZDNet this week where the author listed it as the number 1 Android phone. How could it be left off of this list? It looks like a European study and maybe the EVO is not readily available there?
0 Votes
+ -
Just curious... Why did you ignore SonyEricsson Xperia X10?
It's equipped with Snapdragon 1GHz processor, has WVGA display and so on. Do you think that Xperia isn't High-end Android smartphone?
(I know that it still works under Android 1.6. from the Dinosaurs era. But is it really a deadly sin?)
0 Votes
+ -
@Serge Sereda Well, X10 has not been mentioned in any of the android related reviews I have read. Thanks to the aftersales support of Sony Ericsson. Hoping to get the old 2.1 on my X10 this month. And people are already talking about getting 3.0 on their mobiles. sad
0 Votes
+ -
@Serge Sereda you have to remember that the study was done in Germany. The device may not be available there (see previous comment about the EVO)
0 Votes
+ -
@russdwright@... I've specially checked - SE Xperia X10 was available in Germany since April 2010 - http://www.teltarif.de/sony-ericsson-x10-test/news/38487.html. Thus, the real reason is in something else...
0 Votes
+ -
RE: Benchmark showdown: High-end Android smartphones
darreno1450 Updated - 16th Sep 2010
This article was written prematurely and is pretty meaningless because it compares a custom rom to Froyo to Eclair and then tries to judge the devices based on the results. Sorry but until all these devices carry Froyo, the results have to be taken with a truckload of salt.

This article speaks more about Froyo (optimized for the snapdragon)Vs Eclair than the actual differences in hardware performance.

Only when everyone's on a level playing field with regards to the OS will I take your results seriously.
Where's the Evo in all of this?
0 Votes
+ -
http://www.itemsellout.com
itemselllout 17th Sep 2010
please check my name to link our SITE
I just really get upset to see otherwise apparently educated people put themselves down by so consistently misspellind or misusing "their", "there", "they're", "then" and "than". I especially don't understand the "then" vs. "than" problem, because I pronounce them differently, to match the spellings.
0 Votes
+ -
RE: Benchmark showdown: High-end Android smartphones
jackson1984-24316069205748857739440257893812 10th Oct
I seen your weblog on google and examination lots of of this early posts. Manage mulberry outlet store up the exceptional operate. I just significantly more up your RSS feed to my MSN Information Reader.
0 Votes
+ -
RE: Benchmark showdown: High-end Android smartphones
tomlin21-24319035676893835085146735905770 11th Oct
Hey, I these days started off learning your running a blog web site ?C thanks for your personal good operate. nfl football jerseys
As I known, the pipeline depths in Cortex-A8 and Scorpion are both 13. Here is the proof. www.qualcomm.com/documents/files/linley-report-dual-core-snapdragon.pdf

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix