both running 2.2 (epic on dk28)
epic gets 991-1000 and the evo just scored 1241... wtf?!
the evo isn't EXT4 is it?
the epic is currently RFS... I'm having problems going to EXT4
The Quadrant was made specifically for the Snapdragon process; which the Evo uses if i'm not mistaken.
Besides; they don't prove real world performance. I've gotten my hands on numerous evo's and all seemed to be 'laggy' they arn't nearly as responsive as my Epic.
Quadrant scores do not accurately represent Snapdragon vs the Galaxy S Hummingbird (or any other Cortex-A8 like those in Verizon's Droid lineup). Certain functions such as the Virtual Floating Point extension in Snapdragon allow for artificially inflated Linpack scores which do not represent real-world performance. Additionally, the RFS file system that Samsung uses on the Galaxy S phones is not well-understood by Quadrant, resulting in drastically lower scores.
For example, when we switch to EXT4 from RFS, our FroYo Quadrant scores can jump from 1100 to the 1600 range (which kicks the pants off that EVO). The actual performance increase however is hardly perceptible.
In short, Quadrant sucks, and Linpack is susceptible as well. For ****s and giggles, a little while back I made a minor modification to my Epic and produced a Quadrant score of 2597, which is currently listed as the 10th highest score on SmartphoneBenchmarks.com, and is the highest stock clock Quadrant score recorded. I accomplished this score utilizing a simple hack devised by a few developers here on XDA that fools the Quadrant application by utilizing a ramdrive for the I/O test. I posted about it on their forums and was advised by an administrator that they are aware of the problems with Quadrant and are releasing their own benchmark tool.
Android runs on top of a virtual machine so really what you're testing is virtual machine performance, and currently that virtual machine is tweaked for Snapdragon. With the Nexus S now a Google flagship phone, we'll likely see the VM better optimized for Hummingbird in the near future, and in fact, Gingerbread had a few more JIT enhancements as well.
Hummingbird is a slightly better performing chip MHz for MHz than the first-generation Snapdragons, if by a small amount. However it is significantly more power-efficient. Second-gen Snapdragons do draw even in terms of efficiency and performance, but both are going to be blown away by the Cortex-A9 Tegra phones we'll be seeing this spring.
EDIT - So I just noticed that SmartphoneBenchmarks.com has released their own benchmark tool recently, Smartbench 2010. I just ran it on my phone and scored 1178 on the Productivity Index (CPU) and 2610 on the Games Index (GPU). The highest-scoring competitor, the HTC G2, scores 1045 and 1396 respectfully. DRockstar on IRC ran the benchmark on his Epic that has RFS, and scored 1133 and 2521. So, this benchmark tool actually performs fine on RFS. Amazing! Grab it off the Android Market!
Electrofreak said:
Quadrant scores do not accurately represent Snapdragon vs the Galaxy S Hummingbird (or any other Cortex-A8 like those in Verizon's Droid lineup). Certain functions such as the Virtual Floating Point extension in Snapdragon allow for artificially inflated Linpack scores which do not represent real-world performance. Additionally, the RFS file system that Samsung uses on the Galaxy S phones is not well-understood by Quadrant, resulting in drastically lower scores.
For example, when we switch to EXT4 from RFS, our FroYo Quadrant scores can jump from 1100 to the 1600 range (which kicks the pants off that EVO). The actual performance increase however is hardly perceptible.
In short, Quadrant sucks, and Linpack is susceptible as well. For ****s and giggles, a little while back I made a minor modification to my Epic and produced a Quadrant score of 2597, which is currently listed as the 10th highest score on SmartphoneBenchmarks.com, and is the highest stock clock Quadrant score recorded. I accomplished this score utilizing a simple hack devised by a few developers here on XDA that fools the Quadrant application by utilizing a ramdrive for the I/O test. I posted about it on their forums and was advised by an administrator that they are aware of the problems with Quadrant and are releasing their own benchmark tool.
Android runs on top of a virtual machine so really what you're testing is virtual machine performance, and currently that virtual machine is tweaked for Snapdragon. With the Nexus S now a Google flagship phone, we'll likely see the VM better optimized for Hummingbird in the near future, and in fact, Gingerbread had a few more JIT enhancements as well.
Hummingbird is a slightly better performing chip MHz for MHz than the first-generation Snapdragons, if by a small amount. However it is significantly more power-efficient. Second-gen Snapdragons do draw even in terms of efficiency and performance, but both are going to be blown away by the Cortex-A9 Tegra phones we'll be seeing this spring.
EDIT - So I just noticed that SmartphoneBenchmarks.com has released their own benchmark tool recently, Smartbench 2010. I just ran it on my phone and scored 1178 on the Productivity Index (CPU) and 2610 on the Games Index (GPU). The highest-scoring competitor, the HTC G2, scores 1045 and 1396 respectfully. DRockstar on IRC ran the benchmark on his Epic that has RFS, and scored 1133 and 2521. So, this benchmark tool actually performs fine on RFS. Amazing! Grab it off the Android Market!
Click to expand...
Click to collapse
Electrofreak,
I just wanted to thank you (I pushed the button, too!) for this post. I'm trying to decide between three phones for my Sprint upgrade next month. My three candidates are the Epic, Evo, & new Evo Shift.
I was not aware of everything you stated, so it helped me look at the Epic in a different light.
Again, thanks.
tps70 said:
Electrofreak,
I just wanted to thank you (I pushed the button, too!) for this post. I'm trying to decide between three phones for my Sprint upgrade next month. My three candidates are the Epic, Evo, & new Evo Shift.
I was not aware of everything you stated, so it helped me look at the Epic in a different light.
Again, thanks.
Click to expand...
Click to collapse
No probs, and if you're interested in still more info, you're welcome to read an article I wrote comparing the hardware in multiple smartphones back in April (though the focus was on the EVO 4G and the Samsung Galaxy S I9000). The article is starting to get a little outdated, (neither the EVO nor the Galaxy S line had been released at that point yet) and it also doesn't cover some other details I've unearthed since then (my blog in my signature is where you'll find that) but most of it is still relevant.
http://alienbabeltech.com/main/?p=17125
Edit - I think I have an addiction to parenthesis (which I'm ashamed to admit)
Electrofreak said:
Quadrant scores do not accurately represent Snapdragon vs the Galaxy S Hummingbird (or any other Cortex-A8 like those in Verizon's Droid lineup). Certain functions such as the Virtual Floating Point extension in Snapdragon allow for artificially inflated Linpack scores which do not represent real-world performance. Additionally, the RFS file system that Samsung uses on the Galaxy S phones is not well-understood by Quadrant, resulting in drastically lower scores.
For example, when we switch to EXT4 from RFS, our FroYo Quadrant scores can jump from 1100 to the 1600 range (which kicks the pants off that EVO). The actual performance increase however is hardly perceptible.
In short, Quadrant sucks, and Linpack is susceptible as well. For ****s and giggles, a little while back I made a minor modification to my Epic and produced a Quadrant score of 2597, which is currently listed as the 10th highest score on SmartphoneBenchmarks.com, and is the highest stock clock Quadrant score recorded. I accomplished this score utilizing a simple hack devised by a few developers here on XDA that fools the Quadrant application by utilizing a ramdrive for the I/O test. I posted about it on their forums and was advised by an administrator that they are aware of the problems with Quadrant and are releasing their own benchmark tool.
Android runs on top of a virtual machine so really what you're testing is virtual machine performance, and currently that virtual machine is tweaked for Snapdragon. With the Nexus S now a Google flagship phone, we'll likely see the VM better optimized for Hummingbird in the near future, and in fact, Gingerbread had a few more JIT enhancements as well.
Hummingbird is a slightly better performing chip MHz for MHz than the first-generation Snapdragons, if by a small amount. However it is significantly more power-efficient. Second-gen Snapdragons do draw even in terms of efficiency and performance, but both are going to be blown away by the Cortex-A9 Tegra phones we'll be seeing this spring.
EDIT - So I just noticed that SmartphoneBenchmarks.com has released their own benchmark tool recently, Smartbench 2010. I just ran it on my phone and scored 1178 on the Productivity Index (CPU) and 2610 on the Games Index (GPU). The highest-scoring competitor, the HTC G2, scores 1045 and 1396 respectfully. DRockstar on IRC ran the benchmark on his Epic that has RFS, and scored 1133 and 2521. So, this benchmark tool actually performs fine on RFS. Amazing! Grab it off the Android Market!
Click to expand...
Click to collapse
That was great!
I scored 1147/2704 but i'm rooted/rommed.
the evo scored 700/910
razorseal said:
That was great!
I scored 1147/2704 but i'm rooted/rommed.
the evo scored 700/910
Click to expand...
Click to collapse
That EVO on 2.2? I would have expected it to score around 1000 at least. I wonder how it would score on EXT4 running CM6...
Smartphone benchmarks is a great benchmark.
Sent from my SPH-D700 using XDA App
Electrofreak said:
That EVO on 2.2? I would have expected it to score around 1000 at least. I wonder how it would score on EXT4 running CM6...
Click to expand...
Click to collapse
yup, it's a stock evo running whatever sprint updated for it
Scored 1257/2751 CM6 EXT4
Sent from my CM6 EXT4 Epic
1255p 2945g,Im running my ROM,how could I be faster then CM6? maybe not the best benchmark.
Sent from my SPH-D700 using XDA App
My Epic w/ Cmod's latest gave me 1115 and 2600
My wife has an Evo with CMods latest as well but only got 1089 and 1050, why so low on the second one?
My Epic scored 606\1901 in smartbench 2010. Weird... much lower productivity score than other people, but really high gaming score.
My Epic is stock.
EDIT: I ran it a few more times and watched it carefully.
603/1808
618/1954
633/1941
Seems I/O is pretty slow...
I'm just wondering why it matters? It's not like Android has a robust collection of high performance games.
razorseal said:
both running 2.2 (epic on dk28)
epic gets 991-1000 and the evo just scored 1241... wtf?!
the evo isn't EXT4 is it?
the epic is currently RFS... I'm having problems going to EXT4
Click to expand...
Click to collapse
Probably because she keeps her Evo in her bra and you keep your Epic in your pocket. It's a fact (check quadrant scores) that smartphones prefer boobs to guys hips 9 out of 10 days of the week. So obviously her Evo is happier and therefor performs better than yours. Do your Epic a favor and give him some booby time and watch those Quadrant scores rise!
+1,agreed and its been proven time and time again...
jirafabo said:
Probably because she keeps her Evo in her bra and you keep your Epic in your pocket. It's a fact (check quadrant scores) that smartphones prefer boobs to guys hips 9 out of 10 days of the week. So obviously her Evo is happier and therefor performs better than yours. Do your Epic a favor and give him some booby time and watch those Quadrant scores rise!
Click to expand...
Click to collapse
The purpose of this post is to inform people of all the major benchmarks, pros/cons or each and what each of them do.
Quadrant Standard/Advanced - This benchmark is made for phones using the Snapdragon proccessor such as the g2/droids/evo etc. Please do not rely on this benchmark for the Epic as the Epic has a Hummingbird.
SmartBench - This benchmark was made to show fair scores for the actual speed of the phone. The developer of this app works very hard to work out "cheats" and bugs. This benchmark seperates the speed in games from the speed in doing other, non-game, tasks.
Linpack - This benchmark, like Quadrant, is mainly for Snapdragon. It shows floating point speed that does not really determine real life performance. Phones like the Evo and G2 get scores way higher than the Epic even though the proccessor on the Epic is faster.
0xBench - This benchmark is a combonation of different benchmarks. The purpose of this benchmark is to find out how fast your phone is for many different things.
Total Benchmark - This benchmark is a FULL benchmark. It not only measures speed but it measures many other things such as accelerometer, display, multitouch, etc.
An3dBench - This benchmark does a wide variety of tests to determine 3d speed
SQLight - This benchmark measures the time it takes to complete a series of non-gaming/non-media tasks.
SetCpu - If you didn't know, SetCpu has 3 different benchmarks included in it. These benchmarks show proccessor speed improvements from your overclock/kernal or rom change.
Nenamark - A GPU benchmark
Neocore - Another GPU benchmark. Made by Qualcomm to showcase their GPU. Since our GPU isnt Qualcomm, you cant fully trust it, but it seems pretty legit.
Did I miss any? Please send me a PM telling me. I know there are alot more but I think I got all of the major ones.
It would be great if this could be stickied.
Reserved for later use
A few others I've got on my phone:
Benchmark Pi: I don't recommend, since all it really does is test one function of the CPU, hardly a comprehensive benchmark.
GLBenchmark: Pretty decent benchmark, all things considered. Lots of options.
NenaMark1: Primarily a GPU benchmark, provides FPS (frames per second) score.
Neocore: Same as the above, mostly tests GPU performance. Created by Qualcomm to showcase their Adreno GPU, so take the FPS scores with a grain of salt.
Another I've heard of, BaseMark. AFAIK its currently only available to software developers. Looking to get my hands on it... looks to be pretty full-featured.
I still recommend SmartBench2010 over anything else right now, mostly because it seems to be accurate and the developer has shown himself to be very dedicated.
Also note AnTuTu. It's comprehensive, and gives a very good breakdown of what goes into its scores.
Added Nenamark and Neocore
Sent from my SPH-D700 using XDA Premium App
GLbenchmarks
Its one of the best. I personally only really care about benchmarks that Anandtech uses since they give the most detailed and comprehensive reviews and testing of new phones and devices. I would check out there site to make sure you got what they use. I know for a fact that GLbenchmarks is one of them. Its a graphical benchmark that tests the GPU. There are also a benchmark to test browser performance, java and i think one other one that they use.
You can get all these on the market?
No, some of these you have to get outside of the market. GLbenchmarks for example is downloaded from their website.
This is just a thread so we can post our quadrant scores.
Highest score will be edited in to this first post.
also a question if you can answer. Why can the nexus s clocked at 1.544ghz score 5000+ on quadrant but we struggle to hit 3000 clocked at 2ghz?
link to video to prove it http://www.youtube.com/watch?v=cAOvEmeriFs
Not to burst your bubble or anything but Quadrant scores have been proven to be useless.
how?
Which would be the best benchmark app to use? Everyone says the same thing about quadrant :S
The I/O testing is flawed and the results don't represent real life.Phones with low Quadrant score can feel smoother than phones with higher Quadrant score eg. Xperia Play vs Galaxy S.
Random.Guy said:
The I/O testing is flawed and the results don't represent real life.Phones with low Quadrant score can feel smoother than phones with higher Quadrant score eg. Xperia Play vs Galaxy S.
Click to expand...
Click to collapse
True
I always thought that the quatrent scores reflected how fast you could MAKE the phone go at optimal conditions... Why can't people just syandardize what you do before you test the phone and leave it at that?
sent from my Experia Play
Random.Guy said:
The I/O testing is flawed and the results don't represent real life.Phones with low Quadrant score can feel smoother than phones with higher Quadrant score eg. Xperia Play vs Galaxy S.
Click to expand...
Click to collapse
This is SO true. When I had my Evo 3d I ran SenselessROM and it felt to be the fastest rom available, but obtained the lowest scores. Didn't make sense at all.
Are my scores correct for my stock M8, in high developer mode i get a score with antutu x of 44713 it is and in antutu my score is 44696. Then not being in high developer mode in antutu x i get a score of 44959 and in antutu a score of 44850. Reason i am asking is, this handset is a new replacement handset. Now the score on my old stock handset from what i remember was 35000. Thoughts people ?
Thread closed at OP's request.
Many thanks,
Ghost