Database Users

Quadrant Benchmark on Vibrant 2600???

One of my coworkers has a tmobile vibrant with some lag fix according to him.. he did a quadrant benchmark right in front of me and it was showing 2500 plus everytime.. Im very curious as to what is making his phone so fast. And can it be dont to ours. Hes not running a custom rom or overclocking. Im only getting 1030 with mine clocked at 1.2ghz. Any Ideas? I couldnt get into too much details with him yesterday and I dont know whens the next time ill see him..

If you were to look at a test break down you would see generally all the scores are identical or the epic a little ahead except in the read/write area. The scores from their read/write are just inflating their overall score. It's a issue with quadrant and how it handles its overall score. Basically it just makes the system easy to abuse/cheat. So I wouldn't worry much about the difference in your score and his.
Sent from my Samsung Epic

The reason other Galaxy S phones score high in quadrant is because of the lag fix they use. The lag fix mounts a different file system on the phone with DRAMATICALLY increases read-write times. That portion of the quadrant benchmark gets inflated beyond reason. Using this game technique, Cyanogen was able to score more than 3000 on a snapdragon phone.
All of the Galaxy S phones have the same processor. Also, quadrant is a terrible benchmark. It's the most over-quoted and abused benchmark for android phones

Ahh ok.. thats good to know.. so what would be a better benchmark to use? Linpack?

jok3sta said:
Ahh ok.. thats good to know.. so what would be a better benchmark to use? Linpack?
Click to expand...
Click to collapse
Linpack is good for measuring raw CPU processing power... but only on devices running the same version of android. Phones with 2.2 will score insanely high due to the JIT compiler. For example, a snapdragon phone with Froyo can score ~40 Mflops. A snapdragon phone with eclair scores around 7 Mflops. Does Froyo make the phone run 5-6X faster? Hell no. In some cases, the difference is almost unnoticeable to the human eye.
Here is a rundown of what I believe to be the pros and cons of various benchmarks:
Linpack
Pros:
- Good for measuring CPU processing power on the same version of Android
- Great tool for measuring the performance gain from overclocking
Cons
- Scores are boosted unreasonably by Froyo's JIT compiler on snapdragon phones
Quadrant
Pros:
- Great tool for measuring the performance gain from overclocking
- Decent tool for measuring 3D graphics performance (just pay attention to FPS, not the end result)
- Decent tool for measuring 2D graphics performance (again, look at FPS)
- The paid version ("Quadrant Pro" I believe) shows which parts of the benchmark contributed to the score. Easier to spot the inflated CPU or I/O inflation
Cons:
- I/O portion isn't valued as much as others, but can boost scores beyond reason via exploits, hacks, fixes, etc.
- CPU portion is inflated on phones running 2.2. A Nexus One is not faster than any Galaxy S, Droid X, Droid 2, etc.
Neocore
Pros:
- Good tool for measuring graphics processing power
Cons:
- Graphics are not intense enough to push the power of very fast GPU's. Some phones will hit their FPS limit
- Only measures graphics processing power.
Nenamark1
Pros:
- Great tool for measuring graphics processing power
- Effects are advanced enough to show the performance of faster GPUs in relation to phones with lesser GPUs.
Cons:
- Only measures graphics processing power.

Sweet thanks for all the info man..

Agreed, this is great info thanks. I think the quadrant score is the most quoted becuase it provides a very easy to read graph built in with it for instant comparing/gratification. I guess I am gonna start going by linpack and nenamark1.

hydralisk said:
Linpack is good for measuring raw CPU processing power... but only on devices running the same version of android. Phones with 2.2 will score insanely high due to the JIT compiler. For example, a snapdragon phone with Froyo can score ~40 Mflops. A snapdragon phone with eclair scores around 7 Mflops. Does Froyo make the phone run 5-6X faster? Hell no. In some cases, the difference is almost unnoticeable to the human eye.
Click to expand...
Click to collapse
Linpack is ok for when your using same CPU comparison, different CPU's can cause issues...The reason why snapdragon gets scores of 5-6x is for some reason the snapdragon utilizes the VFP rather then using raw processing power..aka snapdragon cheats on the Linpack.
In reality our I/O scores should be a lot higher then it is as even in the Epic some of samsung's crappy file system still exists. But not as high as the lagfixed Vibrant of course.
Quadrant Pro is probably best indicator out of them all(The non-pro version is pretty much useless unless your comparing the same phone)...the con of having 2.2 show is higher is expected as it is a measure of efficiency of JIT in comparison to the current. The OS always played a role in Benchmarks so it is expected.

it can be faked by using a different partition to test on. IIRC the data partition making the speeds much faster than they should be so be careful when accepting those high scores

rjmjr69 said:
it can be faked by using a different partition to test on. IIRC the data partition making the speeds much faster than they should be so be careful when accepting those high scores
Click to expand...
Click to collapse
It is not exactly faking it..as you are increasing performance..thing is you cannot see at what it performs well at unless you see the individual scores from the Pro version....

Holly Quadrant Batman! 1700+

Seems like I got a pretty quick device I got a best of 1703

fifedogg said:
Seems like I got a pretty quick device I got a best of 1703
Click to expand...
Click to collapse
Nice score man, I would suggest running Smartbench 2010 however. Quadrant is skewed towards Snapdragon processors so its really not a good benchmark.

kenvan19 said:
Nice score man, I would suggest running Smartbench 2010 however. Quadrant is skewed towards Snapdragon processors so its really not a good benchmark.
Click to expand...
Click to collapse
Compared to other types of processors your right. But as far as our phones go I think its a pretty good score.
Smartbench is byast to phones with higher GPU's like the Epic just like quadrant is more byast to CPU speed, with Snapdragon having the upper hand. I'm sure the Epic will do much better on quadrant with a legit 2.2 build and JIT enabled. From what I understand Quadrant uses more CPU when processing the 2d/3d as opposed to Smartbench using mainly the GPU. IMO quadrant gets high scores with fast cpu's and Smartbench gets super high scores with high GPU phones. I have an Epic and my Shift is faster all around except when its something to do with pure GPU.

fifedogg said:
Compared to other types of processors your right. But as far as our phones go I think its a pretty good score.
Click to expand...
Click to collapse
Oh I wasn't saying you had a bad score, its just that Quadrant scores are meaningless, sure you can compare a Shift to a Shift but it won't give you any scores that are applicable in the real world. If you're just looking for a big number then quadrant is great for that, however if you want something that provides an accurate representation of your phone's power Smartbench is the ticket!
~Edit~
Also, I forgot to mention how easy it is to trick quadrant and fake scores. People have gotten it to give last gen devices 2500+ scores. Quadrant is just a terrible benchmarking tool all around.
~Edit #2~
I know I sound like a **** who is trolling you but what I'm really trying to do is prove to the Evo and Epic fanboys that this device is really great. If you quote a big quadrant score they'll jump all over you and discredit you. If you quote a Smartbench score they will 1) have to go look up what smartbench is (c'mon its really new lol) and 2) make up some other fake reason to claim the other devices are better.
My point is that having owned an Epic since launch day, an Evo for a few days and my wife owning a Shift for a few days I can find only one thing I dislike about the shift whereas I have a myriad of issues with the others (that one issue is the screen size).

Thread cleaned, let's get this back on track

Sorry for taking it down that path Impaler
Sent from my HTC Evo Shift 4G

My bad
Sent from my HERO200 using XDA App

BrandoKC said:
Sorry for taking it down that path Impaler
Sent from my HTC Evo Shift 4G
Click to expand...
Click to collapse
the5ifty said:
My bad
Sent from my HERO200 using XDA App
Click to expand...
Click to collapse
It's ok guys, just trying to get stuff back on track

Anyway...i ran a smartbench on the wifes shift and it scored considerably lower than the G2...i get ~1650s in quadrant
Sent from my HERO200 using XDA App

fifedogg said:
Compared to other types of processors your right. But as far as our phones go I think its a pretty good score.
Smartbench is byast to phones with higher GPU's like the Epic just like quadrant is more byast to CPU speed, with Snapdragon having the upper hand. I'm sure the Epic will do much better on quadrant with a legit 2.2 build and JIT enabled. From what I understand Quadrant uses more CPU when processing the 2d/3d as opposed to Smartbench using mainly the GPU. IMO quadrant gets high scores with fast cpu's and Smartbench gets super high scores with high GPU phones. I have an Epic and my Shift is faster all around except when its something to do with pure GPU.
Click to expand...
Click to collapse
Slight correction - Smartbench simply reports the performance of each phones in comparison to Nexus One. Productivity Index scores aren't supposed to be compared with Games Index scores since the bases for each are different.
I own a G2, Vibrant and N1 (also Optimus One). I am pretty happy with what Smartbench reports vs real experience.
The numbers may change drastically in v2011 if another phone is chosen as the base (I am tempted to do this since it appears that almost every phone in the market today grossly outperforms Snapdragon QSD8x50 in GPU by a big margin...

I scored a little over 1500 on Quadrant. Smart bench gave me 759/1097 and 693/1116
not sure if that is good or not. But my phone does seem a little sluggish.

Heelfan71 said:
I scored a little over 1500 on Quadrant. Smart bench gave me 759/1097 and 693/1116
not sure if that is good or not. But my phone does seem a little sluggish.
Click to expand...
Click to collapse
For some reason, Evo Shifts (in general) aren't reporting numbers as high as the G2 or Desire Z. Have a look at http://smartphonebenchmarks.com you will see some numbers for G2 and Desire Z, both stock and overclocked.

I also found my Shift scores are considerably lower than the G2, but then again I don't put too much stock into benchmarking programs. I find that out of the box the Shift is buttery smooth and at 800Mhz the quadrant/SB scores soundly beat my EVO clocked at 1Ghz and the EVO is pretty beastly.
Also considering people have been able to overclock the processor in the G2 from 800 to 1.9Ghz, we should be able to boost the Shift considerably once we have root. Hopefully the Shift is embraced by the dev community because overclock plus AOSP will be a beautiful thing.

I'll be adding Evo Shift score to the chart shortly. So far, 759/1097 is the best score I've seen on here. If anyone can beat this score (in a stock form), please let me know here!

Acei said:
I'll be adding Evo Shift score to the chart shortly. So far, 759/1097 is the best score I've seen on here. If anyone can beat this score (in a stock form), please let me know here!
Click to expand...
Click to collapse
Will do, man thanks!

Acei said:
I'll be adding Evo Shift score to the chart shortly. So far, 759/1097 is the best score I've seen on here. If anyone can beat this score (in a stock form), please let me know here!
Click to expand...
Click to collapse
832/1240 is what I got 1st try. I'm gonna try a few more times and see what she does. I can post screen shots if need be as well.

fifedogg said:
832/1240 is what I got 1st try. I'm gonna try a few more times and see what she does. I can post screen shots if need be as well.
Click to expand...
Click to collapse
Great! Thanks.

[OFFTOPIC] Motorola Xoom OC'd to 1.5GHz and benchmarked!

Motorola Xoom overclocked to 1.5GHz, eats Quadrant and Linpack for breakfast
Hold on to your hats, gents, because things just got real -- that's a Motorola Xoom in the picture above, clocked at a blazing 1.504GHz. While we highly doubt that's a new world record of any sort, the dual-core Tegra 2 inside seriously screams at that clockspeed, scorching Quadrant to the tune of 3105 (remember this?) and delivering 47 MFLOPS in Linpack. Oh, and in case you're curious, this achievement wasn't some random hack. It was perpetrated for our collective benefit by the master of SetCPU himself, and you'll find full video proof of his accomplishment below and instructions at our source link. Got root? Then you're on your way.
Click to expand...
Click to collapse
Hey guess what? At 1.5GHz the Nexus S can break 4k without a sweat. Simms22, care to post some of your Quadrant scores
******Official Scoreboard*******
Premier DC Honeycomb Tablet: 0
Google Nexus S: 1

who cares quadrant sucks not to mention it still does not still work correctly with 2.3 i highly doubt its accurate with honeycomb and dualcore CPU
also you're talking about a 4k plus score with voodoo

demo23019 said:
who cares quadrant sucks does not still work correctly with 2.3 i highly doubt its accurate with honeycomb and dualcore CPU
also youre talking about a 4k plus score with voodoo
Click to expand...
Click to collapse
Pardon? What do you mean by Voodoo? If you mean the ext4 hack then the 4k I am referring to was actually before the ext4 hack was implemented. And if its broken for both Gingerbread and Honeycomb then wouldn't it kind of negate the being broken? Since their both broken?
Why do people always have to **** all over everything? It was an interesting post and I found it funny that Engadget would use the phrase "eat for breakfast" when in reality 3.1k is not that impressive. Seriously though, why is it necessary to be an ass instead of just having a laugh? Clearly I posted this in good fun. JFC.

And only scores 47 MFLOPS when the nexus one snapdragon can score higher you going to say nexus one is faster than xoom and Nexus S i dont thin so
Being huge into PC benchmarking and im not impressed with what android currently has for software...Anything that can be manipulated into giving false result is bogus
reminds me of 3dmark vantage with nvidia cards giving off very high inaccurate CPU scores with physx is enabled
....Not saying vantage is bogus

demo23019 said:
And only scores 47 MFLOPS when the nexus one snapdragon can score higher you going to say nexus one is faster than xoom and Nexus S i dont thin so
Being huge into PC benchmarking and im not impressed with what android currently has for software...Anything that can be manipulated into giving false result is bogus
reminds me of 3dmark vantage with nvidia cards giving off very high inaccurate CPU scores with physx is enabled
....Not saying vantage is bogus
Click to expand...
Click to collapse
Which benchmarks if any do you think are valid or quasi valid for the NS? I use Fps2D to test FPS

jlevy73 said:
Which benchmarks if any do you think are valid or quasi valid for the NS? I use Fps2D to test FPS
Click to expand...
Click to collapse
I am using an3DXL for benchmarking as well as nenamark. an3DXL gave results that had the lowest spread, while quadrant was all over the place, having as much as a 500 point different..

List Of Current Android Benchmarks

The purpose of this post is to inform people of all the major benchmarks, pros/cons or each and what each of them do.
Quadrant Standard/Advanced - This benchmark is made for phones using the Snapdragon proccessor such as the g2/droids/evo etc. Please do not rely on this benchmark for the Epic as the Epic has a Hummingbird.
SmartBench - This benchmark was made to show fair scores for the actual speed of the phone. The developer of this app works very hard to work out "cheats" and bugs. This benchmark seperates the speed in games from the speed in doing other, non-game, tasks.
Linpack - This benchmark, like Quadrant, is mainly for Snapdragon. It shows floating point speed that does not really determine real life performance. Phones like the Evo and G2 get scores way higher than the Epic even though the proccessor on the Epic is faster.
0xBench - This benchmark is a combonation of different benchmarks. The purpose of this benchmark is to find out how fast your phone is for many different things.
Total Benchmark - This benchmark is a FULL benchmark. It not only measures speed but it measures many other things such as accelerometer, display, multitouch, etc.
An3dBench - This benchmark does a wide variety of tests to determine 3d speed
SQLight - This benchmark measures the time it takes to complete a series of non-gaming/non-media tasks.
SetCpu - If you didn't know, SetCpu has 3 different benchmarks included in it. These benchmarks show proccessor speed improvements from your overclock/kernal or rom change.
Nenamark - A GPU benchmark
Neocore - Another GPU benchmark. Made by Qualcomm to showcase their GPU. Since our GPU isnt Qualcomm, you cant fully trust it, but it seems pretty legit.
Did I miss any? Please send me a PM telling me. I know there are alot more but I think I got all of the major ones.
It would be great if this could be stickied.

Reserved for later use

A few others I've got on my phone:
Benchmark Pi: I don't recommend, since all it really does is test one function of the CPU, hardly a comprehensive benchmark.
GLBenchmark: Pretty decent benchmark, all things considered. Lots of options.
NenaMark1: Primarily a GPU benchmark, provides FPS (frames per second) score.
Neocore: Same as the above, mostly tests GPU performance. Created by Qualcomm to showcase their Adreno GPU, so take the FPS scores with a grain of salt.
Another I've heard of, BaseMark. AFAIK its currently only available to software developers. Looking to get my hands on it... looks to be pretty full-featured.
I still recommend SmartBench2010 over anything else right now, mostly because it seems to be accurate and the developer has shown himself to be very dedicated.

Also note AnTuTu. It's comprehensive, and gives a very good breakdown of what goes into its scores.

Added Nenamark and Neocore
Sent from my SPH-D700 using XDA Premium App

GLbenchmarks
Its one of the best. I personally only really care about benchmarks that Anandtech uses since they give the most detailed and comprehensive reviews and testing of new phones and devices. I would check out there site to make sure you got what they use. I know for a fact that GLbenchmarks is one of them. Its a graphical benchmark that tests the GPU. There are also a benchmark to test browser performance, java and i think one other one that they use.

You can get all these on the market?

No, some of these you have to get outside of the market. GLbenchmarks for example is downloaded from their website.

Low Benchmarks scores

I know about the differences in benchmarks and how they arent set up for dual core, but I just ran smartbench 2011 and my gaming score is off by 1000 points on a stock xoom, I am rooted and running stock kernel. I am not sure why, maybe something is wrong with it.

My quadrant scores are lower than my dx but my linpack score is 64mflops! Don't know why our quadrant scores are so low but I'm having the same problem.
Sent from my Xoom using XDA App

Off from what? A phone? Synthetic benchmarks say almost nothing about real world performance, and they will always be different with devices at different resolutions.
A 1280x800 tablet will always score unusually low on a graphics benchmark that scales to resolution compared to a phone.

Usmc7356 said:
My quadrant scores are lower than my dx but my linpack score is 64mflops! Don't know why our quadrant scores are so low but I'm having the same problem.
Sent from my Xoom using XDA App
Click to expand...
Click to collapse
Quadrant also places a lot of weight on the filesystem, and my Xoom always hangs quite a while during database writes.
Also I think that getting ~6 FPS on their first 2D animation test can't help.
The Xoom is really zippy, take the benchmarks with many, many grains of salt.

I was just talking about smart bench, everything else is working fine, but the smartbench 2011 shows a galaxy s as being more powerful than my xoom, and the half the speed of a stock xoom. I am just wondering if other people were showing that they are below what a stock xoom should be too.

you have to make sure that these benchmarks are compatible with dual core processors. otherwise the results are moot.

I know that, but it is shows below the average xoom, thats the problem I am seeing, average xoom gets like 2k I get 1k

I was having the same issue, I believe it is because of spare parts for gaming full screen. I factory restored my xoom and scored higher than average. The benchmark ran on a much smaller screen when I ran it on a fresh xoom.

joepfalzgraf said:
I was having the same issue, I believe it is because of spare parts for gaming full screen. I factory restored my xoom and scored higher than average. The benchmark ran on a much smaller screen when I ran it on a fresh xoom.
Click to expand...
Click to collapse
Confirmed that is it, thanks for this I guess I was overlooking it and thinking my xoom wasnt up to par.