Database Users

Quadrant Benchmark on Vibrant 2600???

One of my coworkers has a tmobile vibrant with some lag fix according to him.. he did a quadrant benchmark right in front of me and it was showing 2500 plus everytime.. Im very curious as to what is making his phone so fast. And can it be dont to ours. Hes not running a custom rom or overclocking. Im only getting 1030 with mine clocked at 1.2ghz. Any Ideas? I couldnt get into too much details with him yesterday and I dont know whens the next time ill see him..

If you were to look at a test break down you would see generally all the scores are identical or the epic a little ahead except in the read/write area. The scores from their read/write are just inflating their overall score. It's a issue with quadrant and how it handles its overall score. Basically it just makes the system easy to abuse/cheat. So I wouldn't worry much about the difference in your score and his.
Sent from my Samsung Epic

The reason other Galaxy S phones score high in quadrant is because of the lag fix they use. The lag fix mounts a different file system on the phone with DRAMATICALLY increases read-write times. That portion of the quadrant benchmark gets inflated beyond reason. Using this game technique, Cyanogen was able to score more than 3000 on a snapdragon phone.
All of the Galaxy S phones have the same processor. Also, quadrant is a terrible benchmark. It's the most over-quoted and abused benchmark for android phones

Ahh ok.. thats good to know.. so what would be a better benchmark to use? Linpack?

jok3sta said:
Ahh ok.. thats good to know.. so what would be a better benchmark to use? Linpack?
Click to expand...
Click to collapse
Linpack is good for measuring raw CPU processing power... but only on devices running the same version of android. Phones with 2.2 will score insanely high due to the JIT compiler. For example, a snapdragon phone with Froyo can score ~40 Mflops. A snapdragon phone with eclair scores around 7 Mflops. Does Froyo make the phone run 5-6X faster? Hell no. In some cases, the difference is almost unnoticeable to the human eye.
Here is a rundown of what I believe to be the pros and cons of various benchmarks:
Linpack
Pros:
- Good for measuring CPU processing power on the same version of Android
- Great tool for measuring the performance gain from overclocking
Cons
- Scores are boosted unreasonably by Froyo's JIT compiler on snapdragon phones
Quadrant
Pros:
- Great tool for measuring the performance gain from overclocking
- Decent tool for measuring 3D graphics performance (just pay attention to FPS, not the end result)
- Decent tool for measuring 2D graphics performance (again, look at FPS)
- The paid version ("Quadrant Pro" I believe) shows which parts of the benchmark contributed to the score. Easier to spot the inflated CPU or I/O inflation
Cons:
- I/O portion isn't valued as much as others, but can boost scores beyond reason via exploits, hacks, fixes, etc.
- CPU portion is inflated on phones running 2.2. A Nexus One is not faster than any Galaxy S, Droid X, Droid 2, etc.
Neocore
Pros:
- Good tool for measuring graphics processing power
Cons:
- Graphics are not intense enough to push the power of very fast GPU's. Some phones will hit their FPS limit
- Only measures graphics processing power.
Nenamark1
Pros:
- Great tool for measuring graphics processing power
- Effects are advanced enough to show the performance of faster GPUs in relation to phones with lesser GPUs.
Cons:
- Only measures graphics processing power.

Sweet thanks for all the info man..

Agreed, this is great info thanks. I think the quadrant score is the most quoted becuase it provides a very easy to read graph built in with it for instant comparing/gratification. I guess I am gonna start going by linpack and nenamark1.

hydralisk said:
Linpack is good for measuring raw CPU processing power... but only on devices running the same version of android. Phones with 2.2 will score insanely high due to the JIT compiler. For example, a snapdragon phone with Froyo can score ~40 Mflops. A snapdragon phone with eclair scores around 7 Mflops. Does Froyo make the phone run 5-6X faster? Hell no. In some cases, the difference is almost unnoticeable to the human eye.
Click to expand...
Click to collapse
Linpack is ok for when your using same CPU comparison, different CPU's can cause issues...The reason why snapdragon gets scores of 5-6x is for some reason the snapdragon utilizes the VFP rather then using raw processing power..aka snapdragon cheats on the Linpack.
In reality our I/O scores should be a lot higher then it is as even in the Epic some of samsung's crappy file system still exists. But not as high as the lagfixed Vibrant of course.
Quadrant Pro is probably best indicator out of them all(The non-pro version is pretty much useless unless your comparing the same phone)...the con of having 2.2 show is higher is expected as it is a measure of efficiency of JIT in comparison to the current. The OS always played a role in Benchmarks so it is expected.

it can be faked by using a different partition to test on. IIRC the data partition making the speeds much faster than they should be so be careful when accepting those high scores

rjmjr69 said:
it can be faked by using a different partition to test on. IIRC the data partition making the speeds much faster than they should be so be careful when accepting those high scores
Click to expand...
Click to collapse
It is not exactly faking it..as you are increasing performance..thing is you cannot see at what it performs well at unless you see the individual scores from the Pro version....

Holly Quadrant Batman! 1700+

Seems like I got a pretty quick device I got a best of 1703

fifedogg said:
Seems like I got a pretty quick device I got a best of 1703
Click to expand...
Click to collapse
Nice score man, I would suggest running Smartbench 2010 however. Quadrant is skewed towards Snapdragon processors so its really not a good benchmark.

kenvan19 said:
Nice score man, I would suggest running Smartbench 2010 however. Quadrant is skewed towards Snapdragon processors so its really not a good benchmark.
Click to expand...
Click to collapse
Compared to other types of processors your right. But as far as our phones go I think its a pretty good score.
Smartbench is byast to phones with higher GPU's like the Epic just like quadrant is more byast to CPU speed, with Snapdragon having the upper hand. I'm sure the Epic will do much better on quadrant with a legit 2.2 build and JIT enabled. From what I understand Quadrant uses more CPU when processing the 2d/3d as opposed to Smartbench using mainly the GPU. IMO quadrant gets high scores with fast cpu's and Smartbench gets super high scores with high GPU phones. I have an Epic and my Shift is faster all around except when its something to do with pure GPU.

fifedogg said:
Compared to other types of processors your right. But as far as our phones go I think its a pretty good score.
Click to expand...
Click to collapse
Oh I wasn't saying you had a bad score, its just that Quadrant scores are meaningless, sure you can compare a Shift to a Shift but it won't give you any scores that are applicable in the real world. If you're just looking for a big number then quadrant is great for that, however if you want something that provides an accurate representation of your phone's power Smartbench is the ticket!
~Edit~
Also, I forgot to mention how easy it is to trick quadrant and fake scores. People have gotten it to give last gen devices 2500+ scores. Quadrant is just a terrible benchmarking tool all around.
~Edit #2~
I know I sound like a **** who is trolling you but what I'm really trying to do is prove to the Evo and Epic fanboys that this device is really great. If you quote a big quadrant score they'll jump all over you and discredit you. If you quote a Smartbench score they will 1) have to go look up what smartbench is (c'mon its really new lol) and 2) make up some other fake reason to claim the other devices are better.
My point is that having owned an Epic since launch day, an Evo for a few days and my wife owning a Shift for a few days I can find only one thing I dislike about the shift whereas I have a myriad of issues with the others (that one issue is the screen size).

Thread cleaned, let's get this back on track

Sorry for taking it down that path Impaler
Sent from my HTC Evo Shift 4G

My bad
Sent from my HERO200 using XDA App

BrandoKC said:
Sorry for taking it down that path Impaler
Sent from my HTC Evo Shift 4G
Click to expand...
Click to collapse
the5ifty said:
My bad
Sent from my HERO200 using XDA App
Click to expand...
Click to collapse
It's ok guys, just trying to get stuff back on track

Anyway...i ran a smartbench on the wifes shift and it scored considerably lower than the G2...i get ~1650s in quadrant
Sent from my HERO200 using XDA App

fifedogg said:
Compared to other types of processors your right. But as far as our phones go I think its a pretty good score.
Smartbench is byast to phones with higher GPU's like the Epic just like quadrant is more byast to CPU speed, with Snapdragon having the upper hand. I'm sure the Epic will do much better on quadrant with a legit 2.2 build and JIT enabled. From what I understand Quadrant uses more CPU when processing the 2d/3d as opposed to Smartbench using mainly the GPU. IMO quadrant gets high scores with fast cpu's and Smartbench gets super high scores with high GPU phones. I have an Epic and my Shift is faster all around except when its something to do with pure GPU.
Click to expand...
Click to collapse
Slight correction - Smartbench simply reports the performance of each phones in comparison to Nexus One. Productivity Index scores aren't supposed to be compared with Games Index scores since the bases for each are different.
I own a G2, Vibrant and N1 (also Optimus One). I am pretty happy with what Smartbench reports vs real experience.
The numbers may change drastically in v2011 if another phone is chosen as the base (I am tempted to do this since it appears that almost every phone in the market today grossly outperforms Snapdragon QSD8x50 in GPU by a big margin...

I scored a little over 1500 on Quadrant. Smart bench gave me 759/1097 and 693/1116
not sure if that is good or not. But my phone does seem a little sluggish.

Heelfan71 said:
I scored a little over 1500 on Quadrant. Smart bench gave me 759/1097 and 693/1116
not sure if that is good or not. But my phone does seem a little sluggish.
Click to expand...
Click to collapse
For some reason, Evo Shifts (in general) aren't reporting numbers as high as the G2 or Desire Z. Have a look at http://smartphonebenchmarks.com you will see some numbers for G2 and Desire Z, both stock and overclocked.

I also found my Shift scores are considerably lower than the G2, but then again I don't put too much stock into benchmarking programs. I find that out of the box the Shift is buttery smooth and at 800Mhz the quadrant/SB scores soundly beat my EVO clocked at 1Ghz and the EVO is pretty beastly.
Also considering people have been able to overclock the processor in the G2 from 800 to 1.9Ghz, we should be able to boost the Shift considerably once we have root. Hopefully the Shift is embraced by the dev community because overclock plus AOSP will be a beautiful thing.

I'll be adding Evo Shift score to the chart shortly. So far, 759/1097 is the best score I've seen on here. If anyone can beat this score (in a stock form), please let me know here!

Acei said:
I'll be adding Evo Shift score to the chart shortly. So far, 759/1097 is the best score I've seen on here. If anyone can beat this score (in a stock form), please let me know here!
Click to expand...
Click to collapse
Will do, man thanks!

Acei said:
I'll be adding Evo Shift score to the chart shortly. So far, 759/1097 is the best score I've seen on here. If anyone can beat this score (in a stock form), please let me know here!
Click to expand...
Click to collapse
832/1240 is what I got 1st try. I'm gonna try a few more times and see what she does. I can post screen shots if need be as well.

fifedogg said:
832/1240 is what I got 1st try. I'm gonna try a few more times and see what she does. I can post screen shots if need be as well.
Click to expand...
Click to collapse
Great! Thanks.

Xoom Benchmarks?

Can anyone report on some benchmark scores for the Xoom?
I found this one that Anandtech uses:
http://www.glbenchmark.com/download.jsp

That is a good benchmark for general openGL performance testing. Others are:
Linpack to measure floating-point rate of execution = generally useless score.
Quadrant measures overall system performance
Smartbench 2011 measures general system performance
The xoom scores very well. The scores in GLBenchmarks will seem low, because all tests are run at the native resolution on each device. So a phone with a 480x800 resolution and a tegra 2 will get a much higher score than the xoom with the same processor and a 1280x800 resolution.

Linpack is useless for dual-core devices, it only tests one core.

muyoso said:
The xoom scores very well. The scores in GLBenchmarks will seem low, because all tests are run at the native resolution on each device. So a phone with a 480x800 resolution and a tegra 2 will get a much higher score than the xoom with the same processor and a 1280x800 resolution.
Click to expand...
Click to collapse
Good to know! Hopefully, there will be some dual core benchmarks coming out soon.

Smartbench 2011 just added dual core support! I haven't tried it yet, only quadrant, but am anxious to see the differences.
Sent from the most 'Epic' phone in the world! ...Using XDA Premium app

js042507 said:
Smartbench 2011 just added dual core support! I haven't tried it yet, only quadrant, but am anxious to see the differences.
Sent from the most 'Epic' phone in the world! ...Using XDA Premium app
Click to expand...
Click to collapse
It runs in a tiny little window on the Xoom. Don't think this is a worthy benchmark for tablets.

Wow!
in SmartBench 2011 I got highest score there - 3895/2466. Some game scores were higher on other devices, but they were overclocked to hell.
I'm impressed.

My results are posted here (benchmark and quadrant) http://4pda.ru/forum/index.php?showtopic=173393&st=320#entry6752974

keitht said:
It runs in a tiny little window on the Xoom. Don't think this is a worthy benchmark for tablets.
Click to expand...
Click to collapse
Hi guys,
I am the developer of Smartbench 2010/2011.
Basically, I use device independent pixel system for rendering those bitmaps. For some reason, Honeycomb doesn't work so well with DIP. I need to look into why.
On the other hand, I don't believe there's any other benchmarks that spawn multiple symmetric threads for performing multi-core benchmark tests. All CPU tests are absolutely not affected by the screen size/resolution at all, so it shouldn't matter. IMO, I think its a bit premature to deduce that it is not a worthy benchmark from this observation.
And as usual, I am open to suggestions!
(Oh and Hi Arcadia, long time no see! )

Low Benchmarks scores

I know about the differences in benchmarks and how they arent set up for dual core, but I just ran smartbench 2011 and my gaming score is off by 1000 points on a stock xoom, I am rooted and running stock kernel. I am not sure why, maybe something is wrong with it.

My quadrant scores are lower than my dx but my linpack score is 64mflops! Don't know why our quadrant scores are so low but I'm having the same problem.
Sent from my Xoom using XDA App

Off from what? A phone? Synthetic benchmarks say almost nothing about real world performance, and they will always be different with devices at different resolutions.
A 1280x800 tablet will always score unusually low on a graphics benchmark that scales to resolution compared to a phone.

Usmc7356 said:
My quadrant scores are lower than my dx but my linpack score is 64mflops! Don't know why our quadrant scores are so low but I'm having the same problem.
Sent from my Xoom using XDA App
Click to expand...
Click to collapse
Quadrant also places a lot of weight on the filesystem, and my Xoom always hangs quite a while during database writes.
Also I think that getting ~6 FPS on their first 2D animation test can't help.
The Xoom is really zippy, take the benchmarks with many, many grains of salt.

I was just talking about smart bench, everything else is working fine, but the smartbench 2011 shows a galaxy s as being more powerful than my xoom, and the half the speed of a stock xoom. I am just wondering if other people were showing that they are below what a stock xoom should be too.

you have to make sure that these benchmarks are compatible with dual core processors. otherwise the results are moot.

I know that, but it is shows below the average xoom, thats the problem I am seeing, average xoom gets like 2k I get 1k

I was having the same issue, I believe it is because of spare parts for gaming full screen. I factory restored my xoom and scored higher than average. The benchmark ran on a much smaller screen when I ran it on a fresh xoom.

joepfalzgraf said:
I was having the same issue, I believe it is because of spare parts for gaming full screen. I factory restored my xoom and scored higher than average. The benchmark ran on a much smaller screen when I ran it on a fresh xoom.
Click to expand...
Click to collapse
Confirmed that is it, thanks for this I guess I was overlooking it and thinking my xoom wasnt up to par.

Benchmark scores.

This is just a thread so we can post our quadrant scores.
Highest score will be edited in to this first post.
also a question if you can answer. Why can the nexus s clocked at 1.544ghz score 5000+ on quadrant but we struggle to hit 3000 clocked at 2ghz?
link to video to prove it http://www.youtube.com/watch?v=cAOvEmeriFs

Not to burst your bubble or anything but Quadrant scores have been proven to be useless.

how?

Which would be the best benchmark app to use? Everyone says the same thing about quadrant :S

The I/O testing is flawed and the results don't represent real life.Phones with low Quadrant score can feel smoother than phones with higher Quadrant score eg. Xperia Play vs Galaxy S.

Random.Guy said:
The I/O testing is flawed and the results don't represent real life.Phones with low Quadrant score can feel smoother than phones with higher Quadrant score eg. Xperia Play vs Galaxy S.
Click to expand...
Click to collapse
True

I always thought that the quatrent scores reflected how fast you could MAKE the phone go at optimal conditions... Why can't people just syandardize what you do before you test the phone and leave it at that?
sent from my Experia Play

Random.Guy said:
The I/O testing is flawed and the results don't represent real life.Phones with low Quadrant score can feel smoother than phones with higher Quadrant score eg. Xperia Play vs Galaxy S.
Click to expand...
Click to collapse
This is SO true. When I had my Evo 3d I ran SenselessROM and it felt to be the fastest rom available, but obtained the lowest scores. Didn't make sense at all.