Database Users

Quadrant Benchmark on Vibrant 2600???

One of my coworkers has a tmobile vibrant with some lag fix according to him.. he did a quadrant benchmark right in front of me and it was showing 2500 plus everytime.. Im very curious as to what is making his phone so fast. And can it be dont to ours. Hes not running a custom rom or overclocking. Im only getting 1030 with mine clocked at 1.2ghz. Any Ideas? I couldnt get into too much details with him yesterday and I dont know whens the next time ill see him..

If you were to look at a test break down you would see generally all the scores are identical or the epic a little ahead except in the read/write area. The scores from their read/write are just inflating their overall score. It's a issue with quadrant and how it handles its overall score. Basically it just makes the system easy to abuse/cheat. So I wouldn't worry much about the difference in your score and his.
Sent from my Samsung Epic

The reason other Galaxy S phones score high in quadrant is because of the lag fix they use. The lag fix mounts a different file system on the phone with DRAMATICALLY increases read-write times. That portion of the quadrant benchmark gets inflated beyond reason. Using this game technique, Cyanogen was able to score more than 3000 on a snapdragon phone.
All of the Galaxy S phones have the same processor. Also, quadrant is a terrible benchmark. It's the most over-quoted and abused benchmark for android phones

Ahh ok.. thats good to know.. so what would be a better benchmark to use? Linpack?

jok3sta said:
Ahh ok.. thats good to know.. so what would be a better benchmark to use? Linpack?
Click to expand...
Click to collapse
Linpack is good for measuring raw CPU processing power... but only on devices running the same version of android. Phones with 2.2 will score insanely high due to the JIT compiler. For example, a snapdragon phone with Froyo can score ~40 Mflops. A snapdragon phone with eclair scores around 7 Mflops. Does Froyo make the phone run 5-6X faster? Hell no. In some cases, the difference is almost unnoticeable to the human eye.
Here is a rundown of what I believe to be the pros and cons of various benchmarks:
Linpack
Pros:
- Good for measuring CPU processing power on the same version of Android
- Great tool for measuring the performance gain from overclocking
Cons
- Scores are boosted unreasonably by Froyo's JIT compiler on snapdragon phones
Quadrant
Pros:
- Great tool for measuring the performance gain from overclocking
- Decent tool for measuring 3D graphics performance (just pay attention to FPS, not the end result)
- Decent tool for measuring 2D graphics performance (again, look at FPS)
- The paid version ("Quadrant Pro" I believe) shows which parts of the benchmark contributed to the score. Easier to spot the inflated CPU or I/O inflation
Cons:
- I/O portion isn't valued as much as others, but can boost scores beyond reason via exploits, hacks, fixes, etc.
- CPU portion is inflated on phones running 2.2. A Nexus One is not faster than any Galaxy S, Droid X, Droid 2, etc.
Neocore
Pros:
- Good tool for measuring graphics processing power
Cons:
- Graphics are not intense enough to push the power of very fast GPU's. Some phones will hit their FPS limit
- Only measures graphics processing power.
Nenamark1
Pros:
- Great tool for measuring graphics processing power
- Effects are advanced enough to show the performance of faster GPUs in relation to phones with lesser GPUs.
Cons:
- Only measures graphics processing power.

Sweet thanks for all the info man..

Agreed, this is great info thanks. I think the quadrant score is the most quoted becuase it provides a very easy to read graph built in with it for instant comparing/gratification. I guess I am gonna start going by linpack and nenamark1.

hydralisk said:
Linpack is good for measuring raw CPU processing power... but only on devices running the same version of android. Phones with 2.2 will score insanely high due to the JIT compiler. For example, a snapdragon phone with Froyo can score ~40 Mflops. A snapdragon phone with eclair scores around 7 Mflops. Does Froyo make the phone run 5-6X faster? Hell no. In some cases, the difference is almost unnoticeable to the human eye.
Click to expand...
Click to collapse
Linpack is ok for when your using same CPU comparison, different CPU's can cause issues...The reason why snapdragon gets scores of 5-6x is for some reason the snapdragon utilizes the VFP rather then using raw processing power..aka snapdragon cheats on the Linpack.
In reality our I/O scores should be a lot higher then it is as even in the Epic some of samsung's crappy file system still exists. But not as high as the lagfixed Vibrant of course.
Quadrant Pro is probably best indicator out of them all(The non-pro version is pretty much useless unless your comparing the same phone)...the con of having 2.2 show is higher is expected as it is a measure of efficiency of JIT in comparison to the current. The OS always played a role in Benchmarks so it is expected.

it can be faked by using a different partition to test on. IIRC the data partition making the speeds much faster than they should be so be careful when accepting those high scores

rjmjr69 said:
it can be faked by using a different partition to test on. IIRC the data partition making the speeds much faster than they should be so be careful when accepting those high scores
Click to expand...
Click to collapse
It is not exactly faking it..as you are increasing performance..thing is you cannot see at what it performs well at unless you see the individual scores from the Pro version....

Lower Quadrant Score With New ROM

So I flashed Skyraider today, and my quadrant score dropped 100 points from stock sense. What the hell is going on here....

The Black Droid said:
So I flashed Skyraider today, and my quadrant score dropped 100 points from stock sense. What the hell is going on here....
Click to expand...
Click to collapse
Sitting at 1032. With the stock ROM, I was getting around 1120.
Why are these scores so low???

Q scores || ROMs
Quadrant scores vary by ROM and kernel, and by different kernels in the same ROM.
Those scores are expected to vary.

Quadrant scores, don't take those to heart... It's all about feel. I've run roms where they might score low, but feel and move quick.
Sent from my ADR6300 using XDA App

I just don't understand how some of these guys have anywhere from 2700-3300 as their quad score. I would imagine their phones are running insanely fast

Maybe, they are most likely overclocking. Some phones don't like going too high. Like on mine, I can't go over 1.113, or my phone slows to a crawl and locks up/reboots.
Sent from my ADR6300 using XDA App

The Black Droid said:
I just don't understand how some of these guys have anywhere from 2700-3300 as their quad score. I would imagine their phones are running insanely fast
Click to expand...
Click to collapse
Where have you seen people post these scores for their Inc?
I'm willing to bet good money that if you are seeing people post scores that high, they are either:
A. Not running Quadrant from an Inc but a much more powerful device (like an Android tablet)
B. Faking the results in Photoshop (or just lying about the number if no screenshot is provided)
C. Running a setup that doesn't actually run through the Quadrant test properly. For example, Quadrant didn't run properly on Gingerbread roms at first, and the scores that it would produce were extremely erratic. Sometimes they would be extremely low, sometimes they would be extremely high, but they weren't accurate or repeatable.
D. Running some sort of insane setup that is only stable enough to finish a Quadrant run, and will never actually be used for anything
Frankly, even D is far-fetched.
I would be inclined to call a 100 point fluctuation in Quadrant scores insignificant.
If you really want to chase the highest benchmark scores, you'll need to overclock your CPU and run the system as lean as possible. That means uninstalling or disabling a lot of the things that make your life easier day-to-day.
Also, in case you haven't already seen it in your own testing, Quadrant scores are always lowest on the first run. If you press the back button and immediately start a new Quadrant run, you'll get a much higher score.
Like any unit of measurement, Quadrant scores do serve a useful purpose. But as is often the case when the score itself is seen by some as the end-goal, it is often misapplied.
The same can be seen in digital cameras and the megapixel arms race. Everyone wants to brag about how many megapixels their camera is capable of. Everyone wants the highest number of megapixels, assuming that more MP = better image. Few people realize what it actually means, or why it matters very little these days.

A lot of those people are overclocking to get really high scores and for all the reasons listed above (nice post!).
You really should not be looking to get that high on the incredible, you'll end up draining your battery like crazy. Around the 1,000 mark is great for playing higher-end games on the market as long as you aren't running a bunch of things in the background. Just about anything else you can think up of doing on your phone should run well, you won't have a sluggish device and you won't be killing your battery either.
If you do end up trying to overclock your phone or using a ROM or kernel combination that will give you a much higher score I don't think you'll notice any difference when doing anything on your phone, but your battery will drop much quicker.
Like other people have said, Quad scores don't matter much- take them lightly as you see them.

There is a lot that goes into that score. The highest score I could get today is 1656 but it was consistently in the Upper 1500s, I ran 5 tests.
My setup:
CM7 RC2
Incredikernel 03/06 OC to 1113Mhz/Performance Govenor
16Gb Class 2 microSD card.
If someone is using a class 4 or a class 6 card their i/o scores could be much higher than mine which would result in a much higher overall score than mine. Also keep in mind with Linux Kernels can very alot and that there are different types of task schedulers in them such as BFS or CFS which can have dramatic affect on the quadrent scores. Quadrent tends to score BFS kernels higher. So yeah I can believe people are hitting most of the score they post up. However byrong is right about it not being a setup you'd want to use on a daily basis. For me it causes random reboots, my phone gets hot and the UI becomes laggy after a little while also the battery drops like a brick.
My normal setup that I run on a daily basis is the same kernel uc to 803Mhz/smartass governor. It is extremely stable and is smooth as butter but my quadrent scores are only only in the 1100s with my high being 1244.
Its really not all about the score, if your happy with the performance who cares about the score.

Benchmark scores.

This is just a thread so we can post our quadrant scores.
Highest score will be edited in to this first post.
also a question if you can answer. Why can the nexus s clocked at 1.544ghz score 5000+ on quadrant but we struggle to hit 3000 clocked at 2ghz?
link to video to prove it http://www.youtube.com/watch?v=cAOvEmeriFs

Not to burst your bubble or anything but Quadrant scores have been proven to be useless.

how?

Which would be the best benchmark app to use? Everyone says the same thing about quadrant :S

The I/O testing is flawed and the results don't represent real life.Phones with low Quadrant score can feel smoother than phones with higher Quadrant score eg. Xperia Play vs Galaxy S.

Random.Guy said:
The I/O testing is flawed and the results don't represent real life.Phones with low Quadrant score can feel smoother than phones with higher Quadrant score eg. Xperia Play vs Galaxy S.
Click to expand...
Click to collapse
True

I always thought that the quatrent scores reflected how fast you could MAKE the phone go at optimal conditions... Why can't people just syandardize what you do before you test the phone and leave it at that?
sent from my Experia Play

Random.Guy said:
The I/O testing is flawed and the results don't represent real life.Phones with low Quadrant score can feel smoother than phones with higher Quadrant score eg. Xperia Play vs Galaxy S.
Click to expand...
Click to collapse
This is SO true. When I had my Evo 3d I ran SenselessROM and it felt to be the fastest rom available, but obtained the lowest scores. Didn't make sense at all.

how about your quadrant score when you use 2.3.x?

I installed CM7 with DSC Phoenix test2,overclock to 1344MHz.
when I bench with Quadrant Advanced ver2.1, my score is >1300 to 1400.
It's lower than my old milestone 1 (with CPU 600 MHz Cortex-A8 and GPU PowerVR SGX530, overclock to 1,1Ghz). quadrant score of milestone1 is > 1700. I dont know why?
And this morning I tested with HTC Incredible S of my friend (CPU 1 GHz Scorpion
and GPU Adreno 205, ICS rom without overclock). Score is > 1900.
Is my streak weak? I cant believe streak5 is slower than milestone1 and HTC Incredible S.
how about you?

I think many on here will agree with me when I say forget about the benchmark scores. They largely mean nothing as it relates to real world performance and you can drive yourself crazy trying to tweak your phone to death to increase the numbers. With that being said, the performance hit is likely in the file i/o section.

As normal user and not a programmer, I dont understand about the file i/o section. But thanks you, Lordmorphous. So I'll forget foolish scores, what a stupid app =))

File I/O = File input and output, which in simpler language is the act of reading and writing to the MicroSD cards.
Quadrant and other such benchmark tools are fun to run, but they don't mean much. To properly test a device requires a benchmark program like Futuremark's PCMark, which includes real-world applications and simulates real-world usage. There is no such benchmark app for Android however.

though, if you guys notice the benchmark for the quadrant advance 2.x, the i/o score for our DS5 does a bit low compared to others but... well you know, it just numbers... nothing more.. nothing less...
however, cpu power does have the impact when overclocked, for let say using default cpu speed of 1ghz, software decoding is a bit slow compared to overclocked 1.2ghz...
just my 2 cents

[Q] how to get a high benchmark score in antutu?

how to get a high score in antutu using liquidsmooth rom?:fingers-crossed:

To be honest buddy....benchmark scores mean naff all! I couldnt give two toots about what "score" an app gives my device....i give it 10/10 because its what i want it to be....i wouldn't pay any attention to benchmark scores. People are always complaining about too much ram usage etc, remember....unused ram is wasted ram.

Throw out as much apps as possible, use as less features as possible (no phone calls, no messaging), overclock your CPU and GPU, use as less RAM as possible, switch to CyanogenMod or any other close-to-vanilla Android ROM.
What do you care more about? Some random numbers from benchmarks or the real performance and amount of features during daily usage?
Benchmarks only give pure performance rating based on some random calculations. It gives no overview about how good the phone performs during daily usage. The number does not show you anything. A phone with extremely low benchmark score can work perfectly with no lag in the UI during daily usage, whereas phone with high benchmark score can be laggy and stuttering.

Just my opinion... This thread really is stupid. I mean the OP question.
Sent from my N9005