[app idea] ROM benchmarking app - Windows Mobile Development and Hacking General

Hello guys,
I would like to ask if there is an app that would benchmark the ROM performance as opposed to the device performance as in the most of bencmarking apps available (SkTools, SPB Benchmark...). These apps can be used to benchmark ROMs too - but they show more about actual drivers performance than real life experience.
I did a search on the Internet but found nothing.
Is there anyone able to code such an app for the xda-devs community?​
I am looking for program that would measure following:
- Boot up speed
- Start menu open speed
- Speed of opening settings menu from the Start menu
- Speed of opening programs menu from the Start menu
- Speed of opening the Windows folder from the Explorer
- Speed of opening a standard built in app (for example emulating green phone button press to open the dialer)
- Speed of changing screen orientation form portrait to landscape and back
- Speed of wake up from stand-by
- catch-all master statistic (derived from all other stats) to make it easier to rank the results for various ROMs/Devices
Any other statistics you may consider important when it comes to the speed of your shiny new cooked ROM. Please advise on what can also measure actual ROM performance.
The app would ideally run these tests several times (10x) and then log the average values into a results file.
I think it would help the ROM cookers to troubleshoot their creations and new users to choose the right ROM for them. In short this new application would test the GUI reactions - no benchmark app currently available does it. It is an important characteristics though, because that is what users come in contact with most often.
Thank you for your contributions!​Thanks to MaRaHoX for his advice

May we will take a look ...

CharlyV said:
May we will take a look ...
Click to expand...
Click to collapse
Thanks a lot. I think GUI performance benchmarks are useful even in device to device comparison.

(Rare post by me but...)
Perhaps a single benchmark score would be good to determine the relative difference between the ROM being tested and a controlled test....ie WM6 Vanilla??
so a ROM which scores out in total maybe 3 times better (overall) than the control ROM would score like this:
"XDA-Bench score: 3.00" .............. something like?
the best overall performing ROM would have the highest overall score relative to the control test (vanilla)............im not sure im explaining my concept very well?!?!
ofcourse all the test results could be viewed in detailed view in the same sort of format as the xls spreadsheet??
This way a ROM can undergo a test with a custom setup on anybodys device and get a score to really see how it fairs against other ROMs? I personally see this as a similar sort of thing as PCMark or 3DMark??
EDIT::: just thought it would be cool to see how an app installed affects the XDA-Bench score?? Ive noticed certain apps tend to slow down the device whilst other dont?!

mrvanx said:
(Rare post by me but...)
Perhaps a single benchmark score would be good to determine the relative difference between the ROM being tested and a controlled test....ie WM6 Vanilla??
so a ROM which scores out in total maybe 3 times better (overall) than the control ROM would score like this:
"XDA-Bench score: 3.00" .............. something like?
the best overall performing ROM would have the highest overall score relative to the control test (vanilla)............im not sure im explaining my concept very well?!?!
ofcourse all the test results could be viewed in detailed view in the same sort of format as the xls spreadsheet??
This way a ROM can undergo a test with a custom setup on anybodys device and get a score to really see how it fairs against other ROMs? I personally see this as a similar sort of thing as PCMark or 3DMark??
EDIT::: just thought it would be cool to see how an app installed affects the XDA-Bench score?? Ive noticed certain apps tend to slow down the device whilst other dont?!
Click to expand...
Click to collapse
Thanks for your ideas - Available benchmarks have something like synthetic master score (check my benchmark thread - link is in my sig). Slowdown measuring is also interesting idea. Hopefully somebody will make this xda-bench a reality

Testing methodics
Hi KarhU,
I was thinking about it and one more thing about it - it is also really important to define starting point for this ROM - or better is to say "comparable state"... f.e. - to switch off all today items etc. I understand that for user is better to know how the ROM is powerful in real state... maybe to consider this note as a basic for discussion about it (if it is not already mentioned there or somewhere else )
Glad to help little bit with this important and purposeful work!
M.

I think the official HTC rom would be the best to use as a control rom for comparisons. I would run this app every time I install a new piece of software, at the moment my orbit is running a bit slow, I've just overdone it a bit at the moment, so it would be great to see exactly how an installation affects my system. It would be useful to developers and cookers alike. I hope the idea really takes off.

This would be a great app if developed! I agree with a those above that the official HTC rom would be the best one to use as a control rom for comparisons.

MaRaHoX said:
Hi KarhU,
I was thinking about it and one more thing about it - it is also really important to define starting point for this ROM - or better is to say "comparable state"... f.e. - to switch off all today items etc. I understand that for user is better to know how the ROM is powerful in real state... maybe to consider this note as a basic for discussion about it (if it is not already mentioned there or somewhere else )
Glad to help little bit with this important and purposeful work!
M.
Click to expand...
Click to collapse
Interesting idea - currently my tests were done WYSIWYG method - I wanted to compare the ROMs with their basic settings to see actual performance in more "real life" conditions. You are right that if we want to compare the base there should be comparable testing starting point.

I suggest to add the following test for phone devices:
- time lag between 'caller heard first ring' and 'the device actually rings'

ahlok_hk said:
I suggest to add the following test for phone devices:
- time lag between 'caller heard first ring' and 'the device actually rings'
Click to expand...
Click to collapse
This is a good one and very often people are interested in this statistics, but it is hard to measure as you need two phones.

::bump that!::

Bump! Time to resurrect the thread

i like this idea

Related

X1 low performace after flashing new official ROM upgrade

Hello
I've flashe new ROM from SE (Vodafone UK image APP_SW_X1i_VFE_UK_CDF1215-0285_KOV_R2AA007).
I ran SKTools benchmark before and had results as below (without tweaks):
Integer;327.3780;Moves/25 usec
Floating point;7.399;MWIPS
RAM access;1471;Speed index
Draw bitmaps;788;Speed index
Main storage (write);10326.05;KB/sec
Main storage (read);16786.89;KB/sec
Storage Card (write); 652.30;KB/sec
Storage Card (read);2084.12;KB/sec
Now the test results after upgrading:
Integer;327.5500;Moves/25 usec
Floating point;7.499;MWIPS
RAM access;1516;Speed index
Draw bitmaps;776;Speed index
Main storage (write);2133.33;KB/sec
Main storage (read);7102.89;KB/sec
Storage Card (write); 983.04;KB/sec
Storage Card (read);6212.34;KB/sec
As You see, performance of mainstorage is poor.
Please write your experiences.
re
me the same, look here:
http://forum.xda-developers.com/showthread.php?t=459328&page=32
but subjective the device seems faster
hmm interesting, however from what i've seen around the forums, I believe SKtools benchmarks don't really provide very accurate results . . .
Other strange thing is that it's almost impossible to improwe performance using those well known tweaks (filesystem cache, glyph buffering ...)
mobilemodman said:
hmm interesting, however from what i've seen around the forums, I believe SKtools benchmarks don't really provide very accurate results . . .
Click to expand...
Click to collapse
Well I used to repeat SKTools benchmark few times and use statistic theorem
So that results are stable. In fact running benchmark for the first time usually gives wrong results (differing from average).
@ macko - yep that is true aswell, however running the benchmark is so time consuming, I dont think anyone would actually bother getting all those statistics
mobilemodman said:
@ macko - yep that is true aswell, however running the benchmark is so time consuming, I dont think anyone would actually bother getting all those statistics
Click to expand...
Click to collapse
My loved wife says the same
have you tried spb benchmark?
First of all, despite of the memory benchmarks, the results are quite the same. So what basically changed is the speed of Flash-Rom access, where the internal memory got slower and the external (memory card) appearently faster.
Did you have installed the SD card tweak on the previous and/or new ROM. It was said to be the only tweak really significantly improve the speed at all.
I also think that the memory card speed subjectively is quite low with the old ROM. The question now is: What's more important, high internal memory speed or high memory card speed. I'd go for the first since most applications are stored in the internal memory but that depends.
Does it also occur with other types of the new ROM, I mean from other manufacturers or without branding. I read that they differ slightly, so that could have an influence too.
fards said:
have you tried spb benchmark?
Click to expand...
Click to collapse
I would like to but there was no sense if I didn't previously tested with it. Can anybody post results obtained using spb benchmark? (before - after)
Dandie said:
First of all, despite of the memory benchmarks, the results are quite the same. So what basically changed is the speed of Flash-Rom access, where the internal memory got slower and the external (memory card) appearently faster.
Did you have installed the SD card tweak on the previous and/or new ROM. It was said to be the only tweak really significantly improve the speed at all.
I also think that the memory card speed subjectively is quite low with the old ROM. The question now is: What's more important, high internal memory speed or high memory card speed. I'd go for the first since most applications are stored in the internal memory but that depends.
Does it also occur with other types of the new ROM, I mean from other manufacturers or without branding. I read that they differ slightly, so that could have an influence too.
Click to expand...
Click to collapse
Hi Dandie,
the tweak was installed on both roms branded old/unbranded new,
on the branded rom the sd read and write was very faster after installing the sdcardtool
but
with the new rom the benchmark results are slower and much more with the tweak
i'm assuming updating the rom wipes the phone clean back to factory settings? i'd hate to have to reinstall everything?!
@ stats101: Right!
rookie333 said:
Hi Dandie,
the tweak was installed on both roms branded old/unbranded new,
on the branded rom the sd read and write was very faster after installing the sdcardtool
but
with the new rom the benchmark results are slower and much more with the tweak
Click to expand...
Click to collapse
Ahm. what??? What I would like to see are benchmarks without the tweak, from both, old and new ROM. Did anyone try that?
Anyone with R2A can use SPB Benchmark please?
It's more accurated for a real use.
Then I post my result of R1A hardresetted.
Thx.
Dandie said:
Ahm. what??? What I would like to see are benchmarks without the tweak, from both, old and new ROM. Did anyone try that?
Click to expand...
Click to collapse
hi dandie,
the benchmark from old rom i remember, was a little bit lower than the new rom without tweak.
anyway, i don't thrust the benchmark and the tweaks, because the system feels a bit faster, with or without tweak, there's no different.
Benchmarks ? Here we go !
Darth Sith said:
Anyone with R2A can use SPB Benchmark please?
It's more accurated for a real use.
Then I post my result of R1A hardresetted.
Thx.
Click to expand...
Click to collapse
Have a look here :
http://forum.xda-developers.com/showthread.php?p=3242912#post3242912
In my POV mine runs pretty faster and stable
Curiously enough, benchmarks point towards the other direction
I ain't going back: I prefer "real feel" over cold benchmarks
gtrab said:
In my POV mine runs pretty faster and stable
Curiously enough, benchmarks point towards the other direction
I ain't going back: I prefer "real feel" over cold benchmarks
Click to expand...
Click to collapse
Me neither !
My feelings are the same as yours ... !
I upgraded to R2A a few days ago on my x1a, and I couldn't really notice any significant difference in speed between the two firmwares just from day to day use. However, when I loaded up the HTC youtube app, I found the new firmware to clearly have quite a lot of difficulty playing back clips at high quality with dropped frames, desynced audio, etc, whereas the same youtube clips would play flawlessly on my R1A Xperia. Also, I feel like video playback is more choppy in the Media panel, although Coreplayer playback is still the same as before. I have reflashed my x1a twice with the R2A firmware, and both times video playback performance suffered. Now I'm back to R1A and video is working fine. Does anyone else have this problem?

Speedbooster and your Diamond will fly!!

Hi to all, I would share with you my experience with this software:
http://www.teksoftco.com/index.php?section=speedbooster
just installed on my Diamond, and now everything runs smoother and faster!!
I don't know exactly how it works but I must say that it's amazing!
I didn't notice any difference ... :/
Thanks Diego,
I will play around with it this to compare the before and after.
give us a screenshot with the settings that you made so we can try them, I didn't notice any difference either...
diego1810 said:
Hi to all, I would share with you my experience with this software:
http://www.teksoftco.com/index.php?section=speedbooster
just installed on my Diamond, and now everything runs smoother and faster!!
I don't know exactly how it works but I must say that it's amazing!
Click to expand...
Click to collapse
Yes, it makes a difference for my diamond too.
I'm using the settings shown on their forum:
Code:
increase gwes.exe for overall drawing speed
increase targetapp.exe to make it run smoother
change target app to the process you use most, like browser or game.
Does this app have any impact on Battery?
xavierdemon said:
Does this app have any impact on Battery?
Click to expand...
Click to collapse
overclocking usually kills the battery but diamond microprocessor cant be overcloced... i dont understand very well what does this app do to the device....
i am gonna try it... the posted one is trial 5 days.
It does not overclock the diamond CPU as so far it is not possible, i have CPU benchmarked before and after to prove this and it is no different.
I also do not notice any performance difference from this software, but that may be due to running duttys rom which already includes many performance tweaks.
I installed the trial and maybe I was being paranoid but my battery levels were just dropping more than normal and I wasn't even using the phone . Didn't notice any improvement on the phone either while I had a quick play.
Speedbooster uninstalled.
Speedbooster - Does it work??
Well... I downloaded the 5 day trial but the trial is limited to only partially tweaking/enhancing aspects of the Diamond.
But in saying that I noticed some apps refreshing faster. At almost 15 Euro's I am not game enough to buy this program to see if it works. Our poor Australian dollar would make this program as expensive as 9 BigMacs (without fries!) or half a tank of petrol.
I have tried so many tweaking programs and my conclusion is that if you want your Diamond to run faster wait for future models with a faster processor than the now old & slow Qualcomm 528Mhz. I read that 600 Mhz to 1 Ghz processors are coming.
I would certainly give up my 9 BigMacs for a faster CPU. Only with that will we see a real speed boost in our HTC's!!!
Aussie
correct me if I am wrong but doesnt changing the Pagepool do the same?
anyway all we are talking about here is a milliseconds in time difference.
Are we that time poor that we cant wait 0.5 second for an app to load?
The diamond has its limitations & i would say after a year or so of tweaking the ROMs & all the apps that we have just about reached that limitation.
sounds like a scam to me
No much good reactions, thats sad, i hoped this program would be a nice add-on to our Diamond.
Yeah, just lets wait on new phones with a decent processor, 1 Ghz would be awesome, i'm sure they are will coming very soon
aussie1234 said:
Well... I downloaded the 5 day trial but the trial is limited to only partially tweaking/enhancing aspects of the Diamond.
But in saying that I noticed some apps refreshing faster. At almost 15 Euro's I am not game enough to buy this program to see if it works. Our poor Australian dollar would make this program as expensive as 9 BigMacs (without fries!) or half a tank of petrol.
Click to expand...
Click to collapse
it tried a full cracked version and didnt like it. after a lot of benchmarks i didnt notice any difference...
Ι also used ful verison, to my custom rom, and turn to full gwes.exe and manila2.exe . The diference is very big. I didnt expected it. I dont know if the same will happen to original rom version . (I dont think there is manila2.exe to the original rom)
sosimple said:
Ι also used ful verison, to my custom rom, and turn to full gwes.exe and manila2.exe . The diference is very big. I didnt expected it. I dont know if the same will happen to original rom version . (I dont think there is manila2.exe to the original rom)
Click to expand...
Click to collapse
Yeah its the same for me. Speedbooster makes some apps run much faster.
Strange thing is that the benchmark result is usually the same. This might be a good thing - meaning that the CPU speed remains the same, but it just gives more power to some specific app instead of another. Actually this is exactly what I want:
I don't care about the stupid OS doing stupid things, but I DO CARE about my GPS or webbrowser - and here this proggie seems to give a useful hand.
I agree about the price, is a bit expensive, but at least it works
About the price...
You can get it for free on the developer's website, it's some kind of promotion, you only need to install it, run a benchmark with the built in tool, and post your score:
http://teksoftco.com/forum/viewtopic.php?t=2011
hurry up, I don't know how much it will last!
How it works.
It modifies the process priority similarly to the task manager in windows.
It does other stuff too but that's basically what it does.
and what's the verdict ? does it speed up our Diamonds ? (i was testing it... and didn't notice any difference :/ )
It DOES have impact on performance.
Its very easy to test. Try to lower the system apps and services and you will se that the device run slower.
On TF3D its very clear the it makes it run faster/slower if you change the priority.
My opinion; It works...somehow.

Linpack scores for every custom ROM

Do you run a non-sprint ROM?
Help us out by booting your phone without SetCPU enabled and post your linpack score* on the wiki:
http://forum.xda-developers.com/wiki/index.php?title=HTC_Supersonic/ROMs
Make sure your version matches the version posted before posting your score.
On behalf of the community, thanks!
* Linpack scores are not the be-all and end-all of the value of a ROM. Results may vary from device to device. If you experience an erection lasting more than four hours, consult your physician immediately.
Why not post Quadrant scores too?
by all means, add a column for quadrant.
I just used linpack because i wanted to keep it simple. But if you want to add quadrant scores (or any other benchmark) go ahead
I like this idea Quadrant column added
Added scores for Fresh - using HTC's current kernel. Don't kernels effect a roms performance; could skew each person's results, right?
The problem with this set up si that the scores very to much from device to device and that depending on how the phone is set up etc or how the test is run determines the outcome.
We saw the same issue when neif was doing his rom comparison. some where taking averages some where taking best some where using everything stock some werent even with the test instruction unless one person does all the tests exactly the same for each rom on the same phone with the same set up .... it makes the numbers very useless in my opinion. Thats not even accounting for diffrent rom versions kernels etc.
So i would use this with a big grain of salt as there is basically no standard used in obtaining it if it is done as a community and YMMV.
omegasun18 said:
The problem with this set up si that the scores very to much from device to device and that depending on how the phone is set up etc or how the test is run determines the outcome.
We saw the same issue when neif was doing his rom comparison. some where taking averages some where taking best some where using everything stock some werent even with the test instruction unless one person does all the tests exactly the same for each rom on the same phone with the same set up .... it makes the numbers very useless in my opinion. Thats not even accounting for diffrent rom versions kernels etc.
So i would use this with a big grain of salt as there is basically no standard used in obtaining it if it is done as a community and YMMV.
Click to expand...
Click to collapse
+2 THIS for the sake of good science!!!!
Who knows how many variables you are not taking into account!
If you really want to do this right, you need to ensure that the ROM is the SINGLE VARIABLE for the tests.
Now who wants to take the time to do that???
I have never even remotely tried to update a wiki page, but if someone wants to post my score, running Fresh ROM 3.3.0.1 with the Netarchy 4.1.9.1 BFS kernel I got 35.523 Linpack.

Benchmarks DO Matter!

hi. i have seen people here saying that "Benchmarks prove nothing" and even one of the Senior member saying so.
but what i have experienced after using Note and switching between different ROMS like Rocket Rom v22 and v23, Midnote, CheckRom and Stunner Rom, i have found that Yes the Benchmarks Do matter a lot in terms of just explaining how your phone will perform.
i mean i ran the bencmarks on all of these Roms and i used them all for about 4 to 5 days each, and i found that not all of these give equal results and not all of these are equal.
the Check rom performed the worst among all of these Roms. by the time i installed it, my phone started giving me issues. like the battery issue. whenever i connected the phone to the data cable and either connect to my pc or laptop or even the charger, there would a screen popup saying, battery removed! i did everything i could do to fix this issue but all in vain.
well the best Rom in terms of performance is the Rocket Rom. rocket rom gave me the highest scores and i found it to be the most stable Rom.
Midnote was ok rom. it gave me really good benchmark scores but there were lots of force closes.
i really dont want to talk about the CheckRom. it gave me the lowest scores and it proved to be the most buggy rom i have used, and then came the battery removed issue.
Surprisingly i, the ICS Stunner Rom was the Rom which gave me around 110000 score in the Browser mark in the native browser, but for the rest of the benchmarks it gave me normal scores.
so in my point of view the best rom for note for now is the Rocket rom, but if u want buttery smooth UI and 199% smoothness, go for the ICS Stunner. but the payoff is that u loose the SNote and the screen capture capability which i really love about my note.
hence proved, Benchmark Results Do make a difference!...... These are my own personal results and you may have different results but I thought I would share my findings....
aami.aami said:
hence proved, Benchmark Results Do make a difference!
Click to expand...
Click to collapse
Hardly proved! Far from it.
Benchmarks *can* give you an indication of performance, but *nothing* is better than simply trying out different ROMs and making your own objective decision.
Fwiw though, some benchmarks simply aren't worth the time and effort - Quadrant, I'm looking at you!
Regards,
Dave
Sent from my GT-N7000 using Tapatalk 2
I am gonna steal my friend's Chasmodo quote (credits to Chas)
A man without a benchmark is like a camel without electric toothbrush
end
Sent from my GT-N7000 using Tapatalk
Benchmarking could be slightly usefull when comparing different roms though optimalizations that are specifically made to reduce boottime, remove lag or whatever might not show up in te scores.
Using benchmarks to compare phones is definately useless, for example because Android forces you to run apps in the native phone resolution. The Note runs at 1280x800 which means any phone with a similar GPU but lower resolution like the standard 800x480 could synthetically outperform the Note.
Just to throw another point in there I know it can be easily disputed but take for example iOS and windows phone.
Windows phones are limited to single core and they still run smoothly due to optimization.
the latest iPhone 4s has a dual core A5s @ 800mhz, yet it still runs smoothly.
As mentioned above in the thread the only real way is to try out the phone for yourself.
Dude, it's obvious you're no scientist. You haven't proved anything trying to connect benchmark scores with stability and force closes. The only thing a benchmark could indicate is possibly smoothness. It's all about you simply trying different ROMs and finding one that is subjectively working best for you.
Sent from my superior GT-N7000 using Tapatalk
Benchmarks generally test specific capabilities of hardware: arithmetic calculations, GPU performance, etc.
That being the case they are a good yard stick for how the HARDWARE of different devices compare in terms of performance for the most part. Although software and the OS do obviously play their part, the tests are generally targeted at exercising specific aspects of the 'computer' rather than the overall OS.
OS performance is another, much more complex, aspect that benchmarks struggle to cater for. Small changes in benchmark scores between different ROMs is unlikely to tell us much. Somebody who reviews those ROMs and give a fair summary of the overall performance, stability, etc is a much better guide (like the OP, in this case - after a fashion!)
Check Rom is '****ty'?
What utter claptrap. Only proves you have no idea about how to set your phone up properly.
As for the battery issue, really? I've been running checkrom on 3 notes(mine,my wifes and my dads) and never had fcs, battery issues.
Benchmarks are for people like you.
aami.aami said:
the Check rom is the Most ****ty Rom i have used among all of these Roms. by the time i installed it, my phone started giving me ****ty issues.
Click to expand...
Click to collapse
Yo, Benchmarker, watch your language.
Calling any development '****ty' just showcases your poor manners, egomania and general absence of intelligent thinking.
The devs give you something for free.
You don't like it, move on. And keep shtum about it. That's what people with manners do.
I wish you luck in your future benchmarking endeavors, and hope never to hear about them.
Benchmarks don't prove a ****. But I do it every time I try out a new kernel and waste 5 precious minutes of my life.
By the way, calling Checkrom ****ty was insult of all checkrom devs and ultimately an insult of xda itself, we are here because of all these devs.
You simply could have said it had lowest benchmarks or even it was sub par.
May I hope that next time you will carry general code of conduct and keep your ****ty opinions within your skull ?
chasmodo said:
Yo, Benchmarker, watch your language.
Calling any development '****ty' just showcases your poor manners, egomania and general absence of intelligent thinking.
The devs give you something for free.
You don't like it, move on. And keep shtum about it. That's what people with manners do.
I wish you luck in your future benchmarking endeavors, and hope never to hear about them.
Click to expand...
Click to collapse
That's what I'm talking about.
Don't benchmark the OS and mobile, but benchmark your brain that is it capable enough to run that device at its fullest without the need of any score to prove anything.
Just my 2 cents.
aami.aami said:
hence proved, Benchmark Results Do make a difference!
Click to expand...
Click to collapse
where have you proved anything? you really are a bit deluded arent you
Benchmark are valuable in terms of relative comparison to the same benchmark.
Benchmark just don't correlate well to real world performance.
IE: Note LTE ATT on speed app runs 15-20 M's, mine runs 7-9 in same location. Same network. Yet download Engadget simultaneously and they're even.
Benchmarks prove nothing.
/wisdom
mfractal said:
Benchmarks prove nothing.
/wisdom
Click to expand...
Click to collapse
Benchmarks prove everything.
/wisdumb
Zamboney said:
Dude, it's obvious you're no scientist. You haven't proved anything trying to connect benchmark scores with stability and force closes. The only thing a benchmark could indicate is possibly smoothness. It's all about you simply trying different ROMs and finding one that is subjectively working best for you.
Sent from my superior GT-N7000 using Tapatalk
Click to expand...
Click to collapse
i really dont understand why some people dont understand what the main point some statement is. its quite simple, nothing scientific and i did not talk about any technicalities. see for your self, the more smoother the ROM is the more better the Hardware of the phone is going with the build of the ROM that's obvious, right? now that would mean more room for the hardware of the phone to be available for better benchmark results.
aami.aami said:
i really dont understand why some people dont understand what the main point some statement is. its quite simple, nothing scientific and i did not talk about any technicalities. see for your self, the more smoother the ROM is the more better the Hardware of the phone is going with the build of the ROM that's obvious, right? now that would mean more room for the hardware of the phone to be available for better benchmark results.
Click to expand...
Click to collapse
probably but not necessarily, correlation does not mean causation,
each benchmark result is moreless the weighted average of few or more individual test results - now let's take Quadrant, which is (was?) heavily biased towards 3D graphics performance - how much is that representative of ROM performance under typical (non-gaming) phone usage?
PS.
Benchmarks may matter. Size matters more.
(Anyone telling otherwise is either ashamed or trying to be nice)
From the Moderator
Watch your language....... nothing wrong with arguing about results or subjective findings, but almost all opinions are subjective..... so discuss nicely or we close the thread if flaming starts up
Thanks.... oka1
One thing apple got google and its oem beats. Dont fking look at the hardware and benchmark. Look at the user experience. Not saying ios and iphone is great for the folks who like to tinker. But for a dual core 800mhz iphone4 or ipad2 it sure runs a lot smoother than a note with stock touchwiz or some other launcher. Afterall u r using ur device, ur own judgement should tell u how good the device is not some program score. And there will always room for hardware improvement, but can the software follows? How many app is actually utilizing multi core process?
Sent from my GT-N7000 using Tapatalk 2
put new Kernels you will see big different in benchmark.
From my experience testing roms + kernels I see that benchmarks really nothing
I got with Antutu benchamrk with stock rom and stock kernel about 6900 score
but it was so laggy and battery sucks. atm using Chrack´s rom extra small + speedmod v10 and its perfect no lags good battery life smooth but the benchmark sucked got like 4500. So benchmarks aren't the way to chose a rom otherwise there is no need to test and share experience with people

[REQUEST] Antutu Benchmarking from Locked/Stock/Stock or variations

Hi. Title says it all.
If anyone has a locked bootloader, stock ROM, stock launcher, (Basically new out the box), I'd love to see your AnTuTu benchmarks.
Also, I'd be interested in any other combination of unlocked/locked bootloader, STOCK ROM, and stock or 3rd party launcher. (If not stock rom, please post your BMs and details in the threads for your ROM )
THANKS! In advance (and when you post your screen). :good:
---
https://play.google.com/store/apps/details?id=com.antutu.ABenchMark
If you're new and want to help out, (because let's face it, who else has locked/stock/stock?) what you'll do is click that link above, choose to install, send to your Nexus 7. After a couple minutes or when your N7 notifies you that AnTuTu benchmark is installed, open the device, click the 2nd tab at top called "TEST" and then hit "Start Test".
This will take about 5 minutes. You'll get a benchmark screen but go ahead and give it a few more minutes, in fact on the first benchmark screen you see, (with a score at the top) if you tap the first divider labelled "Detailed scores", you'll see that more parts of your system are still being benchmarked. Make sure to pull down this DETAILED SCORES before taking the screen screen!
After that, and all benchmarking is done, hold power+vol down to take a screen shot. You can then post from your N7 to here or send it to yourself/etc to post the screenshot here.
Attached is an example (from my N7, which is unlocked/SGT7 ROM/modified stock launcher) of what it should look like.
Locked or unlocked has zero effect on performance/becnhmarks/battery etc. Effects nothing at all.
Sent from my Nexus 7 using Tapatalk 2
Thanks for your valuable input. albundy.
Thanks for the sarcastic reply after making a thread with such a silly idea to bench with a locked and unlocked bootloader.
It makes no difference. I am curious to how you can even ponder the idea that it could to be honest.
If you where so curious about it do it yourself. Waste your own time instead of trying get a noob to waste theirs. Anybody that isn't a complete newbie knows already it makes no difference and most would even know why.
albundy2010 said:
Thanks for the sarcastic reply after making a thread with such a silly idea to bench with a locked and unlocked bootloader.
It makes no difference. I am curious to how you can even ponder the idea that it could to be honest.
If you where so curious about it do it yourself. Waste your own time instead of trying get a noob to waste theirs. Anybody that isn't a complete newbie knows already it makes no difference and most would even know why.
Click to expand...
Click to collapse
I'm looking to gather benchmarks from a variety of configurations with stock ROM - that's the goal. The bootloader is quite obviously the least important part of this. I included it because there are quite a few people who may have unlocked and rooted and don't realize that it doesn't matter and to avoid filling the thread with meaningless posts that don't at all provide to the conversation like "Does it matter if I have unlocked my bootloader?". Basically, I was providing the detail that I would love to see benchmarking off *all* configurations with stock ROM.
antutu is mostly cpu speed dependant, with some infuence on 2d/3d scores if or if not you have force gpu acceleration enabled in developer options(device main settings). mostly, scores with similar cpu speeds will score the same(root or stock) if you bench with that cpu speed locked(for example 1200mhz high/1200mhz low). if you let the device scale(set cpu speed to the highest high and lowest low) then you wont know what cpu speed its actually benchmarking because the device scales and decides what cpu speed it wants. allowing it to scale can produce a huge variation in scores and is inaccurate in providing the true scores for a certain cpu speed, stock or root.

Categories

Resources