Related
Results in Google Docs Spreadsheet
All ICS ROMs Benchmarked
Any regular visitors to this thread can't have failed to notice the big changes in the spreadsheet. In particular I've been studying the effect of the kernel the ROM developer includes. If you look at column H, you will see whether I recommend flashing another kernel to improve performance at stock speeds.
REMEMBER: Performance is not everything! Many custom kernels provide extra features!
If you do decide to switch kernels, and only desire stock speeds and a reduced feature set, I recommend two kernels in this post.
If you are new to this stuff read this.
SUMMARY OF RESULTS
#1st place: Pixel ROM 1.72
#2nd place: CyberGR-MOD|NS.NGN ICS v10 HYBRID
#3rd place: MIUI Catalyst 2.4.6
#4th place: AOSP+ N.5
#5th place: [MIUI][2.4.6] Oodie pRiMe rOcket fUeled
Where do I find all these wonderful ROMs?
Their XDA threads are all linked in the table, so click through to discover each ROM's feature set, included apps, theme, and evidence of good karma!
Looking for a Gingerbread ROM? Try this.
Where did all your other benchmarks go?
Kernel Features & Benchmarks: this thread
Battery drain: this thread
CPU Governors and I/O Schedulers: this thread
Power Saving Governors: this thread
Thanks to all the developers.
Testing Methodology
Each ROM is clean installed, allowed its own default settings, then all benchmark software is installed and run once the system is settled. I also perform one screen off screen on, just out of habbit (this used to resolve a graphics bug in gingerbread, which I'm not even sure exists in ICS). All results are recorded in the spreadsheet. Then I restart in recovery, wipe cache and dalvic (thanks morfic for dalvic wiper) and install morfic's T132-I kernel. Reboot, use nstools to select performance (default I/O scheduler for morfic's kernel is deadline). Reperform all benchmarks, recording them in the spreadsheet. The calculation for the overall CPU RAM I/O and GRAPHICS scores is identical to the one I use in my kernel benchmarking spreadsheet. Please refer to that thread for more detail. However, there is one difference. Quadrant behaves very differently in different ROMs depending on what graphics tweaks they incorporate. As such, no Quadrant scores are used in this ROM benchmarking study. For more details, see under 'Graphics' below.
The final step was to average out the results of both kernel scores, and ranking on that basis. Some would say that they are best ranked by looking at T132 scores only. I would say that is a fair point, and definitely worth consideration.
There are two reasons I incorporate the default kernel score:
1) Overall scores have a worst case scenario accuracy of within 2% of the true mean due to variability in the benchmarks (more detail on how I obtain this figure is available in my kernel benchmarking thread). For normally distributed data (which we can safely assume these benchmarks produce) averaging two sets of results will result in doubling the accuracy to within 1% of the true mean, making the ranking more reliable.
2) Combining the default kernel Scores for ROMs that used a poor performing kernel, or selected bad governor/scheduler combinations by default will suffer as a consequence. These problems can be solved if the user flashes their own preferred kernel and/or adjusts the kernel settings. However, many new users will not perform this step. For that reason, I want to give a score that at least somewhat reflects the performance as the developer intended.
-Graphics
One of the early findings is selecting force GPU rendering in the developer options improves 2D performance, in Quadrant only. Also, and only in Quadrant, 3D performance can be improved by deleting or moving /system/lib/egl/libGLES_android.so using root explorer or equivalent. These tweaks/hacks do not seem to affect other benchmarks in the slightest.
Because of the bizarre effects of these tweaks on Quadrant scores, I have removed them from the formula that calculates the overall GFX score, and this in turn impacts the overall average score. In short, it makes comparing each ROM's score fairer.
You can see evidence of how the graphics tweaks make Quadrant behave differently at the bottom of the spreadsheet, highlighted in light red. The host ROM for this particular comparison was DianXin or DX ROM for short. This is a reference to a post I make in DX ROMs thread, where I first decide that removing Quadrant is the best option: http://forum.xda-developers.com/showpost.php?p=22323688&postcount=194
-Android 4.0.1
These ROMs (at the bottom of the spreadsheet, highlighted in light red) were based on early maguro ports provided by koush. I have left them in, because although they are difficult to compare to 4.0.3 builds with the correct drivers and whatnot, they do compare to each other in one important respect: the kernel. One is stock, the other is built by eugene373 (galaxy nexus/nexus s dev.) Using eugene373's kernel, CPU, I/O, and Graphics were all raised to a high standard that is on a par, or above some of the current ROMs. This goes to show that a customised kernel can offer great benefits, even on a ported ROM.
-Android 4.0.4
As of the 5th of February, my table contains all the ICS ROMs that are listed in the XDA forums. There was only one 4.0.4 version at the time, and this was the best performing in the benchmarks. When the source code is released, I'm sure many ROMs will update. At this point they will benefit from increased RAM scores and javascript performance. If all the ROMs scores improve by the same proportion, the rankings will not be affected. I will attempt to included major releases, but I will not reperform these tests every time there is a new nightly.
Reserved 4
Reserved 3
Thanks
I was waiting for this
It might lead to troll wars though
By the way, i dont see Pete ICS rom in there, im using it.
Ibn Saeed said:
Thanks
I was waiting for this
It might lead to troll wars though
By the way, i dont see Pete ICS rom in there, im using it.
Click to expand...
Click to collapse
Thanks, and no troll wars please y'all.
Don't you think "popularity" is going a little too far? It will definitely lead to fights...all the devs are good and I don't think prominence is a good indicator of a good rom
But it's up to you
Sent from my Nexus S using XDA App
Personally, benchmarks are very misleading... Some of the most stable and well developed roms don't get the greatest scores because they weren't made with benchmarks in mind.
Sent from my Nexus S 4G using xda premium
Another great work! Thanks
Sent from my Nexus S using XDA App
mathkid95 said:
Don't you think "popularity" is going a little too far? It will definitely lead to fights...all the devs are good and I don't think prominence is a good indicator of a good rom
But it's up to you
Sent from my Nexus S using XDA App
Click to expand...
Click to collapse
just remember, popular doesnt mean better. but to get angry at the truth(whatever it might be) is just silly. its lies that you should be upset with.
Where's Peter Alfonso's ROM? Bugless Beast is a mainstream rom, second only to Cyanogenmod in scope and breadth.. The ROM thread is in the General forum, because he links to his page at Rootzwiki, but it's a more prominent ROM than many you've listed.
Please include it in the benchmarking as well.
Sent from my Nexus S using Tapatalk
http://forum.xda-developers.com/showthread.php?t=1430170
you didn't add and test this one
please add pete ics bugless beast.
Omissions fixed!
UPDATE: kwiboo's project removed, was an SDK port. So so tired now, got to sleep. Tomorrow begin again with Brainmaster's tweaked ICS
Which kernel is used to make the tests?
-----
Forget It...
"I'll be benchmarking them twice with whatever kernel they come with, and then with morfic's bare boned T132"
biotecsoul said:
Which kernel is used to make the tests?
Click to expand...
Click to collapse
Read the op.
Sent from my Nexus S 4G using xda premium
u could also add overnite battery drainage column with sync on or somethin like that, if not overnite then a period of 2 hrs idle .. how much does it drain ..
Holy **** man, what would it be if the NS comunity didnt have you??
Thumbs up!!!!
Sent from my Nexus S using xda premium
thegtfusion said:
Holy **** man, what would it be if the NS comunity didnt have you??
Thumbs up!!!!
Sent from my Nexus S using xda premium
Click to expand...
Click to collapse
Haha, that makes me feel good. Wait, Benchmarks > XDA thread > Positive XDA user feedback > Dopamine release = Addiction to benchmarking? Time to join crackflashers anonymous...
mathkid95 said:
Don't you think "popularity" is going a little too far? It will definitely lead to fights...all the devs are good and I don't think prominence is a good indicator of a good rom
But it's up to you
Sent from my Nexus S using XDA App
Click to expand...
Click to collapse
I doubt it would lead to fights between devs, well hopefully not. I can see users arguing stuff more than devs.
Benchmarks aren't that good anways.
BTW, your kernel sucks!!!!
Just kidding been running smoothly since I started using it the other day
-----------
Thanks for the ratings system. Looks nice!
I am looking for a good combination of Rom and Kernel for maximum Gaming experience. Currently, im using Jr11 and motley kernel, and considering going back to Glazed rom which is imho the best rom for gaming. What do you guys think? Please give me advices. TIA
Before you get flamed by others for having clearly not read the forum rules, I'll say now that the only way to know is by testing them out for yourself.
Afterall, what works great for someone else could work terrible for you.
Sent from my GT-I9100 using xda premium
KidCarter93 said:
Before you get flamed by others for having clearly not read the forum rules, I'll say now that the only way to know is by testing them out for yourself.
Afterall, what works great for someone else could work terrible for you.
Sent from my GT-I9100 using xda premium
Click to expand...
Click to collapse
this is the only correct answer. try them all out, find what your device reacts to best and what fills your needs the best.
that said, my device likes trinity kernel with the rasbean jelly rom.
I use ParanoidAndroid 2.99 Beta6 with Franco kernel r30. I undervolted it too at [email protected] 1,3ghz down to [email protected] 100mhz and i can run the [email protected] 550mhz without problems. I haven't done extensive tests but i think that overclocking the gpu would give the highest gains in terms of gaming performance, but i don't exclude obtaining a little extra performance or more stable fps with some roms.
As the guys above said, it's a matter of taste, not every rom works for everybody.
Most of life is a choice between one or the other but with the Nexus 7 along with Root, Custom Recovery, cm10.2 unofficial, Faux Clock Kernel Control App and Jassy Release 5 Kernel it might just be possible to have both. Jassy has managed to put together a kernel that combines a 1.9 GHz over clock and a 487 MHz GPU over clock. With a global undervolt of -24 MV I managed to pull off stunning benchmarks, smooth lag free performance and incredible battery time. Just under 13 hours battery time in fact. I did this with a YouTube kung fu movie fest for about 12 and a half hours and a half hour of benchmarks and downloading a few apps. Remember if you game you can not expect this kind of battery performance but it does do great at that as well. I've attached some screenshots of my settings so you can reproduce these results if you would like.
Remember when you Root, ROM and Over clock you do it at your own risk and please thank the fine Developers who gave their time to make this kind of fantasy possible. I in no way had a hand in developing this software, I just took the time to do many benches and battery tests on many Roms and kernels then undervolted a bit.
Sent from my Nexus 7 using xda app-developers app
Benchmarks
Sent from my Nexus 7 using xda app-developers app
Nice, will have to check this out
Sent from my Nexus 4 using xda app-developers app
So to replicate your results, we need to flash cyagen, and jassy release 5, and then adjust the settings to replicate yours, or does jassy's release already have some of those settings in it?
What other apps did you download?
Getting longer battery life and a faster tablet is quite attractive!
EDIT I just installed jassy r5, and my quadrant is only 5679.. is something wrong, or do I need to also do the tweaks you listed here first?
EDIT 2: I've set faux to the same setting now, but am still using cleanroom1.3, and the quadrant results are 6787
Gareee said:
So to replicate your results, we need to flash cyagen, and jassy release 5, and then adjust the settings to replicate yours, or does jassy's release already have some of those settings in it?
What other apps did you download?
Getting longer battery life and a faster tablet is quite attractive!
EDIT I just installed jassy r5, and my quadrant is only 5679.. is something wrong, or do I need to also do the tweaks you listed here first?
EDIT 2: I've set faux to the same setting now, but am still using cleanroom1.3, and the quadrant results are 6787
Click to expand...
Click to collapse
Sorry I never saw your posts. Never looked at the thread again. To replicate my results you would have to download cm10.2 and Jassy release 5 and faux kernel control app paid version and set exactly like in the screen shots. I have since made a few more refinements but nothing you couldn't play with yourself. Make sure you enable mpdecision. Make every screen look like mine.
Fiops as I/o and 62c 82c as intellithermal is the only settings changed. Bout 7 hours of YouTube and 5 hours of heavy browsing. Couldn't ask for better battery life. NO Gaming.
Sent from my Nexus 7 using xda app-developers app
Yep, I did duplicate them, but couldn't get quadrant scores anywhere near yours. (they were better though.. it might be a cleanroom issue).
I upgraded to Jassy rev 6, ran into issues, and then just reflashed the stock kernel.
I was hoping we'd see Jassy rev 6 lockup issues fixed, but its been a week now. I'm also read of a few misc cm issues, and I'e been waiting for them to clear up as well. Cleanrom isn't having any issues at all, so I've stuck with it for now.
conan1600 said:
Fiops as I/o and 62c 82c as intellithermal is the only settings changed. Bout 7 hours of YouTube and 5 hours of heavy browsing. Couldn't ask for better battery life. NO Gaming.
Sent from my Nexus 7 using xda app-developers app
Click to expand...
Click to collapse
How's stability with your set-up?
Gareee said:
Yep, I did duplicate them, but couldn't get quadrant scores anywhere near yours. (they were better though.. it might be a cleanroom issue).
I upgraded to Jassy rev 6, ran into issues, and then just reflashed the stock kernel.
I was hoping we'd see Jassy rev 6 lockup issues fixed, but its been a week now. I'm also read of a few misc cm issues, and I'e been waiting for them to clear up as well. Cleanrom isn't having any issues at all, so I've stuck with it for now.
Click to expand...
Click to collapse
Cleanrom will not bench as high. Its a stock based ROM. Truth is though once your this high your not gonna see a whole lot of improvement in daily performance unless you go looking for it. Cleanrom is one of the best Roms I've ever used and there is absolutely nothing wrong with sticking with it. I go back and forth between the 2 myself. As themes and tweaks come out for nexus 7 2013 you'll find cleanrom will get even better than it is now also. Wish someone would do a tablet ui lol.
dkb218 said:
How's stability with your set-up?
Click to expand...
Click to collapse
I haven't had a single random reboot. Chrome works real well as long as you can change it from beta in lower left of xda page. I haven't overheated but I gotta tell you I'm no hardcore android gamer. Some angry birds from time to time or subway surfers lol. I have probably gamed for about an hour or so on these settings and not gone into a state of panic about temps though. Any longer than that or some other game and I couldn't say. in fact FOR me things are so smooth on this machine I had to order a new HP to tinker with lol. Seriously this is the best android machine I've owned. And buddy, I've had em all. I also use adaway so that may help with chrome as well.
Impressive scores man.
Yeah hesitant to jump to other roms myself at least at this time. Everything is so new finding a "good one" is hard to do at least yet. Though I've used CleanROM's on other devices I've had in the past and love them. Personally if CleanROM comes out with a 1.4 I might consider jumping into it.
Thanks for sharing! My only suggestion would be for you to recommend another kernel tuning app other than Faux's app. I'm just personally not a fan of someone who does nothing but kang, and even then still doesn't credit who he is kanging from. Too many hard working honest developers for me to support a faux developer (yes, pun intended. Maybe that's where the screen name came from?).
Just my $0.02.…
EDIT : For anyone questioning the integrity of my comment, just do some research and you'll see what I'm saying
SwiftKey'ed from my '13 Nexus 7 FHD using XDA Premium HD
stanglifemike said:
Thanks for sharing! My only suggestion would be for you to recommend another kernel tuning app other than Faux's app. I'm just personally not a fan of someone who does nothing but kang, and even then still doesn't credit who he is kanging from. Too many hard working honest developers for me to support a faux developer (yes, pun intended. Maybe that's where the screen name came from?).
Just my $0.02.…
EDIT : For anyone questioning the integrity of my comment, just do some research and you'll see what I'm saying
SwiftKey'ed from my '13 Nexus 7 FHD using XDA Premium HD
Click to expand...
Click to collapse
I have absolutely No interest in politics on my nexus 7 2013. if he did wrong, shame on him however I have tried each and every kernel control app on the market and reported my best results. I have yet to produce scores or battery life comparable even within 10% of fauxclock/Jassy R5 combo. I do not intend to do any research at all about whatever faux123 did or didn't do. I understand a personal grudge and respect your right to hold one. If your looking for something as close as you can get to his kernel control app try trickster. I didn't have a lot of success with it but you might find a combination that works close. If I were in the middle of whatever happened between faux123 and you or whoever I might have formulated an opinion. I'm not chiding you either. You brought an issue before me and I am simply stating I don't want involved as its in my humble opinion not my place or my fight, not to mention it appears it was already fought.
if I simply hated and didn't use a product based on someone else I don't know having a problem with that individual I wouldn't be able to buy anything, at all, anywhere, on earth, or in heaven, ever! If you tell me he harmed a baby and I see he was convicted of it in a trial of his peer's elected in a fair and balanced environment I will most certainly NOT have anything to do with him. But unproven or conflicting information, that may be due to personal interpretations is difficult for me to get involved in. Especially after the fact. And then there is the whole, if a man was punished for his crime do you continue to persecute him after he paid his dues thing.
Are there any deal breaking issues in CM? If not, switching does not bother me at all, and getting better all over performance is worth while.
I just don't want to spend more time tinkering with my tablet than actually using it.
What's your binning?
appreciate you sharing your jassy 5 set up with the fauxclock app. im on jassy 5 as well and have been running the setup that jassy posted but now im gonna try your set up. i just got one question about it: how is your sleep mode stand by time? i lose 1-2% in 8 hours
Gareee said:
Are there any deal breaking issues in CM? If not, switching does not bother me at all, and getting better all over performance is worth while.
I just don't want to spend more time tinkering with my tablet than actually using it.
Click to expand...
Click to collapse
I personally would call the current cm build almost RC material. I have no problems with it at all.
My bin was 14/2 if I'm not mistaken.
I probably lose a bit less than that but can't say for certain as I constantly use it lmao. I do get exceptional screen on time really. There are some screen shots on previous page I think.
Cool. Might have to take the plunge. Do you have to wipe to install it? (I didn't have to wipe for cleanrom.)
Gareee said:
Cool. Might have to take the plunge. Do you have to wipe to install it? (I didn't have to wipe for cleanrom.)
Click to expand...
Click to collapse
You have to wipe on a first install.
conan1600 said:
You have to wipe on a first install.
Click to expand...
Click to collapse
Ugh.
Hello Everyone,
I bought a nexus 4 a couple of months back, and have been using stock roms with OTA updates (Currently on Kitkat 4.4) ever since.
Before N4, I was using a samsung galaxy I5500 , which only had a couple of custom roms and it was easy to decide which one to go for.
But now, I see so many roms and kernels and I have no idea where to begin modding my phone.
So, I need suggestions, which rom/rom+kernel should I go for ?
I am not a very heavy user and mostly use my phone for routine activities like music, internet browsing, GPS, whatsapp, text, call [The list is exhaustive ].
The main things that I care for would be long battery life, lesser phone operating temperatures, and a good/beautiful (subjective, but whatever).
so bretheren, Please suggest me a ROM/ROM + Kernel combo which matches my needs.
Thank you for your time and effort.
tyronegoku said:
Hello Everyone,
I bought a nexus 4 a couple of months back, and have been using stock roms with OTA updates (Currently on Kitkat 4.4) ever since.
Before N4, I was using a samsung galaxy I5500 , which only had a couple of custom roms and it was easy to decide which one to go for.
But now, I see so many roms and kernels and I have no idea where to begin modding my phone.
So, I need suggestions, which rom/rom+kernel should I go for ?
I am not a very heavy user and mostly use my phone for routine activities like music, internet browsing, GPS, whatsapp, text, call [The list is exhaustive ].
The main things that I care for would be long battery life, lesser phone operating temperatures, and a good/beautiful (subjective, but whatever).
so bretheren, Please suggest me a ROM/ROM + Kernel combo which matches my needs.
Thank you for your time and effort.
Click to expand...
Click to collapse
slimbeam 4.3.1 + faux123 kernel. or rastakat + ak kernel 223 (or more). leave min freq ate 192 and max at 1.2ghz, mp decision on. and boom.
for performance i say psx 4.4 with caf libs(i dont remember if psx itself comes with them)and ak kernel 223 or more with oc 1.9, gpu oc to 487mhz, both in performance gov, min freq 387, disable mp decision. put thermal throtle to 60ºC, put 2048 of data buffer and row i/o scheduler.
ps: u can use trickster to change kernel settings.
psx rom v2 + stock kernel (psx kernel) or faux kernel AK218 will do.
Sent from my Nexus 4 using XDA Premium 4 mobile app
I am sorry if what im about to ask is already posted somewhere (probably is), but this forum is pretty vast and I couldnt find what im looking for. The question is this, Im using Vanir ROM. Now with the inbuilt kernel I had around 20k benchmark on antutu. I flash hells core, excited to see any difference and whoop, i got 14k. Also i checked the part with 3D testing and fps was higher for about 5-7 points. So what Im asking is this,What is the meaning of this and also how can I, how to put it to not sound noobish, tweak the kernel to perform/save battery etc.?Because Im assuming thats not the top what HellsCore kernel can do, am I right? Or if you guys have any kernels to recommend, all is appreciated. Also if this helps, Im using Nexus 4, Vanir ROM(as posted above) and dont know what else would you need to know to answer.
Thanks in advance
/So I rebooted and now I am on 20840 for some reason.
Benchmarks are not very conclusive abnout anything. Each phone is different each user has different needs and how and where there phone is used. Everyone will tell u to try this kernel and that kernel but u just have to find one that works for you
Sent from my GT-P3110 using Tapatalk
mymeatb18 said:
Benchmarks are not very conclusive abnout anything. Each phone is different each user has different needs and how and where there phone is used. Everyone will tell u to try this kernel and that kernel but u just have to find one that works for you
Sent from my GT-P3110 using Tapatalk
Click to expand...
Click to collapse
I get that, i was more concerned about those numbers. Why did it drop to 14k and then went to 20k again.
Probably some patches were included in the rom's kernel, which can affect the scores.
When you flashed another kernel (helldoctor), you stopped using these patches, so scores went down.
Sent from my NookColor using Tapatalk
Almayce said:
I am sorry if what im about to ask is already posted somewhere (probably is), but this forum is pretty vast and I couldnt find what im looking for. The question is this, Im using Vanir ROM. Now with the inbuilt kernel I had around 20k benchmark on antutu. I flash hells core, excited to see any difference and whoop, i got 14k. Also i checked the part with 3D testing and fps was higher for about 5-7 points. So what Im asking is this,What is the meaning of this and also how can I, how to put it to not sound noobish, tweak the kernel to perform/save battery etc.?Because Im assuming thats not the top what HellsCore kernel can do, am I right? Or if you guys have any kernels to recommend, all is appreciated. Also if this helps, Im using Nexus 4, Vanir ROM(as posted above) and dont know what else would you need to know to answer.
Thanks in advance
/So I rebooted and now I am on 20840 for some reason.
Click to expand...
Click to collapse
Anututu and other benchmarks depend on a number of factors/conditions which affect the final result . The major conditions which affect it result are below
1) The CPU temperature !! When ur phone gets hot the CPU throttle will automatically reduce the active cores and the clock speed to cool down your CPU !! This results in decrease in performance !! When you flash new kernels its possible that ur phone is hot and hence performance decreases
2) Using your phone while running tests also affect the results . for eg if there is a notification during the test or background sync going on it will affect the result
3) probably the kernel packed with vanir had 4 cores active all the time to increase scores and hells core has just 2 cores active ( at a given moment) will mean decreased performance
The ideal way to test kernels is as follows
1) Dirty flash your ROM before flashing kernel
2) Reboot your device after the first boot
3) Let it settle down for an hour
4) turn of data/WiFi during the test
5) see the kernels specs( like cores active/the maximum CPU speed) through an app like trickster/faux clock
6) Now run the test
7) after test let your phone cool down for 15 mins
8) repeat the test a few times and take the average of all scores
Kindly hit the thanks button as a token of appreciation
Antutu was never accurate if you ask me. Sometimes it goes down and the other it went up..so..
I see, thank you guys.
Benchmarks are like putting makeup on.
Sent from my Nexus 4 using Tapatalk