Related
Results in Google Docs Spreadsheet
All ICS ROMs Benchmarked
Any regular visitors to this thread can't have failed to notice the big changes in the spreadsheet. In particular I've been studying the effect of the kernel the ROM developer includes. If you look at column H, you will see whether I recommend flashing another kernel to improve performance at stock speeds.
REMEMBER: Performance is not everything! Many custom kernels provide extra features!
If you do decide to switch kernels, and only desire stock speeds and a reduced feature set, I recommend two kernels in this post.
If you are new to this stuff read this.
SUMMARY OF RESULTS
#1st place: Pixel ROM 1.72
#2nd place: CyberGR-MOD|NS.NGN ICS v10 HYBRID
#3rd place: MIUI Catalyst 2.4.6
#4th place: AOSP+ N.5
#5th place: [MIUI][2.4.6] Oodie pRiMe rOcket fUeled
Where do I find all these wonderful ROMs?
Their XDA threads are all linked in the table, so click through to discover each ROM's feature set, included apps, theme, and evidence of good karma!
Looking for a Gingerbread ROM? Try this.
Where did all your other benchmarks go?
Kernel Features & Benchmarks: this thread
Battery drain: this thread
CPU Governors and I/O Schedulers: this thread
Power Saving Governors: this thread
Thanks to all the developers.
Testing Methodology
Each ROM is clean installed, allowed its own default settings, then all benchmark software is installed and run once the system is settled. I also perform one screen off screen on, just out of habbit (this used to resolve a graphics bug in gingerbread, which I'm not even sure exists in ICS). All results are recorded in the spreadsheet. Then I restart in recovery, wipe cache and dalvic (thanks morfic for dalvic wiper) and install morfic's T132-I kernel. Reboot, use nstools to select performance (default I/O scheduler for morfic's kernel is deadline). Reperform all benchmarks, recording them in the spreadsheet. The calculation for the overall CPU RAM I/O and GRAPHICS scores is identical to the one I use in my kernel benchmarking spreadsheet. Please refer to that thread for more detail. However, there is one difference. Quadrant behaves very differently in different ROMs depending on what graphics tweaks they incorporate. As such, no Quadrant scores are used in this ROM benchmarking study. For more details, see under 'Graphics' below.
The final step was to average out the results of both kernel scores, and ranking on that basis. Some would say that they are best ranked by looking at T132 scores only. I would say that is a fair point, and definitely worth consideration.
There are two reasons I incorporate the default kernel score:
1) Overall scores have a worst case scenario accuracy of within 2% of the true mean due to variability in the benchmarks (more detail on how I obtain this figure is available in my kernel benchmarking thread). For normally distributed data (which we can safely assume these benchmarks produce) averaging two sets of results will result in doubling the accuracy to within 1% of the true mean, making the ranking more reliable.
2) Combining the default kernel Scores for ROMs that used a poor performing kernel, or selected bad governor/scheduler combinations by default will suffer as a consequence. These problems can be solved if the user flashes their own preferred kernel and/or adjusts the kernel settings. However, many new users will not perform this step. For that reason, I want to give a score that at least somewhat reflects the performance as the developer intended.
-Graphics
One of the early findings is selecting force GPU rendering in the developer options improves 2D performance, in Quadrant only. Also, and only in Quadrant, 3D performance can be improved by deleting or moving /system/lib/egl/libGLES_android.so using root explorer or equivalent. These tweaks/hacks do not seem to affect other benchmarks in the slightest.
Because of the bizarre effects of these tweaks on Quadrant scores, I have removed them from the formula that calculates the overall GFX score, and this in turn impacts the overall average score. In short, it makes comparing each ROM's score fairer.
You can see evidence of how the graphics tweaks make Quadrant behave differently at the bottom of the spreadsheet, highlighted in light red. The host ROM for this particular comparison was DianXin or DX ROM for short. This is a reference to a post I make in DX ROMs thread, where I first decide that removing Quadrant is the best option: http://forum.xda-developers.com/showpost.php?p=22323688&postcount=194
-Android 4.0.1
These ROMs (at the bottom of the spreadsheet, highlighted in light red) were based on early maguro ports provided by koush. I have left them in, because although they are difficult to compare to 4.0.3 builds with the correct drivers and whatnot, they do compare to each other in one important respect: the kernel. One is stock, the other is built by eugene373 (galaxy nexus/nexus s dev.) Using eugene373's kernel, CPU, I/O, and Graphics were all raised to a high standard that is on a par, or above some of the current ROMs. This goes to show that a customised kernel can offer great benefits, even on a ported ROM.
-Android 4.0.4
As of the 5th of February, my table contains all the ICS ROMs that are listed in the XDA forums. There was only one 4.0.4 version at the time, and this was the best performing in the benchmarks. When the source code is released, I'm sure many ROMs will update. At this point they will benefit from increased RAM scores and javascript performance. If all the ROMs scores improve by the same proportion, the rankings will not be affected. I will attempt to included major releases, but I will not reperform these tests every time there is a new nightly.
Reserved 4
Reserved 3
Thanks
I was waiting for this
It might lead to troll wars though
By the way, i dont see Pete ICS rom in there, im using it.
Ibn Saeed said:
Thanks
I was waiting for this
It might lead to troll wars though
By the way, i dont see Pete ICS rom in there, im using it.
Click to expand...
Click to collapse
Thanks, and no troll wars please y'all.
Don't you think "popularity" is going a little too far? It will definitely lead to fights...all the devs are good and I don't think prominence is a good indicator of a good rom
But it's up to you
Sent from my Nexus S using XDA App
Personally, benchmarks are very misleading... Some of the most stable and well developed roms don't get the greatest scores because they weren't made with benchmarks in mind.
Sent from my Nexus S 4G using xda premium
Another great work! Thanks
Sent from my Nexus S using XDA App
mathkid95 said:
Don't you think "popularity" is going a little too far? It will definitely lead to fights...all the devs are good and I don't think prominence is a good indicator of a good rom
But it's up to you
Sent from my Nexus S using XDA App
Click to expand...
Click to collapse
just remember, popular doesnt mean better. but to get angry at the truth(whatever it might be) is just silly. its lies that you should be upset with.
Where's Peter Alfonso's ROM? Bugless Beast is a mainstream rom, second only to Cyanogenmod in scope and breadth.. The ROM thread is in the General forum, because he links to his page at Rootzwiki, but it's a more prominent ROM than many you've listed.
Please include it in the benchmarking as well.
Sent from my Nexus S using Tapatalk
http://forum.xda-developers.com/showthread.php?t=1430170
you didn't add and test this one
please add pete ics bugless beast.
Omissions fixed!
UPDATE: kwiboo's project removed, was an SDK port. So so tired now, got to sleep. Tomorrow begin again with Brainmaster's tweaked ICS
Which kernel is used to make the tests?
-----
Forget It...
"I'll be benchmarking them twice with whatever kernel they come with, and then with morfic's bare boned T132"
biotecsoul said:
Which kernel is used to make the tests?
Click to expand...
Click to collapse
Read the op.
Sent from my Nexus S 4G using xda premium
u could also add overnite battery drainage column with sync on or somethin like that, if not overnite then a period of 2 hrs idle .. how much does it drain ..
Holy **** man, what would it be if the NS comunity didnt have you??
Thumbs up!!!!
Sent from my Nexus S using xda premium
thegtfusion said:
Holy **** man, what would it be if the NS comunity didnt have you??
Thumbs up!!!!
Sent from my Nexus S using xda premium
Click to expand...
Click to collapse
Haha, that makes me feel good. Wait, Benchmarks > XDA thread > Positive XDA user feedback > Dopamine release = Addiction to benchmarking? Time to join crackflashers anonymous...
mathkid95 said:
Don't you think "popularity" is going a little too far? It will definitely lead to fights...all the devs are good and I don't think prominence is a good indicator of a good rom
But it's up to you
Sent from my Nexus S using XDA App
Click to expand...
Click to collapse
I doubt it would lead to fights between devs, well hopefully not. I can see users arguing stuff more than devs.
Benchmarks aren't that good anways.
BTW, your kernel sucks!!!!
Just kidding been running smoothly since I started using it the other day
-----------
Thanks for the ratings system. Looks nice!
Over my time here in XDA I've built up a few studies on the Nexus S.
Here are the links. There are summaries in each thread in the first and second (and sometimes third) posts of the main findings, but I've done some very quick and minimal overviews here also.
How to build a kernel: this thread
-This post takes you through installing Ubuntu right through to managing git, in order to compile your own kernel, and flash it in CWM recovery!
-Includes the tools you need to add MTP capabilities to your kernel.
User eXperience Benchmarks: this thread
-This shows which ROM and kernel threads have the best user feedback. The feedback is processed by an external sentiment analysis API. It is only meant as a rough guide, something of a quick reference particularly if you are looking for a new ROM to try. As of June 2012 this is no longer maintained.
All ICS ROM Benchmarks: this thread
-Freely available benchmark programs were used to determine which ROMs had the best performance. Generally the difference between the best ones is very small.
Battery Drain Benchmarks: this thread
-A collection of tips for getting the best battery life, and dispelling some myths.
Kernel Features and Benchmarks: this thread
-My original study, the one that started it all, the kernel benchmarks! Provides a quick table to compare which kernels perform best in CPU/RAM/IO/Database/Graphics.
CPU Governors and I/O Schedulers: this thread
-A study done to find which schedulers perform best in combination with the most popular governors. My two favourites (ondemand and smartassV2) combine best with noop.
Power Saving Governors: this thread
-A meta study done combining the findings from the battery study and governor study to show which governors will save the most power. Ondemand comes out significantly better than conservative, which surprised me. SmartassV2 is the best compromise for high performance and efficiency.
Does SuperCharging work?: this thread
-This was just a short study to find out if this script is suitable for the Nexus S, but it turned out it had no effect, positive or negative.
Kernel Memory Allocators: this thread
-This is another short study for kernel developers to show that SLUB performs best.
====
This thread is just an index. Our new mod veyka agreed would be a good idea to summarise all my studies for addition into the sticky roundup.
====
EDIT: Feel free to suggest any new things that I might be able to test!
im out of thanks for today.. but, awesome work regardless. thank you
simms22 said:
im out of thanks for today.. but, awesome work regardless. thank you
Click to expand...
Click to collapse
Me too, but thank you too!
Edit: ah just use the app, unlimited thanks!
bedalus said:
Me too, but thank you too!
Edit: ah just use the app, unlimited thanks!
Click to expand...
Click to collapse
really? unlimited? i dont use the app though, just the browser.
Uh, well, I haven't tested the limit... but I never get denied!
All your work was great I battery drain thread was very helpful
Sent from my Nexus S
Thanks for all your hard work.
IF , one of my assassins had done their job ..........
.. Generated via Tapatalk ..
Oodie said:
IF , one of my assassins had done their job ..........
.. Generated via Tapatalk ..
Click to expand...
Click to collapse
When they finally come for me, I will benchmark their performance.
bedalus said:
When they finally come for me, I will benchmark their performance.
Click to expand...
Click to collapse
nice answer
And nice guide for your very instructive benchmarks bedalus
Even when browsing through the app you'd still get that annoying thanks limit.
This is a really good overview for new NS users. (I doubt there are ever some since mostly would go directly for G-Nex)
What's next?
That "Oodie's Assassins' Performance Benchmark" sounds interesting, though.
PS: @Oodie, you should have kanged your assassins before sending them to bedalus' compound. That way, your assassins' would have at least injured bedalus
UPDATE: Memory Allocators studied. SLUB wins!
Great reference for a refresher or for a new comer. Really like the battery drain benchmarks and how you discuss some myths. Governors is great...love Smartass V2 with Matrix V20!!
Thanks @bedalus!! Totally deserves a sticky.
Sent from my Nexus S using xda premium
Thanks. It's in the sticky roundup!
bedalus said:
Thanks. It's in the sticky roundup!
Click to expand...
Click to collapse
Can we vote for the sticky or it is just for the moderators?
There was like ten stickies, I think veyka wants to keep everything in a list in one sticky.
I appreciate the sentiment though!
bedalus said:
There was like ten stickies, I think veyka wants to keep everything in a list in one sticky.
I appreciate the sentiment though!
Click to expand...
Click to collapse
thank you for all your work, love your kernels ... currently been using deadline/ondemand but since you say it is not best I will try smartassv2+noop.. (I've found smartass with other combinations give me a lot of lag)
BLaZeDRas said:
thank you for all your work, love your kernels ... currently been using deadline/ondemand but since you say it is not best I will try smartassv2+noop.. (I've found smartass with other combinations give me a lot of lag)
Click to expand...
Click to collapse
Ondemand for good balance between performance and battery saving. Smartassv2 for gaming. CFQ and deadline are the best governors, but deadline probably has the edge.
Thanks! Now this widens my perspective on choosing my own Governor and Scheduler Combo.
This one will be of more interest to kernel developers.
Link to Spreadsheet: Results
RcrdBrt asked me to see which memory allocator performed best, and provided me with four identical kernels except for the allocators being SLQB, SLAB, SLUB, and SLOB.
SLUB turns out to have a slight performance advantage, as RcrdBrt had suspected.
The rank was:
SLUB - 980.56
SLQB - 972.17
SLAB - 967.72
SLOB - 967.72
Not much difference really, but every little helps, as they say at Tesco (Britain's leading super market/Religion).
Thanks to RcrdBrt for trusting me with this nice little study, and to Chainfire for the very useful benchmarking app. (See here)
Methodology
Technical detail (it's not necessary to read this!)
I used CF-Bench to obtain values for:
Native MALLOCS
Native Mem Read
Native Mem Write
Java Mem Read
Java Mem Write
...and used statistical methods to boil 10 passes for each allocator down to one final score: 10 passes is enough to get the mean and median within one percent of each other, i.e. establishes a confidence in the mean, assuming normally distributed data. Three standard deviations are subtracted from the mean, to show the minimum score we'd expect 99.7% of results to be above. This is to penalize variability (high peaks are less significant than a good consistency). The geometric mean is taken of the five end results to provide one final score.
Bedalus can't live without benchmarks. Closed UX benchmark yesterday and opened a new one today
One more instructive and helpful benchmark buddy
Most kernel developers prefer using SLQB. Any thoughts on why this is the case? Do they have a special reason for that or just a matter of not knowing better? Cheers!
RcrdBrt said it was the fashion! Tbh i don't know the differences between them, but some casual googling showed that slub has had success in other Linux arenas
apatal said:
Most kernel developers prefer using SLQB. Any thoughts on why this is the case? Do they have a special reason for that or just a matter of not knowing better? Cheers!
Click to expand...
Click to collapse
Buzzwordism. The other 3 are in kernel.
Sent from my Nexus Prime.
morfic said:
Buzzwordism. The other 3 are in kernel.
Click to expand...
Click to collapse
You mean all those allocators are present but they mention only SLQB because it's the trend?
Sent from my Nexus S
apatal said:
You mean all those allocators are present but they mention only SLQB because it's the trend?
Sent from my Nexus S
Click to expand...
Click to collapse
Correct.
Sent from my Nexus Prime.
Man, bedalus is really fast!
@morfic:
So, in the ICS stock 3.0.8 kernel, how many and which allocators are present?
Am I correct to say that all those four allocators are present, but only one is used?
Sorry for these dumb questions.
glennkaonang said:
Man, bedalus is really fast!
@morfic:
So, in the ICS stock 3.0.8 kernel, how many and which allocators are present?
Am I correct to say that all those four allocators are present, but only one is used?
Click to expand...
Click to collapse
SLAB, SLUB, SLOB are in most (mainline) Linux Kernel, SLQB is patched in.
bedalus, did you run this on GB too?
morfic said:
bedalus, did you run this on GB too?
Click to expand...
Click to collapse
I can do it if i have 4 identical gb kernels (except for the allocator) ... If you'd like it testing you'll have to build them for me?
Hi Everybody,
Anybody here has achieved above 5500 results in Quadrant Score?
If have, can you please state the ROM / Kernel / MOD combinations.
Thank You
kamalsutra said:
Hi Everybody,
Anybody here has achieved above 5500 results in Quadrant Score?
If have, can you please state the ROM / Kernel / MOD combinations.
Thank You
Click to expand...
Click to collapse
Yes, my device just scored 6187. Stock LH3, stock kernel LH3, rooted. No other mods.
Note that all 3 quadrant apps from standard to professional will give you different median scores ranging from 5200 on standard to 6300 on professional version.
This makes this app useless crap and explains a lot about some users complaining and others being perfectly happy with their scores.
Waiting for JKay mod on GT-I9300
My score is varied. Ranging from 5000-6000+, dependent on the temperature of phone. To get higher score, you have to wait until your phone cool down. I got around 6000 with Siyah kernel 1.7, AOKP or Ultima Rom, OC to 1.6 Ghz, UV -100Mhz and GPU overclocking as well. With that configuration, I had 13500+ score or antutu benchmark.
I believe that even though there's variant in the score, it does give a ballpark figure of your device capabilities especially if the scores tabulated comes from a significant number of devices of the same make and model. So, as a scientific question I think it is legitimate to ask. You can't compare this to a matter of preference to which act in X-factor that's just insulting.
You don't need to give opinions if they're not constructive.
Because this has been answered multiple times, it has been explained why it is useless multiple times and yet users continue to ask about it multiple times. Search Button, please use it
DramatikBeats said:
Because this has been answered multiple times, it has been explained why it is useless multiple times and yet users continue to ask about it multiple times. Search Button, please use it
Click to expand...
Click to collapse
Maybe useless for some and useful for others m8.
JJEgan said:
No why are you supporting the posting of multiple identical questions day after day .
Oh Goody Goody Mr Bumper yet another Quadrant post .
http://forum.xda-developers.com/showthread.php?t=1935269
jje
Click to expand...
Click to collapse
You could also just answer the question so the thread dies in a peaceful way, or you could just not reply. Better than being so hostile.
Can any one post the score of i9350 ???
Sent from my GT-I9300 using xda premium
Please see here.
==================================================================
==================================================================
USERS of ALL ROMS !!!!
VOTE FOR YOUR FAVORITE ROM+Kernel and GIVE IT A SCORE !!!
For the Note II - **N7100 AND N7105**
Now as a fully integrated Ranking system for both ROMs and Kernels !!!
Help EVERYONE in the N7100 and N7105 family !!!
==================================================================
2013-06-04 02:30MYT - NEW !! Completely integrated ROM+Kernels together !!! Includes Screen On Time - see which combination is best !!
2013-05-18 23:30MYT - Added table of tracked ROMs and "Number Last updated in x days"
2013-05-16 23:30MYT - Added list of active N7105 ROMs (ie updated within the last 60 days)
2013-05-09 01:20MYT - Added Full, sortable Feature Scores table !!!! Every Feature is listed and sortable.
2013-05-06 18:30MYT - Added ROM Score Graph !!!! Ranks ROMs by Averaged Feature Score !!!!.
2013-05-01 00:30MYT - v2.0 of Survey form with version selection !!! Entries cleared for May 2013.
==================================================================
Rules:
No posts regarding which ROM / kernel is best.
No posts regarding the sheet statistics.
Only post if something is not included in the sheets that should be (like what lyldz posts in the [INDEX] thread - see link below)
==================================================================
Tracked Kernels (N7100 and N7105) F5 to refresh
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Click to expand...
Click to collapse
Tracked ROMs (N7100 and N7105) F5 to refresh
Click to expand...
Click to collapse
Hi all,
Choose your favorite ROM and Kernel !!!!
I have created the GRAND ROM Survey for the N7100 and N7105, using both the ROM and Kernel list from sunny2303's pinned [INDEX] ROM and Kernel Repository N7100 thread, and my own review of the N7105 Android Development thread, and published it here:
I have sunny2303 to thank for the effort in compiling the N7100 list. Please visit his thread in the link above to get your ROMs and Kernels, and don't forget to thank him as well.
=====================================================
You may now select your originating forum (eg you can select XDA as a dropdown option).
If you are submitting a TEST entry, please put username as TEST.
**PLEASE POST HONESTLY**
1. Master Index for ROMs (including ALL versions N7100 and N7105 and release dates)
http://joytestmobiledevices.blogspot.com/2013/05/sortable-table-of-all-roms.html
2. Master Index for Kernels (including ALL versions N7100 & N7105 and release dates)
http://joytestmobiledevices.blogspot.com/2013/06/galaxy-note-2-n7100-n7105-master-kernel.html
This list builds upon @sunny2303's list by adding release date for EVERY version, first released, latest version, number of days since last update. Credits to sunny2303 and his original OP for all initial work.
With this list, you may be able to plan your ORD/Flashoholism activities in a structured manner
3. Grand ROM & Kernel Ranking Form
(Updated for June 2013, with fully integrated with ROM, Kernel, Version and Nightlies Date selection) - See CHANGELOG below
>>CLICK HERE FOR THE FORM<<
Most Popular ROM Survey Top 10 Summary Bar Chart (easier to read than the default pie chart)
*** IN PROGRESS ***
Fully sortable, Full List of Features Scores Table
***in progress***
Score Chart by ROM and Version (F5 to refresh)
Response List (contains all responses submitted)
*** IN PROGRESS FOR JUNE ***
NOTICE : Any bulk postings within a limited time window will be removed !!!!
=====================================================
You may submit MULTIPLE ENTRIES for all the ROMs/Kernels you've tried.
Appreciate your support to submit responses and show everyone the real measure of popularity.
If you have any suggestions or recommendations that I can feasibly incorporate I will try to do it.
Please give a Thanks if this post has helped you !!
Please rate this thread as well !!
Click to expand...
Click to collapse
Thank you all.
CHANGELOG:
2013-06-03
Posted v3.0 of Survey, providing fully integrated ROM & Kernel selection with versions and selectable dates for Nightlies ROM & Kernels. Includes a ranking for Screen on Time (SOT) to evaluate overall Battery Life.
Similar statistic as v2.0, but provides insight into a match of ROM+Kernel and its corresponding expected battery life.
2013-05-01
Posted v2.0 of Survey, providing Version selection and quantitative results.The selection grid provides a value of 0 to 5 per feature, and this is summed to give a value for each response.
2013-04-28
I finally completed the master index containing 55 ROMs with all their versions, and correlated to their release dates.
A total of 400 versions were logged, with 202 unique version numbers. This will be used to maintain stacked data selection for the new survey version.
Click to expand...
Click to collapse
NOTE: My timezone is +8 UTC (Kuala Lumpur) so please consider this if you are looking for the score update for your submission.
Rules:
No posts regarding which ROM / kernel is best.
No posts regarding the sheet statistics.
Only post if something is not included in the sheets that should be (like what lyldz posts in the [INDEX] thread)
================================================== ================
NOTICE:
I will scrub the results from time to time. Any bulk submissions for a single ROM posted within a 5 minute time window will be removed.
Live Results Image feed from the survey
Jun 2013 (All responses are live. You may press F5 to refresh the page.)
F5 to refresh
<< SURVEY FORM LINK HERE >> for those who did not read post 1
NOTE: Due to the way the responses are stored by Google Form, the sum formula does not get inserted with the submission. I will update the sum formula several times daily per entry/entries. That is why you may not be able to see your ROM score change immediately.
Click to expand...
Click to collapse
Click to expand...
Click to collapse
>> Raw Response Data is here <<
This is the Chart showing the average of ROM score, Kernel score, SOT score and summed ROM+Kernel score.
It distinguishes between different ROM versions but due to limitations in the graph, it cannot show Kernel versions.
Click on the chart to go to the live link which reveals individual score points when you hover your mouse.
=============================================================================
May 2013
Highest Ranked ROMs based on Feature Score (lowest = 0, highest =45)
This chart shows the SCORE GIVEN by all submissions for the feature ranking, which in effect allows the ranking of "Best"ness of a ROM.
This gives a more ACCURATE representation of what users REALLY THINK of a ROM.
The score is the AVERAGE of all scores for any given ROM Version, so you may see multiple points per ROM. This means users have rated multiple versions of the ROM
You may rollover your mouse on the score points to see score by version on the live chart link:
Link: Live score chart with rollover values display
This Chart shows the TOTAL ENTRIES per ROM, and does not consider the feature score.
This chart simply shows all submissions per ROM without considering version number or the Features Score.
For example, if there were 10 entries for ROM-A v1 and 5 entries for ROM-A v2, total entries are counted as 15.
Sortable Individual Features Score Table
This table allows drill down by ROM for any of the scores in the survey.
https://docs.google.com/spreadsheet/ccc?key=0As-peidjMwx4dG9TdWRpZ0xsQlNCRkRQeGRqQUJnbkE#gid=13
This is the chart for all ROM entries.
Click to expand...
Click to collapse
April 2013
Click to expand...
Click to collapse
Thanks to @sunny2303 of the [INDEX] thread, @wesamothman of Assassin ROM, @BoBCatRoM of BobCatROM, @grilleld of Moon ROM, @monx® of monxDIFIED ROM, @raghavafitt of N7100 Facebook page, @tamirda of PhoeniX ROM for mentions in their thread, sig or posts.
If there are any who have mentioned, please let me know and I will add you here.
See Methodology description in Post #3
Monthly Ranking and Methodology Description
Rules:
No posts regarding which ROM / kernel is best.
No posts regarding the sheet statistics.
Only post if something is not included in the sheets that should be (like what lyldz posts in the [INDEX] thread)
================================================== ================
2013-06-03
This summary is planned for monthly updates. Since it is currently beta, I will update more frequently for testing.
Current Top 3 for Kernels (May 2013):
1. Perseus
2. Redpill
3. N.E.A.K Note II
Current Top 3 for ROMs (May 2013 result)
1. Assassin
2. BoBCaTROM
3. PhoeniX
267 responses for May 2013.
Methodology
Description of Features for Scoring:
Default Look - the default themes, wallpapers etc that come with the ROM. This is a subjective measure but you can give your rating
Installation - feature richness of the installation process. Full selection with Aroma should be rated a "5"
Included Kernel(s) - if the ROM comes only with Stock kernel, it will be a "1". For each additional Kernel included, add 1, for a max score of 5.
Slimness - AOSP based ROMs should be either "4" or "5". ROMs which are close to Stock should be rated based on how you think the chef removed bloatware
Stability - does the ROM FC a lot?
Battery Life - If you can get at least 3.5 hrs Screen On Time, it will be a "3"
Speedy Updates - If the ROM is updated at least once a month, it should get a "3". Nightlies should get a "5"
Developer Responsiveness - is the dev friendly and responds quickly? Daily responses from the dev should get a "5".
Overall Impression - Your overall impression and rating of the ROM
There are 2 presentations of results list:
https://docs.google.com/spreadsheet/ccc?key=0As-peidjMwx4dEJhUGJoTTBVcHlEaG1KRUhVcEs3bXc&pli=1#gid=0
Most Popular
The first one, used by the Most Popular ROMs bar charts, are a simple count of all entries of a particular ROM. Ie, Column E "Choose Your ROM from dropdown list". It does not distinguish between different versions of a ROM. More entries means the count gets higher.
Features Score
The second one, used by the ROM Features score Table and Graph, is the average of all scores per ROM Version. Ie Columns G to O are summed, result displayed in Column Q "Summary Score". Due to the nature of how Google Forms inputs entries into the sheet, I need to manually update the formula for every entry. I do it several times daily, so by day's end, all submissions should have the Summary Score available.
NOTE: My timezone is +8 UTC (Kuala Lumpur) so please consider this if you are looking for the score update for your submission.
This score is a better indicator of the "quality" of a ROM, as it is the aggregated quantitative feedback from all users.
A pivot table sorts by ROM Name as Row1, Version as Column 1 and Summary Score as values. The Summary Score values are displayed by the AVERAGE pivot table function in Google Sheets.
This is then displayed in 2 ways.
The first is simply a Table display of the same pivot table. This is done to allow faster sort and view of the pivot data.
The second one is where it is displayed as a chart with the AVERAGE score on left axis, ROM Name on bottom axis, and data points of the Value are plotted.
ROMs which have data for different versions will have multiple dots along the same axis but at different score points.
Hope that clarifies how the results were obtained.
NOTE: My timezone is +8 UTC (Kuala Lumpur) so please consider this if you are looking for the score update for your submission.
I also maintain the Malaysian Lowyat.net forum for Note II
https://forum.lowyat.net/topic/2806226
Come visit us.
A simple writeup about Rooting I made:
http://forum.lowyat.net/index.php?showtopic=2806226&view=findpost&p=60257337
In the absence of an [INDEX] thread for N7105 ROMs, I've decided to post the tracked ROMs here.
N7105 ROMs
Avatar ROM for Samsung Notes II (N7105) / CM10.1 - http://forum.xda-developers.com/showthread.php?t=2167066
CleanROM ACE / TW - http://forum.xda-developers.com/showthread.php?t=2123311
CyanogenMod 10.1 official nightlies / CM10.1 - http://forum.xda-developers.com/showthread.php?t=2105902
#HASHCHECK-HYBRID# / TW - http://forum.xda-developers.com/showthread.php?t=2093080
PARANOIDANDROID 3.15 / AOSP - http://forum.xda-developers.com/showthread.php?t=2113132
RootBox [Unofficial Nightlies] / CM10.1 - http://forum.xda-developers.com/showthread.php?t=2218008
Sons Of Android JEDI / CM10.1 - http://forum.xda-developers.com/showthread.php?t=2182245
WanamLite / TW - http://forum.xda-developers.com/showthread.php?t=2125101
Xylon / CM10.1 - http://forum.xda-developers.com/showthread.php?t=2231979
Great idea actually.. voted
Sent from my GT-N7100
Imao if you sort via no of replies, it gives a pretty good idea of the popularity. But if we consider the day it was posted like omega arhd wanam were released almost when the photos new has. They ought to be more popular than the roms which were recently released.
Sent from my GT-N7100 using xda premium
Mohammed779 said:
Great idea actually.. voted
Sent from my GT-N7100
Click to expand...
Click to collapse
Thank you Mohammed. Spread the word around so we can get a more accurate and up to date picture.
UtkarshGupta said:
Imao if you sort via no of replies, it gives a pretty good idea of the popularity.
Sent from my GT-N7100 using xda premium
Click to expand...
Click to collapse
But that is probably due to duration of the thread as well, since earlier threads usually have more responses. This aims to provide an easy to read statistic, with also a "I like x feature" list.
Reading 100k replies is no fun and this is a concise summary.
Give it a try.
Is there one for launchers?
I know I saw one on the general section but this kind of things would be great.
EDIT:
OP, I think you spelled kernel wrong?
Simone said:
Is there one for launchers?
I know I saw one on the general section but this kind of things would be great.
EDIT:
OP, I think you spelled kernel wrong?
Click to expand...
Click to collapse
Thank you very much for spotting the error !!! :angel:
Give the form a spin and let me know what you think.
Takes time compiling the info. I don't know if there is a central point for all launcher varieties. If there is I can whip up a form but a little later.
joytest said:
Thank you very much for spotting the error !!! :angel:
Give the form a spin and let me know what you think.
Takes time compiling the info. I don't know if there is a central point for all launcher varieties. If there is I can whip up a form but a little later.
Click to expand...
Click to collapse
Voted for both.
Just wanted to know the percentage of TouchWiz and Nova Launcher users. Haha.
Anyway, thank you.
Simone said:
Voted for both.
Just wanted to know the percentage of TouchWiz and Nova Launcher users. Haha.
Anyway, thank you.
Click to expand...
Click to collapse
Good idea. If you can provide a launcher list I will try to whip something up.
Hello friend,
Can you please fix my name?
Its tamirda not tmirda
Thanks.
tamirda said:
Hello friend,
Can you please fix my name?
Its tamirda not tmirda
Thanks.
Click to expand...
Click to collapse
Oops thank you sir !!!!
Changed. Appreciate feedback on the form.
Submitted PhoeniX and Perseus!
DubelBoom said:
Submitted PhoeniX and Perseus!
Click to expand...
Click to collapse
+1 :good:
DubelBoom said:
Submitted PhoeniX and Perseus!
Click to expand...
Click to collapse
Thanks !!
How was the experience with the forms?
You may submit MULTIPLE ENTRIES for all the ROMs/Kernels you've tried.
voted for the best - monx and adam -
joytest said:
Thanks !!
How was the experience with the forms?
You may submit MULTIPLE ENTRIES for all the ROMs/Kernels you've tried.
Click to expand...
Click to collapse
Easy and understandable
I'll submit more roms soon.
Updated Bar Chart
Made the bar chart sort by Most Popular descending, and added live feed to post 2.
Enjoy everybody.