Related
Benchmark standardization would help clear up "A vs B" fight's I've seen in a many threads. I am still working on a battery life bench but here's my proposed testing standards and what I've been doing:
Tests are run from a fresh flashed phone. Software is run as it is (no change in settings). All tests are run three times with a computed average. The phone must be rebooted after each test to clear any data from the RAM. (BTW this takes fffooorrreeevvveeerrrr)
Software used: An3DBench, FPS2D, Linpack, NBench, NenaMark1 and Neocore.
Example:
ROM X Kernel X
An3DBench=3355
FPS2D=28 dev3.5
Linpack=33
NBench=2.69/4.049/0.92
NenaMark1=14.8
Neocore=25.9
Feedback and input would be greatly appreciated, then hopefully an agreed upon standard.
*Admin's, where would you like benckmark results posted? I'm sitting on 8 so far using the above methods.
Don't forget Quadrant.
Benchmarks are fun and all but in the end all that matters is how your phone runs and feels. If your happy, well that's all that matters.
Sent from my Evo CM6
+1 on quadrant
For battery life you could do two tests. One by letting the phone sit idle for like a hour or two and another by playing a movie or something for thats like 30mins or hour long. only thing that sucks is that will take forever!
I'd be willing to test a rom just pm me with witch one you want me to do.
funny part is these numbers mean NOTHING in the end it how YOUR phone run is what matters
drmacinyasha said:
Don't forget Quadrant.
Click to expand...
Click to collapse
As a few dev's have stated,and I've been able to duplicate, Quadrant numbers are easily manipulated at the kernel level. That's the reason I didn't include it in my tests.
Sporkman said:
funny part is these numbers mean NOTHING
Click to expand...
Click to collapse
Yes and no. For example An3DBench, NenaMark1 and Neocore scores mean nothing if FPS2D shows you have a high deviation. A high deviation affects gameplay, video playback, video recording and ui smoothness. I've benched a number of roms and kernels and the ones with the lowest FPS2D deviations stutter less on all areas. It's been brought up many times that the soft side needs help. As a tech going all the way back to 386's and IIe's, I've found that tests like these show where things are good and where things can be improved.
Has anyone else noticed that when using NAND Desire HD/Z sense builds that their phone seems to run more smoothly after the 1st day or two running at stock speeds than it does when running overclocked?
I was getting a bit of lag here and there, and as expected after having streamed music literally all night via wifi the phone was a real dog first thing in the morning until the memory cleared out.
I noticed after a couple of days my phone would spontaneously reboot - I was overclocking to 1.5ghz using MDJ's 10.3OC kernel, so I figured that it was the overclock causing the reboot - sure enough the phone runs smooth as glass now that I've throttled it back to 1ghz (interactive governor).
Is it just my imagination?
It is hard to say really, as you will have different apps, widgets and syncs set up to me, plus we are running different builds, thus a direct comparison is very hard.
All that matters is what works for YOU.
FYI I don't find any meaningful benefit by overclocking. So I don't bother. I haven't really noticed a speed difference either way. If however it made a positive difference, I would.
Just for the record, benchmarking and Quadrant scores are nothing more than a waste of time and are only useful for arguments starting with the words "Mine is better than yours because...".
Curiousity always gets me to run Quadrant, but having seen varied phones with roller-coaster scores, I know the scores are not really any kind of valid gauge for real world performance.
I'm going to run my phone at stock speeds for the rest of the week and see how it does. I've got a feeling it will be running a lot smoother.
hi. i have seen people here saying that "Benchmarks prove nothing" and even one of the Senior member saying so.
but what i have experienced after using Note and switching between different ROMS like Rocket Rom v22 and v23, Midnote, CheckRom and Stunner Rom, i have found that Yes the Benchmarks Do matter a lot in terms of just explaining how your phone will perform.
i mean i ran the bencmarks on all of these Roms and i used them all for about 4 to 5 days each, and i found that not all of these give equal results and not all of these are equal.
the Check rom performed the worst among all of these Roms. by the time i installed it, my phone started giving me issues. like the battery issue. whenever i connected the phone to the data cable and either connect to my pc or laptop or even the charger, there would a screen popup saying, battery removed! i did everything i could do to fix this issue but all in vain.
well the best Rom in terms of performance is the Rocket Rom. rocket rom gave me the highest scores and i found it to be the most stable Rom.
Midnote was ok rom. it gave me really good benchmark scores but there were lots of force closes.
i really dont want to talk about the CheckRom. it gave me the lowest scores and it proved to be the most buggy rom i have used, and then came the battery removed issue.
Surprisingly i, the ICS Stunner Rom was the Rom which gave me around 110000 score in the Browser mark in the native browser, but for the rest of the benchmarks it gave me normal scores.
so in my point of view the best rom for note for now is the Rocket rom, but if u want buttery smooth UI and 199% smoothness, go for the ICS Stunner. but the payoff is that u loose the SNote and the screen capture capability which i really love about my note.
hence proved, Benchmark Results Do make a difference!...... These are my own personal results and you may have different results but I thought I would share my findings....
aami.aami said:
hence proved, Benchmark Results Do make a difference!
Click to expand...
Click to collapse
Hardly proved! Far from it.
Benchmarks *can* give you an indication of performance, but *nothing* is better than simply trying out different ROMs and making your own objective decision.
Fwiw though, some benchmarks simply aren't worth the time and effort - Quadrant, I'm looking at you!
Regards,
Dave
Sent from my GT-N7000 using Tapatalk 2
I am gonna steal my friend's Chasmodo quote (credits to Chas)
A man without a benchmark is like a camel without electric toothbrush
end
Sent from my GT-N7000 using Tapatalk
Benchmarking could be slightly usefull when comparing different roms though optimalizations that are specifically made to reduce boottime, remove lag or whatever might not show up in te scores.
Using benchmarks to compare phones is definately useless, for example because Android forces you to run apps in the native phone resolution. The Note runs at 1280x800 which means any phone with a similar GPU but lower resolution like the standard 800x480 could synthetically outperform the Note.
Just to throw another point in there I know it can be easily disputed but take for example iOS and windows phone.
Windows phones are limited to single core and they still run smoothly due to optimization.
the latest iPhone 4s has a dual core A5s @ 800mhz, yet it still runs smoothly.
As mentioned above in the thread the only real way is to try out the phone for yourself.
Dude, it's obvious you're no scientist. You haven't proved anything trying to connect benchmark scores with stability and force closes. The only thing a benchmark could indicate is possibly smoothness. It's all about you simply trying different ROMs and finding one that is subjectively working best for you.
Sent from my superior GT-N7000 using Tapatalk
Benchmarks generally test specific capabilities of hardware: arithmetic calculations, GPU performance, etc.
That being the case they are a good yard stick for how the HARDWARE of different devices compare in terms of performance for the most part. Although software and the OS do obviously play their part, the tests are generally targeted at exercising specific aspects of the 'computer' rather than the overall OS.
OS performance is another, much more complex, aspect that benchmarks struggle to cater for. Small changes in benchmark scores between different ROMs is unlikely to tell us much. Somebody who reviews those ROMs and give a fair summary of the overall performance, stability, etc is a much better guide (like the OP, in this case - after a fashion!)
Check Rom is '****ty'?
What utter claptrap. Only proves you have no idea about how to set your phone up properly.
As for the battery issue, really? I've been running checkrom on 3 notes(mine,my wifes and my dads) and never had fcs, battery issues.
Benchmarks are for people like you.
aami.aami said:
the Check rom is the Most ****ty Rom i have used among all of these Roms. by the time i installed it, my phone started giving me ****ty issues.
Click to expand...
Click to collapse
Yo, Benchmarker, watch your language.
Calling any development '****ty' just showcases your poor manners, egomania and general absence of intelligent thinking.
The devs give you something for free.
You don't like it, move on. And keep shtum about it. That's what people with manners do.
I wish you luck in your future benchmarking endeavors, and hope never to hear about them.
Benchmarks don't prove a ****. But I do it every time I try out a new kernel and waste 5 precious minutes of my life.
By the way, calling Checkrom ****ty was insult of all checkrom devs and ultimately an insult of xda itself, we are here because of all these devs.
You simply could have said it had lowest benchmarks or even it was sub par.
May I hope that next time you will carry general code of conduct and keep your ****ty opinions within your skull ?
chasmodo said:
Yo, Benchmarker, watch your language.
Calling any development '****ty' just showcases your poor manners, egomania and general absence of intelligent thinking.
The devs give you something for free.
You don't like it, move on. And keep shtum about it. That's what people with manners do.
I wish you luck in your future benchmarking endeavors, and hope never to hear about them.
Click to expand...
Click to collapse
That's what I'm talking about.
Don't benchmark the OS and mobile, but benchmark your brain that is it capable enough to run that device at its fullest without the need of any score to prove anything.
Just my 2 cents.
aami.aami said:
hence proved, Benchmark Results Do make a difference!
Click to expand...
Click to collapse
where have you proved anything? you really are a bit deluded arent you
Benchmark are valuable in terms of relative comparison to the same benchmark.
Benchmark just don't correlate well to real world performance.
IE: Note LTE ATT on speed app runs 15-20 M's, mine runs 7-9 in same location. Same network. Yet download Engadget simultaneously and they're even.
Benchmarks prove nothing.
/wisdom
mfractal said:
Benchmarks prove nothing.
/wisdom
Click to expand...
Click to collapse
Benchmarks prove everything.
/wisdumb
Zamboney said:
Dude, it's obvious you're no scientist. You haven't proved anything trying to connect benchmark scores with stability and force closes. The only thing a benchmark could indicate is possibly smoothness. It's all about you simply trying different ROMs and finding one that is subjectively working best for you.
Sent from my superior GT-N7000 using Tapatalk
Click to expand...
Click to collapse
i really dont understand why some people dont understand what the main point some statement is. its quite simple, nothing scientific and i did not talk about any technicalities. see for your self, the more smoother the ROM is the more better the Hardware of the phone is going with the build of the ROM that's obvious, right? now that would mean more room for the hardware of the phone to be available for better benchmark results.
aami.aami said:
i really dont understand why some people dont understand what the main point some statement is. its quite simple, nothing scientific and i did not talk about any technicalities. see for your self, the more smoother the ROM is the more better the Hardware of the phone is going with the build of the ROM that's obvious, right? now that would mean more room for the hardware of the phone to be available for better benchmark results.
Click to expand...
Click to collapse
probably but not necessarily, correlation does not mean causation,
each benchmark result is moreless the weighted average of few or more individual test results - now let's take Quadrant, which is (was?) heavily biased towards 3D graphics performance - how much is that representative of ROM performance under typical (non-gaming) phone usage?
PS.
Benchmarks may matter. Size matters more.
(Anyone telling otherwise is either ashamed or trying to be nice)
From the Moderator
Watch your language....... nothing wrong with arguing about results or subjective findings, but almost all opinions are subjective..... so discuss nicely or we close the thread if flaming starts up
Thanks.... oka1
One thing apple got google and its oem beats. Dont fking look at the hardware and benchmark. Look at the user experience. Not saying ios and iphone is great for the folks who like to tinker. But for a dual core 800mhz iphone4 or ipad2 it sure runs a lot smoother than a note with stock touchwiz or some other launcher. Afterall u r using ur device, ur own judgement should tell u how good the device is not some program score. And there will always room for hardware improvement, but can the software follows? How many app is actually utilizing multi core process?
Sent from my GT-N7000 using Tapatalk 2
put new Kernels you will see big different in benchmark.
From my experience testing roms + kernels I see that benchmarks really nothing
I got with Antutu benchamrk with stock rom and stock kernel about 6900 score
but it was so laggy and battery sucks. atm using Chrack´s rom extra small + speedmod v10 and its perfect no lags good battery life smooth but the benchmark sucked got like 4500. So benchmarks aren't the way to chose a rom otherwise there is no need to test and share experience with people
I've found that on ICS ROM's specific games tend to look much better than on Stock ROM's without much of a sacrifice for general performance. However because the touchpads work better on the Stock ROM's it's usually better to go for one of them!
So, I've been trying to find a way to get similar looks on the Stock ROM's without much of a decrease in performance and with options to revert back if needed with ease.
As many of you may know, Chainfire3D doesn't really bode well with ICS or JB however I've got it running on MarkPython's Stock ICS ROM and I've got several games that would normally look extremely poor with very low textures to now look much better with not much of a drop in framerate!
NOVA 3 for example, looks terrible normally on this ROM. However with Chainfire3D and a plugin or two you can get it to look really good!
That being said, I have gone a little too far currently and made it look so good that it now plays for about 3 seconds before crashing! But hey, that's not the point!
What I'm trying to find out is, what combinations of modifications, apps and other things do you use in order to push your Xperia Play to the limit and get whatever performance it can get?
I guess clock speeds and benchmark results would also be a good thing to post so... I'm running at 1.6Ghz, deadline, performance/smartassV2. Best I've ever managed on Nenamark is 35.9 FPS and I currently have all games on FPSe running at 60fps at all times.
But how is the framerate on NOVA 3? If it's looking that good performance can't be great.
Yeah, on average with the standard textures the game provides you get a fair framerate... Which is somewhat consistant when the textures are higher too.. Hence why i was so confused when they're so low on the Stock ROM but not as bad on CM9.
Which is why i was trying to find the balance between the two with Chainfire3D...
Unfortunately it puts the textures up VERY high and makes the game look great! Downside is framerate is terrible and eventually the game crashes..
However! The Play can hand much better than what is set by the game.. What you're given almost makes my eyes bleed just looking at it.
Hi guys,
first of all let me apologize for this stupid question. Personally I hate these questions too, but I have my device in service for 3 weeks, therefore I'm not able to continue with my research...
It's already a long time since I've bought my G2 (D802). Of course, the first thing what I've done > go to custom ROM ... (It's my habit since Xperia Arc S) I think that I was dissappointed of my new LG G2 even then. Games wasn't fluent and lagless as I supposed they should be. It was another good reason to go to the custom ROM. But unfortunatelly and surprisingly it was even worse. So I find another thing why is that so bad. In that time custom ROMS wasnť based on Kitkat sources (kernel), so I hoped that everything will be fine after developers merge source code. But the improvement has never become (in that form I hoped for) In that time I became reconciled that I will never play games on my G2 as smooth as on my iPad.
That's the reason why I'm looking for the best ROM for games. (I'm a heavy gamer)
So my question: Do you know any good rom for Gaming? Could you recommend me something?
I tried Mahdi. PA, Beanstalk, Slim ROM, CloudyStock, Pro, Flex, G3... But none of these ROMs is fine...
(I can't understand how can be Cloudy ROMs so popular (Nothing against Cloudyfa ) because they have too many lags in games !!! I think it's more laggier than stock...
DominikHolecek said:
Hi guys,
first of all let me apologize for this stupid question. Personally I hate these questions too, but I have my device in service for 3 weeks, therefore I'm not able to continue with my research...
It's already a long time since I've bought my G2 (D802). Of course, the first thing what I've done > go to custom ROM ... (It's my habit since Xperia Arc S) I think that I was dissappointed of my new LG G2 even then. Games wasn't fluent and lagless as I supposed they should be. It was another good reason to go to the custom ROM. But unfortunatelly and surprisingly it was even worse. So I find another thing why is that so bad. In that time custom ROMS wasnť based on Kitkat sources (kernel), so I hoped that everything will be fine after developers merge source code. But the improvement has never become (in that form I hoped for) In that time I became reconciled that I will never play games on my G2 as smooth as on my iPad.
That's the reason why I'm looking for the best ROM for games. (I'm a heavy gamer)
So my question: Do you know any good rom for Gaming? Could you recommend me something?
I tried Mahdi. PA, Beanstalk, Slim ROM, CloudyStock, Pro, Flex, G3... But none of these ROMs is fine...
(I can't understand how can be Cloudy ROMs so popular (Nothing against Cloudyfa ) because they have too many lags in games !!! I think it's more laggier than stock...
Click to expand...
Click to collapse
What's the definition of "lagless" for you, and what games are you playing?
First of all, you have to realise and acknowledge that this is a smartphone. No matter what, it's still a phone and it's not made for heavy gaming. Second, you have to realise that despite the fact that many developers (ie Gameloft) has a lot of experience with games, they're too lazy too optimize them even for the most powerful chips out there. The games utilise 100% CPU speed even if they don't need it at all, and then the CPU throttles down because it's becoming too hot. Logic/10.
Thirdly, you have to realise that the ROM is not what makes the game fluid or lag-free. It's the kernel.
Since the G2 (like ALL other phones) is cooled passively (it has no fan whatsoever), it's important that it runs as cool as possible to prevent overheating and throttling.
My advice to you would be the following:
Install your favourite ROM and a kernel you can tweak heavily (gpu/cpu). A good bet would be dorimanx.
Go to kernel settings, and chance max frequency to 1.27 Ghz or around that. Change governor to performance.
Change GPU to 450 Mhz.
Try playing a game =)
I used to play Asphalt 8 back when I first got the phone and I got about 30 FPS? Anyway it was smooth as butter, and I see no real reason why you want to put a custom rom on your phone. The good 'ol days where nothing was better than custom roms are pretty much over. Stock is just fine, root it, use a custom kernel if neccessary and use xposed. Will solve it.
vPro97 said:
What's the definition of "lagless" for you, and what games are you playing?
First of all, you have to realise and acknowledge that this is a smartphone. No matter what, it's still a phone and it's not made for heavy gaming. Second, you have to realise that despite the fact that many developers (ie Gameloft) has a lot of experience with games, they're too lazy too optimize them even for the most powerful chips out there. The games utilise 100% CPU speed even if they don't need it at all, and then the CPU throttles down because it's becoming too hot. Logic/10.
Thirdly, you have to realise that the ROM is not what makes the game fluid or lag-free. It's the kernel.
Since the G2 (like ALL other phones) is cooled passively (it has no fan whatsoever), it's important that it runs as cool as possible to prevent overheating and throttling.
My advice to you would be the following:
Install your favourite ROM and a kernel you can tweak heavily (gpu/cpu). A good bet would be dorimanx.
Go to kernel settings, and chance max frequency to 1.27 Ghz or around that. Change governor to performance.
Change GPU to 450 Mhz.
Try playing a game =)
I used to play Asphalt 8 back when I first got the phone and I got about 30 FPS? Anyway it was smooth as butter, and I see no real reason why you want to put a custom rom on your phone. The good 'ol days where nothing was better than custom roms are pretty much over. Stock is just fine, root it, use a custom kernel if neccessary and use xposed. Will solve it.
Click to expand...
Click to collapse
Of course that kernel is the most important thing in performance (because of sequencer laws, etc...), but nowadays we have no (except render) custom kernels for AOSP/ CM ROMs, so my question was focused on a ROM → I connected it to the whole... (And furthermore each ROM has own kernel. + ROM can cause lags as well)
used to play Asphalt 8 back when I first got the phone and I got about 30 FPS?
Click to expand...
Click to collapse
Unfortunately these times are gone, at least I think it. There were lots of updates, which increase the performance consumption (Simply they add tons of new features and stuff, but they ,,forget" to optimize that... ) I played this game, Dead trigger 2, Dungeon Hunter 4 and even simple games like traffic racer with incredibly high count of lags (And it wasn't lags in miliseconds → not always). I thought it was because of my current ROM (Mahdi) so I tried PA and then stock based ROMs (CloudyFlex, Stock) but nearly no changes) Therefore I think it will be the same on stock ROMs too, if it's on Cloudy ROM with heavily optimized kernel, system... (Even Dorimanx kernel doesn't change anything).
Go to kernel settings, and chance max frequency to 1.27 Ghz or around that. Change governor to performance.
Change GPU to 450 Mhz
Click to expand...
Click to collapse
Thanks for this tip, I tried something similar but with UC to 1,9 GHz and I didn't set governor to performance (My device was incredibly hot in a while with performance governor), I didn't notice any bigger changes - I expected that lower frequency will cause even more lags and I was obviously wrong. For sure I will try your advice.... :laugh:
The good 'ol days where nothing was better than custom roms are pretty much over. Stock is just fine, root it, use a custom kernel if neccessary and use xposed. Will solve it
Click to expand...
Click to collapse
I don't like the LG's design of system, and I don't like xposed → it causes higher battery consumption and it ,,eats" RAM and performance (At least on my previous device )
i have 10 xposed modules installed and i didn't notice any additional battery decrease...
as for ram, as stated many times - free ram = wasted ram...
as for the thread - "what's the best this&that" threads aren't allowed on xda
i played rr3 and csr racing on this device and didn't notice anything wrong with the framerate (stock kk v20f, rooted with dorimanx kernel on default)
Oddly enough, I haven't noticed a major change in gaming performance coming from the S4 Pro. Asphalt 8 specifically is buggy, sluggish, etc on my LG OG & G2, but I don't care for android gaming since the apps aren't optimized (too many HW configs, whereas iOS is just SGX & Ax chips).
Transmitted via Geass
First of all, I like to say that we lacked similar threads, so OP started an useful topic. I would have stayed with simple dual-core smartphone, but I bought G2 in November for a reason, to try new games and so on, I woudn't have bought it if I needed a phone only for texting and browsing, like many argue like this. What I observed is that, 2,3 Ghz for a phone with passive cooling is a nonsense because after few minutes of gaming it will keep running like 1,5 Ghz and lower, hell what's the use of those 4 cores if a device would burn out. I never owned an apple product, but on my colleague's 5S, they run very smooth and fast with same graphics on a dual-core, so it all goes to optimazing and not using these ridiculous frequencies. I was expecting a lot from a phone like that, sorry for a long post.