Jump to content


Photo

Benchmark comparison of CM9 to CM11 (Quadrant, CF-Bench)

- - - - -

  • Please log in to reply
4 replies to this topic

#1
HomeEnd

HomeEnd

    Newbie

  • Members
  • Pip
  • 5 posts

Hi fellas,

 

since I got back my trusty old Orange San Francisco yesterday, I thought it would be interesting to do some ROM comparisons, investigating if there is such thing as a "performance build".

 

The hardware:

Gen1 TFT Blade

512MB RAM

Gen1-to-Gen2 TPT v10f (180MB /system)

Stock CPU clock

 

The software:

- Eco-CM9-20130723-stable-blade by jventura (http://www.modaco.co...ery-efficiency/)

- cm-10-20140613-NIGHTLY-blade-DAEMOND by daemand/KonstaT (http://www.modaco.co...-konstats-work/)

- cm-10.1-20130724-KonstaKANG-blade by KonstaT (http://www.modaco.co...01-android-422/)

- cm-10.2-20131220-KonstaKANG-blade by KonstaT (http://www.modaco.co...02-android-431/)

- cm-11-20140608-ZeeLogKANG-blade by zeelog (http://www.modaco.co...10-android-443/)

 

Procedure every time was: Complete wipe (including /system), flash ROM, first boot, one-minute-wait, reboot and then start the benchmark. No gapps or other stuff, internet connection off (apart from some seconds to submit the quadrant score, since it won't display the values otherwise).

 

So, without further ado, I present: STATISTICS!

 

Attached File  blade0.jpg   49.98KB   44 downloads

 

To visualize the results (and, to make it look a little bit more like science than nerd-spending-hours-doing-useless-nerd-stuff), I also created some charts:

 

Attached File  blade1.jpg   21.78KB   42 downloads

As you can see, the best score is achieved by the good ol' CM9 build, followed not by CM10 but (surprise!) 10.1. The more recent versions both perform worse.

 

The detailed Quadrant scores:

Attached File  blade2.jpg   20.79KB   35 downloads

Processor and memory are more or less equal in the first three versions, but especially the CPU performance really degrades in Android 4.3 and 4.4. Maybe that's why KitKat feels kinda sluggish even just scolling through the menus.

Interestingly, the I/O was significantly better in ICS than in the later versions.

 

And we get to the CF-Bench Native and Java results:

Attached File  blade3.jpg   21.36KB   31 downloads

ICS scores first place, followed by the second JB release. Java performance is kinda bad in KK (almost half the score of CM9)

 

Last, but not least: The graphics performace!

Attached File  blade4.jpg   21.88KB   31 downloads

From 4.0 to 4.2, 3D got a bit better while 2D gets just a tad less frames. Notice the huge drop at CM10.2, for both dimensional layers. KitKat performs average.

 

 

So, what do we learn?

 

CM9 is still the performance king, because of the +30% I/O throughput compared to the newer versions. Apart from that, the ROM of your choice should be KonstaT's CM10.1 build, which even offers a gain in 3D framerates (but not that big).

 

Kitkat and the latest JellyBean should be avoided, since there is a big gap in CPU respectively memory / 3D performance.

 

What this small excursion into the land of modern communication devices didn't cover: Stability, functionality, battery consumption, and, ironically, communication. I don't even know if the phone speaker works (it didn't in some CM10 build for my LG2x. Took me weeks to notice.)

 

I personally will give CM10.1 a shot as my daily driver. A little bit more modern than ICS, but not much slover. Also needs only 160MB /system TPT ;)

 

Have a nice day!

 

Cheers,

HomeEnd


  • 5

#2
szpilasty

szpilasty

    Enthusiast

  • Members
  • PipPipPip
  • 159 posts
  • Gender:Male
  • Location:Cracow
  • Devices:ZTE Blade KK 4.4.3 by Zeelog
Thank You for your work!
As you said there is so much other things that are more important than just performance.
If someone needs all functions (camcorder, radio etc) then only CM7 will provide that.
I've tried all roms and almost all builds since February 2013. I think less problems I had was with cm10.2. (longest usage)

  • 0

#3
Lucas Dracul

Lucas Dracul

    Newbie

  • Members
  • Pip
  • 17 posts
  • Gender:Male
  • Devices:Orange sanfrancisco/ ZTE blade
  • Twitter:@Lucas_Dracul
for gaming cm7 does more for me

  • 0

#4
q2dm1

q2dm1

    Newbie

  • Members
  • Pip
  • 5 posts
  • Devices:zte blade

Very nice info, thank you. It would be interesting to see how CM7.2 as well as stock gingerbread-based ROMs (eg swedish snow) compare to android 4.x on this phone.


  • 0

#5
la72pt

la72pt

    Newbie

  • Members
  • Pip
  • 43 posts
  • Gender:Male
  • Devices:zte blade

... I thought it would be interesting to do some ROM comparisons, investigating if there is such thing as a "performance build"...

 

.. I personally will give CM10.1 a shot as my daily driver. A little bit more modern than ICS, but not much slover....

 

thank you for you report


  • 0




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users