New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
CentminMod vs EasyEngine vs Webinoly vs VestaCP vs OneInStack Nginx/OpenResty
Just ran some Nginx comparison benchmarks for various LEMP stack's and though I'd share them here ^_^
I can be long winded when it comes to benchmarks, so if you want to just straight into Nginx HTTP/2 HTTPS high concurrency benchmark results you can find them here https://community.centminmod.com/posts/64258/
Otherwise
LEMP stacks installed within Ubuntu 18.04 LTS LXD containers on a ssdnode's 4 CPU, 16GB ram, 80GB disk KVM VPS with Ubuntu 18.04 LTS.
- Centmin Mod 123.09beta01 beta Nginx 1.15.0 on CentOS 7.5 64bit (default gzip compression = 5)
- Easyengine 3.8.1 using Nginx 1.14.0 on Ubuntu 16.04 LTS (default gzip compression = 6)
- OneInStack Nginx 1.14.0 on Ubuntu 16.04 LTS (default gzip compression = 6)
- OneInStack OpenResty Nginx 1.13.6 on Ubuntu 16.04 LTS (default gzip compression = 6)
- VestaCP 0.9.8-21 using Nginx 1.15.0 on Ubuntu 16.04 LTS (default gzip compression = 9)
- Webinoly 1.4.3 using Nginx 1.14.0 on Ubuntu 18.04 LTS (default gzip compression = 6)
Enjoy !
Comments
Being a full PHP stack and processing HTTP(s), 14k r/s is alright.
A bit unfair comparssion, but on a 16 core /32 thread dedicated I get 1M r/s using compiled golang. And CPU only reaches 80% / 3200% (so 98% idle). 1Gb/s limiting factor.
Also this test is across networks. If it's done in the same machine, I get about 6M.
Edit: cpu is actually 98% idle.
Question, does your CPU max out at 14k? Any insight into us/sy/wa/si usage?
Respective resource usage is next up on my list of comparisons to do
FYI, these are Accept-Encoding: gzip enabled wrk and h2load tests so compression is involved.
edit: comparison of Nginx idle server resource usage https://community.centminmod.com/posts/64264/
@eva2000
OT: my personal wish list:
1.) Add vanilla Apache, maybe with/without PHP7 for comparism
2.) Benchmark testing in a small container (1Gb RAM or so)
PHP is something I will test later when i read up on how other LEMP stacks php configs.
Apache is on Centmin Mod LEMP stack integration to do list so right now not available - preview https://community.centminmod.com/threads/custom-apache-2-4-rpms-for-centmin-mod-lemp-stack.4471/. See Centmin Mod dev dashboard at https://github.com/centminmod/centminmod/projects/1
PHP 7.x will be tested too - for Centmin Mod, PHP 7.x has optional Profile Guided Optimisation (PGO) performance boost option that can optionally enabled see benchmarks comparing Remi YUM PHP-FPM vs Centmin Mod PHP-FPM at https://community.centminmod.com/threads/php-7-2-0-ga-stable-vs-php-7-1-12-vs-7-0-26-vs-5-6-32-benchmarks.13590/
PHP 7.3 testing is underway too https://community.centminmod.com/threads/php-7-3-0-alpha-1.14931/
Low memory VPS testing probably can be done as LXD can restrict memory within each LXD container.
Though Centmin Mod LEMP won't be out of box config then if I do it that way as Centmin Mod LEMP at initial install time will detect resources i.e. memory/cpu and hardware and kernel version/supported features and auto optimise and tune nginx, php-fpm and MariaDB MySQL based on that detected info.
If i restrict memory within existing Centmin Mod LEMP LXD container now, Centmin Mod wouldn't be using out of box 1GB VPS profiled/detected optimisations but still be using the 16GB memory detected auto tuned profile.
My meaning was, I wonder how the numbers compare to any out of the box Apache server setup. Let's say right after installed CentOS. I presume this is what many do (I did some years and now feel it's too much trouble the change the whole server with several websites, full email setup etc.)
oh.. probably been a good 7+ yrs since I have used Apache like that LOL. I don't bother anymore as 95% of all my servers use my own Centmin Mod LEMP out of the box
If only there were some nice and good tutorials of centminmod, of course I mean up to date tutorials.
Tutorials for what specifically ? Install guide is still the same as always at https://centminmod.com/install.html
centminmod.com site has most for 123.08stable but latest tested 123.09beta01 above has documentation being work in progress for centminmod.com site - main reason it's still beta status while I write up official centminmod.com docs.
For 123.09beta01 all updated stuff is on the community forums https://community.centminmod.com/ so definitely suggest you join up if you want to learn more
i.e.
Unfortunately, you won't get the most out of Centmin Mod LEMP stack without doing some reading
For example taking advantage for further Nginx optimisations by pairing your cpu model with optimal GCC or Clang compiler versions
FYI, Centmin Mod 123.09beta01 is heavily optimised if Intel cpus are detected to leverage Intel newer cpus feature sets. But already started optimisations for AMD EPYC cpus too thanks for Packet.ent AMD EPYC cpu testing https://community.centminmod.com/threads/packet-net-bare-metal-cloud-amd-epyc-7401p-review-benchmarks.14097/
If there was only debian support
agreed
Not LEMP, but LNMP stack
. It would be nice to throw in some caching apps like memcache or/and varnish on top.
yeah not right now - not until I do all I need to do for Centmin Mod features https://github.com/centminmod/centminmod/projects/1 at least
Ah definitely interested in that myself too for memcached/redis performance within respective LEMP/LNMP stacks. Centmin Mod source compiles memcached server but uses Remi yum repo's redis server by default. There's unofficial optional redis server source compile support via my redis-generator.sh repo though i.e. https://github.com/centminmod/centminmod-redis/blob/master/examples/redis-sourceinstall-support.md
Started PHP test https://community.centminmod.com/threads/14988/
FYI, PHP-FPM comparison benchmarks are in for both low and high concurrency load testing https://community.centminmod.com/threads/14988/
I don't use centminmod but I always like looking at the nginx configs and stuff on the centminmod website
.
the wonders of open source code and the internet
And lnmp.org, a competitive option
You've used lnmp.org ?
但是我不知道中文 :-(
Please re-test with VPSSIM included, they are back from death.
not enough disk space for a 7th OS to be installed on same VPS so other lemp stacks will have to be in next round of testing
round 1 Nginx HTTP/2 testing is still ongoing. This time Nginx HTTP/2 HTTPS latency response times with nghttp2 comparisons for Centmin Mod vs EasyEngine vs Webinoly vs VestaCP vs OneInStack https://community.centminmod.com/posts/64615/
This is HTTP/2 latency processing times for a single request for respective LEMP stack's Nginx HTTP/2 performance. You can clearly see why Centmin Mod Nginx has done so well in HTTP/2 tests done so far
if you want a handful of VPS for testing purposes for a month, pm me
@Bruce thanks for the offer, however I plan on continuous testing for much longer. The test VPS is a ssdnodes 4cpu skylake KVM vps which is prepaid for a full 12 months so lots of time for continuous comparison testing. Ideally having a dedicated server would be better due to no noisy neighbours which may skew results in KVM environment but for US$120/yr ssdnode is a good alternative.
Continuous testing/benchmarks allow me to further fine tune Centmin Mod LEMP - already have numerous updates lined up to further boost performance for Centmin Mod LEMP stack and that is on top of already optional features you can already enable to get another 20-40% performance compared to what I am testing for out of box Centmin Mod LEMP results already shown
If a LEMP stack isn't constantly benchmarking/re-tuning, then it isn't evolving. Past listings of all Centmin Mod benchmarks at https://centminmod.com/benchmarks.html
Yes, it is a popular choice among Chinese web fans.
Centminmod has among the best and most up-to-date set of references and maintained users group blogs in the industry IMO. (Thanks largely to eva2000's contributions).
I have not run into problems that weren't of my own lack of attention. Centminmod, for example, security is highly tightened down including a custom replacement for apache .htaccess with standard settings that prevent running of scripts until you specifically whitelist them. That is a level of rigor imposed by the stack as a default. You can disable if, which I thought about. However, it makes sense for eCommerce and other sites that wish to have tight, professional level control over Wordpress vulnerabilities.
Other areas are just as well thought out. I have questioned the logic on other things, which shows what I did not know, and always end up agreeing with eva's decisions.
Thanks @open5g for the kind words. Yes Centmin Mod's autoprotect.sh tool might be annoying for some folks not use to having to whitelist directories etc. But pretty sure it's more annoying trying to clean up a compromised/malware infected site or leaking data/files which were only protected by .htaccess and not properly protected by Nginx rules
@eva2000 never use centminmod before, because i'm check, installation get took to long. can you confirm why? any suggest maybe for get it's fast (ex using dedicated) .. thanks
Official FAQ item 9 answers your question. You can see how the speed of your VPS can affect install times - think of Centmin Mod install as a good gauge of performance as a VPS benchmark tester itself. So faster install time on one VPS can mean that VPS is faster than another VPS.
Centmin Mod users posting their install times at https://community.centminmod.com/threads/post-your-centmin-mod-123-09beta01-install-time-stats.8866/ can be as fast as 600-900 seconds on fast servers.
If you had to manually do all the automated Centmin Mod optimisations that are done on initial install, it would probably take you a good full day to do ! So exchange longer install time for better performance
Thanks, looks good now
hmm nginx and php times too fast, probably failed installs there !
might want to sign up on official community forums to troubleshoot the initial install as per https://community.centminmod.com/threads/how-to-troubleshoot-centmin-mod-initial-install-issues.102/