Vanilla vs. FluxBB vs. MyBB siege test

vanarp

@Chanux said: light weight

@Ollie said: Vanilla is very nice, it's lite weight

According to the tests done by @zsero Vanilla does not seem light weight. The reason why LET loads so fast could be because it is using CloudFlare and [probably] is running on a powerful dedi.

rm_

@AnthonySmith said: http://forum.lowendspirit.com runs FluxBB on 64mb OVZ I still cant get over how snappy it is

Can't really argue with 1st thread title there

Wira_Soenaryo

Does anyone also still consider phpBB as it also an open source forum software..
Does it already no longer used by community?
Thanks..

exussum

Ive carried this one with the following

PHPBB

MyBB

FluxBB

Vanilla

Will add more if requested all latest github versions as of now (except phpBB which is 3.0.11).

All are benchmarks of the home page, With only the 1 topic each after installation.

All performed on a Liquid Host box

Ive put down APC and Memcache numbers also where i could enable them.

Note to mods: Sorry i had to break post up, It was too long per message

so standard files (both -c100)

the Default "it works" static HTML page

Lifting the server siege...      done.                                         
Transactions:                    1364 hits
Availability:                 100.00 %
Elapsed time:                   4.20 secs
Data transferred:               0.19 MB
Response time:                  0.01 secs
Transaction rate:             324.76 trans/sec
Throughput:                     0.05 MB/sec
Concurrency:                    2.17
Successful transactions:        1364
Failed transactions:               0
Longest transaction:            0.09
Shortest transaction:           0.00

and the phpinfo page (containing <?php phpinfo(); ?>)

Lifting the server siege...      done.                                         
Transactions:                     951 hits
Availability:                 100.00 %
Elapsed time:                   4.24 secs
Data transferred:               9.54 MB
Response time:                  0.34 secs
Transaction rate:             224.29 trans/sec
Throughput:                     2.25 MB/sec
Concurrency:                   75.57
Successful transactions:         951
Failed transactions:               0
Longest transaction:            1.38
Shortest transaction:           0.00

PHPBB

Standard install
file cache
-c100

Lifting the server siege...      done.                                         
Transactions:                     157 hits
Availability:                 100.00 %
Elapsed time:                   4.77 secs
Data transferred:               0.46 MB
Response time:                  1.65 secs
Transaction rate:              32.91 trans/sec
Throughput:                     0.10 MB/sec
Concurrency:                   54.47
Successful transactions:         157
Failed transactions:               0
Longest transaction:            2.87
Shortest transaction:           0.37

file cache
-c200

Lifting the server siege...      done.                                         
Transactions:                     231 hits
Availability:                 100.00 %
Elapsed time:                   4.94 secs
Data transferred:               0.68 MB
Response time:                  1.79 secs
Transaction rate:              46.76 trans/sec
Throughput:                     0.14 MB/sec
Concurrency:                   83.70
Successful transactions:         231
Failed transactions:               0
Longest transaction:            3.40
Shortest transaction:           0.03

memcache
-c100

Lifting the server siege...      done.                                         
Transactions:                     196 hits
Availability:                 100.00 %
Elapsed time:                   4.25 secs
Data transferred:               0.57 MB
Response time:                  1.09 secs
Transaction rate:              46.12 trans/sec
Throughput:                     0.14 MB/sec
Concurrency:                   50.07
Successful transactions:         196
Failed transactions:               0
Longest transaction:            1.90
Shortest transaction:           0.05

memcache
-c200

Lifting the server siege...      done.                                         
Transactions:                     202 hits
Availability:                 100.00 %
Elapsed time:                   4.51 secs
Data transferred:               0.59 MB
Response time:                  1.69 secs
Transaction rate:              44.79 trans/sec
Throughput:                     0.13 MB/sec
Concurrency:                   75.69
Successful transactions:         202
Failed transactions:               0
Longest transaction:            3.41
Shortest transaction:           0.00

APC
-c100

Lifting the server siege...      done.                                         
Transactions:                     248 hits
Availability:                 100.00 %
Elapsed time:                   4.63 secs
Data transferred:               0.73 MB
Response time:                  0.92 secs
Transaction rate:              53.56 trans/sec
Throughput:                     0.16 MB/sec
Concurrency:                   49.09
Successful transactions:         248
Failed transactions:               0
Longest transaction:            1.60
Shortest transaction:           0.01

APC
-c200

Lifting the server siege...      done.                                         
Transactions:                     246 hits
Availability:                 100.00 %
Elapsed time:                   4.79 secs
Data transferred:               0.72 MB
Response time:                  1.68 secs
Transaction rate:              51.36 trans/sec
Throughput:                     0.15 MB/sec
Concurrency:                   86.22
Successful transactions:         246
Failed transactions:               0
Longest transaction:            3.31
Shortest transaction:           0.08

exussum

MyBB

File cache
-c100

Lifting the server siege...      done.                                         
Transactions:                     363 hits
Availability:                 100.00 %
Elapsed time:                   4.55 secs
Data transferred:               1.06 MB
Response time:                  0.60 secs
Transaction rate:              79.78 trans/sec
Throughput:                     0.23 MB/sec
Concurrency:                   47.75
Successful transactions:         363
Failed transactions:               0
Longest transaction:            0.90
Shortest transaction:           0.04

file cache
-c200

Lifting the server siege...      done.                                         
Transactions:                     393 hits
Availability:                 100.00 %
Elapsed time:                   4.89 secs
Data transferred:               1.15 MB
Response time:                  1.29 secs
Transaction rate:              80.37 trans/sec
Throughput:                     0.23 MB/sec
Concurrency:                  103.83
Successful transactions:         393
Failed transactions:               0
Longest transaction:            3.49
Shortest transaction:           0.02

memcache
-c100

Lifting the server siege...      done.                                         
Transactions:                     324 hits
Availability:                 100.00 %
Elapsed time:                   4.21 secs
Data transferred:               0.95 MB
Response time:                  0.60 secs
Transaction rate:              76.96 trans/sec
Throughput:                     0.23 MB/sec
Concurrency:                   46.55
Successful transactions:         324
Failed transactions:               0
Longest transaction:            0.99
Shortest transaction:           0.02

memcache
-c200

Lifting the server siege...      done.                                         
Transactions:                     318 hits
Availability:                 100.00 %
Elapsed time:                   4.20 secs
Data transferred:               0.93 MB
Response time:                  1.09 secs
Transaction rate:              75.71 trans/sec
Throughput:                     0.22 MB/sec
Concurrency:                   82.50
Successful transactions:         318
Failed transactions:               0
Longest transaction:            2.80
Shortest transaction:           0.01

APC
-c100

Lifting the server siege...      done.                                         
Transactions:                     444 hits
Availability:                 100.00 %
Elapsed time:                   4.32 secs
Data transferred:               1.31 MB
Response time:                  0.37 secs
Transaction rate:             102.78 trans/sec
Throughput:                     0.30 MB/sec
Concurrency:                   38.44
Successful transactions:         444
Failed transactions:               0
Longest transaction:            0.58
Shortest transaction:           0.00

APC
-c200

Lifting the server siege...      done.                                         
Transactions:                     390 hits
Availability:                 100.00 %
Elapsed time:                   4.87 secs
Data transferred:               1.15 MB
Response time:                  1.27 secs
Transaction rate:              80.08 trans/sec
Throughput:                     0.24 MB/sec
Concurrency:                  101.44
Successful transactions:         390
Failed transactions:               0
Longest transaction:            3.01
Shortest transaction:           0.01

exussum

FluxBB
(not sure how to enable memcache or APC so just standard install here)

-c100

Lifting the server siege...      done.                                         
Transactions:                     859 hits
Availability:                 100.00 %
Elapsed time:                   4.59 secs
Data transferred:               1.29 MB
Response time:                  0.04 secs
Transaction rate:             187.15 trans/sec
Throughput:                     0.28 MB/sec
Concurrency:                    7.71
Successful transactions:         859
Failed transactions:               0
Longest transaction:            0.18
Shortest transaction:           0.00

-c200

Lifting the server siege...      done.                                         
Transactions:                     329 hits
Availability:                 100.00 %
Elapsed time:                   4.38 secs
Data transferred:               0.49 MB
Response time:                  0.80 secs
Transaction rate:              75.11 trans/sec
Throughput:                     0.11 MB/sec
Concurrency:                   59.72
Successful transactions:         329
Failed transactions:               0
Longest transaction:            2.80
Shortest transaction:           0.00

exussum

Vanilla

filecache

-c100

Lifting the server siege...      done.                                         
Transactions:                      58 hits
Availability:                 100.00 %
Elapsed time:                   4.28 secs
Data transferred:               0.10 MB
Response time:                  2.04 secs
Transaction rate:              13.55 trans/sec
Throughput:                     0.02 MB/sec
Concurrency:                   27.60
Successful transactions:          58
Failed transactions:               0
Longest transaction:            3.69
Shortest transaction:           0.18

filecache
-c200

Lifting the server siege...      done.                                         
Transactions:                      56 hits
Availability:                 100.00 %
Elapsed time:                   4.15 secs
Data transferred:               0.10 MB
Response time:                  2.01 secs
Transaction rate:              13.49 trans/sec
Throughput:                     0.02 MB/sec
Concurrency:                   27.15
Successful transactions:          56
Failed transactions:               0
Longest transaction:            4.05
Shortest transaction:           0.00

memcache
-c100

Lifting the server siege...      done.                                         
Transactions:                      87 hits
Availability:                 100.00 %
Elapsed time:                   4.79 secs
Data transferred:               0.15 MB
Response time:                  2.01 secs
Transaction rate:              18.16 trans/sec
Throughput:                     0.03 MB/sec
Concurrency:                   36.47
Successful transactions:          87
Failed transactions:               0
Longest transaction:            3.71
Shortest transaction:           0.12

memcache
-c200 (this one actually killed my apache first round )

after a restart
Lifting the server siege...      done.                                         
Transactions:                      96 hits
Availability:                 100.00 %
Elapsed time:                   4.71 secs
Data transferred:               0.17 MB
Response time:                  2.37 secs
Transaction rate:              20.38 trans/sec
Throughput:                     0.04 MB/sec
Concurrency:                   48.38
Successful transactions:          96
Failed transactions:               0
Longest transaction:            4.62
Shortest transaction:           0.08

Lee

I hate it when you view a thread and your Anti Virus bellows out something about a threat on this page!

fly

fluxbb++

exussum

@fly said:
fluxbb++

While still the best performer, The drop in requests per second is huge between the 100 and the 200, Nothing else had that sort of drop

IcyLiquid

@exussum Out of curiosity, the Vanilla you quote here... what version was it?

exussum

@IcyLiquid said:
exussum Out of curiosity, the Vanilla you quote here... what version was it?

commit bf714d9b89b86f2608a5d4eaded7e3aa9fa646f1
Author: Todd Burry 
Date:   Sun May 19 14:29:31 2013 -0400

    Vanilla: version 2.1a40.

Can test for any commit number / tag if you want

exussum

SMF

filecache
-c100

Lifting the server siege...      done.                                         
Transactions:                     158 hits
Availability:                 100.00 %
Elapsed time:                   4.48 secs
Data transferred:               0.46 MB
Response time:                  1.62 secs
Transaction rate:              35.27 trans/sec
Throughput:                     0.10 MB/sec
Concurrency:                   57.23
Successful transactions:         158
Failed transactions:               0
Longest transaction:            3.67
Shortest transaction:           0.61

filecache
-c200

Lifting the server siege...      done.                                         
Transactions:                     182 hits
Availability:                 100.00 %
Elapsed time:                   4.83 secs
Data transferred:               0.53 MB
Response time:                  2.21 secs
Transaction rate:              37.68 trans/sec
Throughput:                     0.11 MB/sec
Concurrency:                   83.34
Successful transactions:         182
Failed transactions:               0
Longest transaction:            3.71
Shortest transaction:           0.04

memcache
-c100

Lifting the server siege...      done.                                         
Transactions:                     202 hits
Availability:                 100.00 %
Elapsed time:                   4.62 secs
Data transferred:               0.59 MB
Response time:                  1.23 secs
Transaction rate:              43.72 trans/sec
Throughput:                     0.13 MB/sec
Concurrency:                   53.56
Successful transactions:         202
Failed transactions:               0
Longest transaction:            1.90
Shortest transaction:           0.09

memcache -c200

Lifting the server siege...      done.                                         
Transactions:                     172 hits
Availability:                 100.00 %
Elapsed time:                   4.12 secs
Data transferred:               0.50 MB
Response time:                  1.61 secs
Transaction rate:              41.75 trans/sec
Throughput:                     0.12 MB/sec
Concurrency:                   67.08
Successful transactions:         172
Failed transactions:               0
Longest transaction:            3.01
Shortest transaction:           0.03

APC -c100

Lifting the server siege...      done.                                         
Transactions:                     200 hits
Availability:                 100.00 %
Elapsed time:                   4.78 secs
Data transferred:               0.59 MB
Response time:                  1.39 secs
Transaction rate:              41.84 trans/sec
Throughput:                     0.12 MB/sec
Concurrency:                   58.17
Successful transactions:         200
Failed transactions:               0
Longest transaction:            2.31
Shortest transaction:           0.01

APC -c200

Lifting the server siege...      done.                                         
Transactions:                     218 hits
Availability:                 100.00 %
Elapsed time:                   5.01 secs
Data transferred:               0.64 MB
Response time:                  1.82 secs
Transaction rate:              43.51 trans/sec
Throughput:                     0.13 MB/sec
Concurrency:                   79.41
Successful transactions:         218
Failed transactions:               0
Longest transaction:            3.41
Shortest transaction:           0.02