Dizkus

I'll preface this post by saying these are not reliable results, the environment is not typical of a production server.. this was only meant as a general evaluation.

2.16 GHz Dual Core Darwin OS (Apple OS 10.4.9)
2 GB Ram
L2 Cache: 4MB per processor
Bus Speed: 667 MHz
120 GB 5400 rpm Serial ATA (SATA) Gen-I (1.5 Gbps)
PHP v5.2.1
Apache 2.2.4 (APC 3.0.12p2 disabled)

Standard default install (all modules), no modifications.

ab -c 10 -t 60 http://localhost/development/pn8
This is ApacheBench, Version 1.3d <$Revision: 1.73 $> apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 5000 requests
Completed 10000 requests
Completed 15000 requests
Completed 20000 requests
Completed 25000 requests
Completed 30000 requests
Completed 35000 requests
Completed 40000 requests
Completed 45000 requests
Finished 50000 requests
Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 80

Document Path: /development/pn8
Document Length: 241 bytes

Concurrency Level: 10
Time taken for tests: 14.658 seconds
Complete requests: 50000
Failed requests: 34500
(Connect: 17250, Length: 17250, Exceptions: 0)
Broken pipe errors: 0
Non-2xx responses: 32757
Total transferred: 16575042 bytes
HTML transferred: 7894437 bytes
Requests per second: 3411.11 [#/sec] (mean)
Time per request: 2.93 [ms] (mean)
Time per request: 0.29 [ms] (mean, across all concurrent requests)
Transfer rate: 1130.78 [Kbytes/sec] received

Connnection Times (ms)
min mean[sd] median max
Connect: 0 0 0.3 0 20
Processing: 0 2 1.6 3 20
Waiting: 0 3 0.9 3 19
Total: 0 2 1.7 3 20

Percentage of the requests served within a certain time (ms)
50% 3
66% 4
75% 4
80% 4
90% 5
95% 5
98% 6
99% 7
100% 20 (last request)


edit: added php/apache versions, disabled APC



edited by: InvalidResponse, Apr 18, 2007 - 03:49 PM

--
http://www.invalidresponse.com

Devin,

We looking at optimising the code at the moment - there have been some improvements since MS3.

Also note that the out of box configuration isn't the most performant. .8 is designed to be cached. I'd suggest turning on pnRender caching or, even better, Theme page caching.

-Mark

thanks mark.

--
http://www.invalidresponse.com

Devin,

I'd add that i've noticed some problems, at least on my local dev setup, with PHP v5.2.1 that have an extremely negative effect on performance. I've not had sufficient time to isolate this yet.

-Mark

Interesting. I ran the same options against a little "home spun" app I use for small sites that uses Smarty and ADOdbLite which should have performed a lot better .. wondering if it may have anything to do with either one or both of those libs. I don't know that it has significant bearing, but I've read that require_once is pretty expensive and both libraries use the function quite a bit. Interested to hear your findings.. thanks again mark.



edited by: InvalidResponse, Apr 18, 2007 - 04:05 PM

--
http://www.invalidresponse.com

Hi IR,

can you please run an identical benchmark against a 0.764 install? This would give us a baseline to compare things to ...

Greetings/Thanks
R

Hi Robert,
fresh install, no modifications/configuration changes:

ab -c 10 -t 60 http://localhost/development/pn764
This is ApacheBench, Version 1.3d apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 5000 requests
Completed 10000 requests
Completed 15000 requests
Completed 20000 requests
Completed 25000 requests
Completed 30000 requests
Completed 35000 requests
Completed 40000 requests
Completed 45000 requests
Finished 50000 requests
Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 80

Document Path: /development/pn764
Document Length: 243 bytes

Concurrency Level: 10
Time taken for tests: 14.265 seconds
Complete requests: 50000
Failed requests: 34482
(Connect: 17241, Length: 17241, Exceptions: 0)
Broken pipe errors: 0
Non-2xx responses: 32762
Total transferred: 16708620 bytes
HTML transferred: 7961166 bytes
Requests per second: 3505.08 [#/sec] (mean)
Time per request: 2.85 [ms] (mean)
Time per request: 0.29 [ms] (mean, across all concurrent requests)
Transfer rate: 1171.30 [Kbytes/sec] received

Connnection Times (ms)
min mean[sd] median max
Connect: 0 0 0.3 0 19
Processing: 0 2 1.5 3 12
Waiting: 0 3 0.8 3 12
Total: 0 2 1.6 3 19

Percentage of the requests served within a certain time (ms)
50% 3
66% 4
75% 4
80% 4
90% 4
95% 5
98% 6
99% 7
100% 19 (last request)

--
http://www.invalidresponse.com

the "issue" appears to be Smarty .. I'd like to see what .750 looks like.. anyone have a copy?



edited by: InvalidResponse, Apr 26, 2007 - 04:15 PM

--
http://www.invalidresponse.com

Thanks to AmmoDump

http://host.dpahl.com/~pndave/downloads/pn_archive/ver0750/PostNuke-0.750.zip
I wonder...

- Igor

--
Have a nice day

zikulapro.be is currently running
Zikula 1.0.2

thanks Igor..! Smarty was added in .750, but not as integrated, so I think it'll give a better idea of this vs. that ;)

thanks again.

PS: I just realized these are in the NOC.. checked out .726 too (egads! .. like time travel)

--
http://www.invalidresponse.com

v.726 Default install. APC disabled.

ab -c 10 -t 60 http://localhost/development/pn726/index.php
This is ApacheBench, Version 1.3d apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Finished 1017 requests
Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 80

Document Path: /development/pn726/index.php
Document Length: 20282 bytes

Concurrency Level: 10
Time taken for tests: 60.046 seconds
Complete requests: 1017
Failed requests: 0
Broken pipe errors: 0
Total transferred: 21079845 bytes
HTML transferred: 20710485 bytes
Requests per second: 16.94 [#/sec] (mean)
Time per request: 590.42 [ms] (mean)
Time per request: 59.04 [ms] (mean, across all concurrent requests)
Transfer rate: 351.06 [Kbytes/sec] received

Connnection Times (ms)
min mean[sd] median max
Connect: 0 0 0.0 0 0
Processing: 100 587 170.8 585 1200
Waiting: 100 587 170.8 585 1200
Total: 100 587 170.8 585 1200

Percentage of the requests served within a certain time (ms)
50% 585
66% 647
75% 690
80% 721
90% 791
95% 855
98% 906
99% 1019
100% 1200 (last request)


--
http://www.invalidresponse.com

WordPress 2.1.2:

dhayes$ ab -c 10 -t 60 http://localhost/test/publishers/wordpress/
This is ApacheBench, Version 1.3d apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Finished 104 requests
Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 80

Document Path: /test/publishers/wordpress/
Document Length: 6258 bytes

Concurrency Level: 10
Time taken for tests: 60.006 seconds
Complete requests: 104
Failed requests: 0
Broken pipe errors: 0
Total transferred: 728784 bytes
HTML transferred: 700896 bytes
Requests per second: 1.73 [#/sec] (mean)
Time per request: 5769.81 [ms] (mean)
Time per request: 576.98 [ms] (mean, across all concurrent requests)
Transfer rate: 12.15 [Kbytes/sec] received

Connnection Times (ms)
min mean[sd] median max
Connect: 0 0 0.0 0 0
Processing: 5116 5411 146.9 5423 5641
Waiting: 5116 5411 146.9 5423 5641
Total: 5116 5411 146.9 5423 5641

Percentage of the requests served within a certain time (ms)
50% 5423
66% 5475
75% 5519
80% 5554
90% 5588
95% 5606
98% 5620
99% 5630
100% 5641 (last request)

Joomla 1012:
dhayes$ ab -c 10 -t 60 http://localhost/development/Joomla_1012/
This is ApacheBench, Version 1.3d apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Finished 945 requests
Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 80

Document Path: /development/Joomla_1012/
Document Length: 22016 bytes

Concurrency Level: 10
Time taken for tests: 60.020 seconds
Complete requests: 945
Failed requests: 631
(Connect: 0, Length: 631, Exceptions: 0)
Broken pipe errors: 0
Total transferred: 21142490 bytes
HTML transferred: 20747062 bytes
Requests per second: 15.74 [#/sec] (mean)
Time per request: 635.13 [ms] (mean)
Time per request: 63.51 [ms] (mean, across all concurrent requests)
Transfer rate: 352.26 [Kbytes/sec] received

Connnection Times (ms)
min mean[sd] median max
Connect: 0 0 0.0 0 0
Processing: 126 632 88.3 627 1078
Waiting: 126 632 88.3 626 1078
Total: 126 632 88.3 627 1078

Percentage of the requests served within a certain time (ms)
50% 627
66% 645
75% 664
80% 677
90% 721
95% 769
98% 855
99% 913
100% 1078 (last request)

.726 appears to perform pretty well in comparison.

--
http://www.invalidresponse.com

PHP 5.2.2
APC disabled
PN v0.8 pnrender caching enabled, compile check disabled.
Themes caching enabled, compile check disabled:



PS: ran 2 sets. re-started apache between each test, after the 3rd, restarted the machine ran 2 more re-starting apache befor each, the results were pretty "competitive"..

PPS: run against the may 7 export



edited by: InvalidResponse, May 07, 2007 - 03:42 PM

--
http://www.invalidresponse.com

Just wondering - if I create a module that simply outputs "hello world" and exit(); will there be routines run from the core that are not required to acheive this? ie render stuff (Smarty, theme), database stuff (adobe), etc, etc. Is PostNuke set up to only run what is required at the time?

I am asking this becuase I want to only use pn8's core permissions and user libraries / functionality without any extra overhead from other non required functionality

-Lobos



edited by: Lobos, May 18, 2007 - 03:35 AM

--
-Lobos
Professional PHP Framework Services: Concept, Development and Deployment

If you are looking to get a solid chart I would also suggest running tests on the following versions.

.80 MS1 & 2
.721
.714
.703

It would be interesting. If the older versions aren't on the NOC i think I still have them archived along with probably .6x series :)