I'll preface this post by saying these are not reliable results, the environment is not typical of a production server.. this was only meant as a general evaluation.
2.16 GHz Dual Core Darwin OS (Apple OS 10.4.9)
2 GB Ram
L2 Cache: 4MB per processor
Bus Speed: 667 MHz
120 GB 5400 rpm Serial ATA (SATA) Gen-I (1.5 Gbps)
PHP v5.2.1
Apache 2.2.4 (APC 3.0.12p2 disabled)
Standard default install (all modules), no modifications.
ab -c 10 -t 60 http://localhost/development/pn8
This is ApacheBench, Version 1.3d <$Revision: 1.73 $> apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Completed 5000 requests
Completed 10000 requests
Completed 15000 requests
Completed 20000 requests
Completed 25000 requests
Completed 30000 requests
Completed 35000 requests
Completed 40000 requests
Completed 45000 requests
Finished 50000 requests
Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 80
Document Path: /development/pn8
Document Length: 241 bytes
Concurrency Level: 10
Time taken for tests: 14.658 seconds
Complete requests: 50000
Failed requests: 34500
(Connect: 17250, Length: 17250, Exceptions: 0)
Broken pipe errors: 0
Non-2xx responses: 32757
Total transferred: 16575042 bytes
HTML transferred: 7894437 bytes
Requests per second: 3411.11 [#/sec] (mean)
Time per request: 2.93 [ms] (mean)
Time per request: 0.29 [ms] (mean, across all concurrent requests)
Transfer rate: 1130.78 [Kbytes/sec] received
Connnection Times (ms)
min mean[sd] median max
Connect: 0 0 0.3 0 20
Processing: 0 2 1.6 3 20
Waiting: 0 3 0.9 3 19
Total: 0 2 1.7 3 20
Percentage of the requests served within a certain time (ms)
50% 3
66% 4
75% 4
80% 4
90% 5
95% 5
98% 6
99% 7
100% 20 (last request)
edit: added php/apache versions, disabled APC
edited by: InvalidResponse, Apr 18, 2007 - 03:49 PM
--
http://www.invalidresponse.com
- pborchelt answered »HowtoPNForms module unable to find template« 03:52h
- Teb answered »MenuTree Mystery« 05. Jul
- dks answered »include a file« 05. Jul
- dks answered ».764 -> 1.1.1, Can't add new blocks« 05. Jul
- craigh posted »PostCalendar 5.5.0RC1 needs testers and translators« 05. Jul
- bartl answered »Upgrading 1.0.2 --> 1.1.1« 05. Jul
- Charlie-otb answered »SafeHTML output filter and youtube« 05. Jul
Login
0.8 MS3 Benchmarkhh
-
- Rank: Professional
- Registered: 01.09.03
- last visit: 27.06.09
- Posts: 2408
-
- Rank: Moderator
- Registered: 19.03.02
- last visit: 27.06.09
- Posts: 7661
Devin,
We looking at optimising the code at the moment - there have been some improvements since MS3.
Also note that the out of box configuration isn't the most performant. .8 is designed to be cached. I'd suggest turning on pnRender caching or, even better, Theme page caching.
-Mark
--
Visit My homepage and Zikula themes. -
- Rank: Professional
- Registered: 01.09.03
- last visit: 27.06.09
- Posts: 2408
-
- Rank: Moderator
- Registered: 19.03.02
- last visit: 27.06.09
- Posts: 7661
Devin,
I'd add that i've noticed some problems, at least on my local dev setup, with PHP v5.2.1 that have an extremely negative effect on performance. I've not had sufficient time to isolate this yet.
-Mark
--
Visit My homepage and Zikula themes. -
- Rank: Professional
- Registered: 01.09.03
- last visit: 27.06.09
- Posts: 2408
Quote
I'd add that i've noticed some problems, at least on my local dev setup, with PHP v5.2.1 that have an extremely negative effect on performance.
Interesting. I ran the same options against a little "home spun" app I use for small sites that uses Smarty and ADOdbLite which should have performed a lot better .. wondering if it may have anything to do with either one or both of those libs. I don't know that it has significant bearing, but I've read that require_once is pretty expensive and both libraries use the function quite a bit. Interested to hear your findings.. thanks again mark.
edited by: InvalidResponse, Apr 18, 2007 - 04:05 PM
--
http://www.invalidresponse.com -
- Rank: Professional
- Registered: 06.01.03
- last visit: 30.06.09
- Posts: 603
Hi IR,
can you please run an identical benchmark against a 0.764 install? This would give us a baseline to compare things to ...
Greetings/Thanks
R -
- Rank: Professional
- Registered: 01.09.03
- last visit: 27.06.09
- Posts: 2408
Hi Robert,
fresh install, no modifications/configuration changes:
ab -c 10 -t 60 http://localhost/development/pn764
This is ApacheBench, Version 1.3d apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Completed 5000 requests
Completed 10000 requests
Completed 15000 requests
Completed 20000 requests
Completed 25000 requests
Completed 30000 requests
Completed 35000 requests
Completed 40000 requests
Completed 45000 requests
Finished 50000 requests
Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 80
Document Path: /development/pn764
Document Length: 243 bytes
Concurrency Level: 10
Time taken for tests: 14.265 seconds
Complete requests: 50000
Failed requests: 34482
(Connect: 17241, Length: 17241, Exceptions: 0)
Broken pipe errors: 0
Non-2xx responses: 32762
Total transferred: 16708620 bytes
HTML transferred: 7961166 bytes
Requests per second: 3505.08 [#/sec] (mean)
Time per request: 2.85 [ms] (mean)
Time per request: 0.29 [ms] (mean, across all concurrent requests)
Transfer rate: 1171.30 [Kbytes/sec] received
Connnection Times (ms)
min mean[sd] median max
Connect: 0 0 0.3 0 19
Processing: 0 2 1.5 3 12
Waiting: 0 3 0.8 3 12
Total: 0 2 1.6 3 19
Percentage of the requests served within a certain time (ms)
50% 3
66% 4
75% 4
80% 4
90% 4
95% 5
98% 6
99% 7
100% 19 (last request)
--
http://www.invalidresponse.com -
- Rank: Professional
- Registered: 01.09.03
- last visit: 27.06.09
- Posts: 2408
the "issue" appears to be Smarty .. I'd like to see what .750 looks like.. anyone have a copy?
edited by: InvalidResponse, Apr 26, 2007 - 04:15 PM
--
http://www.invalidresponse.com -
- Rank: Professional
- Registered: 22.03.03
- last visit: 05.07.09
- Posts: 943
Thanks to AmmoDump
http://host.dpahl.com/~pndave/downloads/pn_archive/ver0750/PostNuke-0.750.zip
I wonder...
- Igor
--
Have a nice day
zikulapro.com is currently running
Zikula 1.1.1 -
- Rank: Professional
- Registered: 01.09.03
- last visit: 27.06.09
- Posts: 2408
thanks Igor..! Smarty was added in .750, but not as integrated, so I think it'll give a better idea of this vs. that ;)
thanks again.
PS: I just realized these are in the NOC.. checked out .726 too (egads! .. like time travel)
--
http://www.invalidresponse.com -
- Rank: Professional
- Registered: 01.09.03
- last visit: 27.06.09
- Posts: 2408
v.726 Default install. APC disabled.
ab -c 10 -t 60 http://localhost/development/pn726/index.php
This is ApacheBench, Version 1.3d apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Finished 1017 requests
Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 80
Document Path: /development/pn726/index.php
Document Length: 20282 bytes
Concurrency Level: 10
Time taken for tests: 60.046 seconds
Complete requests: 1017
Failed requests: 0
Broken pipe errors: 0
Total transferred: 21079845 bytes
HTML transferred: 20710485 bytes
Requests per second: 16.94 [#/sec] (mean)
Time per request: 590.42 [ms] (mean)
Time per request: 59.04 [ms] (mean, across all concurrent requests)
Transfer rate: 351.06 [Kbytes/sec] received
Connnection Times (ms)
min mean[sd] median max
Connect: 0 0 0.0 0 0
Processing: 100 587 170.8 585 1200
Waiting: 100 587 170.8 585 1200
Total: 100 587 170.8 585 1200
Percentage of the requests served within a certain time (ms)
50% 585
66% 647
75% 690
80% 721
90% 791
95% 855
98% 906
99% 1019
100% 1200 (last request)
--
http://www.invalidresponse.com -
- Rank: Professional
- Registered: 01.09.03
- last visit: 27.06.09
- Posts: 2408
WordPress 2.1.2:
dhayes$ ab -c 10 -t 60 http://localhost/test/publishers/wordpress/
This is ApacheBench, Version 1.3d apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Finished 104 requests
Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 80
Document Path: /test/publishers/wordpress/
Document Length: 6258 bytes
Concurrency Level: 10
Time taken for tests: 60.006 seconds
Complete requests: 104
Failed requests: 0
Broken pipe errors: 0
Total transferred: 728784 bytes
HTML transferred: 700896 bytes
Requests per second: 1.73 [#/sec] (mean)
Time per request: 5769.81 [ms] (mean)
Time per request: 576.98 [ms] (mean, across all concurrent requests)
Transfer rate: 12.15 [Kbytes/sec] received
Connnection Times (ms)
min mean[sd] median max
Connect: 0 0 0.0 0 0
Processing: 5116 5411 146.9 5423 5641
Waiting: 5116 5411 146.9 5423 5641
Total: 5116 5411 146.9 5423 5641
Percentage of the requests served within a certain time (ms)
50% 5423
66% 5475
75% 5519
80% 5554
90% 5588
95% 5606
98% 5620
99% 5630
100% 5641 (last request)
Joomla 1012:
dhayes$ ab -c 10 -t 60 http://localhost/development/Joomla_1012/
This is ApacheBench, Version 1.3d apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Finished 945 requests
Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 80
Document Path: /development/Joomla_1012/
Document Length: 22016 bytes
Concurrency Level: 10
Time taken for tests: 60.020 seconds
Complete requests: 945
Failed requests: 631
(Connect: 0, Length: 631, Exceptions: 0)
Broken pipe errors: 0
Total transferred: 21142490 bytes
HTML transferred: 20747062 bytes
Requests per second: 15.74 [#/sec] (mean)
Time per request: 635.13 [ms] (mean)
Time per request: 63.51 [ms] (mean, across all concurrent requests)
Transfer rate: 352.26 [Kbytes/sec] received
Connnection Times (ms)
min mean[sd] median max
Connect: 0 0 0.0 0 0
Processing: 126 632 88.3 627 1078
Waiting: 126 632 88.3 626 1078
Total: 126 632 88.3 627 1078
Percentage of the requests served within a certain time (ms)
50% 627
66% 645
75% 664
80% 677
90% 721
95% 769
98% 855
99% 913
100% 1078 (last request)
.726 appears to perform pretty well in comparison.
--
http://www.invalidresponse.com -
- Rank: Professional
- Registered: 01.09.03
- last visit: 27.06.09
- Posts: 2408
PHP 5.2.2
APC disabled
PN v0.8 pnrender caching enabled, compile check disabled.
Themes caching enabled, compile check disabled:
Code
dhayes$ ab -c 10 -t 60 http://localhost/development/pn8
This is ApacheBench, Version 1.3d <$Revision: 1.73 $> apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Completed 5000 requests
Completed 10000 requests
Completed 15000 requests
Completed 20000 requests
Completed 25000 requests
Completed 30000 requests
Completed 35000 requests
Completed 40000 requests
Completed 45000 requests
Finished 50000 requests
Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 80
Document Path: /development/pn8
Document Length: 241 bytes
Concurrency Level: 10
time taken for tests: 15.097 seconds
Complete requests: 50000
Failed requests: 34482
(Connect: 17241, Length: 17241, Exceptions: 0)
Broken pipe errors: 0
Non-2xx responses: 32763
Total transferred: 16578078 bytes
HTML transferred: 7895883 bytes
Requests per second: 3311.92 [#/sec] (mean)
time per request: 3.02 [ms] (mean)
time per request: 0.30 [ms] (mean, across all concurrent requests)
Transfer rate: 1098.10 [Kbytes/sec] received
Connnection Times (ms)
min mean[sd] median max
Connect: 0 0 0.2 0 9
Processing: 0 2 3.2 3 131
Waiting: 0 3 2.9 3 131
Total: 0 3 3.2 3 131
Percentage of the requests served within a certain time (ms)
50% 3
66% 4
75% 4
80% 4
90% 5
95% 5
98% 6
99% 7
100% 131 (last request)
PS: ran 2 sets. re-started apache between each test, after the 3rd, restarted the machine ran 2 more re-starting apache befor each, the results were pretty "competitive"..
PPS: run against the may 7 export
edited by: InvalidResponse, May 07, 2007 - 03:42 PM
--
http://www.invalidresponse.com -
- Rank: Professional
- Registered: 03.12.02
- last visit: 27.06.09
- Posts: 1572
Just wondering - if I create a module that simply outputs "hello world" and exit(); will there be routines run from the core that are not required to acheive this? ie render stuff (Smarty, theme), database stuff (adobe), etc, etc. Is postnuke set up to only run what is required at the time?
I am asking this becuase I want to only use pn8's core permissions and user libraries / functionality without any extra overhead from other non required functionality
-Lobos
edited by: Lobos, May 18, 2007 - 03:35 AM
--
-Lobos
Professional PHP Framework Services: Concept, Development and Deployment -
- Rank: Developer
- Registered: 31.12.69
- last visit: 27.06.09
- Posts: 790
If you are looking to get a solid chart I would also suggest running tests on the following versions.
.80 MS1 & 2
.721
.714
.703
It would be interesting. If the older versions aren't on the NOC i think I still have them archived along with probably .6x series :)
- Moderated by :
- Support
Users online
This list is based on the users active over the last 60 minutes.
