Forum Activity

Forum feed

» see all | » latest posts

0.8 MS3 Benchmarkhh  Top

Goto page: 1 - 2 [+1]

  • I'll preface this post by saying these are not reliable results, the environment is not typical of a production server.. this was only meant as a general evaluation.

    2.16 GHz Dual Core Darwin OS (Apple OS 10.4.9)
    2 GB Ram
    L2 Cache: 4MB per processor
    Bus Speed: 667 MHz
    120 GB 5400 rpm Serial ATA (SATA) Gen-I (1.5 Gbps)
    PHP v5.2.1
    Apache 2.2.4 (APC 3.0.12p2 disabled)

    Standard default install (all modules), no modifications.

    ab -c 10 -t 60 http://localhost/development/pn8
    This is ApacheBench, Version 1.3d <$Revision: 1.73 $> apache-1.3
    Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

    Benchmarking localhost (be patient)
    Completed 5000 requests
    Completed 10000 requests
    Completed 15000 requests
    Completed 20000 requests
    Completed 25000 requests
    Completed 30000 requests
    Completed 35000 requests
    Completed 40000 requests
    Completed 45000 requests
    Finished 50000 requests
    Server Software: Apache/2.2.4
    Server Hostname: localhost
    Server Port: 80

    Document Path: /development/pn8
    Document Length: 241 bytes

    Concurrency Level: 10
    Time taken for tests: 14.658 seconds
    Complete requests: 50000
    Failed requests: 34500
    (Connect: 17250, Length: 17250, Exceptions: 0)
    Broken pipe errors: 0
    Non-2xx responses: 32757
    Total transferred: 16575042 bytes
    HTML transferred: 7894437 bytes
    Requests per second: 3411.11 [#/sec] (mean)
    Time per request: 2.93 [ms] (mean)
    Time per request: 0.29 [ms] (mean, across all concurrent requests)
    Transfer rate: 1130.78 [Kbytes/sec] received

    Connnection Times (ms)
    min mean[sd] median max
    Connect: 0 0 0.3 0 20
    Processing: 0 2 1.6 3 20
    Waiting: 0 3 0.9 3 19
    Total: 0 2 1.7 3 20

    Percentage of the requests served within a certain time (ms)
    50% 3
    66% 4
    75% 4
    80% 4
    90% 5
    95% 5
    98% 6
    99% 7
    100% 20 (last request)


    edit: added php/apache versions, disabled APC



    edited by: InvalidResponse, Apr 18, 2007 - 03:49 PM

    --
    http://www.invalidresponse.com
  • Devin,

    We looking at optimising the code at the moment - there have been some improvements since MS3.

    Also note that the out of box configuration isn't the most performant. .8 is designed to be cached. I'd suggest turning on pnRender caching or, even better, Theme page caching.

    -Mark

    --
    Visit My homepage and Zikula themes.
  • Devin,

    I'd add that i've noticed some problems, at least on my local dev setup, with PHP v5.2.1 that have an extremely negative effect on performance. I've not had sufficient time to isolate this yet.

    -Mark

    --
    Visit My homepage and Zikula themes.
  • Quote


    I'd add that i've noticed some problems, at least on my local dev setup, with PHP v5.2.1 that have an extremely negative effect on performance.

    Interesting. I ran the same options against a little "home spun" app I use for small sites that uses Smarty and ADOdbLite which should have performed a lot better .. wondering if it may have anything to do with either one or both of those libs. I don't know that it has significant bearing, but I've read that require_once is pretty expensive and both libraries use the function quite a bit. Interested to hear your findings.. thanks again mark.



    edited by: InvalidResponse, Apr 18, 2007 - 04:05 PM

    --
    http://www.invalidresponse.com
  • Hi IR,

    can you please run an identical benchmark against a 0.764 install? This would give us a baseline to compare things to ...

    Greetings/Thanks
    R
  • Hi Robert,
    fresh install, no modifications/configuration changes:

    ab -c 10 -t 60 http://localhost/development/pn764
    This is ApacheBench, Version 1.3d apache-1.3
    Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

    Benchmarking localhost (be patient)
    Completed 5000 requests
    Completed 10000 requests
    Completed 15000 requests
    Completed 20000 requests
    Completed 25000 requests
    Completed 30000 requests
    Completed 35000 requests
    Completed 40000 requests
    Completed 45000 requests
    Finished 50000 requests
    Server Software: Apache/2.2.4
    Server Hostname: localhost
    Server Port: 80

    Document Path: /development/pn764
    Document Length: 243 bytes

    Concurrency Level: 10
    Time taken for tests: 14.265 seconds
    Complete requests: 50000
    Failed requests: 34482
    (Connect: 17241, Length: 17241, Exceptions: 0)
    Broken pipe errors: 0
    Non-2xx responses: 32762
    Total transferred: 16708620 bytes
    HTML transferred: 7961166 bytes
    Requests per second: 3505.08 [#/sec] (mean)
    Time per request: 2.85 [ms] (mean)
    Time per request: 0.29 [ms] (mean, across all concurrent requests)
    Transfer rate: 1171.30 [Kbytes/sec] received

    Connnection Times (ms)
    min mean[sd] median max
    Connect: 0 0 0.3 0 19
    Processing: 0 2 1.5 3 12
    Waiting: 0 3 0.8 3 12
    Total: 0 2 1.6 3 19

    Percentage of the requests served within a certain time (ms)
    50% 3
    66% 4
    75% 4
    80% 4
    90% 4
    95% 5
    98% 6
    99% 7
    100% 19 (last request)

    --
    http://www.invalidresponse.com
  • the "issue" appears to be Smarty .. I'd like to see what .750 looks like.. anyone have a copy?



    edited by: InvalidResponse, Apr 26, 2007 - 04:15 PM

    --
    http://www.invalidresponse.com
  • Thanks to AmmoDump

    http://host.dpahl.com/~pndave/downloads/pn_archive/ver0750/PostNuke-0.750.zip
    I wonder...

    - Igor

    --
    Have a nice day
    zikulapro.com is currently running
    Zikula 1.1.1
  • thanks Igor..! Smarty was added in .750, but not as integrated, so I think it'll give a better idea of this vs. that ;)

    thanks again.

    PS: I just realized these are in the NOC.. checked out .726 too (egads! .. like time travel)

    --
    http://www.invalidresponse.com
  • v.726 Default install. APC disabled.

    ab -c 10 -t 60 http://localhost/development/pn726/index.php
    This is ApacheBench, Version 1.3d apache-1.3
    Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

    Benchmarking localhost (be patient)
    Finished 1017 requests
    Server Software: Apache/2.2.4
    Server Hostname: localhost
    Server Port: 80

    Document Path: /development/pn726/index.php
    Document Length: 20282 bytes

    Concurrency Level: 10
    Time taken for tests: 60.046 seconds
    Complete requests: 1017
    Failed requests: 0
    Broken pipe errors: 0
    Total transferred: 21079845 bytes
    HTML transferred: 20710485 bytes
    Requests per second: 16.94 [#/sec] (mean)
    Time per request: 590.42 [ms] (mean)
    Time per request: 59.04 [ms] (mean, across all concurrent requests)
    Transfer rate: 351.06 [Kbytes/sec] received

    Connnection Times (ms)
    min mean[sd] median max
    Connect: 0 0 0.0 0 0
    Processing: 100 587 170.8 585 1200
    Waiting: 100 587 170.8 585 1200
    Total: 100 587 170.8 585 1200

    Percentage of the requests served within a certain time (ms)
    50% 585
    66% 647
    75% 690
    80% 721
    90% 791
    95% 855
    98% 906
    99% 1019
    100% 1200 (last request)


    --
    http://www.invalidresponse.com
  • WordPress 2.1.2:

    dhayes$ ab -c 10 -t 60 http://localhost/test/publishers/wordpress/
    This is ApacheBench, Version 1.3d apache-1.3
    Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

    Benchmarking localhost (be patient)
    Finished 104 requests
    Server Software: Apache/2.2.4
    Server Hostname: localhost
    Server Port: 80

    Document Path: /test/publishers/wordpress/
    Document Length: 6258 bytes

    Concurrency Level: 10
    Time taken for tests: 60.006 seconds
    Complete requests: 104
    Failed requests: 0
    Broken pipe errors: 0
    Total transferred: 728784 bytes
    HTML transferred: 700896 bytes
    Requests per second: 1.73 [#/sec] (mean)
    Time per request: 5769.81 [ms] (mean)
    Time per request: 576.98 [ms] (mean, across all concurrent requests)
    Transfer rate: 12.15 [Kbytes/sec] received

    Connnection Times (ms)
    min mean[sd] median max
    Connect: 0 0 0.0 0 0
    Processing: 5116 5411 146.9 5423 5641
    Waiting: 5116 5411 146.9 5423 5641
    Total: 5116 5411 146.9 5423 5641

    Percentage of the requests served within a certain time (ms)
    50% 5423
    66% 5475
    75% 5519
    80% 5554
    90% 5588
    95% 5606
    98% 5620
    99% 5630
    100% 5641 (last request)

    Joomla 1012:
    dhayes$ ab -c 10 -t 60 http://localhost/development/Joomla_1012/
    This is ApacheBench, Version 1.3d apache-1.3
    Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

    Benchmarking localhost (be patient)
    Finished 945 requests
    Server Software: Apache/2.2.4
    Server Hostname: localhost
    Server Port: 80

    Document Path: /development/Joomla_1012/
    Document Length: 22016 bytes

    Concurrency Level: 10
    Time taken for tests: 60.020 seconds
    Complete requests: 945
    Failed requests: 631
    (Connect: 0, Length: 631, Exceptions: 0)
    Broken pipe errors: 0
    Total transferred: 21142490 bytes
    HTML transferred: 20747062 bytes
    Requests per second: 15.74 [#/sec] (mean)
    Time per request: 635.13 [ms] (mean)
    Time per request: 63.51 [ms] (mean, across all concurrent requests)
    Transfer rate: 352.26 [Kbytes/sec] received

    Connnection Times (ms)
    min mean[sd] median max
    Connect: 0 0 0.0 0 0
    Processing: 126 632 88.3 627 1078
    Waiting: 126 632 88.3 626 1078
    Total: 126 632 88.3 627 1078

    Percentage of the requests served within a certain time (ms)
    50% 627
    66% 645
    75% 664
    80% 677
    90% 721
    95% 769
    98% 855
    99% 913
    100% 1078 (last request)

    .726 appears to perform pretty well in comparison.

    --
    http://www.invalidresponse.com
  • PHP 5.2.2
    APC disabled
    PN v0.8 pnrender caching enabled, compile check disabled.
    Themes caching enabled, compile check disabled:

    Code

    dhayes$ ab -c 10 -t 60 http://localhost/development/pn8
    This is ApacheBench, Version 1.3d <$Revision: 1.73 $> apache-1.3
    Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

    Benchmarking localhost (be patient)
    Completed 5000 requests
    Completed 10000 requests
    Completed 15000 requests
    Completed 20000 requests
    Completed 25000 requests
    Completed 30000 requests
    Completed 35000 requests
    Completed 40000 requests
    Completed 45000 requests
    Finished 50000 requests
    Server Software:        Apache/2.2.4                                      
    Server Hostname:        localhost
    Server Port:            80

    Document Path:          /development/pn8
    Document Length:        241 bytes

    Concurrency Level:      10
    time taken for tests:   15.097 seconds
    Complete requests:      50000
    Failed requests:        34482
       (Connect: 17241, Length: 17241, Exceptions: 0)
    Broken pipe errors:     0
    Non-2xx responses:      32763
    Total transferred:      16578078 bytes
    HTML transferred:       7895883 bytes

    Requests per second:    3311.92 [#/sec] (mean)
    time per request:       3.02 [ms] (mean)
    time per request:       0.30 [ms] (mean, across all concurrent requests)
    Transfer rate:          1098.10 [Kbytes/sec] received

    Connnection Times (ms)
                  min  mean[sd] median   max
    Connect:        0     0    0.2      0     9
    Processing:     0     2    3.2      3   131
    Waiting:        0     3    2.9      3   131
    Total:          0     3    3.2      3   131

    Percentage of the requests served within a certain time (ms)
      50%      3
      66%      4
      75%      4
      80%      4
      90%      5
      95%      5
      98%      6
      99%      7
     100%    131 (last request)


    PS: ran 2 sets. re-started apache between each test, after the 3rd, restarted the machine ran 2 more re-starting apache befor each, the results were pretty "competitive"..

    PPS: run against the may 7 export



    edited by: InvalidResponse, May 07, 2007 - 03:42 PM

    --
    http://www.invalidresponse.com
  • Just wondering - if I create a module that simply outputs "hello world" and exit(); will there be routines run from the core that are not required to acheive this? ie render stuff (Smarty, theme), database stuff (adobe), etc, etc. Is postnuke set up to only run what is required at the time?

    I am asking this becuase I want to only use pn8's core permissions and user libraries / functionality without any extra overhead from other non required functionality

    -Lobos



    edited by: Lobos, May 18, 2007 - 03:35 AM

    --
    -Lobos
    Professional PHP Framework Services: Concept, Development and Deployment
  • If you are looking to get a solid chart I would also suggest running tests on the following versions.

    .80 MS1 & 2
    .721
    .714
    .703

    It would be interesting. If the older versions aren't on the NOC i think I still have them archived along with probably .6x series :)

Goto page: 1 - 2 [+1]

This list is based on the users active over the last 60 minutes.