CCP14 Homepage - Single Crystal and Powder Diffraction - Methods, Problems and Solutions - BSD UNIX Information for Crystallography - Optimising and tuning FreeBSD 4.2 UNIX and Apache for High Performance PC Webserving

[CCP14 Home: (Frames \| No Frames)] CCP14 Mirrors: [UK] \| [CA] \| [US] \| [AU]	What's New	Introduction	Site Map
Search the CCP14	Download Programs What do you want to do? (lists of software by crystallographic method)	Tutorials	Solutions

(This Webpage Page in No Frames Mode)

CCP14

Methods, Problems and Solutions

BSD UNIX Information for Crystallography

Optimising and tuning FreeBSD 4.2 UNIX and Apache for High Performance PC Webserving

(tutorials for doing this are near the bottom of the webpage)

The CCP14 Homepage is at http://www.ccp14.ac.uk

[Back to Problems and Solutions]
[Back to: BSD UNIX Information for Crystallography] [To: Linux Information for Crystallography]

[Apache, Redhat and FreeBSD comparison] | [Optimising FreeBSD for Apache and High Performance web serving]

(Please note that Apache is a good, flexible web server but is not lightning fast. For high capacity serving of static webpages without overwhelming the server computer, thttpd (tiny/turbo/throttling HTTP server) may be a better web server to use.)

Acknowledgements

Thanks to assistance from Steven Fletcher, Richard Smith and Ben Smithurst from the FreeBSD users mailing list. The following is a draft and done without a full appreciation of the consequences. Thus it may be highly inaccurate and dangerous. Let the viewer beware.

Summary

Recompiling the kernel with maxusers=512 majorly improved the robustness of FreeBSD 4.2 to handle very nasty loads by Apache Bench. Details and waffle follow. Tutorials for doing this are near the bottom of the webpage.

The following is a set of relatively incoherant notes for optimising FreeBSD 4.2 UNIX for PC with relation to getting the best high performance web serving from Apache and FreeBSD.
FreeBSD (for a UNIX operating system) is "freely available", secure, easy to administer and control in a confident manner, robust and actively maintained by its developer community. The intension for a proposed next-generation CCP14 primary webserver is to use FreeBSD on a PC. This is expected to give very high performance at far less cost than going to other brands of proprietary UNIX that also require the purchase of expensive proprietary hardware. However, some tweaking of the operating system parameters may be required for very heavily used servers running on standard PC hardware. At present (December 2000) the BSD based operating systems of which FreeBSD is one - have a reputation of being better designed (by gurus no less!), more secure (and more security conscious) and more robust than most other operating systems (including Linux - an operating system - it is claimed - "written by kiddies - for kiddies"). Refer to: FreeBSD, OpenBSD and SuSE 6.2 Eval Review by Keith Rankin: "The differences between FreeBSD and Linux used to be much more obvious than they are now. Now it comes down to theology. The BSD world is still the 'high church' or Druid Unix. Blood will be spilled on a stone altar at midnite when star systems are in a certain alignment to learn the ways of this tribe. Linux is a happier world. The spirits of Captain Kirk,Peter Pan and good beer come to mind." ("Buckets of Blood" and non-alcoholic prudery is official CCP14 computer operating system policy)
This is still being investigated and the user should be wary that some of these tweaks could have un-forseen consequences so do be careful and take notes on what you are doing (the following should not be considered a substitute for thinking for yourself). It is expected that tweaking of the FreeBSD kernel defaults would not be required for it to be a primary CCP14 server. But it is safer to sort out the ability to handle very high loading issues in advance. As FreeBSD is free and runs on PCs, this is not that difficult to do. Also, it should be noted that these tweaks may not be required if you have better PC hardware than being tested below(?)

Some web References

(some directly relevant, some not):

Tuning with ab - ApacheBench: http://perl.apache.org/guide/performance.html#Tuning_with_ab_ApacheBench
FreeBSD Security Information: http://www.freebsd.org/security/
FreeBSD UNIX Security How-To: http://www.FreeBSD.org/~jkb/howto.html
Comprehensive Guide to FreeBSD: http://www.vmunix.com/fbsd-book/
Mark's FreeBSD Resource Site: http://www.vmunix.com/~mark/FreeBSD/
FreeBSD Java Project: http://www.FreeBSD.org/java/
FreeBSD Handbook (The FreeBSD Documentation Project): http://www.freebsd.org/handbook/index.html
FreeBSD Handbook: Configuring the FreeBSD Kernel: http://www.freebsd.org/handbook/kernelconfig.html
FreeBSD Handbook: Configuring the FreeBSD Kernel: Why Build a Custom Kernel?: http://www.freebsd.org/handbook/x2437.html
FreeBSD Handbook: Configuring the FreeBSD Kernel: Building and Installing a Custom Kernel: http://www.freebsd.org/handbook/kernelconfig-building.html
FreeBSD Handbook: Configuring the FreeBSD Kernel: The Configuration File: http://www.freebsd.org/handbook/kernelconfig-config.html
FreeBSD Handbook: Configuring the FreeBSD Kernel: If Something Goes Wrong: http://www.freebsd.org/handbook/kernelconfig-trouble.html
apache webserver performance testing tools
- httperf - webserver Benchmarking tool, http_load - another webserver Benchmarking tool, ab - ApacheBench (comes with apache), Daquiri - yet another webserver Benchmarking tool
- At http://perl.apache.org/guide/download.html#httperf_webserver_Benchmarking
Web Server Comparisons - comparing apache, thttpd, etc.
- "...factoring out I/O, the primary determinant to server performance is the concurrency strategy."
- apache in this test - barfs at around 125 simultaneous users.
- At http://www.acme.com/software/thttpd/benchmarks.html
JAWS: Understanding High Performance Web Systems
- At http://www.cs.wustl.edu/~jxh/research/research.html
mod_backhand
- "mod_backhand is project that allows seamless redirection of HTTP requests from one web server to another. This redirection can be used to target machines with under-utilized resources, thus providing fine-grained, per-request load balancing of web requests."
- At http://www.backhand.org/mod_backhand/

Test PC Config and FreeBSD UNIX Install

Default minimum install of FreeBSD 4.2 UNIX with man pages and kernel source

(Apache compiled from source code)

Viglan 300 MHZ Intel Pentium with 128 Meg RAM
3COMFast Etherlink XL 10/100 Mb TX Ethernet NIC (3C 905B-TX) on IRQ 9
ATI Xpert@Work Video Card (ATI 3D RAGE PRO - DirectX) (MACH64 Drivers based for XFree86 Xwindows)
iiyama 17" MT-9017T video monitor that can do (Frequency: 50/60Hz):
- 1024x768 at 75Hz VESA; 60.02kHz HorizontalFrequency; 75.0kHz Vertical Frequency
- 1280x1024 at 75Hz VESA; 79.98kHz HorizontalFrequency; 75.0kHz Vertical Frequency
Generic Floppy Disk
In board SYMBIOS Logic 875XSID (NCR53c8xx) (Hardcopy Manual: SYM8751SP) PCI Ultra SCSI Host adapter (no devices connected)
SCSI Fujitsu Hard Disk drive with ~8 Gig IDE Hard-disk
Yamaha OPL3-Sax Sound System
Atapi CD-ROM: TEAC CD-532E

When doing ab-ApacheBench apache stress testing on "DEFAULT" FreeBSD 4.2

Possible messages/errors when going to the extreme:

socket: (mbuf errors = nmbclusters problems) Too many open files in system: or socket: "No buffer space available": /kernel: or file: table is full /var/run/utmp: Too many open files in system. no memory for rx list, etc.

The following was too stressful for default FreeBSD on the above hardware. (After tuning the operating system, far worse that this could be done)

/usr/local/apache/bin/ab -n 259 -c 250 http://www.servername.org/test/test.pl

Various responses from the FreeBSD Mailing list:

From: Richard Smith 
Organization: http://www.rdls.net
To: "L. Cranswick" [[email protected]]
Cc: Free BSD UK users List 
Subject: Re: FreeBSD: stressing 4.2 and Apache with  ab (fwd)

"L. Cranswick" wrote:
> 
> With nmbclusters = 10000 - it now takes a lot more to drag
> FreeBSD down in these tests.  (is still a 300 MHz Pentium
> with 128 Meg RAM)
> 
> But when I do:
> 
>   /usr/local/apache/bin/ab -n 10000 -c 1000 http://system.dl.ac.uk/test/test.pl
> 
> I get:
>   Benchmarking system.dl.ac.uk (be patient)...
>     socket: Too many open files in system

You might want to build a more robust kernel before you start tweaking
individual parameters. My notebook has a kernel configuration file with
"maxusers = 512", and doesn't suffer from _any_ of the symptoms you have
observed with apache and ab.

Richard.

From: Richard Smith
Organization: http://www.rdls.net
To: "L. Cranswick" [[email protected]]
Cc: Free BSD UK users List [[email protected]]
Subject: Re: FreeBSD: stressing 4.2 and Apache with  ab (fwd)
Date: Sun, 31 Dec 2000 22:10:05 +0000

"L. Cranswick" wrote:
> 
> Do you have the parameters you have tweaked to make a
> "robust" kernel?  Can you post the relevant parts of
> the config files that could also be included on the web?

The only significant change from the GENERIC kernal configuration file
is:

maxusers	512

The only reason that I chose the value of 512 was that it was the
maximum value allowed (a warning is issued by config(8) if you try to
set maxusers larger than 512).

I have extracted a few values using `sysctl -a' to demonstrate how the
entire system scales with maxusers=512:

kern.ipc.nmbclusters: 8704
kern.ipc.nmbufs: 34816
kern.maxfiles: 16424
kern.maxfilesperproc: 16424

It may well be that you have an application or benchmark that requires
more NMBCLUSTERS than 8704, in which case you could make additional
changes in your `/etc/sysctl.conf' file. However, I must admit that I
perfer scaling the entire system using maxusers rather than tweeking
specific parameters to suit a particular benchmark.

My objective has always been to build a "robust" kernel, rather than the
optimum kernel for a specific application, indeed, one could fiddle with
many parameters to obtain the maximum performance or the minimum memory
footprint.

Most of my systems are currently 400MHz Celerons with 128M of RAM,
running mainly my own code. However, I will soon be deploying some
Apache web servers on the Internet using more extreme platforms, so I
look forward to reading your final conclusions in the not too distant
future,

Best regards,
Richard.

Date: Sat, 30 Dec 2000 20:49:19 +0000
To: Steven Fletcher
Cc: "L. Cranswick" [[email protected]], [email protected]
Subject: Re: FreeBSD: stressing 4.2 and Apache with  ab
From: (Dominic Mitchell)

On Sat, Dec 30, 2000 at 02:26:57AM +0000, Steven Fletcher wrote:
> On Sat, 30 Dec 2000 00:19:23 +0000 (GMT), L. Cranswick wrote:
> 
> >   socket: "No buffer space available"
> 
> Sounds (if I remember correctly) that you are running out of NMB
> clusters. Increase them (probably need to add the setting: options
> NMBCLUSTERS="10000") in your kernel config file, or possibly by sysctl
> (kern.ipc.nmbclusters)

Beware of setting the sysctl; you need to do it early.  There is a flag
in loader.conf to let you do this.  Look in /boot/defaults/loader.conf
and copy the line referencing nmbclusters to /boot/loader.conf
(uncommenting it, of course).

-Dom (saving kernel compiles)

To: "L. Cranswick" [[email protected]]
Cc: [email protected]
Subject: Re: FreeBSD: stressing 4.2 and Apache with  ab
Date: Sat, 30 Dec 2000 02:26:57 +0000

On Sat, 30 Dec 2000 00:19:23 +0000 (GMT), L. Cranswick wrote:

>   socket: "No buffer space available"

Sounds (if I remember correctly) that you are running out of NMB
clusters. Increase them (probably need to add the setting: options
NMBCLUSTERS="10000") in your kernel config file, or possibly by sysctl
(kern.ipc.nmbclusters)

-Steven

From: Ben Smithurst
To: "L. Cranswick" [[email protected]]
Cc: Free BSD UK users List [[email protected]]
Subject: Re: FreeBSD: stressing 4.2 and Apache with  ab (fwd)
Date: Sat, 30 Dec 2000 18:10:36 +0000

L. Cranswick wrote:

> But when I do:
>   
>   /usr/local/apache/bin/ab -n 10000 -c 1000 http://system.dl.ac.uk/test/test.pl
> 
> I get:
>   Benchmarking system.dl.ac.uk (be patient)...
>     socket: Too many open files in system 
> 
> And the FreeBSD consol/logs reports: /kernel: file: table is full
> /var/run/utmp: Too many open files in system.
> no memory for rx list, etc.
> 
> Does this give suggestions on parameters to tweak 
> (just increase nmbclusters more) or am
> I asking too much from the system?

You need more file descriptors, probably on both the server side and the
client (ab) side.  The error is talking about the client side though...

ben@strontium:~$ sysctl -a | grep maxfile          
kern.maxfiles: 552
kern.maxfilesperproc: 552

I *think* just increasing those with sysctl -w might work, if not,
increase maxusers in your kernel config and recompile.  The formula
for determining maxfiles and maxproc and stuff from maxusers is in
/sys/conf/param.c

-- 
Ben Smithurst / [email protected] / PGP: 0x99392F7D

From: Steven Fletcher 
To: "L. Cranswick" [[email protected]]
Subject: Re: FreeBSD: stressing 4.2 and Apache with  ab (fwd)
Date: Sat, 30 Dec 2000 20:02:24 +0000

On Sat, 30 Dec 2000 04:57:37 +0000 (GMT), L. Cranswick wrote:

>On web searching:
>I cannot find anything about tuning FreeBSD with Apache though
>there are Linux equivalents - what are the parameters that
>should be tweaked and what are the implications - especially
>if RAM might be becoming tight - will it just swap to disk?

As far as tuning goes, there are certain options that you can tune
inside the kernel and via various sysctl options that, when 2.2.8 was in
use, I used to always be sure of setting. One of these was the
nmbclusters setting, however also take a peek at setting MAXUSERS 512 in
the kernel as well.

As far as I am aware, apache treats the memory as memory, and won't
differentiate between a VM filesystem and physical ram - that is up to
the operation of the computer.

>-----
>
>With nmbclusters = 10000 - it now takes a lot more to drag
>FreeBSD down in these tests.  (is still a 300 MHz Pentium
>with 128 Meg RAM)
>
>But when I do:
>  
>  /usr/local/apache/bin/ab -n 10000 -c 1000 http://system.dl.ac.uk/test/test.pl
>
>I get:
>  Benchmarking system.dl.ac.uk (be patient)...
>    socket: Too many open files in system 

Then you're running into the next limiation - maxfiles. Each connection
requires a file descriptor, and as a simple method of stopping the OS
getting carried away, there is an upper limit on the number of open
descriptors (and thus connections) that you can have at any one time.
It's similar to nmbclusters, in a way, but is also bit of a different
kettle of fish. Stop me when I'm starting to sound silly. This is
generally a per-user setting (although the kernel does have a sysctl
setting, kern.maxfiles, which is [probably] a system-wide limit),
however is controlled on a per-user basis by the parameters in
/etc/login.conf. You can check your current limit by running 'ulimit -a'
but the output depends on what shell you're using.

>no memory for rx list, etc.

This last error is your network card complaining about nmbclusters.

>Does this give suggestions on parameters to tweak 
>(just increase nmbclusters more) or am
>I asking too much from the system?  I would like to
>get a strategy that FreeBSD/apache starts to go slow 
>rather than barfs when it starts to get under
>excessive load - if this is a reasonable request.  

It's not barfing - it is merely complaining that its maxed out the
resources that you allowed it to use. The problem comes when you need to
balance out the maximum that your applications can use and just how
"slow" you actually want your machine to go. We're only really talking
about network settings here, mind.

>(I should note that FreeBSD even in default mode is
>majorly out-performing my SGI O2 on these benchmarks
>and seems to be doing better than the computer mentioned
>in 

Good good, it's what we like to hear ;)

-Steven

Part of Initial Summary Post and Results to FreeBSD Users Mailing List

Doing the various tweaks and recompiling the kernel with
an elevated maxusers has majorly improved the ability of 
FreeBSD 4.2 to wade through these ApacheBench tests fax
is excess of what was expected was possible (Spare 
Pentium 300 PC with 128 Meg RAM, Apache 1.3.14 and 
FreeBSD 4.2 and recompiled kernel, Max users = 128, 
kern.ipc.nmbclusters= 30000, kern.maxfilesperproc=2048 ):

Summary of posts, possibly flawed tutorials and various waffle 
still at:
  
 http://www.ccp14.ac.uk/solution/bsdunix/optimise_freebsd_for_apache.html

Cheers,

Lachlan.

========================================================================

LIGHT TASK - LIGHT FILE:

/usr/local/apache/bin/ab -n 100 -c 10 http://ccp14vig1.dl.ac.uk/test/test.pl

This is ApacheBench, Version 1.3c [$Revision: 1.41 $] apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-1999 The Apache Group, http://www.apache.org/

Server Software:        Apache/1.3.14
Server Hostname:        ccp14vig1.dl.ac.uk
Server Port:            80

Document Path:          /test/test.pl
Document Length:        281 bytes

Concurrency Level:      10
Time taken for tests:   0.163 seconds
Complete requests:      100
Failed requests:        0
Non-2xx responses:      105
Total transferred:      45990 bytes
HTML transferred:       29505 bytes
Requests per second:    613.50
Transfer rate:          282.15 kb/s received

Connnection Times (ms)
              min   avg   max
Connect:        0     4     9
Processing:    12    10    14
Total:         12    14    23

========================================================================

HEAVY TASK - LIGHT FILE:

/usr/local/apache/bin/ab -n 10000 -c 1000 http://ccp14vig1.dl.ac.uk/test/test.pl

This is ApacheBench, Version 1.3c [$Revision: 1.41 $] apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-1999 The Apache Group, http://www.apache.org/

Server Software:        Apache/1.3.14
Server Hostname:        ccp14vig1.dl.ac.uk
Server Port:            80

Document Path:          /test/test.pl
Document Length:        281 bytes

Concurrency Level:      1000
Time taken for tests:   16.760 seconds
Complete requests:      10000
Failed requests:        0
Non-2xx responses:      10056
Total transferred:      4404528 bytes
HTML transferred:       2825736 bytes
Requests per second:    596.66
Transfer rate:          262.80 kb/s received

Connnection Times (ms)
              min   avg   max
Connect:        4    97  9148
Processing:   247   391   481
Total:        251   488  9629

========================================================================

LIGHT TASK - HEAVY FILE:

/usr/local/apache/bin/ab -n 100 -c 10 http://ccp14vig1.dl.ac.uk/csiro/

This is ApacheBench, Version 1.3c [$Revision: 1.41 $] apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-1999 The Apache Group, http://www.apache.org/

Server Software:        Apache/1.3.14
Server Hostname:        ccp14vig1.dl.ac.uk
Server Port:            80

Document Path:          /csiro/
Document Length:        87712 bytes

Concurrency Level:      10
Time taken for tests:   0.625 seconds
Complete requests:      100
Failed requests:        0
Total transferred:      8796300 bytes
HTML transferred:       8771200 bytes
Requests per second:    160.00
Transfer rate:          14074.08 kb/s received

Connnection Times (ms)
              min   avg   max
Connect:        3     9    15
Processing:    57    52    48
Total:         60    61    63

========================================================================

HEAVY TASK - HEAVY FILE:

/usr/local/apache/bin/ab -n 10000 -c 1000 http://ccp14vig1.dl.ac.uk/csiro/

This is ApacheBench, Version 1.3c [$Revision: 1.41 $] apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-1999 The Apache Group, http://www.apache.org/

Server Software:        Apache/1.3.14
Server Hostname:        ccp14vig1.dl.ac.uk
Server Port:            80

Document Path:          /csiro/
Document Length:        87712 bytes

Concurrency Level:      1000
Time taken for tests:   73.549 seconds
Complete requests:      10000
Failed requests:        0
Total transferred:      884710785 bytes
HTML transferred:       882177442 bytes
Requests per second:    135.96
Transfer rate:          12028.86 kb/s received

Connnection Times (ms)
              min   avg   max
Connect:        2   179 45182
Processing:   191  1962  2100
Total:        193  2141 47282

Recompiling to give a robust Kernel by tweaking maxusers

(Warning: Number may have to be varied depending on your custom requirements and hardware)

(This involves compiling a custom kernel - you will need to download the kernel sources)

Refer:
FreeBSD Handbook (The FreeBSD Documentation Project): http://www.freebsd.org/handbook/index.html
FreeBSD Handbook: Configuring the FreeBSD Kernel: http://www.freebsd.org/handbook/kernelconfig.html
FreeBSD Handbook: Configuring the FreeBSD Kernel: Why Build a Custom Kernel?: http://www.freebsd.org/handbook/x2437.html
FreeBSD Handbook: Configuring the FreeBSD Kernel: Building and Installing a Custom Kernel: http://www.freebsd.org/handbook/kernelconfig-building.html
FreeBSD Handbook: Configuring the FreeBSD Kernel: The Configuration File: http://www.freebsd.org/handbook/kernelconfig-config.html
FreeBSD Handbook: Configuring the FreeBSD Kernel: If Something Goes Wrong: http://www.freebsd.org/handbook/kernelconfig-trouble.html
If using bash shell = "ulimit -a" to see the bash shell resources

Making sure you read the above web pages and do the other things it advices. This assumes you have not upgraded from the CVS Source.

Copy the generic Kernel Configuration File from /usr/src/sys/i386/conf/GENERIC to /usr/src/sys/i386/conf/TWEAK

cp /usr/src/sys/i386/conf/GENERIC /usr/src/sys/i386/conf/TWEAK

Now edit the TWEAK file to make changes so you don't interfer with the GENERIC config file.

vi /usr/src/sys/i386/conf/TWEAK

Find maxusers and change this to the required value (default is 32) - a suggested value is 512

(Specifying the CPU type: "you can use the dmesg command to view your boot up messages" - good if you want to specify only the type of CPU you have on the Computer - and a recommended thing to do for custom FreeBSD kernels)

cd /usr/src/sys/i386/conf

/usr/sbin/config TWEAK

cd ../../compile/TWEAK

make depend

make

make install

Now, in theory, i) Reboot and be happy or ii) Reboot and have problems with failure of FreeBSD to boot and run properly. If problems, refer to FreeBSD Handbook: Configuring the FreeBSD Kernel: If Something Goes Wrong:

Tweaking the kernel for nmbclusters

(Before playing around with this, first try things out with only doing a maxusers=512)

(Warning: Number may have to be varied depending on your custom requirements and hardware)

running sysctl -a will give you an overview to the kernel setting. NMBCLUSTERS is only set for 1024 (with maxusers=16).

Or use:

sysctl kern.ipc.nmbclusters
kern.ipc.nmbclusters: 1024

After reading /boot/loader.help, Look in /boot/default/loader.conf and copy the line referencing nmbclusters to /boot/loader.conf (uncommenting it, of course).

This is under Kernel tunables, enable the kern.ipc.nmbclusters line and set the number you want:

kern.ipc.nmbclusters="10000"

or if that is not enough(?)

kern.ipc.nmbclusters="30000"

Now reboot and good times should be yours for the moment.

Tweaking maxfiles

(Before playing around with this, first try things out with only doing a maxusers=512)

(Warning: Number may have to be varied depending on your custom requirements and hardware)

Checking /etc/login.conf shows what the per-user limits are. In a default install, these are set to unlimited

Now look at changing the overall system wide number of maxfiles.

sysctl kern.maxfiles gives (with maxusers=16)
kern.maxfiles: 1064
sysctl kern.maxfiles gives
kern.maxfilesperproc: 1064

sysctl -a | grep maxfile gives
kern.maxfiles: 1064
kern.maxfilesperproc: 1064

To enable this immediately, do:

sysctl -w kern.maxfiles=2048
sysctl -w kern.maxfilesperproc=2048

To have this always set at boot time:

Add the following to /etc/sysctl.conf

kern.maxfiles=2048
kern.maxfilesperproc=2048

Now, again, good times should be yours for the moment. Tweak as required.

Misc stuff for possible future use

sysctl -a | grep 1024

sysctl -w net.inet.ip.portrange.first=4096

sysctl -w net.inet.tcp.v6mssdflt=4096

vi /etc/login.conf

sysctl -w kern.ipc.somaxconn=1024 (listen queue length - 128 is the default with maxusers=512)

Some test runs that can be done with ab (apachebench) - use your own example files - script or static HTML.

apache webserver performance testing tools
- httperf - webserver Benchmarking tool, http_load - another webserver Benchmarking tool, ab - ApacheBench (comes with apache), Daquiri - yet another webserver Benchmarking tool
- At http://perl.apache.org/guide/download.html#httperf_webserver_Benchmarking
Web Server Comparisons - comparing apache, thttpd, etc.
- "...factoring out I/O, the primary determinant to server performance is the concurrency strategy."
- apache in this test - barfs at around 125 simultaneous users.
- At http://www.acme.com/software/thttpd/benchmarks.html
JAWS: Understanding High Performance Web Systems
- At http://www.cs.wustl.edu/~jxh/research/research.html

Click here for zip file with: Small, Medium and Large HTML test files

Click here for tar.Z file with: Small, Medium and Large HTML test files

c = Number of simultaneous users (Concurrency Level)
n = Number of request per user (the per user load)

LIGHT LOAD STATIC FILE (~1.5 kB file)

/usr/local/apache/bin/ab -n   10   -c 10 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n  100   -c 10 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 1000   -c 10 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 10000  -c 10 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 100000 -c 10 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 5000   -c 10 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n  150   -c 150 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n  500   -c 150 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 1500   -c 150 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 5000   -c 150 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n  250   -c 250 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n  500   -c 250 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 2500   -c 250 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 5000   -c 250 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n  300   -c 300 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n  500   -c 500 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 1000   -c 500 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 5000   -c 500 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 1000   -c 1000 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 10000  -c 1000 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 1010   -c 1010 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 1024   -c 1024 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 1025   -c 1025 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 1250   -c 1250 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 1500   -c 1500 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 2000   -c 2000 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 20000  -c 2000 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 5000   -c 5000 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 50000  -c 5000 http://ccp14vig1.dl.ac.uk/small.html

/usr/local/apache/bin/ab -n 100000 -c 10000 http://ccp14vig1.dl.ac.uk/small.html

DECENT LOAD STATIC FILE (~140 kB file)

/usr/local/apache/bin/ab -n   10   -c 10 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n  100   -c 10 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 1000   -c 10 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 10000  -c 10 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 100000 -c 10 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 5000   -c 10 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n  150   -c 150 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n  500   -c 150 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 1500   -c 150 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 5000   -c 150 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n  250   -c 250 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n  500   -c 250 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 2500   -c 250 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 5000   -c 250 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n  300   -c 300 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n  500   -c 500 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 1000   -c 500 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 5000   -c 500 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 1000   -c 1000 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 10000  -c 1000 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 1010   -c 1010 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 1024   -c 1024 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 1025   -c 1025 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 1250   -c 1250 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 1500   -c 1500 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 2000   -c 2000 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 20000  -c 2000 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 5000   -c 5000 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 50000  -c 5000 http://ccp14vig1.dl.ac.uk/medium.html

/usr/local/apache/bin/ab -n 100000 -c 10000 http://ccp14vig1.dl.ac.uk/medium.html


HEAVY LOAD STATIC FILE (~670 kB file)

/usr/local/apache/bin/ab -n   10   -c 10 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n  100   -c 10 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 1000   -c 10 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 10000  -c 10 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 100000 -c 10 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 5000   -c 10 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n  150   -c 150 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n  500   -c 150 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 1500   -c 150 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 5000   -c 150 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n  250   -c 250 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n  500   -c 250 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 2500   -c 250 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 5000   -c 250 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n  300   -c 300 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n  500   -c 500 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 1000   -c 500 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 5000   -c 500 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 1000   -c 1000 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 10000  -c 1000 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 1010   -c 1010 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 1024   -c 1024 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 1025   -c 1025 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 1250   -c 1250 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 1500   -c 1500 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 2000   -c 2000 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 20000  -c 2000 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 5000   -c 5000 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 50000  -c 5000 http://ccp14vig1.dl.ac.uk/large.html

/usr/local/apache/bin/ab -n 100000 -c 10000 http://ccp14vig1.dl.ac.uk/large.html

[Apache, Redhat and FreeBSD comparison] | [Optimising FreeBSD for Apache and High Performance web serving]

[Back to Problems and Solutions]
[Back to: BSD UNIX Information for Crystallography] [To: Linux Information for Crystallography]

[CCP14 Home: (Frames \| No Frames)] CCP14 Mirrors: [UK] \| [CA] \| [US] \| [AU]	What's New	Introduction	Site Map
Search the CCP14	Download Programs What do you want to do? (lists of software by crystallographic method)	Tutorials	Solutions

(This Webpage Page in No Frames Mode)

If you have any queries or comments, please feel free to contact the CCP14