+ All Categories
Home > Documents > Benchmarking On Web Server For Budget 2008 Day

Benchmarking On Web Server For Budget 2008 Day

Date post: 08-May-2015
Category:
Upload: harisfazillah-jamel
View: 1,938 times
Download: 0 times
Share this document with a friend
Description:
Benchmarking On Web Server For Budget 2008 Day by OSCC MAMPU
31
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE (OSS) PROGRAMME BENCHMARK/EVALUATION REPORT on WEB SERVERS for BUDGET 2008 DAY AUGUST 2008
Transcript
Page 1: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR

OPEN SOURCE SOFTWARE (OSS)

PROGRAMME

BENCHMARK/EVALUATION REPORT

on WEB SERVERS for BUDGET 2008 DAY

AUGUST 2008

Page 2: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Copyright

The government of Malaysia retains the copyright of this document.

Page 3: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Table of Contents

1.0 EXECUTIVE SUMMARY.....................................................................................................12.0 INTRODUCTION..................................................................................................................1

2.1 Background ......................................................................................................................12.2 Purpose ............................................................................................................................22.3 Scope .............................................................................................................................3

2.3.1 Benchmarking activities ............................................................................................32.3.2 Visitor access statistic ..............................................................................................32.3.3 Personnel involved ...................................................................................................4

3.0 METHODOLOGY ................................................................................................................53.1 Benchmarking methodology ............................................................................................53.2 Visitor access recording and statistic generation ............................................................5

4.0 BENCHMARKING REPORT ...............................................................................................64.1 Benchmarking Activities..................................................................................................6

4.1.1 Experimental Setup ..................................................................................................64.1.2 Test System Specification And Configuration ...........................................................74.1.3 Commands Used ......................................................................................................7

4.2 Result of Benchmarking Exercise ..................................................................................94.2.1 Apache Web Server 2.2.3 .........................................................................................94.2.2 Lighttpd Web Server 1.4.15-1 ................................................................................10

4.3 Proposed Infrastructure Solution ...................................................................................115.0 BUDGET DAY SERVER OPERATION REPORT .............................................................13

5.1 Server Preparation Activities .......................................................................................135.2 Production Server Setup & Configuration ...................................................................13

5.2.1 Sysctl.conf ..............................................................................................................135.2.2 Synchronization scripts ..........................................................................................14

5.3 Budget Day Operation Report .....................................................................................175.4 Visitors Statistic For The Budget Day ..........................................................................17

5.4.1 General statistic ......................................................................................................175.4.2 Visitors per hour......................................................................................................185.4.3 Visitors by countries (Top 20) .................................................................................195.4.4 Visitors by operating system types..........................................................................205.4.5 Visitors by browser types.........................................................................................20

6.0 BENEFITS OF OSCC'S PARTICIPATION ........................................................................217.0 CONCLUSION ..................................................................................................................228.0 APPENDICES ..................................................................................................................24

8.1 Snapshot Treasury Portal during the Budget Day .........................................................248.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo embedded ...........258.3 Snapshot of Awstats reports...........................................................................................268.4 Snapshot of appreciation letter from MOF.....................................................................27

Page 4: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

1.0 EXECUTIVE SUMMARY

This document is designed to provide detailed report of all exercises done by OSCC during

their participation in preparing a dedicated web server for the Budget 2008 presentation day

conducted by the Ministry Of Finance (MOF). Due to a massive visitor access spike projected

during the budget day, OSCC team has been assigned to propose, set up and maintain a web

server infrastructure solution based on Open Source technology that is reliable to handle the

visitor surge, secure and cost saving. This solution is meant to replace the solution adopted

by MOF for the past years that are too expensive and complex. The solution provided by

OSCC has successfully performs reliably and receives more than 130,000 page views

without any problem. The solution also saves MOF a huge amount of money as it eliminates

the need of expensive hardwares and it only uses a single unit of server equipped with free

Open Source softwares. All activities, findings and information will be presented in detail

within this report which will be used as source of reference for similar implementation in the

future.

2.0 INTRODUCTION

2.1 Background

Over the years Ministry Of Finance's (MOF) website (http://www.treasury.gov.my) receives a

huge number of web accesses particularly during the national budget day presentation. These

spikes of requests were caused by a large number of visitors trying to get information

concerning the upcoming year's budget and also downloading the Malaysia Economic

Reports in digital format documents. Visitors also access the website to get information about

the live video broadcast of the presentation, and for this purpose the treasury website only

provide a web URL to a third party portal that handles the web broadcast. For the past years

OSCC had involved whether directly or indirectly in providing consultancy and human

expertise in preparing a suitable server solution for the budget presentation day. It was

Page 1

Page 5: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

reported that in 2005, during the Malaysian Budget 2006 presentation day, such huge visitor

accesses had caused the web server to stall due to the excessive load congesting the server

resources. This event had caused denial of service state to the server thus causing failure of

web access requests to the visitors. To prevent the situation from happening again, for the

Malaysian Budget 2007 presentation day in 2006, drastic approaches have been taken. An

alternative server infrastructure consists of several unit of servers with load balancing

approach was implemented to substitute the actual web server only for the budget days

period. This solution was installed a few days prior to the budget date and being

decommissioned several days after once visitor access numbers back to normal day to day

routine. The solution had proven to be reliable as there are no denial of access reported but

for MOF's view, it was somewhat too expensive and too complicated and they are seeking for

a more practical and economical approach for the next national budget day. In August 2007,

OSCC once again been invited to provide consultancy and to facilitate the preparation

process for the Malaysian Budget 2008 presentation day. Both R&D and Technical Unit of

OSCC involved cooperatively to propose, design, install and operates a suitable server

solution for the budget day.

2.2 Purpose

The purpose of this document is to:-

1. Identify suitable web server infrastructure solution to be applied by Ministry Of Finance

for the Budget 2008 presentation day

2. To identify whether or not a server load balancing formation is needed to handle high

web access request on the particular day

3. To determine which type of web server package to be used

4. To provide reports of operations initiated during the actual budget presentation day

5. To present web access statistic captured for the whole budget day

6. To table any related findings gathered during and after the operation day

Page 2

Page 6: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

The testing is not in any way done to declare which web server application is better compared

to others, but merely to find which solution is the most suitable within the scope of our specific

requirement. Therefore, any results, findings and recommendation provided in this report

should not be considered as a generalized head to head comparison.

2.3 Scope

2.3.1 Benchmarking activities

Only two web servers software were selected to be the testing subjects which were Apache

(http://www.apache.org) and Lighttpd (http://www.lighttpd.net). All testing activities were done

on machines with the same hardware specifications, identical operating systems and similar

configurations and performance tuning settings. All testing were done in a lab located in

OSCC. All network connections were Local Area Network in nature which means that

maximum network bandwidth should be approximately 100Mbps.

2.3.2 Visitor access statistic

This report examines visitor activity log data for the website www.treasury.gov.my only for the

budget presentation day which is on the 7th September 2007. Only genuine human visitor will

be counted in the analysis and no visits or page hits by automated robots such as crawler,

bots and external data mining agents will be used within this report.

Due to the internet nature of 'the world without boundaries', visitor origins in the analysis will

be from all over the world which is not limited to specific geographical location. Data that will

be taken into consideration are hourly unique visitors and visitors which are divided by

countries. The analysis will also provide comparison between operating system types and

internet browser types to estimate the percentage in term of users who are using open source

technologies.

Page 3

Page 7: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

2.3.3 Personnel involved

Both RND and technical teams were involved directly with this project. There were also a

number of personnel from MOF participate in various activities throughout the server

benchmarking, server preparation and during operation day.

OSCC personnel involved in the benchmarking activities:

1. Haris (R&D Unit)

2. Jamal (R&D Unit)

3. Hisham (Technical Unit)

4. Azizul (Technical Unit)

5. Maisarah (R&D Unit)

6. Indhran (R&D Unit)

OSCC personnel involved for the server preparation and operation day:

1. Haris (R&D Unit)

2. Jamal (R&D Unit)

3. Hisham (Technical Unit)

4. Azizul (Technical Unit)

Page 4

Page 8: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

3.0 METHODOLOGY

3.1 Benchmarking methodology

The benchmarking activities were done using an open source web server stress test tool

called ApacheBench (AB). ApacheBench is a command line computer program for measuring

the performance of HTTP web servers, in particular the Apache HTTP Server. It was designed

to give an idea of the performance that a given Apache installation can provide. In particular, it

shows how many requests per second the server is capable of serving. A series of testing

were done on each test subject and the results were recorded. On each occasion, a number

of connections and quantity of concurrency were pre-determined. If the test finished

successfully, meaning all request been served effectively by the test subject without any failed

or denied request, the number of concurrency will be increased and another round of test will

be done. The procedures were repeated until the subject matters fail to serve. This would

mean that the limit of connection that the particular web server can handle has been found.

By using this method, a comparison can be made on which web server has the capability to

serve the highest number of connections and maintain availability through sudden spike of

visitor access.

3.2 Visitor access recording and statistic generation

Throughout the operation process including the budget presentation day, no additional

monitoring tools were used on the web server rather than the conventional web server log

capability provided by both Apache and Lighttpd. This is to minimize resource usage of the

particular server to keep the free of unnecessary overhead. The web server logs are kept in

the access_log. Analyses were done to the log after the budget day to generate meaningful

statistic using an open source log analyzer tool called Awstat (http://awstats.sourceforge.net).

AWStats is a free powerful and featureful tool that generates advanced web, streaming, ftp or

mail server statistics, graphically. This log analyzer works as a CGI or from command line and

shows you all possible information your log contains, in few graphical web pages. It uses a

partial information file to be able to process large log files, often and quickly. It can analyze

Page 5

Page 9: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

log files from all major server tools like Apache log files (NCSA combined/XLF/ELF log format

or common/CLF log format), WebStar, IIS (W3C log format) and a lot of other web, proxy,

wap, streaming servers, mail servers and some ftp servers.

4.0 BENCHMARKING REPORT

4.1 Benchmarking Activities

4.1.1 Experimental Setup

A series of benchmarking activities were done using the Apache Bench tool. 2 servers with

identical hardware specification, Operating System and configurations were installed

with Apache and Lighttpd respectively.

Machine A :

IP address : 10.20.20.51

Apache 2.2.3

Machine B :

IP address : 10.20.20.52

Lighttpd 1.4.15-1

Another machine was being set up as the testing terminal where the benchmarking and stress

test tool will be executed. This machine was equipped with the Apache Bench Tool.

Page 6

Page 10: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

4.1.2 Test System Specification And Configuration

All machines specification are identical. Using the same hardware model, operating system

and configurations.

Maker Model HP DC770

Processor Intel(R) Pentium(R) D CPU 3.20GHz

RAM 512 MB

Hard Disk 40 GB

Operating System Linux CentOS 5

4.1.3 Commands Used

Command used to launch the benchmarking process

ab –n 10000 –c xxx http://ipaddress/

Where :-

–n is the number of connections to be generated during the test emulating the number of web

access estimated to be received by the server within a specific timeframe (approximately

below 20 seconds) during the budget day. The value 10000 was pre-determined by the

team as the appropriate number of estimated connection judging by the projected number of

web access for the upcoming budget day based on the past years pattern.

–c is the number of concurrent connection that will take place during the series of tests. This

is the most crucial element within the benchmarking activities, understanding that the aspect

of availability should be the highest priority in the choosing the most suitable solution. For

each round of testing, the number of concurrent connection will be increased until error

encountered which signals the actual limit where the web server capable of serving.

Example : ab –n 10000 –c 500 http://10.20.20.52/

*Testing the Machine B with 10000 number of connection with 500 number of concurrency.

During the test, system resource utilization was monitored and logged using vmstat

Page 7

Page 11: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

command. This was to find any spike of resource usage or any occurrence of I/O bottleneck.

Several data that were closely monitored were:

CPU Idle To determine whether any excessive CPU usage

occurred during the stress test process. High CPU

Idle status means that the system is healthy

Free Memory To determine whether any excessive RAM usage

occurred during the stress test process. High Free

Memory status means that the system is

healthy

Page 8

Page 12: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

4.2 Result of Benchmarking Exercise

4.2.1 Apache Web Server 2.2.3

Number of request (n) = 10,000

On each test round, Apache failed to surpass 400 concurrency connection level.

Page 9

Page 13: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

4.2.2 Lighttpd Web Server 1.4.15-1

Number of request (n) = 10,000

Page 10

Page 14: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Based on the above results, it is clear that Lighttpd capable of handling larger number of

concurrent web requests compared to Apache when it comes to serving static web contents.

The above rounds of tests were repeated a few times but the outcome persists. In addition,

the team also tried a larger number of requests to the Lighttpd server which was supposedly

beyond the scope of testing by increasing the –n number and the –c number and lighttpd

proves to have the ability to withstand them.

4.3 Proposed Infrastructure Solution

Based on the results of the testing, the team has decided to opt for Lighttpd as the web server

to use. We are confident that a single server with adequate hardware specification, equipped

with Lighttpd could withhold the high number of web access requests during the budget day

provided that the server only servers static contents without any server side scripting nor any

king of database connectivity involved. To make sure that the server uses resources efficiently

and to increase stability, several modifications and fine tuning configurations will be done to

the production server. These include CPU & RAM allocation and kernel optimization tuning.

Unneeded services were also turned off minimize resource overhead. All software installation,

modification and tuning processes will be done by OSCC with assistance of MOF personnel.

In addition, one unit of standby server will be also placed alongside the production server for

Page 11

Page 15: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

contingency measure such as in the event of hardware failure to the primary server. The

standby server also has the same configuration and contents as the production server with

almost identical hardware specification. The team had also suggested the use of multiple

servers located in different data centers if in case large binary files such as 'self extracting

compilation of economic reports' were going to be served and made available to the public as

what have been done in the previous years. Those servers will act as the alternatives

download locations listed as download links within the download page in the main portal,

where visitors can choose from. This method will reduce the burdens of the primary portal.

Those server were also equipped with Lighttpd where minimal hardware specification as low

as a Personal Computer (PC) specification could be used.

Based on mutual agreement with MOF, three alternative download locations were identified.

Those three servers are:

• The standby server which are located in NetMyne Datacenter alongside primary server

• One unit of server located at Ministry of Finance

• One unit of server located at OSCC

A simple bash script was created to handle synchronization among servers to make sure that

all servers have the same up-to-date web contents. The scripts will be provided in the later

part of this document.

*** However during the budget day, none of the alternative download servers were utilized, as

there are no large binary files were served by MOF, and the main server showed no indication

of congestion and it's resource utilization were successfully kept at the very minimum.

Page 12

Page 16: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Overview of the proposed server structure for Budget 2008 presentation day

Page 13

Page 17: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.0 BUDGET DAY SERVER OPERATION REPORT

5.1 Server Preparation Activities

All servers has been freshly installed with Linux CentOS 5 one week before the actual event.

Several round of stress test were done on all machines to make sure they don't have any

problem particularly on the hardware aspect. An overnight stress test also have be done using

combination of AB stress tool and cron job to make sure that the servers are stable.

5.2 Production Server Setup & Configuration

5.2.1 Sysctl.conf

Exact file location: /etc/sysctl.conf

#additional parameter to increase performance kernel.shmmax = 436883456

kernel.shmall = 268435456

kernel.sem = 500 51200 64 2048

kernel.shmmni = 4096

fs.file-max = 65536

net.core.rmem_default = 262144

net.core.wmem_default = 262144

net.core.rmem_max = 262144

net.core.wmem_max = 262144

net.ipv4.ip_local_port_range = 1024 65000

kernel.msgmni = 2048

kernel.msgmax = 65536

vm.page-cluster = 20

net.ipv4.tcp_rmem = 4096 87380 16777216

net.ipv4.tcp_wmem = 4096 87380 16777216

net.ipv4.tcp_tw_reuse = 1

Page 14

Page 18: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.2.2 Synchronization scripts

The main script (called via command line at the primary server by the system administrator)

Exact file location: /usr/local/bin/rsync-mof

#!/bin/bash # mirror-script.sh # created by Jamal if [ $(whoami) = bajet08 ]; then echo -e "\n\nProcess started. Please wait..." /usr/local/bin/rsync-mdec2 sleep 1 /usr/local/bin/rsync-oscc sleep 1 /usr/local/bin/rsync-treasury echo -e "Process finished\n\n" else echo -e "Denied: Only bajet08 user can run this script\n" fi

The above script will launch three series of rsync instances.

/usr/local/bin/rsync-mdec2

#!/bin/sh # mirror-script.sh # created by Jamal DATE=`/bin/date +%y%m%d-%H%M%S` OUTFILE=/var/log/mirror/mdec2-$DATE.log date >> /var/log/mirror/mdec2-exec.log if [ -f "/home/bajet08/rsync-mof.pid" ]; then RUNPID=`cat /home/bajet08/rsync-mof.pid` if ps -p $RUNPID; then echo "Mirror is already running..." echo "Mirror is already running..." >> /var/log/mirror/mdec2- exec.log exit 1 else echo "Mirror pid found but process dead, cleaning up" >> /var/log/mirror/mdec2-exec.log fi

Page 15

Page 19: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

else echo "No process Detected" >> /var/log/mirror/mdec2-exec.log fi echo $$ > /home/bajet08/rsync-mof.pid echo -n "MDEC2 Server Mirroring Started at " echo "Mirror Started " >> /var/log/mirror/mdec2-exec.log date #$rsync $mirror $local > $OUTFILE 2>&1 /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \ /var/www/html/ 202.75.59.26:/var/www/html > $OUTFILE 2>&1

/usr/local/bin/rsync-oscc

#!/bin/sh # mirror-script.sh # created by Jamal DATE=`/bin/date +%y%m%d-%H%M%S` OUTFILE=/var/log/mirror/oscc-$DATE.log date >> /var/log/mirror/oscc-exec.log if [ -f "/home/bajet08/rsync-mof.pid" ]; then RUNPID=`cat /home/bajet08/rsync-mof.pid` if ps -p $RUNPID; then echo "Mirror is already running..." echo "Mirror is already running..." >> /var/log/mirror/oscc-exec.log exit 1 else echo "Mirror pid found but process dead, cleaning up" >> /var/log/mirror/oscc-exec.log fi else echo "No process Detected" >> /var/log/mirror/oscc-exec.log fi echo $$ > /home/bajet08/rsync-mof.pid echo -n "OSCC Server Mirroring Started at " echo "Mirror Started " >> /var/log/mirror/oscc-exec.log date /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \ /var/www/html/ 210.187.27.213:/var/www/html > $OUTFILE 2>&1

Page 16

Page 20: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

/usr/local/bin/rsync-treasury

#!/bin/sh # mirror-script.sh # created by Jamal DATE=`/bin/date +%y%m%d-%H%M%S` OUTFILE=/var/log/mirror/treasury-$DATE.log date >> /var/log/mirror/treasury-exec.log if [ -f "/home/bajet08/rsync-mof.pid" ]; then RUNPID=`cat /home/bajet08/rsync-mof.pid` if ps -p $RUNPID; then echo "Mirror is already running..." echo "Mirror is already running..." >> /var/log/mirror/treasury- exec.log exit 1 else echo "Mirror pid found but process dead, cleaning up" >> /var/log/mirror/treasury-exec.log fi else echo "No process Detected" >> /var/log/mirror/treasury-exec.log fi echo $$ > /home/bajet08/rsync-mof.pid echo -n "Treasury Server Mirroring Started at " echo "Mirror Started " >> /var/log/mirror/treasury-exec.log date /usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no -i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \ /var/www/html/ 202.75.6.53:/var/www/html > $OUTFILE 2>&1

Page 17

Page 21: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.3 Budget Day Operation Report

Several OSCC staffs have been located at all critical points where the servers reside. Each of

them will monitor the log files activity of each server for any kind of problem. Live report file

uploading processes were done by MOF's staff directly to the primary server and the

synchronization scripts will distribute and duplicate the changes to other backup servers.

There are no occurrence of error detected for the whole day and the backup servers were not

utilized at all as the primary server shows any symptom of resources drainage.

5.4 Visitors Statistic For The Budget Day

Below is the visitor statistic collected during the Budget 2008 Presentation Day which was

held on 7th September 2007. All data were taken from web access log and was analyzed

using Awstats. Only the primary server was used during that day, therefore all statistics shown

here are purely from a single server.

5.4.1 General statistic

Date : 7th September 2007

Total number of unique visitors 9, 874

Total number of visits 12, 796 (1.29 visits/visitor)

Total number of pages viewed 130, 398 (10.19 Pages/Visit)

Total number of hits generated 519, 184 (40.57 Hits/Visit)

Total bandwidth consumed 4.58 GB (374.95 KB/Visit)

Page 18

Page 22: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.4.2 Visitors per hour

Hours Pages Hits Bandwidth

00:00 am 282 1263 7,619,401

01:00 am 145 601 4,713,187

02:00 am 114 486 3,400,969

03:00 am 96 377 2,695,992

04:00 am 56 160 973,597

05:00 am 45 144 1,096,283

06:00 am 110 504 3,377,156

07:00 am 671 3,800 18,702,079

08:00 am 1,979 10,428 56,068,174

09:00 am 2,505 11,851 70,603,683

10:00 am 2,739 12,972 79,936,375

11:00 am 3,046 14,192 79,977,401

12:00 pm 2,192 10,347 59,969,313

01:00 pm 1,626 7,457 44,138,365

02:00 pm 5,388 23,544 142,280,704

03:00 pm 16,097 76,505 393,637,888

04:00 pm 32,647 150,655 580,046,848

05:00 pm 28,605 104,234 1,040,812,032

06:00 pm 12,070 33,375 835,983,360

07:00 pm 5,166 16,029 343,683,072

08:00 pm 3,335 11,222 264,849,408

09:00 pm 5,187 12,175 405,623,808

10:00 pm 4,551 10,335 380,430,336

11:00 pm 1,746 6,529 92,384,038 * The above data doesn't includes traffic generated by robots, worms,

or replies with special HTTP status codes.

Page 19

Page 23: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.4.3 Visitors by countries (Top 20)

No Country Pages Hits Bandwidth

1. Malaysia 119,908 485,441 4.29 MB

2. United States 2,559 7,589 59.42 MB

3. Singapore 2,468 6,838 61.50 MB

4. Japan 1,125 3,672 20.01 MB

5. Australia 715 2,862 22.97 MB

6. India 551 953 45.21 MB

7. Hong Kong 541 2,103 12.63 MB

8. European country 439 1,640 14.87 MB

9. Great Britain 379 1,422 17.34 MB

10. France 191 755 3.86 MB

11. Indonesia 179 636 4.95 MB

12. China 161 672 3.30 MB

13. Germany 154 466 3.92 MB

14. South Korea 134 646 2.31 MB

15. Philippine 74 198 1.62 MB

16. Taiwan 67 290 1.97 MB

17. New Zealand 61 278 1.24 MB

18. Qatar 48 141 1.56 MB

19. Switzerland 45 224 1.22 MB

20. United Arab Emirates 42 177 0.53 MB

Page 20

Page 24: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.4.4 Visitors by operating system types

Operating Systems Hits Percent

1. Windows 500,848 96.40%

2. Unknown 14,574 2.80%

3. Macintosh 1,829 0.30%

4. Linux 1,559 0.30%

5. Symbian OS 332 0%

6. Sun Solaris 42 0%

5.4.5 Visitors by browser types

Browsers Hits Percent

1. MS Internet Explorer 445,607 85.80%

2. Firefox 54,316 10.40%

3. NetAnts 10,638 2.00%

4. Mozilla 2,244 0.40%

5. Unknown 1,919 0.30%

6. Opera 1,826 0.30%

7. Safari 1,764 0.30%

8. Netscape 570 0.10%

9. RssReader (RSS Reader) 82 0%

10. K-Meleon 37 0%

11. Others 181 0%

Page 21

Page 25: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

6.0 BENEFITS OF OSCC'S PARTICIPATION

Benefits for OSCC

1. OSCC gained significant visibility during Budget Day 2008 by having its logo

embedded within the treasury.gov.my website from 2.00pm until 5.00pm. More than

250,000 hits generated during that time-frame.

2. Valuable knowledge based on research about comparison between 2 open-source web

server (Apache/Lighttpd).

3. Data will be used for OSCC OSS benchmarking reports as part of RND department

deliverables

4. Transfer of technology, exposure and knowledge sharing about Open Source

technology to MOF.

5. Providing solid proof about reliability, flexibility and future potential of open source

products .

6. Valuable lessons and experience for all OSCC Technical and RND department staffs .

7. Helping MOF in substantially reducing the total cost for preparing budget day server

compared to previous years.

Page 22

Page 26: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

7.0 CONCLUSION

Overall, our recommended server infrastructure solution performs reliably in serving such high

number of web access for the www.treasury.gov.my portal during the budget 2008

presentation day. All requests were successfully served and the server did not encounter

any kind of problem such as network congestion or service interruption during the production

period. The resource utilization of the server also kept at very minimum with majority of the

system resources such as CPU and RAM were underutilized which means that the same

setup could theoretically handles even larger number of web access request in the future if

the same infrastructure solution and practices were to be reused.

Both MOF and OSCC have gained valuable experiences and knowledge throughout each of

the project phase especially during the benchmarking, installation and production phase.

Those knowledge and experience would be helpful in improving OSCC operation most

importantly in the technical aspects in the future. The benchmarking activities have provided

valuable knowledge especially in realizing the solidness of open source web server products

particularly for Lighttpd web application. Although the team did not took the results as

absolute declaration of which web server is the better compared to others as there a a lot of

external variables should be considered in making any justification, nevertheless it was a

good indicator of the wide variety of possibilities offered by the open source world where there

are so many alternatives to choose from in catering any specific needs.

Based on number of visitors divided by operating system types and internet browser types,

Microsoft has proven that they dominated the operating system and internet browser

application market especially for desktop workstation among the internet users particularly in

Malaysia. This information is crucial to the future strategic planning for OSCC as it could be

used as a guideline or reference in tabulating the trend of open source usage among the

Malaysian people. Only 0.30% of the total visitors were using Linux operating system while for

Page 23

Page 27: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Open Source internet browser, Firefox only manage to achieve slightly above 10%.

The number is tremendously small compared to the Microsoft and shows that user

acceptance toward open source technologies for desktop workstation and software

application is still arguable and majority of computer users are still prefer proprietary products.

This is also indicates that there are still a large room for OSCC to work on in the future.

Prepared by: Harifazillah Jamel, OSCC MAMPU

Page 24

Page 28: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.0 APPENDICES

8.1 Snapshot Treasury Portal during the Budget Day

Page 25

Page 29: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo

embedded

Page 26

Page 30: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.3 Snapshot of Awstats reports

Page 27

Page 31: Benchmarking On  Web  Server For  Budget 2008  Day

MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.4 Snapshot of appreciation letter from MOF

Page 28


Recommended