Load Testing in the Cloud

Load Testing Drupal

load testing DrupalDrupal is one of the most popular open source content management platforms and is being adopted at ever larger organizations because of its powerful features.

Our team is conducting load testing against copies of Drupal on various sizes of EC2 instances. We intend to establish performance benchmarks for Drupal version 6.x.

load testing DrupalIf you are a Drupal developer and want to join us in the fun, please make a comment to this post or contact Scott Price at scottp@loadstorm.com.

Other have previously established benchmarks for Drupal 5.x versus 4.7. Do you know of other Drupal benchmarking studies? Please share them with us.

There are many questions that can be asked, and we set out to answer as many as possible. Some key questions that we wish to answer:

  • How can you get Drupal to perform at an optimal level?
  • What are the affects of application caching?
  • How many concurrent users can different servers support without performance degradation?
  • Which database settings produce the greatest performance improvements?
  • How can you tell if you are tuning Drupal to get the best performance?
  • What Apache configuration settings impact Drupal performance?

To do a performance case study justice, this will not be a simple or quick process. Our goal is to publish a series of articles on our load tests, performance results, tuning, and conclusions.

We thought of this concept before LoadStorm was even a finished product, and Christian Romano's introduction laid the groundwork for what we wanted to do. Now we have begun the testing and intend to publish this complete series in the next few weeks. We welcome your input and feedback regarding any aspect of this study.

Amazon AWSPrimarly, our methodology will be to "keep it as simple as possible". Crawl - before walking - before running. We will get more advanced in our performance engineering techniques as we progress.

The fundamental process will be to install the application in a neutral environment so we can test it and establish baseline metrics without any modification to the "off the shelf" configurations. Specifically, we want to establish a basic Drupal install, run the simplest load tests, and make obvious configuration changes to measure performance.

LAMP stackLAMP stackLAMP stackLAMP stackWe will use a LAMP stack on small, large, and extra large Amazon EC2 server instances. Our Drupal application has 1,000 users and 10,000 pages. We didn't change any of the default settings of Drupal, Apache, or MySQL. We left everything as it comes out of the box. Remember crawl first...

The Amazon network pipe is essentially unlimited, so we knew that bandwidth would not be an issue. Our objective was to isolate any change in performance to the Drupal/Apache/MySQL configuration.

In 2008 when the Drupal Project announced the official release of Drupal 6, they made this statement:

"Dramatic Performance Improvements. All these new features come with an added bonus - higher performance. In addition to high-performance caching for anonymous users, Drupal 6 offers a host of under-the-hood optimizations that speed up sites with large numbers of logged-in users."

Let's find out how dramatic the higher performance really is. This should be fun and interesting.

We hope you get value from these test results. Each round of testing will have its own post, and I will summarize the results here.

Anonymous Users

Please review the details of this first series of load testing in the post Load Testing Drupal - Anonymous Users.

EC2 Instance Caching Users Requests/sec Avg Response Error Rate Result
Small Off 67 1.63 5 sec 0% Failure
Small On 100 2.7 0.34 sec 0% Success
Small On 500 14 0.68 sec 0% Success
Small On 926 28 0.53 sec 0% Success
Small On 1000 10.6 22.8 sec 81.5% Failure

Key performance data point: Normal page caching increases anonymous user requests/sec processing by 1,718%.








Improve Performance

Looking for a simple way to speed up your site? We found a cool performance solution that can deliver HUGE improvement without rewriting your web application. aiCache web application acceleration is a new partner with LoadStorm because they can help our clients where we cannot. It's a great alternative to buying biggers servers, implementing load balancers, or re-architecting your app.

Placing aiCache in front of your web servers increases the number of requests per second and concurrent users you can sustain by orders of magnitude - delivers in excess of 250,000 HTTP requests per second while managing hundreds of thousands of connected clients.

Woot.com uses LoadStorm for performance testing and aiCache to handle the crush of traffic. They have saved a bunch of money and eliminated time spent optimizing.

more information

New Pricing Model

Storm on Demand Users Cost
250 $9.97
500 $19.95
1,000 $39.90
5,000 $199.50
10,000 $399.00
25,000 $997.50
50,000 $1,995.00

To See All Plans & Pricing Details

Web Developers Like Us!

“I deeply resent every second of my life I waste by thinking about load testing. All I ask is that our site be tested with a lot of traffic and without a bunch of BS for me to deal with. Thanks to LoadStorm, I need never again lose another moment to this insufferably tedious aspect of my job. I can feel the rage melting away.” - Shawn Miller, Web Developer, Woot.com

"I am definitely a fan of LoadStorm. I like its ease-of-use and the way in which the solution scales." - Darin Creason, Sr. Software Engineer, TransCore Corp

"LoadStorm is a great product at a great price with fantastic support. Setup time is minimal and the learning curve is low which was essential for us. I couldn't be happier with LoadStorm! Thanks again for your excellent support and product. - Nate Woolls, Director of Software Technology, InstallerNet, Inc.

"You guys are the best. Great customer service." - Melinda Keedy, Windstream Communications