Load Testing in the Cloud

Regression Load Testing

NetworkWorld's Senior Editor Denise Dubie provides her views on What is considered good application performance?

The article essentially concludes that whatever the end user can tolerate is probably adequate performance. I was hoping for more technical content and details of studies or something like that.

Don't Get Caught With Your Britches Down (hat tip to Capt Kirk in Wrath of Khan)

The best point made in the article is that the web developers, network managers, and/or performance engineers can get surprised when performance problems start to become noticeable by the end users. It sneaks up on us!

"Usage of the portal could slowly increase -- not registering a spike in activity across the monitoring systems network managers use to track performance issues. Time outs and unavailability of functions could occur when all the health indicators seem normal and operating at the expected levels, because something in the application or the infrastructure might not have changed, it would take some time for network managers to figure out why out of seemingly nowhere performance degraded."

My advice is simple:

Set up your load testing plans to cover the primary user types and scenarios for your application. Then run those tests against production weekly or monthly at off-times like Sunday morning at 3:00 a.m.

The tests don't need to be overly complex. They don't need to run for several hours - you aren't looking for memory leaks. You need to know if the application's performance is where you expect it. Compare the results to last week's test results.

The whole regression load testing process should take about 2 hours of your actual time. I am convinced that 2 hours is well invested time for you if you care about performance. Are you the Product Manager? Are you the Marketing Manager? Do you have responsibility in IT for this app? There could be several people in your organization that really do care about the performance - even if they don't think about it.

Not Even the CTO is Consulted for Every Little Change

There are more reasons to worry about web application performance degradation than just gradually having increasing concurrent users. How often do you release bug fixes in your web app? Do your network guys ever make configuration changes in the infrastructure without telling you? Has some Apache guru ever tweaked some settings without consulting you? Is it possible that the DBA could adjust a few parameters that impact your app's ability to get connections? ABSOLUTELY!!

Protect your web application! Protect yourself! Don't let "seemingly out of nowhere" your app's performance degrade. Don't let it sneak up on you.

I hate those meetings where the senior execs get involved and call you in after it is too late (performance failure). You want to be a hero, a winner, a respected web developer.

So be proactive - start regression load testing now. It won't take that long. Just do it.

Improve Performance

Looking for a simple way to speed up your site? We found a cool performance solution that can deliver HUGE improvement without rewriting your web application. aiCache web application acceleration is a new partner with LoadStorm because they can help our clients where we cannot. It's a great alternative to buying biggers servers, implementing load balancers, or re-architecting your app.

Placing aiCache in front of your web servers increases the number of requests per second and concurrent users you can sustain by orders of magnitude - delivers in excess of 250,000 HTTP requests per second while managing hundreds of thousands of connected clients.

Woot.com uses LoadStorm for performance testing and aiCache to handle the crush of traffic. They have saved a bunch of money and eliminated time spent optimizing.

more information

New Pricing Model

Storm on Demand Users Cost
250 $9.97
500 $19.95
1,000 $39.90
5,000 $199.50
10,000 $399.00
25,000 $997.50
50,000 $1,995.00

To See All Plans & Pricing Details

Web Developers Like Us!

“I deeply resent every second of my life I waste by thinking about load testing. All I ask is that our site be tested with a lot of traffic and without a bunch of BS for me to deal with. Thanks to LoadStorm, I need never again lose another moment to this insufferably tedious aspect of my job. I can feel the rage melting away.” - Shawn Miller, Web Developer, Woot.com

"I am definitely a fan of LoadStorm. I like its ease-of-use and the way in which the solution scales." - Darin Creason, Sr. Software Engineer, TransCore Corp

"LoadStorm is a great product at a great price with fantastic support. Setup time is minimal and the learning curve is low which was essential for us. I couldn't be happier with LoadStorm! Thanks again for your excellent support and product. - Nate Woolls, Director of Software Technology, InstallerNet, Inc.

"You guys are the best. Great customer service." - Melinda Keedy, Windstream Communications