Load Testing in the Cloud

Wikipedia & Performance Testing Definitions

wiki and load testing /></p>
<h3>Happy Birthday Wikipedia!</h3>
<p>As a child, my mother made an investment in a set of World Book Encyclopedias for my education.  Those books came in handy so many times - especially on the night before a paper was due. If the subject was worth a teacher assigning homework about it, then it was in the encyclopedia.</p>
<p>Well, today I would like to recognize the 9th birthday of Wikipedia.  With a tag line of

I thought it would be fun to see how Wikipedia defines some of the key terms we deal with in web application development and testing.

  1. Load testing is the process of putting demand on a system or device and measuring its response. There is little agreement on what the specific goals of load testing are. The term is often used synonymously with software performance testing, reliability testing, and volume testing.
  2. Performance Testing in the computer industry is used to determine the speed or effectiveness of a computer, network, software program or device. This process can involve quantitative tests done in a lab, such as measuring the response time or the number of MIPS (millions of instructions per second) at which a system functions. Qualitative attributes such as reliability, scalability and interoperability may also be evaluated. Performance testing is often done in conjunction with stress testing.
  3. Web testing is the name given to software testing that focuses on web applications, and is one of the fastest growing areas of software testing. Complete web testing of a system before going live is the primary step to get assured of an entire web application’s ability to work properly. It can help address such issues like readiness of your web server for the traffic you are expecting and for the increasing number of users (Load testing), the ability to survive a massive spike in user traffic, your server hardware sufficiency and so on.
  4. Stress testing refers to tests that put a greater emphasis on robustness, availability, and error handling under a heavy load, rather than on what would be considered correct behavior under normal circumstances. In particular, the goals of such tests may be to ensure the software doesn't crash in conditions of insufficient computational resources (such as memory or disk space), unusually high concurrency, or denial of service attacks.
  5. Endurance testing is usually done to determine if the application can sustain the continuous expected load. During endurance tests, memory utilization is monitored to detect potential leaks. Also important, but often overlooked is performance degradation. That is, to ensure that the throughput and/or response times after some long period of sustained activity are as good or better than at the beginning of the test.
  6. Soak testing involves testing a system with a significant load extended over a significant period of time, to discover how the system behaves under sustained use. For example, in software testing, a system may behave exactly as expected when tested for 1 hour. However, when it is tested for 3 hours, problems such as memory leaks cause the system to fail or behave randomly.
  7. Spike testing is done by spiking the number of users and understanding the behavior of the application whether it will go down or will it be able to handle dramatic changes in load.
  8. Configuration testing is another variation on traditional performance testing. Rather than testing for performance from the perspective of load you are testing the effects of configuration changes in the application landscape on application performance and behaviour. A common example would be experimenting with different methods of load-balancing.
  9. Isolation testing is a term used to describe repeating a test execution that resulted in an application problem. Often used to isolate and confirm the fault domain.
  10. Reliability testing often consists of conducting a test on an item (under specified load and conditions) to determine the time it takes for a failure to occur. Forcing failures also allows analysis of the mode of failure for possible corrective actions.

Improve Performance

Looking for a simple way to speed up your site? We found a cool performance solution that can deliver HUGE improvement without rewriting your web application. aiCache web application acceleration is a new partner with LoadStorm because they can help our clients where we cannot. It's a great alternative to buying biggers servers, implementing load balancers, or re-architecting your app.

Placing aiCache in front of your web servers increases the number of requests per second and concurrent users you can sustain by orders of magnitude - delivers in excess of 250,000 HTTP requests per second while managing hundreds of thousands of connected clients.

Woot.com uses LoadStorm for performance testing and aiCache to handle the crush of traffic. They have saved a bunch of money and eliminated time spent optimizing.

more information

New Pricing Model

Storm on Demand Users Cost
250 $9.97
500 $19.95
1,000 $39.90
5,000 $199.50
10,000 $399.00
25,000 $997.50
50,000 $1,995.00

To See All Plans & Pricing Details

Web Developers Like Us!

“I deeply resent every second of my life I waste by thinking about load testing. All I ask is that our site be tested with a lot of traffic and without a bunch of BS for me to deal with. Thanks to LoadStorm, I need never again lose another moment to this insufferably tedious aspect of my job. I can feel the rage melting away.” - Shawn Miller, Web Developer, Woot.com

"I am definitely a fan of LoadStorm. I like its ease-of-use and the way in which the solution scales." - Darin Creason, Sr. Software Engineer, TransCore Corp

"LoadStorm is a great product at a great price with fantastic support. Setup time is minimal and the learning curve is low which was essential for us. I couldn't be happier with LoadStorm! Thanks again for your excellent support and product. - Nate Woolls, Director of Software Technology, InstallerNet, Inc.

"You guys are the best. Great customer service." - Melinda Keedy, Windstream Communications