https://loadstorm.com Load Testing the Better Way Fri, 22 May 2015 23:05:03 +0000 en-US hourly 1 http://wordpress.org/?v=4.2.2 WordPress Hosting Providers Study: Web Performance & Scalability https://loadstorm.com/2015/01/wordpress-hosting-web-performance/ https://loadstorm.com/2015/01/wordpress-hosting-web-performance/#comments Mon, 05 Jan 2015 19:14:58 +0000 https://loadstorm.com/?p=11196 Click to Zoom Experiment: When it comes to web performance, study after study has proven: fast and scalable wins the race. But with thousands of WordPress hosting providers, how do you know which one is fast and scalable? That is where ReviewSignal.com comes in. Their business is all about helping people identify which hosting provider is the best choice for them. Kevin Ohashi from ReviewSignal has been working with LoadStorm to run a series of load tests on some of the top WordPress hosting providers to determine which is the best for companies who need scalable websites. Our performance engineers […]

The post WordPress Hosting Providers Study: Web Performance & Scalability appeared first on LoadStorm.

]]>

Click to Zoom

ReviewSignal Infographic

Experiment:

When it comes to web performance, study after study has proven: fast and scalable wins the race. But with thousands of WordPress hosting providers, how do you know which one is fast and scalable?

That is where ReviewSignal.com comes in. Their business is all about helping people identify which hosting provider is the best choice for them. Kevin Ohashi from ReviewSignal has been working with LoadStorm to run a series of load tests on some of the top WordPress hosting providers to determine which is the best for companies who need scalable websites.

Our performance engineers have teamed up with Kevin to analyze the multitude of data and provide this report of the top WordPress hosting providers for web performance. Providers included in this study are: A Small Orange, FlyWheel, GoDaddy, Kinsta, LightningBase, MediaTemple, Nexcess, Pagely, Pantheon, and WebSynthesis. These providers were included in the 2,000 user load test because they didn’t struggle with the first test of 1,000 concurrent users.

This analysis only looks at the final load test of 2,000 concurrent users, but Kevin’s article analyzes the results of both tests and looks at long term up-time reliability. Check out Review Signal’s report of the full study here.

Parameters:

All tests were performed on identical WordPress dummy websites hosted on 10 different hosting services. All sites were tested with the same plugins except in cases where hosts added extra plugins. The websites had identical scripts that included browsing and login. The load tests were run in LoadStorm PRO for 30 minutes with a linear 20 minute ramp up from 500 to 2,000 virtual users and holding at the peak for the for the remaining 10 minutes.

Test Parameters Ramp Up

Scoring:

In order to rank the top providers, we have broken our analysis down by the key web performance metrics:

To fairly rank the top providers, we ranked each provider by each performance metric at the 20 minute mark in the test, when all sites were under full load of 2,000 users. For each metric, the providers were ranked (1st through 10th) according to their performance and then a point value was assigned to each. Then we determined our final ranking position based on their total score, the sum of all points from all the metrics.
ReviewSignal Scoring System

Test Data:

To view the full test results with interactive graphs in LoadStorm PRO, click on each hosting provider below:

Pantheon web performance graph

Metrics:

Error Rate

Error rate is probably the most important metric for businesses wanting to be certain that a website won’t crash under high traffic. High error rates mean one thing: Lost customers.

Surprisingly, we had a 7-way tie for first place with 0% error rates. Overall, this speaks volumes to the scalability of all the websites included in the study. Flywheel started to fail at around 1500 concurrent users and began returning 502 errors, which explains its high error rate.
Error Rate Ranking Table

Average Response Time

Average Response Time is very significant because it directly affects the user experience and perceived load time. This metric measures the time each request takes “round trip” from the browser sending the request to the server, the server processing the request, and then the response from the server back to the browser. The Average Response Time takes into consideration every round trip request/response cycle for that minute interval and calculates the mathematical mean of all response times.
Average Response Time Ranking Table

Peak Response Time

This metric also measures the same “round trip” that the Average Response Time does, but instead of averaging the time for all requests, Peak Response Time is simply the single longest (slowest) time for a single request.
Peak Response Time Ranking Table Final

Average Page Completion

Average Page Completion Time is a metric that measures the amount of time from the start of the first request to the end of the final request on a page.

In regards to the specific times in this study, the test shows unusually fast Average Page Completion times. After investigating why the pages were loading so quickly, it turns out that some of the pages on the dummy website were very simple with very few requests each. While users with real websites on these providers would expect to see slower average page completion times, the tests are still valid because all providers had the same simple pages.
Average Page Completeion Ranking Table

Throughput

Throughput is measured by the number of kilobytes per second that is being transferred. This measurement shows how data is flowing back and forth from the server(s). High throughput is a mark of good web performance under load because it shows that there aren’t any bottlenecks blocking and slowing the data transfer. Low throughput, as seen in WebSynthesis, signifies that the server is overwhelmed and is struggling to pass data to and from the server.

Interestingly, GoDaddy pushed triple the amount of data through because their admin screen had more resources being loaded. Which is why the average throughput is so high. Despite the extra data to process, they still had significantly higher average response times than most of the other providers. Anytime a site makes more requests, it slows down performance. Therefore, without so much extra data it is fair to say that GoDaddy could have possibly been faster than all the others.
Throughput Ranking Table final

Ranking

From the final point tallies, we can see that there are three clear sections.
Top Performers: Pantheon, MediaTemple, GoDaddy, and Kinsta.
Good Performers: Nexcess, LightningBase, A Small Orange, and Pagely.
Fair Performers:: FlyWheel and WebSynthesis.
Total Scores Ranking Table

Conclusion:

Overall, most of the providers did surprisingly well under the full load of 2,000 concurrent users. Even though we wanted to rank them in a definitive order, the fact of it is that most providers did not reach failure rates at all in the test. So while we were able to rank them, there were several metrics where the difference between points was negligible (ie: 1 ms average response time difference between GoDaddy and Kinsta) but still calculated in our scores.

Additionally, the test utilized in our report is only part of the full ReviewSignal study. ReviewSignal ran tests at 1,000 users and the providers that crashed were not included in the tests at 2,000. Therefore, all of the providers included in this ranking should be considered great choices for scalable WordPress hosting.

This level of high performance in all 10 providers was unexpected with such a heavy load and we were very impressed by the results.

facebooktwittergoogle_plusredditpinterestlinkedin

The post WordPress Hosting Providers Study: Web Performance & Scalability appeared first on LoadStorm.

]]> https://loadstorm.com/2015/01/wordpress-hosting-web-performance/feed/ 25 Infographic: Web Performance Impacts Conversion Rates https://loadstorm.com/2014/04/infographic-web-performance-impacts-conversion-rates/ https://loadstorm.com/2014/04/infographic-web-performance-impacts-conversion-rates/#comments Wed, 09 Apr 2014 15:46:37 +0000 https://loadstorm.com/?p=9187 There are many companies that design or re-design websites with the goal of increasing conversion rates. What do we mean by conversion rates? SiteTuners defines Conversion Rate as: “The percentage of landing page visitors who take the desired conversion action.” Included in this list are completing a purchase, filling out an information form, or donating to the cause. Almost all companies focus on the design, look, and layout of a website when attempting to increase conversion rates. However, we at LoadStorm want to draw more attention to the role that web performance plays in conversions. Many studies have conclusively shown […]

The post Infographic: Web Performance Impacts Conversion Rates appeared first on LoadStorm.

]]> There are many companies that design or re-design websites with the goal of increasing conversion rates. What do we mean by conversion rates? SiteTuners defines Conversion Rate as: “The percentage of landing page visitors who take the desired conversion action.” Included in this list are completing a purchase, filling out an information form, or donating to the cause.

Almost all companies focus on the design, look, and layout of a website when attempting to increase conversion rates. However, we at LoadStorm want to draw more attention to the role that web performance plays in conversions. Many studies have conclusively shown that a delay in page load time will negatively affect conversions, check out our latest infographic for a summary of the statistics!

Conversion Infographic Final

 

Sources:
1. http://www.aberdeen.com/Aberdeen-Library/5136/RA-performance-web-application.aspx
2. https://econsultancy.com/blog/10936-site-speed-case-studies-tips-and-tools-for-improving-your-conversion-rate
3. http://www.globaldots.com/how-website-speed-affects-conversion-rates/
4. http://www.crestechglobal.com/wp-content/uploads/2013/10/WhitePaper_AgileBottleneck_Performance.pdf
5. http://www.webperformancetoday.com/2013/12/11/slower-web-pages-user-frustration/
6. http://kylerush.net/blog/meet-the-obama-campaigns-250-million-fundraising-platform
7. http://www-01.ibm.com/software/th/collaboration/webexperience/index.html

facebooktwittergoogle_plusredditpinterestlinkedin

The post Infographic: Web Performance Impacts Conversion Rates appeared first on LoadStorm.

]]> https://loadstorm.com/2014/04/infographic-web-performance-impacts-conversion-rates/feed/ 0 Importance of Mobile Web Performance https://loadstorm.com/2014/01/importance-mobile-web-performance/ https://loadstorm.com/2014/01/importance-mobile-web-performance/#comments Wed, 22 Jan 2014 16:07:43 +0000 https://loadstorm.com/?p=7098 Mobile web browsing and shopping is growing at a remarkable rate. Sites that aren’t optimized to perform well on mobile devices will miss out on a large part of the market! Check out some surprising statistics on why mobile web performance is so important:

The post Importance of Mobile Web Performance appeared first on LoadStorm.

]]> Mobile web browsing and shopping is growing at a remarkable rate. Sites that aren’t optimized to perform well on mobile devices will miss out on a large part of the market! Check out some surprising statistics on why mobile web performance is so important:

Mobile Infographic V4

facebooktwittergoogle_plusredditpinterestlinkedin

The post Importance of Mobile Web Performance appeared first on LoadStorm.

]]> https://loadstorm.com/2014/01/importance-mobile-web-performance/feed/ 2 Ecommerce Holiday Statistics https://loadstorm.com/2013/12/ecommerce-holidy-statistics/ https://loadstorm.com/2013/12/ecommerce-holidy-statistics/#comments Thu, 12 Dec 2013 23:06:57 +0000 https://loadstorm.com/?p=6180 The post Ecommerce Holiday Statistics appeared first on LoadStorm.

]]> holiday infographic

facebooktwittergoogle_plusredditpinterestlinkedin

The post Ecommerce Holiday Statistics appeared first on LoadStorm.

]]> https://loadstorm.com/2013/12/ecommerce-holidy-statistics/feed/ 0 The Importance of Web Performance https://loadstorm.com/2013/12/importance-web-performance/ https://loadstorm.com/2013/12/importance-web-performance/#comments Mon, 09 Dec 2013 19:59:10 +0000 https://loadstorm.com/?p=6145 The post The Importance of Web Performance appeared first on LoadStorm.

]]> web infographic

facebooktwittergoogle_plusredditpinterestlinkedin

The post The Importance of Web Performance appeared first on LoadStorm.

]]> https://loadstorm.com/2013/12/importance-web-performance/feed/ 0 Cloud Load Testing Tool https://loadstorm.com/2013/10/load-testing-tool-cloud/ https://loadstorm.com/2013/10/load-testing-tool-cloud/#comments Wed, 16 Oct 2013 17:46:07 +0000 https://loadstorm.com/?p=5855 There are several ways we could go about answering this question. Our engineering team could probably write a whole book to explain cloud load testing on a very technical level. On another level, I wanted to explain it using a single graphic. LoadStorm can be explained in 5 simple steps: 1. A tester builds scenarios (also call scripts or playbacks) 2. The LoadStorm controller activates load generation servers 3. Virtual users storm the target application and follow the actions laid out in the scenarios 4. LoadStorm measures the responses of the application (such as response times, errors, and throughput) 5. […]

The post Cloud Load Testing Tool appeared first on LoadStorm.

]]> There are several ways we could go about answering this question. Our engineering team could probably write a whole book to explain cloud load testing on a very technical level. On another level, I wanted to explain it using a single graphic.

LoadStorm can be explained in 5 simple steps:
1. A tester builds scenarios (also call scripts or playbacks)
2. The LoadStorm controller activates load generation servers
3. Virtual users storm the target application and follow the actions laid out in the scenarios
4. LoadStorm measures the responses of the application (such as response times, errors, and throughput)
5. These responses are summarized in various reports for the tester to analyze.

Here is the infographic summarizing the LoadStorm load testing cycle:

How LoadStorm Works Infographic

facebooktwittergoogle_plusredditpinterestlinkedin

The post Cloud Load Testing Tool appeared first on LoadStorm.

]]> https://loadstorm.com/2013/10/load-testing-tool-cloud/feed/ 0 SlideShare – Why is Load Testing Important? https://loadstorm.com/2013/07/slideshare-why-is-load-testing-important/ https://loadstorm.com/2013/07/slideshare-why-is-load-testing-important/#comments Wed, 03 Jul 2013 18:03:24 +0000 https://loadstorm.com/?p=4673 As we have seen proven time and again by various customer satisfaction studies, web performance optimization is critical to a successful website or application. Slow sites cause unhappy customers, unhappy customers don’t make purchases and even often share their bad experiences with others. Its clear to see that web performance optimization is key to customer satisfaction. Check out our new slideshare presentation for a clear cut answer to the question: Why is Load Testing Important? And for some surprising statistics on just how important load testing is to ensure customer satisfaction under high traffic. Fast, Reliable Website = Happy Customers […]

The post SlideShare – Why is Load Testing Important? appeared first on LoadStorm.

]]> As we have seen proven time and again by various customer satisfaction studies, web performance optimization is critical to a successful website or application. Slow sites cause unhappy customers, unhappy customers don’t make purchases and even often share their bad experiences with others. Its clear to see that web performance optimization is key to customer satisfaction.

Check out our new slideshare presentation for a clear cut answer to the question: Why is Load Testing Important? And for some surprising statistics on just how important load testing is to ensure customer satisfaction under high traffic. Fast, Reliable Website = Happy Customers = More Sales.

facebooktwittergoogle_plusredditpinterestlinkedin

The post SlideShare – Why is Load Testing Important? appeared first on LoadStorm.

]]> https://loadstorm.com/2013/07/slideshare-why-is-load-testing-important/feed/ 0 Infographic: Why Is Speed So Important? https://loadstorm.com/2013/06/why-is-speed-so-important/ https://loadstorm.com/2013/06/why-is-speed-so-important/#comments Wed, 12 Jun 2013 18:42:00 +0000 https://loadstorm.com/?p=4323 Ever wonder if performance optimization is really worth all the effort? Turns out, the answer is clearly YES! Check out our latest infographic for some significant statistics that make it clear how important speed really is!

The post Infographic: Why Is Speed So Important? appeared first on LoadStorm.

]]> Ever wonder if performance optimization is really worth all the effort?

Turns out, the answer is clearly YES!

Check out our latest infographic for some significant statistics that make it clear how important speed really is!

Speed Infographic

facebooktwittergoogle_plusredditpinterestlinkedin

The post Infographic: Why Is Speed So Important? appeared first on LoadStorm.

]]> https://loadstorm.com/2013/06/why-is-speed-so-important/feed/ 0 History of Programming Languages – an infographic https://loadstorm.com/2013/05/history-of-programming-languages-infographic/ https://loadstorm.com/2013/05/history-of-programming-languages-infographic/#comments Thu, 30 May 2013 18:17:05 +0000 https://loadstorm.com/?p=4110 Easy & fun, but not too elegant In 1980, Bryan Station High School had 3 brand-new Commodore PET computers in a “lab”, and I was the geeky kid that couldn’t wait to get my hands on one of those beauties. We wrote code in BASIC language. The machine wasn’t very powerful, nor was the language, yet somehow we wrote a simple version of Space Invaders (ancient video game) that worked. Yeah, it was slow. Just the accomplishment of seeing a game do ANYTHING on that computer with 32k of memory was thrilling to us. My friends, we will call them […]

The post History of Programming Languages – an infographic appeared first on LoadStorm.

]]> basic programming language

Easy & fun, but not too elegant

In 1980, Bryan Station High School had 3 brand-new Commodore PET computers in a “lab”, and I was the geeky kid that couldn’t wait to get my hands on one of those beauties. We wrote code in BASIC language. The machine wasn’t very powerful, nor was the language, yet somehow we wrote a simple version of Space Invaders (ancient video game) that worked.

Yeah, it was slow. Just the accomplishment of seeing a game do ANYTHING on that computer with 32k of memory was thrilling to us. My friends, we will call them Sheldon, Leonard, Howard, and Rajesh, were all the guys who played D&D and got A’s in the advanced placement math classes. We loved pushing the limits of BASIC.

So when I think of a history lesson in programming languages, there is a soft spot in my heart for BASIC. I bet there are thousands of nerds like me in the 70’s and 80’s that learned BASIC first. That’s why I was surprised when I read the infographic (embedded below) because it mentions Fortran, C, COBOL, LISP, Pascal, as the “old” languages, but is says nothing about BASIC. As an old school programmer, I have written in all of those languages listed in the previous sentence – mostly in college courses. I worked on banking software for a few years, and it was all COBOL…probably still is running that bank. 😉

Anyway, all of the engineers on our team at LoadStorm are now Java. We are replacing the current version of our load testing tool with a major new release that has a totally redesigned UI coded in Java (using GWT). The current version is built in Ruby on Rails. I’m happy we are mainstream, and it was nice to see the infographic data showing Java as the most popular language and still growing. Hope you enjoy this trip down memory lane as much as I did.

The History of Programming Languages

The History of Programming Languages infographic

 

facebooktwittergoogle_plusredditpinterestlinkedin

The post History of Programming Languages – an infographic appeared first on LoadStorm.

]]> https://loadstorm.com/2013/05/history-of-programming-languages-infographic/feed/ 1 Infographic: Real Performance Metrics from 14,000 Sites https://loadstorm.com/2012/12/infographic-real-performance-metrics-14000-sites/ https://loadstorm.com/2012/12/infographic-real-performance-metrics-14000-sites/#comments Fri, 28 Dec 2012 06:38:02 +0000 http://127.0.0.1/wordpress51/?p=500 Yottaa is a customer of LoadStorm’s load testing tool, and they are focused on helping companies speed up their website. They test and monitor thousands of web apps, and they recently compiled web performance metrics that I found interesting. Thus, I share it with you. The data sample comprised 14,000 different sites. They measured several aspects of web performance in metrics for front-end and back-end. The infographic below is well-designed and hopefully will be of value to you.  

The post Infographic: Real Performance Metrics from 14,000 Sites appeared first on LoadStorm.

]]> Yottaa is a customer of LoadStorm’s load testing tool, and they are focused on helping companies speed up their website. They test and monitor thousands of web apps, and they recently compiled web performance metrics that I found interesting. Thus, I share it with you.

The data sample comprised 14,000 different sites. They measured several aspects of web performance in metrics for front-end and back-end. The infographic below is well-designed and hopefully will be of value to you.

web performance metrics from 14,000 sites

 

facebooktwittergoogle_plusredditpinterestlinkedin

The post Infographic: Real Performance Metrics from 14,000 Sites appeared first on LoadStorm.

]]> https://loadstorm.com/2012/12/infographic-real-performance-metrics-14000-sites/feed/ 1