Posted on

Comparing Test Results in JMeter

Introduction

As performance testers, we are often asked to compare the difference in the performance between two versions of an application. Whatever the changes made in the second version (i.e., usage of new libraries, change of technological stack, etc.), ultimately, the business wants to know if the second version is better (or worst) and by how much.

This article discusses two solutions, including one based on a new JMeter plugin to help you "gauge" the improvement or degradation brought along by the second version of the application.

Posted on

Reporting of Apdex Rating in JMeter

Application Performance Index

If, like me, you have some difficulties in making a Pass/Fail call for your performance tests when given the Summary Statistics of the performance test results, then the Apdex metric may come in handy.

The Application Performance Index defines a score to report the quality of the user experience across any application. The score ranges from 0.0 to 1.0 and the user experience is split into different ratings as per the following table:

Posted on

Getting Rid of Performance Testing Outliers With a New JMeter Plugin

Introduction

Whether we like it or not, outliers happen in our daily lives! For instance, it can be a mansion that sells in your neighbourhood for a price three to four times higher than the average house price. In the workforce, it can also be a few professionals earning very high salaries when compared to the rest of the employees. Or if you were to look at the arrival times of planes at your local airport, you would see that most planes land in a [0..10min] interval around the scheduled arrival time, but then, from time to time, a few planes may be late by 1hr or more...

But back to performance testing where we measure the response times of our applications.