What We'll Do
- Setup Node Environment
- Perform Socket.io Load Test
- Web Socket Application
- Base Environment (Unix/Linux or Windows)
Whenever a new infrastructure is provisioned, proper load testing is required to determine its stability for deployment. Unstable applications are a coherent risk and will fail to handle the expected amount of user traffic resulting in downtime and loss of revenue.
For this reason, it's crucial that whenever we provision new infrastructure, we do the proper amount of load tests on it so that it can be guaranteed to handle real-life scenarios effectively.
Artillery is a Load Testing tool capable of testing protocols such as HTTP/HTTPS, WebSockets and Socket.io. In this guide, we'll learn to set up a NodeJS Development Environment, Install Artillery and Perform a Load Test on a WebSocket endpoint.
To install artillery, we'll start by configuring Node Environment and proceed to install
Setting up Node Environment
First, use brew to install NodeJS (for Ubuntu and Mac-based systems).
If you don't have brew installed, simply run the following command to install brew:
bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install.sh)"
Don't forget to add the Home Brew directory to PATH after installing; otherwise, applications installed via brew will not be accessible.
Use the following command to add the brew directory to PATH:
echo "export PATH=$PATH:/opt/homebrew/bin/brew" >> ~/.zshrc
Use the command below to install the latest LTS release of Node JS.
brew install node@16
With NodeJS installed, we can install artillery with the following command:
npm --location=global install artillery@latest artillery-engine-socketio-v3
This will install the latest release of artillery in our system, which can be used globally, the
-g command specifies that the modules need to be installed globally
-gis deprecated, so we use
Verifying Artillery Install
Artillery has a subcommand called dino, which prints messages on screen.
artillery dino -m "Testing Artillery Installation" -r
-rparameter to colourize the display message.
Dino is a feature provided by the tool. It serves no other purpose than to test a successful installation.
Load Testing with Artillery
There are two modes available for Load Testing using artillery.
- Quick: Quickly run a test using imperative commands in the CLI
- Run: Run a more thorough test using declarative YAML test profiles
The quick load test requires certain parameters specifying the requests per second, the packet size, and the URL. It does the rest automatically.
To quickly run a test, run the command below:
artillery quick -c 10 -n 100 http://127.0.0.1:3000
-c = number of open connections
-n = number of requests to be sent through each open connection
Run using a YAML Test Profile
artillery run command is specifically used to run Test Profiles specified in a YAML declaration file.
Copy and Save the content provided below as
target= URL of Web Socket Endpoint to Test
Phases = We specify request per second (rqs), also known as arrival rate, and time frame for different iterations of the load test here
engines = Socket.io Engine to use for load testing (Use the engine that your app is built on)
Phase 1: Runs for 60 seconds with 5 rqs
Phase 2: Runs for 120 seconds, starting from 5 rqs all the way to 40 rqs in the given time period.
Phase 3: Runs for 600 seconds and sustains 50 rqs during the whole time period.
We can specify different actions for artillery to perform whilst connected to our application.
- Defined the engine to use for testing.
- Different actions to perform in the default namespace.
- A Custom Namespace is also provided for testing.
- Stuff like acknowledgements can also be added to it.
- At last, the think command directs artillery to sleep for 10 seconds before exiting.
Running the Test Profile
The number of open file descriptors (Open Connections) is limited by default. To increase it, run the command
ulimit -n 10000.
This will allow us to complete the test much faster as the default value limits the amount of traffic we can push.
Use the following command to run the test and provide a JSON output which can later be used to analyze the success/failure of our tests!
artillery run test.yaml --output result.json
--output <file-name.json> will save the results into a file which will come in handy for performance analysis.
Generating and Viewing the Report
To open and read your generated report, run:
artillery report output.json
This will generate an HTML report with the same name, which can be opened in the browser to view test results!
By following this tutorial, you have successfully set up a Node JS Development Environment, installed artillery and its dependencies, and load-tested a Web Socket application!
I'll be back with a more advanced guide on load testing in the near future!
Subscribe to the blog to stay updated!