- Last Updated: [[2020-12-07]]
- [[Requires Research]] - haven't fully explored this
- # "Key features of a load testing platform"
- ## Scripting
- ### Creating a script
- Recorder:: [ ]
- Exclude third-party or configured domains:: [ ]
- GUI Test Builder:: [x]
- Web-based script editor:: [ ]
- Upload of scripts from other tools:: [ ]
- Protocol-based Load Testing:: [x]
- Browser-based Load Testing:: [x]
- ### Making the script robust
- Supports all HTTP methods:: [x]
- Sending parameters with request:: [x]
- Modify headers:: [x]
- Response assertions:: [ ]
- Error handling
- Output to log upon error:: [ ]
- Continue on error or restart iteration:: [ ]
- Debugging
- See request and response headers and bodies on single iteration:: [x]
- 
- Source: https://support.smartbear.com/loadninja/docs/api-tests/index.html
- Transaction groups:: [ ]
- Making the script realistic
- Correlation of dynamic values:: [ ]
- Pass variables in request:: [ ]
- Dynamic think time and pacing:: [ ]
- ## Execution
- ### Test Scenarios:: [ ]
<!--ID: 1631100131392-->
- ### Configurable Load profile:: [ ]
<!--ID: 1631100131394-->
- Number of virtual users:: [ ]
- Duration:: [ ]
- Origin or Region:: [ ]
- Fully customizable load profile:: [ ]
- Ramp-up:: [ ]
- Ramp down:: [ ]
- Number of iterations:: [ ]
- ### SLAs
- Set multiple thresholds:: [ ]
- ### No shared infrastructure:: [ ]
<!--ID: 1631100131407-->
- ### Bandwidth throttling:: [ ]
<!--ID: 1631100131410-->
- ### Infrastructure
- Control over how many users per load generator to run:: [ ]
- Self-hosted:: [ ]
- On-premise:: [ ]
- Own cloud accounts:: [ ]
- AWS:: [ ]
- Microsoft Azure:: [ ]
- Google Cloud Platform:: [ ]
- DigitalOcean:: [ ]
- On demand:: [ ]
- ### Multiple IP addresses:: [ ]
<!--ID: 1631100131421-->
- ### Execution Parameters:: [ ]
<!--ID: 1631100131424-->
- ## Analysis
- ### Dashboard
- Custom dashboard creation:: [ ]
- Reusable dashboards:: [ ]
- Easy error troubleshooting
- Screenshots:: [ ]
- Response bodies:: [ ]
- Assertion success or failure:: [ ]
- Log for transaction failure:: [ ]
- ### Metrics
- Response time:: [ ]
- Request throughput:: [ ]
- Number of virtual users:: [ ]
- Error rate:: [ ]
- Network throughput:: [ ]
- Load generator CPU:: [ ]
- Load generator memory:: [ ]
- ### Graphs
- Different Graph Types:: [ ]
- View by transaction:: [ ]
- View by load generator or region:: [ ]
- Custom views:: [ ]
- ### Comparison
- Compare two tests:: [ ]
- Overlay results by relative time:: [ ]
- ### Results
- Raw data:: [ ]
- At least 1s granularity:: [ ]
- Export as plain text:: [ ]
- Integration with APM or Data Visualization tools:: [ ]
- New Relic:: [ ]
- Dynatrace:: [ ]
- AppDynamics:: [ ]
- Tableau:: [ ]
- InfluxDB:: [ ]
- Datadog:: [ ]
- CloudWatch:: [ ]
- CA Technologies APM:: [ ]
<!--ID: 1631100131458-->
- Splunk Cloud:: [ ]
<!--ID: 1631100131460-->
- Keen:: [ ]
<!--ID: 1631100131462-->
- BigPanda:: [ ]
<!--ID: 1631100131465-->
- ## Continuous Integration
- ### Scheduling
- Run tests on a schedule:: [ ]
- Email results:: [ ]
- Alerts:: [ ]
- Slack:: [ ]
<!--ID: 1631100131472-->
- Microsoft Teams:: [ ]
<!--ID: 1631100131474-->
- PagerDuty:: [ ]
<!--ID: 1631100131477-->
- VictorOps:: [ ]
<!--ID: 1631100131479-->
- OpsGenie:: [ ]
<!--ID: 1631100131481-->
- ServiceNow:: [ ]
<!--ID: 1631100131484-->
- Flowdock:: [ ]
<!--ID: 1631100131487-->
- Zapier:: [ ]
<!--ID: 1631100131489-->
- Grove:: [ ]
<!--ID: 1631100131491-->
- ### API hooks:: [ ]
<!--ID: 1631100131493-->
- ### Graph of continuous performance over time:: [ ]
<!--ID: 1631100131495-->