%%
Last Updated:
- [[2021-02-09]]
- [[2020-12-22]]
- [[2020-12-22]]
- [[2020-12-04]]
%%
# NeoLoad
## Recent Releases
### Neoload 7.8
- Dynamic monitor support to get metrics from [[Observability Platforms|APMs]], Prometheus, Windows servers
- PDF dashboard export
- NeoLoad Web Platform: edit test scenarios
### Neoload 7.7
- Default and customizable dashboard reports
- Export graphs as CSV
- SSO
- Integration with [[Prometheus]] for server monitoring metrics
- Cluster logs
## Direction
It seems like Neotys has been going all in on results and analysis lately. I know they released raw results export a few months ago - this is almost certainly due to the influence of [[Stijn Schepers]], who is a perf engineer, Neoload champion, and a very vocal proponent for raw data in load testing + rich data visualization via [[Tableau]].
%%Neotys is angling to be bought by Tricentis, so they'll need to increase their appeal to enterprise customers, especially SAP ones.%% Neotys has also recently branched out into [[Browser-based testing]] with the inclusion of load testing using [[Tosca]].
## How to use Neoload
- [[Getting current iteration in Neoload JavaScript API]]
## Key features of a load testing platform
### Scripting
#### Creating a script
- [x] [[Recorder]]
- [x] [[Exclude third-party or configured domains]]
- 
- [x] [[GUI Test Builder]]
- [x] [[Web-based script editor]]
- ![[neoloadwebplatform.png]] from [source](https://www.neotys.com/neoload/whats-new)
- [ ] [[Upload of scripts from other tools]]
- [x] [[Protocol-based load testing]]
- [x] [[Browser-based testing]]
- Yes, through [[Tosca]]
#### Making the script robust
- [x] [[Supports all HTTP methods]]
- [x] [[Sending parameters with request]]
- [x] [[Modify headers]]
- [x] [[Response assertions]]
- Error handling
- [x] [[Output to log upon error]]
- [x] [[Continue on error or restart iteration]]
- Debugging
- [x] [[See request and response headers and bodies on single iteration]]
- 
- [x] [[Transaction groups]]
- Called "user paths".
#### Making the script realistic
- [x] [[Correlation of dynamic values]]
- [x] [[Pass variables in request]]
- [x] [[Dynamic think time and pacing]]
- 
### Execution
#### [x] [[Test Scenarios]]
- Called Populations
- 
#### [ ] [[Configurable Load profile]]
- 
- [x] [[Number of virtual users]]
- [x] [[Duration]]
- [x] [[Origin or Region]]
- [x] [[Fully customizable load profile]]
- 
- [x] [[Ramp-up]]
- [x] [[Ramp down]]
- [x] [[Number of iterations]]
#### [?] [[Data partitioning across load generators]]
#### SLAs
- [x] [[Set multiple thresholds]]
- 
#### [?] [[No shared infrastructure]]
#### [?] [[Bandwidth throttling]]
#### Infrastructure
- [?] [[Control over how many users per load generator to run]]
- [x] [[Self-hosted]]
- [x] [[On-premise]]
- [ ] [[Own cloud accounts]]
- [ ] [[AWS]]
- [ ] [[Microsoft Azure]]
- [ ] [[Google Cloud Platform]]
- [ ] [[DigitalOcean]]
- [x] [[On demand]]
#### [x] [[Multiple IP addresses]]
#### [x] [[Execution Parameters]]
- Yes, through command line execution: https://www.neotys.com/documents/doc/neoload/latest/en/html/#643.htm
### Analysis
#### Dashboard
- [?] [[Custom dashboard creation]]
- [?] [[Reusable dashboards]]
- Easy error troubleshooting
- [ ] [[Screenshots]]
- [x] [[Response bodies]]
- [x] [[Assertion success or failure]]
- [x] [[Log for transaction failure]]
#### Metrics
- [x] [[Response time]]
- [x] [[Request throughput]]
- [x] [[Number of virtual users]]
- [x] [[Error rate]]
- [x] [[Network throughput]]
- [?] [[Load generator CPU]]
- [?] [[Load generator memory]]
#### Graphs
- [ ] [[Different Graph Types]]
- [x] [[View by transaction]]
- [?] [[View by load generator or region]]
- [ ] [[Custom views]]
#### Comparison
- [?] [[Compare two tests]]
- [ ] [[Overlay results by relative time]]
#### Results
- [x] [[Raw data]]
- [x] [[At least 1s granularity]]
- [x] [[Export as plain text]]
- [ ] [[Integration with APM or Data Visualization tools]]
- [ ] [[New Relic]]
- [x] [[Dynatrace]]
- [ ] [[AppDynamics]]
- [x] [[Tableau]]
- [ ] [[InfluxDB]]
- [ ] [[Datadog]]
- [ ] [[CloudWatch]]
- [ ] [[CA Technologies APM]]
- [ ] [[Splunk Cloud]]
- [ ] [[Keen]]
- [ ] [[BigPanda]]
### Continuous Load Testing
#### Scheduling
- [x] [[Run tests on a schedule]]
- [x] [[Email results]]
- [x] [[Alerts]]
- [ ] [[Slack]]
- [ ] [[Microsoft Teams]]
- [ ] [[PagerDuty]]
- [ ] [[VictorOps]]
- [ ] [[OpsGenie]]
- [ ] [[ServiceNow]]
- [ ] [[Flowdock]]
- [ ] [[Zapier]]
- [ ] [[Grove]]
#### [?] [[API hooks]]
#### [ ] [[Graph of continuous performance over time]]
### Launch NeoLoad from command line
```shell
cd /
cd C:\Program Files\NeoLoad 6.2\bin
NeoLoadCmd.exe -project "\\ict-data\Dev\Bibliotheek\TSC\LR_Projects\30 Projecten\28 GPS Synthetic Monitoring\SyntheticMonitor\SyntheticMonitor.nlp" -launch SM -noGUI -exportRaw D:\NeoLoad-Projects\results_%date:~-4,4%%date:~-7,2%%date:~-10,2%__%time:~0,2%h%time:~3,2%min%.csv
```