- Last Updated: [[2020-12-11]] - Source: [BlazeMeter 2021 Roadmap Session What's New & What's Coming](https://www.youtube.com/watch?v=9o8xICYZpeo) - {{[[youtube]]: https://www.youtube.com/watch?v=9o8xICYZpeo}} - # Key points - ## [[CA BlazeMeter]]'s new mission statement is "Deliver as One" - A full ecosystem rather than a single tool - Integration with third party tools - Bridging the gap between CoE and Agile teams - ## Scripting - Focus on UI script creation - Add predetermined tests depending on your system (? Already available on prem) - Test Data Manager: stores existing assets and generates data on the fly - Better correlation engine for Chrome recorder - ## Executing - Service Virtualization (presumably with CA Lisa) - Focus on front-end performance metrics - ## Analysis - "BizOps": help customers set and assess requirements - DevOps dashboard called Quality Dashboard will contain test results, test data, monitoring, environments, requirements - Continuous performance over time - # Notes - [0:00](https://www.youtube.com/watch?v=9o8xICYZpeo&t=0): Product management: Klaus and Brian - [1:24](https://www.youtube.com/watch?v=9o8xICYZpeo&t=84): Broadcom acquisition - [1:28](https://www.youtube.com/watch?v=9o8xICYZpeo&t=88): Mission statement: "We build software to help the world's leading companies make intelligent, data-driven decisions to achieve better business outcomes." - Delivering as One - [7:26](https://www.youtube.com/watch?v=9o8xICYZpeo&t=446): One means one approach: not just a tool but an ecosystem that ties into full application performance - [7:47](https://www.youtube.com/watch?v=9o8xICYZpeo&t=467): ONE means integration with other products out there on the market. - [9:59](https://www.youtube.com/watch?v=9o8xICYZpeo&t=599): BlazeMeter's Continuous Testing Mission - COllaboration between COE and Agile teams - [10:41](https://www.youtube.com/watch?v=9o8xICYZpeo&t=641): COE often impose quality and standards, whereas Agile teams need to move fast - there's a friction here - [[Long-term thinking is often at odds with short-term needs.]] - [[Testing Centers of Excellence must weigh the need for overall quality standards with the need for Agile delivery.]] - [11:44](https://www.youtube.com/watch?v=9o8xICYZpeo&t=704): - E2E testing and shift left/in sprint - [12:06](https://www.youtube.com/watch?v=9o8xICYZpeo&t=726): COE is more concerned with E2E testing and Agile teams are concerned with testing within the sprint - [12:33](https://www.youtube.com/watch?v=9o8xICYZpeo&t=753): - Complex use cases and test early and often - COE wants complex use case and Agile teams want to test earlier in cycle - [13:15](https://www.youtube.com/watch?v=9o8xICYZpeo&t=795): - Producer and consumer - CoE often produce the test scripts and Agile teams execute - **This isn't often the case, not in a good Agile team. Not sure where he's going here.** - [13:50](https://www.youtube.com/watch?v=9o8xICYZpeo&t=830): - Remove barriers to detecting issues earlier and save cost by fixing them earlier - [14:21](https://www.youtube.com/watch?v=9o8xICYZpeo&t=861): Help customer teams also deliver as ONE and bring these two often conflicting or separate attitudes together. - [16:25](https://www.youtube.com/watch?v=9o8xICYZpeo&t=985): Roadmap - I. Create - Test as code - [16:57](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1017): But more focus now on UI script creation for less technical - [17:34](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1054): Ways for non-technical folks to create scripts: emphasis on recorder, doing it in the UI - [17:58](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1078): They're going to add capabilities to add predetermined tests depending on your system? - [18:13](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1093): This has been available on-prem, but they're going to bring it to SaaS - [19:33](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1173): Test Data Manager - [19:50](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1190): Bring test data from existing sources AND generate data on the fly - [23:41](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1421): Better correlation for their Chrome recorder extension and better integration with platform - [25:02](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1502): II. Running tests - [BlazeMeter] can run tests with millions of users - nobody else can do that - Not true! - [25:58](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1558): Virtual Services (service virtualization) to reduce dependencies for Agile teams - [27:13](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1633): They already have mocks and stubs, but they want to integrate with service virtualization tools that are already out there from Broadcom - **Yes but CA LISA is shit** - [28:15](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1695): End-user Experience: front-end performance - [28:48](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1728): Make it available to existing scripts and assets - [31:51](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1911): III. Analyze and decisions - focus on helping customers with their "BizOps": ops with business goals in mind - focus on requirements and being able to set them - Quality dashboard - [32:43](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1963): Quality dashboard will display not just tests but also other metrics around testing - [32:58](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1978): Test data, monitoring, environments - [33:09](https://www.youtube.com/watch?v=9o8xICYZpeo&t=1989): Requirements and test coverage - [33:51](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2031): Production monitoring was recently released - [34:10](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2050): Continuous performance, not just per test, so that you can see trends. - [36:36](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2196): Kind of sounds like they're moving towards a production dashboard for DevOps people rather than testers. - [37:09](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2229): IV. Platform - [38:28](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2308): Templates for the platform (UI and dashboards presumably) depending on your use case. Helps with best practices for those who are new. - [42:47](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2567): Questions - [43:41](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2621): Q: Timeline? - A: Most already live - contact them to have those features enabled. - [45:52](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2752): Q: Correlation engine for Chrome? - [46:16](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2776): Recording scenarios for mobile applications - [46:54](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2814): He has mentioned not needing to code or understand JMeter several times so far. Seems to be an important point for them. - [49:07](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2947): Recorder will also tie into test data - so different tests (whether JMeter or Selenium) can share test assets - [49:30](https://www.youtube.com/watch?v=9o8xICYZpeo&t=2970): Test Action Library - you can reuse different "actions" in different tests. - Sounds kind of like their multi-test, but at a more granular level (requests/steps/transactions instead of scenarios) - [51:26](https://www.youtube.com/watch?v=9o8xICYZpeo&t=3086): Q: Limit for scaling up on Blazemeter? - A: "Millions". - [52:47](https://www.youtube.com/watch?v=9o8xICYZpeo&t=3167): Q: Support for IE/Edge? - [53:24](https://www.youtube.com/watch?v=9o8xICYZpeo&t=3204): A: Yes, via Selenium. We're adding cross-browser testing for Windows-based browsers too. - {{pdf: assets/1622579181_17.pdf}