Session: Running your tests in production – everything you need to know!

Preventing defect leakages, stability and performance issues in production became a serious challenge due to growing complexity of software production systems, high frequency and velocity of software releases. Adding continuous and canary deployment to the equation makes it even more challenging.

One of the most effective ways to assuring software quality in production is to run your automation tests in this environment. You could argue that this is pretty simple – just keep running your sanity or regression tests with your CI tool in production. However, the way we measure various aspects of quality in production environment is completely different from development and testing stages.

During this session we are going to overview methods and technics of efficiently running your existing tests in production. We are going to talk about production quality metrics, synthetic monitoring, performance testing (client and server-side), uptimes, SLAs, and many more. We are also going to see some tools that can help you to scale your tests and provide an instant root-case analysis, for both defects and performance issues.

Topics to be discussed:
• Why running tests in production
• Synthetic monitoring vs Real user monitoring
• Key measurements and metrics
• Performance 101 – client and server-side
• Cloud infrastructure to run your tests in production
• Observability tools and their key role in efficient defect discovery