Performance Testing in a CI Environment by Thomas Barns & Ian Donnell
Details
Synopsis:
This session will discuss the best practices and will include a demo of automated performance analysis in CI
There is widespread adoption of CI and everyone understand the importance of performance. However there are a number of challenges to managing performance in CI:
• It's impossible to do effective performance testing in CI using conventional methods.
• You just can't generate enough load for long enough periods of time to find out if thresholds are going to be breached in order to trigger alerts.
• Test windows are narrow
• Test environments are low scale; high-scale environments, always on, are expensive
• Cannot delay the pipeline
• Can't always just release to live – the case against move fast and break things
What are the Best Practices to address these challenges?
Thomas Barns
Thomas Barns is risk modeling and performance engineering service lead at Capacitas, where he is responsible for service definition and ensuring consistent best practice across projects. Over the past 10 years, Thomas has provided capacity and performance expertise to clients and owned the roadmap for developing Capacitas’s technical software solutions. During this time, he has seen a big shift in how software engineering is undertaken and viewed by the business and has built on this to introduce more effective and efficient performance risk management processes. This has meant a focus shifting away from large-scale system testing to a full lifecycle approach, alongside research and development in automated data analysis. Thomas is currently defining and governing performance engineering processes and standards for a multimillion-pound multivendor program of work at a FTSE 100 company.
Ian Donnell
Ian Donnell is a Senior Developer and the development lead at Capacitas with 4 years’ experience working in the domain of Capacity management and performance testing. Ian is responsible for running of the development team working to develop Capacitas’s software solutions. Throughout his time at Capacitas he has worked in both consultancy and technical roles giving him invaluable experience that allowed him to develop tooling centered around the automation of performance test analysis and the detection of performance anti-patterns. Ian is currently working to integrate analysis tooling into several large ecommerce companies continuous integration pipelines to help them deliver performant applications faster.
Sponsor:
This event is sponsored by Capacitas (http://www.capacitas.co.uk).