Get Ready for Changes To Load Testing
Download as PPTX, PDF0 likes1,997 views
This document outlines a webinar presentation on performance testing. It discusses how performance testing needs to change to keep up with trends like increased application development, continuous delivery, and more demanding users. Traditional approaches using siloed teams and infrequent testing are outdated. The presentation provides tips on breaking the status quo by increasing test frequency, embracing mobile applications, and integrating performance testing into agile development teams throughout the software lifecycle. Distributed, collaborative performance testing driven by real user data is presented as the new modern approach.
Get Ready for Changes To Load Testing
- 1. April 16, 2015 1© 2015 SOASTA. All rights reserved. Webinar
- 2. April 16, 2015 2© 2015 SOASTA. All rights reserved. Today’s Presenters Mark Tomlinson Independent Performance Coach F1000 Companies Microsoft HP (former LoadRunner PM) Brad Johnson Performance Product “Lifer” SOASTA Borland Mercury Interactive Compuware
- 3. April 16, 2015 3© 2015 SOASTA. All rights reserved.
- 4. April 16, 2015 4© 2015 SOASTA. All rights reserved. Agenda Changes are upon us 1. Breaking the Status Quo 2. Apps are Eating the World 3. What about the Center of Excellence?
- 5. User ExpectationsUnpredictable Demand Continuous DeliveryMultiple Devices P Performance Is Complicated Speed Quality
- 6. April 16, 2015 6© 2015 SOASTA. All rights reserved. Models are inaccurate
- 7. April 16, 2015 7© 2015 SOASTA. All rights reserved. Models are inaccurate Silos are not agile
- 8. April 16, 2015 8© 2015 SOASTA. All rights reserved. Models are inaccurate Silos are not agile Production scale tests are rare
- 9. April 16, 2015 9© 2015 SOASTA. All rights reserved. RetestTest Development Infra setup RepeatFix Tes t Analyze TIME Breaking the Status Quo The Legacy Approach
- 10. April 16, 2015 10© 2015 SOASTA. All rights reserved. Breaking the Status Quo Everything has changed… o Real user data-driven test specifications o Collaborative teams are displacing specialist teams o Increased test frequency
- 11. April 16, 2015 11© 2015 SOASTA. All rights reserved. Breaking the Status Quo Everything has changed… o Real user data-driven test specifications o Collaborative teams are displacing specialist teams
- 12. April 16, 2015 12© 2015 SOASTA. All rights reserved. o Real user data-driven test specifications o Collaborative teams are displacing specialist teams o Increased test frequency Breaking the Status Quo Everything has changed…
- 13. April 16, 2015 13© 2015 SOASTA. All rights reserved. Tips for Breaking the Status Quo Taking your first steps into a larger world… o Calculate the ROI of increased feedback on performance o Calculate the KPI trends on repeated release candidates o Invade the sprint planning and add performance to the stories o Replace your test plans with continuous feedback from APM
- 14. April 16, 2015 14© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously)
- 15. April 16, 2015 15© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously) o Digital commerce & User Experience has changed Dev Cycles o Competing is different
- 16. April 16, 2015 16© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously) o Digital commerce & User Experience has changed Dev Cycles o Competing is different
- 17. April 16, 2015 17© 2015 SOASTA. All rights reserved. Tips for the Explosion of Apps Less is more… o Investigate performance sooner & faster, in smaller scope o Trust external dependencies, until proven otherwise o Know your competitors’ performance - leverage that knowledge o Calculate your impact on time-to-market or project schedules
- 18. April 16, 2015 18© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo
- 19. April 16, 2015 19© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck
- 20. April 16, 2015 20© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck o Integrate to the continuous pace o Add value with complete, integrated performance tests
- 21. April 16, 2015 21© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck o Integrate to the continuous pace o Add value with complete, integrated performance tests
- 22. April 16, 2015 22© 2015 SOASTA. All rights reserved. The Modern Approach TIME The Legacy Approach Run more tests in less time. Start earlier. Cover more ground.repeat / Test Analyz e Fix Test Dev Test Development Infra setup Tes t Analyze Retest RepeatFix Distributed Performance
- 23. April 16, 2015 23© 2015 SOASTA. All rights reserved. Distributed Perforamance Component scalability Performance baseline Integration testing End to End w/ Service Virtualization Unit scalability Database testing 3rd party services Live E2E tests Stress testing Soak test (reliability) Failover Capacity Latency Performance Regression (smoke tests) Network Testing (staging) Operations (prod)Development (sandbox) Define Tests with Real User Data
- 24. April 16, 2015 24© 2015 SOASTA. All rights reserved. Tips for Distributed Excellence Measure yourself by the impact on others… o Find project champions - create institutionalized excellence there o Start an inclusive, collaborative working group - not exclusive silo o Integrate with open-source tools across the lifecycle - enable them o Abandon the questionnaire - assign full-time facilitators
- 25. April 16, 2015 25© 2015 SOASTA. All rights reserved. • Rapidly collect accurate test specifications • Collaborate with all teams • Integrate testing processes • Try new approaches….
- 26. April 16, 2015 26© 2015 SOASTA. All rights reserved. 1. Break the Status Quo 2. Embrace the “App” culture of change 3. Reconsider centalized approches in an agile world
- 27. April 16, 2015 27© 2015 SOASTA. All rights reserved. o Read up on Performance Engineering o Try a free product o Get certified for FREE (SOASTA University) o Test Now and see! NEW WHITEPAPER! www.soasta.com