Downloaded 20 times
Uploaded byCraig Smith
The Speed to Cool: Agile Testing & Building Quality In
This document discusses agile testing practices and building quality into software development. It provides examples of how testing can be integrated into agile workflows, definitions of quality, and strategies for test automation, planning and reporting. Images and diagrams are included to illustrate concepts like quality attributes, success sliders, metrics reporting and the roles of testers in agile teams.
More Related Content
Similar to The Speed to Cool: Agile Testing & Building Quality In
![Governance, Deployment & Methodologies for Agentic Automation [2/3]](https://cdn.slidesharecdn.com/ss_thumbnails/agenticcommunityseries-day2-251112135038-a386476d-thumbnail.jpg?width=640&height=640&fit=bounds)
The Speed to Cool: Agile Testing & Building Quality In
- 1. Speed to Cool:Agile Testing & Building Quality InCraig Smith
- 2. Welcome… Image: ©Gracie Films / 20thCentury Fox Television http://www.paleodietrecipes.org.uk/paleo-images/content/homer-confession.jpg
- 3. Image: Pineapples101 (Flickr)http://www.flickr.com/photos/pineapples101/4292778673/in/set-72157623131356129/ The speed to cool…
- 4.
- 5.
- 6. How Management SeeTesting Image: http://www.craigsfire.com/wp-content/uploads/2010/02/pool.jpg
- 7. How Management WouldLike To See Testing Image: http://us.123rf.com/400wm/400/400/dotshock/dotshock1012/dotshock101200006/8437158-internet-network-server-room-with-computers-racks-and-digital-receiver-for-digital-tv.jpg
- 8.
- 9.
- 10. Look left… Lookright…
- 11.
- 12. Image: © JerryBruckheimer Television http://images2.fanpop.com/images/photos/4700000/CSI-Las-Vegas-9x18-Mascara-csi-4772098-2000-1333.jpg CSI: Software
- 13.
- 14. To Do Analysis Develop Test Done We reflect work like this…
- 15. To Do Analysis Develop Test Done Which is really working like this…
- 16. Image: Craig Smith Remind you of something?
- 17. Let’s ponder theAgile Manifesto Responding tochange over following a plan
- 18. Image: © SonyComputer Entertainment Europe http://www.ultimateps3.fr/images/jeux/buzz-quiz-tv/buzz-quiz-tv_1216759203.jpg Time to play the “Agile Manifesto Tester’s Challenge”
- 19. Image: © Bright/Kauffman/CraneProductions http://miacannedy.files.wordpress.com/2012/11/friends-couch.jpg Individuals and interactions over processes and tools Challenge #1
- 20. Image: http://blog.agafonov.net.ua/image.axd?picture=2011%2F5%2FvNext+Visual+Studio+2011.jpg Workingsoftware overcomprehensive documentation Challenge #2
- 21. Challenge #3 Image:© Touchstone Pictures http://cdn.mymovies.ge/backdrops/ce6/4bc922b5017a3c57fe00dce6/metro-original.jpg Customer collaboration overcontract negotiation
- 22. Image: http://resources3.news.com.au/images/2014/04/01/1226870/743135-26b0c3f6-b92a-11e3-9942-d7dbb3111cd3.jpg Respondingto change overfollowing a plan Challenge #4
- 23. Analyst / Customer Developer Tester Automation Elaboration / Specification Acceptance Criteria High Performing AGILE Project Manager Testers in an agile team
- 24. Developer Tester Analyst More Technical Less Technical Code Design Unit Test AutomatedFunctional / Specialist Tests ManualTest ExploratoryTest Requirements Customer Collab. Developers need more testing involvement Testers need more technical involvement Analysts need more testing involvement Testers in an agile team
- 25. (noun) the standardof something as measured against other things of a similar kind; the degree of excellence of something oxforddictionaries.com Image: http://www.naccho.org/topics/infrastructure/accreditation/images/Quality-Definition.jpg / Definition of Quality…
- 26.
- 27.
- 28.
- 29.
- 30. Quality is everyone’sresponsibility Image: © AP http://i.telegraph.co.uk/multimedia/archive/01893/schumaker-dummies_1893704i.jpg
- 31. Everyone likes tobe seen to value quality Image: © Reveille Productions http://blogs.ubc.ca/kdergous/files/2010/10/body-language-the-office.jpg
- 32. Image: © UnitedFeature Syndicate http://s458.photobucket.com/albums/qq310/mrbigjohnson/Murals/?action=view¤t=NovemberPics115.jpg&newest=1 Quality from kickoff
- 33. 1 2 3 4 Cost Scope Quality Time X X X X Fixed Flexible Success sliders
- 34. 1 2 3 4 Cost Scope Quality Time X X X X Fixed Flexible Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg
- 35. 1 2 3 4 Cost Scope Quality Time X X X X Fixed Flexible Quality almost always at #3
- 36.
- 37. Reliability Robustness Availability Integrity Flexibility Usability Interoperability Efficiency Testability Maintainability Reusability Portability Reliability + + + + - + + Robustness + + + - Availability + + Integrity - - - - - Flexibility + - - + + + Usability + - - Interoperability - + - + Efficiency - - - - - - - - Testability + + + + - + Maintainability + + + - + Reusability - - + + - + + + Portability + - + - + - + Trade Offs
- 38. Quality Advocates Whatdoes quality mean to the different roles in the team? Quality Taxonomy What are quality attributes? Quality Prioritisation How do we know what quality attributes to include? Quality TradeoffRisks What are risks with the quality attributes we are trading off? Quality Measurement How do we test and measure quality? Success Sliders How does quality relate to the sliders? Quality Definition What does quality mean? Next Steps How do we apply quality to our work 1 2 3 4 5 6 7 8 Defining Quality
- 39.
- 40. Image: © 2008Melissa McKenneyhttp://www.kernel.org/pub/linux/kernel/people/paulmck/Confessions/Elephant_Team_03.jpg Shared understanding of quality
- 41.
- 42. Simple test strategy& plans
- 43.
- 44. Image: © SesameWorkshop http://images.wikia.com/muppet/images/9/95/Sesame-english-do-you-like-it-apple_count.jpg Reporting & Metrics
- 45. Understand Development, Quality& Release Metrics
- 46. Report on howtesting is going
- 47.
- 48. HEALTH PROJECT DEVELOPMENT TESTING USER 0 1 2 3 4 5 0 1 2 3 4 5 6 7 1 2 3 4 5 6 7 8 New Risks & Issues Raised Number of Risks & Issues Iteration TESTCOVERAGE 0 5 10 15 20 25 0 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 Number of Tests Number of Defects Iteration MAINTAINABILITY PERFORMANCE 0 200 400 600 800 1000 1200 1400 1600 1800 4700 4800 4900 5000 5100 5200 5300 5400 5500 5600 5700 1 2 3 4 5 6 7 8 Lines of Test Code Lines of Code Iteration OVERALL $- $5 $10 $15 $20 $25 $30 0 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 Business Value Number of Features Iteration BVC
- 49.
- 50. Software is aSeries of Loops Image: http://2.bp.blogspot.com/_4G2ptSlZZn0/R9nRjimkLII/AAAAAAAAAqA/tzYJjRyhLkk/s400/brekky05011049.jpg
- 51. End toend automated tests and cover 10 conditions per test, manual covers 1 condition per test Automated tests cover all high priority business flows, manual tests mostly cover lower priority flows Metrics need context! % Regression test cases automated Automated Manual How Much Automated Testing Is Enough?
- 52. Testing is morethan a series of merely repeatable actions Image: http://cdn.themis-media.com/media/global/images/library/deriv/71/71335.jpg
- 53. Image: © TheCuriosity Company / 20thCentury Fox Television http://images2.fanpop.com/images/photos/3200000/fry-bender-futurama-3295254-1024-768.jpg Low value vs high value
- 54. Testing Craftsmanship Image:© Wild Dancer Productions / Touchstone Television http://www.tvacres.com/images/props_tool_time_binford.jpg
- 55. Red Green Refactor Red Green Refactor ATDD ATDD TDD
- 56. Traditionally Test viathe UI Image: http://stovallorganizing.com/wp-content/uploads/2013/04/Turtleing.jpg
- 57. Manual Exploratory Collaborativelybuilt around system behaviour Developer built optimisedfor fast feedback Confidence Speed / Feedback Exercises components and systems Investment Profile
- 58.
- 59. Image: © GracieFilms / 20thCentury Fox Television http://www.widewallpapers.net/mod/cartoons/simpsons/simpsons-1920x1200-021.jpg Quality Maturity
- 60.
- 61.
- 62.
- 63. No agreed approachto testing Tests are not considered a valuable asset An agreed approach to testing that is aligned to a definition of quality Tests are considered a valuable asset that can be reused as features are progressively implemented Test strategy is agreed and understood by the team and includes targets (coverage, defects, …) Test strategy is documented and visible as a BVC used by the team Non-functional requirements are agreed and included in the test strategy Test planning is based on risk (technical complexity and business impact) Test artifacts are treated with the same importance as code and are properly maintained and refactored The relevant ____ilityand security tests form part of the test strategy -1 1 2 3 4 Test Planning
- 64. Image: © OrionPictures http://sadair.com/wp-content/uploads/2010/07/Robocop_Final012-1024x768.jpg ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENF RCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE O F LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: TH Empowering Testing
- 65. Automation: I workwith developers to automate tests that provide business value and identify system risks Collaboration: I work with analysts and SMEsto ensure that testable acceptance criteria are created for all stories Strategy & Planning: I am involved in the project at all stages to ensure that testing provides the greatest value and quality objectives are achieved Tools & Techniques: I use both manual and automated techniques using the preferred testing tools based on the situation Architecture: I have an understanding of the system architecture and can create tests that verify individual components and the system as a whole Development: I take an interest in development practices and monitor code quality metrics Estimating: I am involved in developing estimates for projects at a story level, for tools and infrastructure and also for deployment/release activities Reporting: I provide metrics that give insight into project health and system quality Agile: I understand Agile project delivery and the differences between testing in the different phases of an phase Qualifications & Training: I have recognised qualifications in testing and continually update and maintain my skills Recruitment & Development: I am attracted to the organisation because testing is a cool career path that offers heaps of opportunities and a way of continually developing my skills Community & Teams: I am part of a community of testers that are embedded within teams but share common values Future Tester
- 66.
- 67. Agile Testing CommandLine Interface Continuous Integration Version Control Build Tools Capture Replay (Selenium) HTML Test Maintenance & Data Specification By Example / ATDD / BDD Concordion/ Cucumber SQL Web Services Test Automation Course
- 68. New Software TestEngineer Role New Graduates, Recruits, Consultants & Partners BA SME Other Up Skill Assessment Current Test Analysts Capable + Current Skills + Desire Capable + Desire Not Capable + No Desire Not Capable + Desire **Assessment = Technical Test + Interview** Assist & Assess
- 69.
- 70.
- 71.
- 72. Continuous Integration WatchCode Build / Compile Run Tests / Analysis Publish Results Stop The Line! Failure?
- 73. Continuous Delivery Image:http://www.thoughtworks.com/imgs/drawing-cd-header.png
- 74.
- 75. Image: http://www.hackerchick.com/wp-content/uploads/2012/01/2012-01-Kanban-is-the-new-Scrum.jpg http://media.tumblr.com/8b6564487c4ee9bc0698fa880d183fe9/tumblr_inline_moky6riBro1qz4rgp.jpg Iterative was only the beginning! Next ???
- 76. Wrap Up Image:© Chuck Lorre Productions http://24.media.tumblr.com/tumblr_ksvfroko3J1qa88nco1_500.jpg
- 77. Do you havea testing skillset (or are you just doing testing?) Image: © Jerry Bruckheimer Television http://photos.telestrekoza.com/var/resizes/Current_shows/CSI/Stills/CSI-Trilogy-Crossover/Miami_8x07/CSI-Miami-Episode-8-07-Bone-Voyage-Promotional-Photos-csi-miami-8507515-1999-1315.jpg
- 78. Does everybody understandtheir role in quality? Image: http://www.swotti.com/tmp/swotti/cacheDMLSBGFNZSBWZW9WBGU=/imgVILLAGE%20PEOPLE1.jpg
- 79. Are you buildingquality in from the start? Image: © HiTEntertainment / Hot Animation http://1.bp.blogspot.com/-iLEyvBHn-W0/TglUWW5Or0I/AAAAAAAAAds/HXtPDGPLghA/s1600/bob+the+builder.jpg
- 80. Are you measuringtesting & assessing quality? Image: © Talent Associates http://confoundedinterest.files.wordpress.com/2011/06/maxwellsmart_missed_it_by_that_much.jpg?w=600&h=423
- 81. Are you huntingdown best practices? Image: © King Features Syndicate / Lee Falk http://www.comicwallpapers.co.uk/images/main/Miscellaneous/Other/1600900/PhantomGen_1010.jpg
- 82. Are you oryour testers empowered? Image: © DC Comics http://collider.com/wp-content/uploads/superman_alex_ross2.jpg
- 83. The world aroundus is getting faster (A… is just the start) Image: https://drawception.com/pub/panels/2012/5-13/ATX2Tj5p9f-12.png
- 84. Image: © Miller-MilkisProductionshttp://imagetime.co.gp/key/henry%20winkler%20ron%20howard# Testing is cool…
- 85. Image: © UniversalTelevision http://30.media.tumblr.com/tumblr_l6g4d631K31qzp4mwo1_r1_500.jpg …but I love it when delivery and quality come together!
- 86.