SlideShare a Scribd company logo
Agile QA 2.0
@aceconf
@mattphilip
Agile QA 2.0
Agile QA 2.0
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
2.  Call-to-action to
reinvigorate the state
of the practice
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
2.  Call-to-action to
reinvigorate the state
of the practice
3.  Work together to
come up
with better ways
So what have
we learned?
-- Barry Boehm (1981)
Eliminate the need for massive
inspection by building quality into the
product in the first place.
-- Edwards Deming (1982)
So what have
we learned?
”
“
Handoffs are waste.
-- Mary Poppendieck (2003)
So what have
we learned?
Move testing to the
front of the
development process
-- Agile Testing (2009)
So what have
we learned?
”
“
Kanban doesn’t mean a return to
waterfall.
-- David Anderson (paraphrase, 2013)
So what have
we learned?
So of course what do our card walls look like?
Agile QA 2.0
Agile QA 2.0
Agile QA 2.0
Agile QA 2.0
Agile QA 2.0
Agile QA 2.0
How did this happen?
We simply repeat the same process
that we've always done
QAs aren’t assertive enough to ask for change
We figure that, if we don’t, the QA
won't have anything to do (resource
efficiency)
#1
#2
#3
But why is this
a problem?
End-‐of-‐cycle testing (mini waterfalls)
#1 Creates too long a feedback loop
#2 Virtually ensures that our testing efforts are
misaligned with value 
#3 Reinforces gatekeeper role (oppositional)
#4 Creates inefficient test suite
But why is this
a problem?
Limits
options to
checking
through
GUI
Creates inefficient test suite
Which
leads to
this
So how do
we remedy
these problems?
Agile QA 2.0
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
Remedies QA and devs collaborate to determine the
right place to test#1 Bring QA forward
Many
here
Some
here
A few
here
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
* Specify acceptance tests up-front
(Acceptance-Test-Driven Development)
Remedies Acceptance-‐Test-‐Driven Development
Development
Iterations
Development
Engine
Write Story and Scenarios
Business Showcase
Story Testing
Story Planning Session
BA / QA Signoff on Dev Box
Daily BA/QA demo
Tester
Dev
BA
TesterDev
Tester BADev
Tester BADev
BABusiness
Tester
Start
Here
System
Testing
Implement Functionality
BABusiness
Implement Automated
Acceptance Tests
Dev
End Development Iteration
Start Development
Iteration
#1 Bring QA forward
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
* Testing efforts are aligned with business
needs and risk
* Specify acceptance tests up-front
(Acceptance-Test-Driven Development)
Remedies Re-‐start by mapping your done list to the wall
#1 Bring QA forward
#2 Map done list to the wall * Simple value-stream
* Lets the team take a conscious role in
defining its wall
Remedies Include QA in Work-‐In-‐Progress Limits
#1 Bring QA forward
#2 Map done list to the wall
#3 Include QA in WIP limits
Expand
this…… to
include this
* Encourages whole-team approach
Where do our biggest handoffs occur?
Here?Here?
Agile QA 2.0
Other considerations Quality Advocacy
Quality Advocacy
* Consultative
* Service provider
* Enabling and informing (not gatekeeping)
* Big picture-oriented
* Polyskilled and skill sharer
* Courageous
Other considerations Integrated QA:
QA is nowhere – and everywhereQuality Advocacy
Integrated QA * Remove Test/QA as a separate column altogether
* QA provides real-time, zero-cycle-time feedback
* Decouples what from who,
decreases bottleneck
* Commits devs and testers
toward same goal:
working, tested software
So do we have a place for
any kind of end-of-cycle testing?
Agile QA 2.0
Other considerations Exploratory Testing as First-‐Class Practice
Quality Advocacy
Integrated QA
Exploratory testing
* Not simply “clickin’ around” but
highly-skilled discipline
* Anyone with the right skill, independence can do it
* Model it on the wall
So what are you
going to do starting Wednesday?
References
§  Alister Scott, http://watirmelon.com/2013/02/28/the-new-qa-the-quality-advocate/
§  Barry Boehm, Software Engineering Economics
§  Martin Fowler, http://martinfowler.com/bliki/TestPyramid.html
§  InfoQ, http://www.infoq.com/articles/David-Anderson-Kanban
§  Deming Institute, http://deming.org/
mphilip@thoughtworks.com
@mattphilip

More Related Content

What's hot (20)

PDF
Agile Testing – embedding testing into agile software development lifecycle
Kari Kakkonen
 
PDF
Optimising Quality Assurance in an Agile World
Original Software
 
PDF
How to Build in Quality from Day 1 using Lean QA and Agile Testing
Atlassian
 
PPTX
Shift left as first transformation step into Quality Assurance
Zbyszek Mockun
 
PPT
Agile testing
Yogita patil
 
PPTX
Agile testing - Testing From Day 1
Kaizenko
 
PPTX
Testing strategy for agile projects updated
Tharinda Liyanage
 
PDF
Agile Testing Introduction
Hai Tran Son
 
PPT
Optimizing Your Agile Testing Processes
Stanton Champion
 
PPTX
Agile Testing Best Practices
Stephen Ritchie
 
PPTX
Agile Testing and Test Automation
Naveen Kumar Singh
 
PPTX
Agile QA: Redefining Quality in the Wild West
Ford Prior
 
PPTX
Introduction to Agile Testing
Raymond Adrian (Rad) Butalid
 
PDF
The Three Pillars Approach to Your Agile Test Strategy
TechWell
 
PPTX
Introduction to Agile Testing
vodQA
 
PPTX
ISTQB agile tester exam - Conclusions about Certification
Michał Dudziak
 
PPTX
Agile tour ncr test360_degree - agile testing on steroids
Vipul Gupta
 
PPTX
Agile Testing - presentation for Agile User Group
suwalki24.pl
 
PPTX
Agile Testing by Example
Mikalai Alimenkou
 
PPTX
Quality strategies in Agile Transformation
Kaali Dass PMP, PhD.
 
Agile Testing – embedding testing into agile software development lifecycle
Kari Kakkonen
 
Optimising Quality Assurance in an Agile World
Original Software
 
How to Build in Quality from Day 1 using Lean QA and Agile Testing
Atlassian
 
Shift left as first transformation step into Quality Assurance
Zbyszek Mockun
 
Agile testing
Yogita patil
 
Agile testing - Testing From Day 1
Kaizenko
 
Testing strategy for agile projects updated
Tharinda Liyanage
 
Agile Testing Introduction
Hai Tran Son
 
Optimizing Your Agile Testing Processes
Stanton Champion
 
Agile Testing Best Practices
Stephen Ritchie
 
Agile Testing and Test Automation
Naveen Kumar Singh
 
Agile QA: Redefining Quality in the Wild West
Ford Prior
 
Introduction to Agile Testing
Raymond Adrian (Rad) Butalid
 
The Three Pillars Approach to Your Agile Test Strategy
TechWell
 
Introduction to Agile Testing
vodQA
 
ISTQB agile tester exam - Conclusions about Certification
Michał Dudziak
 
Agile tour ncr test360_degree - agile testing on steroids
Vipul Gupta
 
Agile Testing - presentation for Agile User Group
suwalki24.pl
 
Agile Testing by Example
Mikalai Alimenkou
 
Quality strategies in Agile Transformation
Kaali Dass PMP, PhD.
 

Viewers also liked (6)

PPTX
Agile Qa Framework Jacky Wu
Jacky Wu
 
PPTX
Testing Best Practices
Axway Appcelerator
 
PPTX
Workplay: The gamified future of agile development (Agile India 2012)
Matthew Philip
 
PPTX
Ugly Truths About Scaling Agile
Cprime
 
PPTX
Scaling Agile at Spotify (representation)
Vlad Mysla
 
PDF
Agile QA Process
Anand Bagmar
 
Agile Qa Framework Jacky Wu
Jacky Wu
 
Testing Best Practices
Axway Appcelerator
 
Workplay: The gamified future of agile development (Agile India 2012)
Matthew Philip
 
Ugly Truths About Scaling Agile
Cprime
 
Scaling Agile at Spotify (representation)
Vlad Mysla
 
Agile QA Process
Anand Bagmar
 
Ad

Similar to Agile QA 2.0 (20)

PDF
JDD2014: QA to AQ: shifting from quality assurance to agile quality - Joseph ...
PROIDEA
 
PPTX
QA in an agile world Tom Churchwell
Tom Churchwell
 
PPTX
Agile testing for mere mortals
Dave Haeffner
 
PDF
MHA2018 - Quality Advocacy: The next progression for Agile Testers - Don Peters
AgileDenver
 
PPTX
Testing Does Not Equal Quality
lazygolfer
 
PPT
A confused tester in agile world finalversion
Ashish Kumar
 
PDF
Iakiv Kramarenko: “Quality Driven Development”
Dakiry
 
PPSX
DISE - Software Testing and Quality Management
Rasan Samarasinghe
 
PDF
Introduction-Software-Testing-for Developers.pdf
NoviaNengtiyas
 
PPTX
Is Test Planning a lost art in Agile? by Michelle Williams
QA or the Highway
 
PDF
Quality Loopback
Omar Bashir
 
PDF
White paper quality at the speed of digital
rajni singh
 
PPT
QA In Agile: solutions
Alexey Krivitsky
 
PDF
Don’t Go over the Waterfall: Keep Agile Testing Agile
TechWell
 
ODP
Agile and QA... ma che ciazzecca?
Stefano Fornari
 
PPTX
Development Projects Failing? What can the Business Analyst Do?
CTE Solutions Inc.
 
PDF
Software Quality: A Cross-Organizational Competency
TechWell
 
PPT
QA в Agile
Denis Petelin
 
PPT
Qa In Agile
Denis Petelin
 
PDF
Helpful Practices in Agile Testing
Josiah Renaudin
 
JDD2014: QA to AQ: shifting from quality assurance to agile quality - Joseph ...
PROIDEA
 
QA in an agile world Tom Churchwell
Tom Churchwell
 
Agile testing for mere mortals
Dave Haeffner
 
MHA2018 - Quality Advocacy: The next progression for Agile Testers - Don Peters
AgileDenver
 
Testing Does Not Equal Quality
lazygolfer
 
A confused tester in agile world finalversion
Ashish Kumar
 
Iakiv Kramarenko: “Quality Driven Development”
Dakiry
 
DISE - Software Testing and Quality Management
Rasan Samarasinghe
 
Introduction-Software-Testing-for Developers.pdf
NoviaNengtiyas
 
Is Test Planning a lost art in Agile? by Michelle Williams
QA or the Highway
 
Quality Loopback
Omar Bashir
 
White paper quality at the speed of digital
rajni singh
 
QA In Agile: solutions
Alexey Krivitsky
 
Don’t Go over the Waterfall: Keep Agile Testing Agile
TechWell
 
Agile and QA... ma che ciazzecca?
Stefano Fornari
 
Development Projects Failing? What can the Business Analyst Do?
CTE Solutions Inc.
 
Software Quality: A Cross-Organizational Competency
TechWell
 
QA в Agile
Denis Petelin
 
Qa In Agile
Denis Petelin
 
Helpful Practices in Agile Testing
Josiah Renaudin
 
Ad

More from Matthew Philip (20)

PDF
Metrics at Every (Flight) Level
Matthew Philip
 
PDF
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
Matthew Philip
 
PDF
The 8 Stances of 
a Transformational Leader
Matthew Philip
 
PDF
Strategy Deployment: Aligning Action to Vision
Matthew Philip
 
PDF
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Matthew Philip
 
PDF
Stop writing stories, start validating working software
Matthew Philip
 
PDF
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
Matthew Philip
 
PDF
From Andon to Yokoten: Japanese for Agilists
Matthew Philip
 
PDF
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
Matthew Philip
 
PDF
Leadership at every level [prdc2019]
Matthew Philip
 
PDF
No (Lab) Jacket Required [Agile Midwest Conference]
Matthew Philip
 
PDF
Leadership at Every Level: Practices for Aligned Autonomy
Matthew Philip
 
PDF
Kanban Cadences for Santa
Matthew Philip
 
PDF
Portfolio kanban (St. Louis Agile Product Ownership Meetup)
Matthew Philip
 
PDF
Culture add over culture fit [flowcon 2018]
Matthew Philip
 
PDF
The Service Delivery Review: The Missing Agile Feedback Loop
Matthew Philip
 
PDF
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Matthew Philip
 
PDF
Leadership at Every Level: Intent-Based Leadership Practices
Matthew Philip
 
PDF
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
Matthew Philip
 
PDF
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
Matthew Philip
 
Metrics at Every (Flight) Level
Matthew Philip
 
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
Matthew Philip
 
The 8 Stances of 
a Transformational Leader
Matthew Philip
 
Strategy Deployment: Aligning Action to Vision
Matthew Philip
 
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Matthew Philip
 
Stop writing stories, start validating working software
Matthew Philip
 
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
Matthew Philip
 
From Andon to Yokoten: Japanese for Agilists
Matthew Philip
 
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
Matthew Philip
 
Leadership at every level [prdc2019]
Matthew Philip
 
No (Lab) Jacket Required [Agile Midwest Conference]
Matthew Philip
 
Leadership at Every Level: Practices for Aligned Autonomy
Matthew Philip
 
Kanban Cadences for Santa
Matthew Philip
 
Portfolio kanban (St. Louis Agile Product Ownership Meetup)
Matthew Philip
 
Culture add over culture fit [flowcon 2018]
Matthew Philip
 
The Service Delivery Review: The Missing Agile Feedback Loop
Matthew Philip
 
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Matthew Philip
 
Leadership at Every Level: Intent-Based Leadership Practices
Matthew Philip
 
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
Matthew Philip
 
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
Matthew Philip
 

Recently uploaded (20)

PDF
Timothy Rottach - Ramp up on AI Use Cases, from Vector Search to AI Agents wi...
AWS Chicago
 
PDF
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
PDF
NewMind AI - Journal 100 Insights After The 100th Issue
NewMind AI
 
PDF
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
PPTX
OpenID AuthZEN - Analyst Briefing July 2025
David Brossard
 
PDF
Empower Inclusion Through Accessible Java Applications
Ana-Maria Mihalceanu
 
PDF
Chris Elwell Woburn, MA - Passionate About IT Innovation
Chris Elwell Woburn, MA
 
PDF
Blockchain Transactions Explained For Everyone
CIFDAQ
 
PDF
Transcript: New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
PDF
"Beyond English: Navigating the Challenges of Building a Ukrainian-language R...
Fwdays
 
PDF
How Startups Are Growing Faster with App Developers in Australia.pdf
India App Developer
 
PDF
Log-Based Anomaly Detection: Enhancing System Reliability with Machine Learning
Mohammed BEKKOUCHE
 
PPTX
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
PDF
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
PDF
Fl Studio 24.2.2 Build 4597 Crack for Windows Free Download 2025
faizk77g
 
PDF
Using FME to Develop Self-Service CAD Applications for a Major UK Police Force
Safe Software
 
PDF
Smart Trailers 2025 Update with History and Overview
Paul Menig
 
PDF
July Patch Tuesday
Ivanti
 
PDF
HCIP-Data Center Facility Deployment V2.0 Training Material (Without Remarks ...
mcastillo49
 
PDF
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 
Timothy Rottach - Ramp up on AI Use Cases, from Vector Search to AI Agents wi...
AWS Chicago
 
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
NewMind AI - Journal 100 Insights After The 100th Issue
NewMind AI
 
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
OpenID AuthZEN - Analyst Briefing July 2025
David Brossard
 
Empower Inclusion Through Accessible Java Applications
Ana-Maria Mihalceanu
 
Chris Elwell Woburn, MA - Passionate About IT Innovation
Chris Elwell Woburn, MA
 
Blockchain Transactions Explained For Everyone
CIFDAQ
 
Transcript: New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
"Beyond English: Navigating the Challenges of Building a Ukrainian-language R...
Fwdays
 
How Startups Are Growing Faster with App Developers in Australia.pdf
India App Developer
 
Log-Based Anomaly Detection: Enhancing System Reliability with Machine Learning
Mohammed BEKKOUCHE
 
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
Fl Studio 24.2.2 Build 4597 Crack for Windows Free Download 2025
faizk77g
 
Using FME to Develop Self-Service CAD Applications for a Major UK Police Force
Safe Software
 
Smart Trailers 2025 Update with History and Overview
Paul Menig
 
July Patch Tuesday
Ivanti
 
HCIP-Data Center Facility Deployment V2.0 Training Material (Without Remarks ...
mcastillo49
 
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 

Agile QA 2.0

  • 4. Why this talk? 1.  Agile QA 1.0 never made it past “staging”
  • 5. Why this talk? 1.  Agile QA 1.0 never made it past “staging” 2.  Call-to-action to reinvigorate the state of the practice
  • 6. Why this talk? 1.  Agile QA 1.0 never made it past “staging” 2.  Call-to-action to reinvigorate the state of the practice 3.  Work together to come up with better ways
  • 7. So what have we learned? -- Barry Boehm (1981)
  • 8. Eliminate the need for massive inspection by building quality into the product in the first place. -- Edwards Deming (1982) So what have we learned? ” “
  • 9. Handoffs are waste. -- Mary Poppendieck (2003) So what have we learned?
  • 10. Move testing to the front of the development process -- Agile Testing (2009) So what have we learned? ” “
  • 11. Kanban doesn’t mean a return to waterfall. -- David Anderson (paraphrase, 2013) So what have we learned?
  • 12. So of course what do our card walls look like?
  • 19. How did this happen? We simply repeat the same process that we've always done QAs aren’t assertive enough to ask for change We figure that, if we don’t, the QA won't have anything to do (resource efficiency) #1 #2 #3
  • 20. But why is this a problem? End-‐of-‐cycle testing (mini waterfalls) #1 Creates too long a feedback loop #2 Virtually ensures that our testing efforts are misaligned with value  #3 Reinforces gatekeeper role (oppositional) #4 Creates inefficient test suite
  • 21. But why is this a problem? Limits options to checking through GUI Creates inefficient test suite Which leads to this
  • 22. So how do we remedy these problems?
  • 24. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test
  • 25. Remedies QA and devs collaborate to determine the right place to test#1 Bring QA forward Many here Some here A few here
  • 26. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test * Specify acceptance tests up-front (Acceptance-Test-Driven Development)
  • 27. Remedies Acceptance-‐Test-‐Driven Development Development Iterations Development Engine Write Story and Scenarios Business Showcase Story Testing Story Planning Session BA / QA Signoff on Dev Box Daily BA/QA demo Tester Dev BA TesterDev Tester BADev Tester BADev BABusiness Tester Start Here System Testing Implement Functionality BABusiness Implement Automated Acceptance Tests Dev End Development Iteration Start Development Iteration #1 Bring QA forward
  • 28. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test * Testing efforts are aligned with business needs and risk * Specify acceptance tests up-front (Acceptance-Test-Driven Development)
  • 29. Remedies Re-‐start by mapping your done list to the wall #1 Bring QA forward #2 Map done list to the wall * Simple value-stream * Lets the team take a conscious role in defining its wall
  • 30. Remedies Include QA in Work-‐In-‐Progress Limits #1 Bring QA forward #2 Map done list to the wall #3 Include QA in WIP limits Expand this…… to include this * Encourages whole-team approach
  • 31. Where do our biggest handoffs occur? Here?Here?
  • 33. Other considerations Quality Advocacy Quality Advocacy * Consultative * Service provider * Enabling and informing (not gatekeeping) * Big picture-oriented * Polyskilled and skill sharer * Courageous
  • 34. Other considerations Integrated QA: QA is nowhere – and everywhereQuality Advocacy Integrated QA * Remove Test/QA as a separate column altogether * QA provides real-time, zero-cycle-time feedback * Decouples what from who, decreases bottleneck * Commits devs and testers toward same goal: working, tested software
  • 35. So do we have a place for any kind of end-of-cycle testing?
  • 37. Other considerations Exploratory Testing as First-‐Class Practice Quality Advocacy Integrated QA Exploratory testing * Not simply “clickin’ around” but highly-skilled discipline * Anyone with the right skill, independence can do it * Model it on the wall
  • 38. So what are you going to do starting Wednesday?
  • 39. References §  Alister Scott, http://watirmelon.com/2013/02/28/the-new-qa-the-quality-advocate/ §  Barry Boehm, Software Engineering Economics §  Martin Fowler, http://martinfowler.com/bliki/TestPyramid.html §  InfoQ, http://www.infoq.com/articles/David-Anderson-Kanban §  Deming Institute, http://deming.org/ [email protected] @mattphilip