"The Art of Questioning
to improve Testing, Agile,
and Automating"
Alan Richardson
Test Consultant
CompendiumDev.co.uk
EvilTester.com
@EvilTester
Asking Questions to...
● Build a model: risks, issues, gaps
● What questions expose the risks?
● What questions trigger action?
● What questions foster responsibility?
5 Whys
● Common 'management' questioning
● Toyota
● (Lean) Six Sigma Tool
● Root Cause Analysis
Fritz Perls on Why
If we spend our time looking for
causes instead of structure we may
as well give up the idea of therapy
and join the group of worrying
grandmothers who attack their prey
with such pointless questions as
“Why did you catch that cold?” “Why
have you been so naughty?”
Fritz Perls,
The Gestalt Approach
“
”
“Why?” is a Belief Question
● Beliefs about causes
● Reinforces a model
– Justification
● Leads to:
– Because...
How? What? Where? When? Who?
● Explore a model
● Build a system
● Lead to
– Experiments
– Action
– Responsibility
Dear Evil Tester
Q&A Agony Aunt for Testers
Sometimes we don't know what to
do and just need some advice.
Q: Should I pretend to test?
“In the past I have worked with project
managers who have only pretended to
manage. Just in case I come across this
sort again in the future, I want to know;
should I only pretend to test too, as a
form of self-preservation?”
Eliza
A: No
Dear Eliza,
...
"NO".
...
All the best,
Uncle Evil
Q: Should I pretend to test?
“In the past I have worked with project
managers who have only pretended to
manage. Just in case I come across this
sort again in the future, I want to know;
should I only pretend to test too, as a
form of self-preservation?”
Eliza
Questions
have a model
of the world
embedded in
them.
Q: Tester not pulling their weight?
Dear Evil Tester,
What's the best way to deal
with a fellow tester who is not
pulling his/her weight?
Anon
A: Delegate Upwards
Dear Anon,
...raise your concerns to your
manager, after all your lazy
manager usually has plenty of
time on their hands, and it is
their responsibility to deal with
your light-weight under
performing co-workers.
Yours,
Team Spirit Coach Evil
Answers also
have a model
of the world
embedded in
them.
A: Delegate Upwards
Dear Anon,
...raise your concerns to your
manager, after all your lazy
manager usually has plenty of
time on their hands, and it is
their responsibility to deal with
your light-weight under
performing co-workers.
Yours,
Team Spirit Coach Evil
Answers also
have a model
of the world
embedded in
them.
Q&A
Provocation
Some Questions are Practical
Q: How to Track Exploratory Testing
Dear Evil Tester,
Do you recommend any tools for
note-taking and managing test
sessions?
Dependency Danger
What do I do next?
What do I do next again?
Consultancy Job Security
● Job Security – 'the answer person'
● Consultants / Managers / Leads
– Aim to go 'out of business'
● build flexibility
● not dependency
Dependency
● Asking questions for 'answers' rather than
to build a model to increase understanding
● A step by step model has no flexibility
● Not learning to ask questions that help
when expert is not present
Avoiding Dependency
● Lead by example
– “asking the right questions”
● Ask questions
– which expose underlying model
– to prompt exploration of model
● Gaps, risks
– to prompt comparison of model to system
● Issues, bugs
Modelling Testing as Questioning
● Given a model, does the System
match the model?
● Requirements say X, can I do X?
● System 'looks like' I should be able to
do Y, can I?
Modelling Testing as Questioning
● Under this model:
– Test == Ask a Question
– Answer -> Expand/Confirm Model
– Reporting == Communicate Model
Modelling Agile as Questioning
● Agile
– responding to change
– Change based on learning
– Learning == changes to models &
understanding
Modelling Agile as Questioning
Agile requires asking a lot of questions
– What are we doing?
– Why?
– How Well?
– Could be better?
– How much?
– Minimum acceptable?
– constantly
Automating as Questioning
● Automate putting system into a specific
state
● Codify specific pre-defined questions
● Assert on the answers
...Repeat
Automating as Questioning
● Automate putting system into a specific
state
● Codify specific pre-defined questions
● Assert on the answers
...Repeat Questions
have a model
of the world
embedded in
them.
Meta-Model
Meta-Model
http://compendiumdev.co.uk/nlp
Meta-Model
Meta-Model
Summary
● The questions we ask reveal our model of the
world.
● We can ask questions of 'the world' to explore
and expand our model.
@EvilTester 35
Ask The Questions!
● Alan Richardson
– @EvilTester
– www.EvilTester.com
– www.JavaForTester.com
– www.SeleniumSimplified.com
– www.CompendiumDev.co.uk

More Related Content

PDF
Agile Testing Days 2014 Keynote - Helping Testers Add Value on Agile Projects
PDF
Why You Should Learn Skills That Have No Application in Real Life
PDF
Confessions of an Accidental Security Tester
PDF
TestIstanbul May 2013 Keynote Experiences With Exploratory Testing
PDF
Technical Testing Webinar
PDF
Open source tools - Test Management Summit - 2009
PDF
Lessons Learned When Automating
PDF
Evil testers guide to technical testing
Agile Testing Days 2014 Keynote - Helping Testers Add Value on Agile Projects
Why You Should Learn Skills That Have No Application in Real Life
Confessions of an Accidental Security Tester
TestIstanbul May 2013 Keynote Experiences With Exploratory Testing
Technical Testing Webinar
Open source tools - Test Management Summit - 2009
Lessons Learned When Automating
Evil testers guide to technical testing

What's hot (20)

PDF
The Evil Tester's Guide to HTTP proxies Tutorial
PPTX
"Worst" practices of software testing
PDF
Test automation – the bitter truth
PPTX
Hindsight lessons about API testing
PPTX
Break to build - the mindset of the modern day tester
PDF
Worst practices in software testing by the Testing troll
PDF
Black Ops Testing Workshop from Agile Testing Days 2014
ODP
Assorted TDD tips
PDF
Automating Pragmatically - Testival 20190604
PDF
If you want to automate, you learn to code
PPT
Reliable tests with selenium web driver
PPTX
James thomas
PDF
Selenium Users Anonymous
PPTX
Agile testing for mere mortals
PPTX
Intro to TDD
PDF
Agile 2012 pitfalls in agile testing - paul carvalho
PPTX
Risk Mitigation Using Exploratory and Technical Testing - QASymphony Webinar ...
PPTX
Agile2015: Explore with Intent - Self-Management
ODP
Agille Testing Meetup 1
PPTX
UK star ultimate testing survival
The Evil Tester's Guide to HTTP proxies Tutorial
"Worst" practices of software testing
Test automation – the bitter truth
Hindsight lessons about API testing
Break to build - the mindset of the modern day tester
Worst practices in software testing by the Testing troll
Black Ops Testing Workshop from Agile Testing Days 2014
Assorted TDD tips
Automating Pragmatically - Testival 20190604
If you want to automate, you learn to code
Reliable tests with selenium web driver
James thomas
Selenium Users Anonymous
Agile testing for mere mortals
Intro to TDD
Agile 2012 pitfalls in agile testing - paul carvalho
Risk Mitigation Using Exploratory and Technical Testing - QASymphony Webinar ...
Agile2015: Explore with Intent - Self-Management
Agille Testing Meetup 1
UK star ultimate testing survival
Ad

Viewers also liked (20)

PDF
Automation for the People
PPTX
Yandex allure
PPTX
COMAQA.BY Conf #2: “Настройка Allure при использовании TestNG-Retry, Антон Ем...
PPTX
AQA TALKS 4 - AUTOMATION TEST REPORTER
PDF
Allure framework
PDF
Why Test Automation Fails
PDF
Allure Framework
PDF
Test Bash Netherlands Alan Richardson "How to misuse 'Automation' for testing...
PPTX
Facilitative questions
PPTX
Value system and value teaching
PPTX
Mediums and techniques of visual arts
PPT
The art of questioning (2)
PDF
Spectrum Organizational Development - Skillful Questioning
PPT
The Elements of Design
PDF
Making Your Results Visible - A Test Result Dashboard and Comparison Tool
PPTX
Organization in the visual arts and Principles of Design
PDF
Bullshit driven development
PPT
Test Automation Best Practices (with SOA test approach)
PPTX
The Art of Questioning : Teacher’s Role
PPTX
Mediums of the Visual Arts
Automation for the People
Yandex allure
COMAQA.BY Conf #2: “Настройка Allure при использовании TestNG-Retry, Антон Ем...
AQA TALKS 4 - AUTOMATION TEST REPORTER
Allure framework
Why Test Automation Fails
Allure Framework
Test Bash Netherlands Alan Richardson "How to misuse 'Automation' for testing...
Facilitative questions
Value system and value teaching
Mediums and techniques of visual arts
The art of questioning (2)
Spectrum Organizational Development - Skillful Questioning
The Elements of Design
Making Your Results Visible - A Test Result Dashboard and Comparison Tool
Organization in the visual arts and Principles of Design
Bullshit driven development
Test Automation Best Practices (with SOA test approach)
The Art of Questioning : Teacher’s Role
Mediums of the Visual Arts
Ad

Similar to The Art of Questioning to improve Software Testing, Agile and Automating (20)

PPT
Root cause analysis apr 2010
PDF
Combining statistics and human judgement
PPTX
Beyond Agile Practices: Where Did We Go Wrong?
PDF
Creating Yourself as a Tester - Keynote Nordic Testing Days June 2017
PDF
Brad Klingenberg, Director of Styling Algorithms, Stitch Fix at MLconf SF - 1...
PPTX
2. know your self first
PDF
5 Cycles Remote Innovation - Systems
PPTX
Nasty Impediments: Unclog the Pipe for Business Agility
PDF
Behavioral hypothesis of team behavior
PDF
Interview winning skills
PPTX
Understanding Lean & Agile Coaching Agile and Beyond 2018
PDF
Adam Wesolowski "How to start working on growth?"
PPTX
Angina Monologues: Ten Essential Steps to Get Through Your Dissertation
PPTX
Using critical thinking to crack case based interviews
PPTX
Sm module a part 2 self confidence
PPT
SM Module A Part 2 Self-Confidence in students.ppt
PPTX
Advancing Testing Using Axioms
PDF
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
PDF
ACM healthcare Interview tips
Root cause analysis apr 2010
Combining statistics and human judgement
Beyond Agile Practices: Where Did We Go Wrong?
Creating Yourself as a Tester - Keynote Nordic Testing Days June 2017
Brad Klingenberg, Director of Styling Algorithms, Stitch Fix at MLconf SF - 1...
2. know your self first
5 Cycles Remote Innovation - Systems
Nasty Impediments: Unclog the Pipe for Business Agility
Behavioral hypothesis of team behavior
Interview winning skills
Understanding Lean & Agile Coaching Agile and Beyond 2018
Adam Wesolowski "How to start working on growth?"
Angina Monologues: Ten Essential Steps to Get Through Your Dissertation
Using critical thinking to crack case based interviews
Sm module a part 2 self confidence
SM Module A Part 2 Self-Confidence in students.ppt
Advancing Testing Using Axioms
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
ACM healthcare Interview tips

More from Alan Richardson (20)

PDF
Add More Security To Your Testing and Automating - Saucecon 2021
PDF
Automating to Augment Testing
PDF
Automating Tactically vs Strategically SauceCon 2020
PDF
The Future of Testing Webinar
PDF
Devfest 2019-slides
PDF
Secrets and Mysteries of Automated Execution Keynote slides
PDF
Joy of Coding Conference 2019 slides - Alan Richardson
PDF
Programming katas for Software Testers - CounterStrings
PDF
Technology Based Testing
PDF
About Consultant Alan Richardson Compendium Developments Evil Tester
PDF
Shift left-testing
PDF
Automating and Testing a REST API
PDF
Technical and Testing Challenges: Using the "Protect The Square" Game
PDF
TDD - Test Driven Development - Java JUnit FizzBuzz
PDF
How To Test With Agility
PDF
Your Automated Execution Does Not Have to be Flaky
PDF
What is Testability vs Automatability? How to improve your Software Testing.
PDF
What is Agile Testing? A MindMap
PDF
Evil Tester's Guide to Agile Testing
PDF
The Evil Tester Show - Episode 001 Halloween 2017
Add More Security To Your Testing and Automating - Saucecon 2021
Automating to Augment Testing
Automating Tactically vs Strategically SauceCon 2020
The Future of Testing Webinar
Devfest 2019-slides
Secrets and Mysteries of Automated Execution Keynote slides
Joy of Coding Conference 2019 slides - Alan Richardson
Programming katas for Software Testers - CounterStrings
Technology Based Testing
About Consultant Alan Richardson Compendium Developments Evil Tester
Shift left-testing
Automating and Testing a REST API
Technical and Testing Challenges: Using the "Protect The Square" Game
TDD - Test Driven Development - Java JUnit FizzBuzz
How To Test With Agility
Your Automated Execution Does Not Have to be Flaky
What is Testability vs Automatability? How to improve your Software Testing.
What is Agile Testing? A MindMap
Evil Tester's Guide to Agile Testing
The Evil Tester Show - Episode 001 Halloween 2017

Recently uploaded (20)

PPTX
warehousing in material management
PPTX
Tracii Hutsona A Story Of Business Success, Resilience, And Giving Back
PPTX
Rotaract New and Prospective Membership Orientation
PDF
Peter Oeij - Industry 5.0 for shaping sustainable and inclusive futures
PDF
SpatzAI Real-time Micro-Conflict Manager - Fairer Teamwork Globally
PPT
L2 - Determinants and Dimensions of Culture.ppt
PDF
Sales Enablement in the Age of AI: Unlocking Growth
PPTX
Women talent hub 😁🥳🤗🤗🎉♊😭👌😊😍🤣😆😁🥰😍
DOCX
home science to read and practice athome
PDF
Leading with Empathy: How Bangladesh Can Build Inclusive Growth
PPTX
Org SmartArt Infographics: a simple way to create your org chart
PPTX
AWAKE-Redefining-Luxury-Through-Sustainability - Copy (1).pptx
PDF
Empowering Future Leaders_ The Impact of the ICC National Leadership Summit b...
PPTX
Modern trend in hrm in human resources management
PPT
social justice to the poor and illlitates and huge support fot he needy peopl...
PDF
Empathetic vision to improve living standards of poors people in society to l...
PPTX
EXT.-EDU-809-ACCOUNTABILITY-IN-EXTENSION.pptx
PPTX
Personnel Management work in medical field
PDF
5 Insights from Maharashtrian of the Year Award Winners
warehousing in material management
Tracii Hutsona A Story Of Business Success, Resilience, And Giving Back
Rotaract New and Prospective Membership Orientation
Peter Oeij - Industry 5.0 for shaping sustainable and inclusive futures
SpatzAI Real-time Micro-Conflict Manager - Fairer Teamwork Globally
L2 - Determinants and Dimensions of Culture.ppt
Sales Enablement in the Age of AI: Unlocking Growth
Women talent hub 😁🥳🤗🤗🎉♊😭👌😊😍🤣😆😁🥰😍
home science to read and practice athome
Leading with Empathy: How Bangladesh Can Build Inclusive Growth
Org SmartArt Infographics: a simple way to create your org chart
AWAKE-Redefining-Luxury-Through-Sustainability - Copy (1).pptx
Empowering Future Leaders_ The Impact of the ICC National Leadership Summit b...
Modern trend in hrm in human resources management
social justice to the poor and illlitates and huge support fot he needy peopl...
Empathetic vision to improve living standards of poors people in society to l...
EXT.-EDU-809-ACCOUNTABILITY-IN-EXTENSION.pptx
Personnel Management work in medical field
5 Insights from Maharashtrian of the Year Award Winners

The Art of Questioning to improve Software Testing, Agile and Automating

  • 1. "The Art of Questioning to improve Testing, Agile, and Automating" Alan Richardson Test Consultant CompendiumDev.co.uk EvilTester.com @EvilTester
  • 2. Asking Questions to... ● Build a model: risks, issues, gaps ● What questions expose the risks? ● What questions trigger action? ● What questions foster responsibility?
  • 3. 5 Whys ● Common 'management' questioning ● Toyota ● (Lean) Six Sigma Tool ● Root Cause Analysis
  • 4. Fritz Perls on Why If we spend our time looking for causes instead of structure we may as well give up the idea of therapy and join the group of worrying grandmothers who attack their prey with such pointless questions as “Why did you catch that cold?” “Why have you been so naughty?” Fritz Perls, The Gestalt Approach “ ”
  • 5. “Why?” is a Belief Question ● Beliefs about causes ● Reinforces a model – Justification ● Leads to: – Because...
  • 6. How? What? Where? When? Who? ● Explore a model ● Build a system ● Lead to – Experiments – Action – Responsibility
  • 7. Dear Evil Tester Q&A Agony Aunt for Testers
  • 8. Sometimes we don't know what to do and just need some advice.
  • 9. Q: Should I pretend to test? “In the past I have worked with project managers who have only pretended to manage. Just in case I come across this sort again in the future, I want to know; should I only pretend to test too, as a form of self-preservation?” Eliza
  • 10. A: No Dear Eliza, ... "NO". ... All the best, Uncle Evil
  • 11. Q: Should I pretend to test? “In the past I have worked with project managers who have only pretended to manage. Just in case I come across this sort again in the future, I want to know; should I only pretend to test too, as a form of self-preservation?” Eliza Questions have a model of the world embedded in them.
  • 12. Q: Tester not pulling their weight? Dear Evil Tester, What's the best way to deal with a fellow tester who is not pulling his/her weight? Anon
  • 13. A: Delegate Upwards Dear Anon, ...raise your concerns to your manager, after all your lazy manager usually has plenty of time on their hands, and it is their responsibility to deal with your light-weight under performing co-workers. Yours, Team Spirit Coach Evil Answers also have a model of the world embedded in them.
  • 14. A: Delegate Upwards Dear Anon, ...raise your concerns to your manager, after all your lazy manager usually has plenty of time on their hands, and it is their responsibility to deal with your light-weight under performing co-workers. Yours, Team Spirit Coach Evil Answers also have a model of the world embedded in them.
  • 16. Some Questions are Practical
  • 17. Q: How to Track Exploratory Testing Dear Evil Tester, Do you recommend any tools for note-taking and managing test sessions?
  • 19. What do I do next?
  • 20. What do I do next again?
  • 21. Consultancy Job Security ● Job Security – 'the answer person' ● Consultants / Managers / Leads – Aim to go 'out of business' ● build flexibility ● not dependency
  • 22. Dependency ● Asking questions for 'answers' rather than to build a model to increase understanding ● A step by step model has no flexibility ● Not learning to ask questions that help when expert is not present
  • 23. Avoiding Dependency ● Lead by example – “asking the right questions” ● Ask questions – which expose underlying model – to prompt exploration of model ● Gaps, risks – to prompt comparison of model to system ● Issues, bugs
  • 24. Modelling Testing as Questioning ● Given a model, does the System match the model? ● Requirements say X, can I do X? ● System 'looks like' I should be able to do Y, can I?
  • 25. Modelling Testing as Questioning ● Under this model: – Test == Ask a Question – Answer -> Expand/Confirm Model – Reporting == Communicate Model
  • 26. Modelling Agile as Questioning ● Agile – responding to change – Change based on learning – Learning == changes to models & understanding
  • 27. Modelling Agile as Questioning Agile requires asking a lot of questions – What are we doing? – Why? – How Well? – Could be better? – How much? – Minimum acceptable? – constantly
  • 28. Automating as Questioning ● Automate putting system into a specific state ● Codify specific pre-defined questions ● Assert on the answers ...Repeat
  • 29. Automating as Questioning ● Automate putting system into a specific state ● Codify specific pre-defined questions ● Assert on the answers ...Repeat Questions have a model of the world embedded in them.
  • 34. Summary ● The questions we ask reveal our model of the world. ● We can ask questions of 'the world' to explore and expand our model.
  • 35. @EvilTester 35 Ask The Questions! ● Alan Richardson – @EvilTester – www.EvilTester.com – www.JavaForTester.com – www.SeleniumSimplified.com – www.CompendiumDev.co.uk