SlideShare a Scribd company logo
DevOps!
Let’s change QA!
Geoffrey van der Tas
DevOps Pro
DevOps! let's change QA! DevOps Pro Lithuania
3
DevOps! Let's Change QA!
4
Testing
DevOps! Let's Change QA!
Specs
Design
Code
Test
Maintain
5
Quality Assurance
DevOps! Let's Change QA!
6
Definition of Testing
DevOps Time Period
Old
“Independent judgement about the quality
of the testobject”
New
“Means of getting fast feedback on your
product”
7
Waterfall DevOps
DevOps Time Period
Specs
Design
Code
Test
Maintain
Test
Test
Test
Test
Test Test
Test
Feedback
Feedback Feedback
Feedback
Feedback
Feedback
Code
Design
Specs
Maintain
8
DevOps Time Period
9
From Assurance towards Engineering
DevOps Time Period
“Quality Engineering is the management,
development, operation and maintenance of IT systems
and enterprise architectures with a high quality
standard.” - New Perspectives on Software Quality by Ruth Breu; Annie
Kuntzmann-Combelles; Michael Felderer (January–February 2014).
10
Quality Engineering
Quality
Engineering
User story
(Automated)
Testing
Development
Monitoring
InfrastructureDesign
Security
Performance
Customer
Experience
11
What needs to happen
Move to Quality Assistance or Engineering
• Testers becoming Quality Engineers
• Quality from the start
• Automation, Automation, Automation
• Explore to test
• The Grand Tour
12
Testers becoming Quality Engineers
13
What is changing
Testers becoming Quality Engineers
The Team
Quality
Dev
Dev
Ops
Ops
Test
Analist
Test Quality
Engineer
Test
Quality Assistant
Agile Test Coach
14
At other companies
Testers becoming Quality Engineers
Quality Engineering at Spotify
“The Quality Engineer will help developers and teams cultivate a quality mindset,
advocating for quality while assisting engineers with software development and test
automation best practices.”
Quality Assistance at Atlassian
“They optimised the process by empowering and educating developers to test their own
features to production quality standards.”
15
Quality Engineer
Testers becoming Quality Engineers
• Advocate for quality
• Actively coach developers/business
• Make testing part of Development Process
• Coordinate testing efforts
• Maintain test reporting and visualization
• Spot opportunities for (Test) Automation
16
Quality from the start
17
Backlog Items – Sprint Backlog Items
Quality from the start
Crap in, Crap out
18
Tell the story
Quality from the start
19
Quality from the start
20
Techniques
Quality from the start
Impact Mapping User Story Mapping
21
Quality Engineering in Scrum
Understanding
the big picture
22
Big Picture to User Stories
Quality from the start
Specifications:
Spec one
Spec two
…
Acceptance Criteria:
Criteria one
Criteria two
Criteria three
…..
23
Communication
Quality from the start
24
Shared understanding
Quality from the start
• Shared vision, idea’s and alignment on what was discussed;
25
Refinements by examples
Quality from the start
26
Specification By Example
Quality from the start
User story: As an employee I want to find other employees so I can find more
information about employees.
Example ATDD:
Search parameter Result
Peter Peter Janssen
Jan Annie Jansen
Jan van Buren
Peter Janssen
Jans Annie Jansen
Peter Janssen
Bakkr (geen)
27
Techniques
Quality from the start
28
Quality Engineering in Scrum
Understanding
the big picture
Powerful Refinements
29
ATDD TDD
Quality from the start
Failing
Acceptance Test
Passing
Acceptance Test
Passing
test
Refactor
Failing
test
30
Quality First at ING
Quality from the start
Date/time Result
Current features
Advisor makes appointment 2017/10/05 12:13:54
- Appointment mailed to customer 2017/10/05 12:14:06
Summary of advice is mailed to customer 2017/10/05 12:14:46
This sprint
Make appointment with Specialist 2017/10/05 12:14:48
Customer details are shared with Specialist 2017/10/05 12:14:49
31
Quality Engineering in Scrum
Understanding
the big picture
Powerful Refinements
Good Development Practices
32
Automation, Automation, Automation
33
Why Automate
Automation, Automation, Automation
 Fast
 Reliable
 Repeatable
 Reuseable
 Control
 Money
 Fun
Automation vs Manual
Manual Automation
34
How to approach it
Automation, Automation, Automation
User Interface
Integration
Unit/Component
10 %
20 %
70 %
Slow, Big, Many Dependencies &
High Maintenance
Fast, Bit Bigger, Some
Dependecies, Easy Maintenance
ATDD
Fast, Small, Easy Maintenance
TDD
35
What to automate
Automation, Automation, Automation
Context is key
Self build vs bought software
Java, Javascript, C++, C#
Employee vs Client facing
User Interface
Integration
Unit/Component
36
Quality goes further then Test Automation
Automation, Automation, Automation
Continuous Delivery Pipeline - Xebia
37
Even further
Automation, Automation, Automation
38
Quality Engineering in Scrum
Understanding
the big picture
Powerful Refinements
Good Development Practices
Automation
39
Explore to test
40
Explore to test
41
Testing helps Checks
Explore to test
https://findingdeefex.com/2016/05/20/the-testing-checkingsynergy/
42
Exploratory Testing
Explore to test
“Exploratory Testing is a style of testing in which you explore the software while
simultaneously designing and executing tests, using feedback from the last test
to inform the next.” – Elisabeth Hendrickson
• Timeboxed
• Charters
• Debrief
• In Pairs
43
Exploratory Testing
Explore to test
Design
Execute
Learn
SteerCharters Debrief
44
Release Strategy
Explore to test
Customers
Product
Canaries
Customer Selection
#Feature Toggles
Pilot
45
Examples
Explore to test
46
Examples
Explore to test
47
Quality Engineering in Scrum
Understanding
the big picture
Powerful Refinements
Good Development Practices
Automation
Explore
Explore
48
49
About the experience
The Grand Tour
50
Quality Engineering
The Grand Tour
 Functionality
 Performance
 Resilience
 Security
 Usability
 Accesability
 Other software components
 Infrastructure
 Servers
 Databases
 Monitoring
 Build pipeline
51
Quality Engineering with the customer in mind
The Grand Tour
52
Key Principles for your team
The Grand Tour
 Customer first
 Whole team is responsible for quality
 Tested = Checked + Explored
 Bugs are fixed when they are found
 ‘Done’ means fully tested
 Quality before new functionality
 Collaboration is key for quality
53
Quality Engineering in Scrum
Understanding
the big picture
Powerful Refinements
Good Development Practices
Automation
Explore
Explore
Quality
Engineers Grand Tour
54
Becoming a Quality Engineer? Sounds impossible?
Quality Engineering Values
55
E-mail: Geoffrey.van.der.Tas@Ordina.nl
Twitter: @Gavdtas
LinkedIn: https://nl.linkedin.com/in/geoffreyvdtas
Geoffrey van der Tas
Stop being a QAssurance and Start become a QAssistance

More Related Content

What's hot (20)

PPTX
Why Automated Testing Matters To DevOps
dpaulmerrill
 
PDF
Agile Tester - Crash Slides
Samer Desouky
 
PPT
Trends in Agile Testing by Lisa Crispin
Directi Group
 
PPT
Optimizing Your Agile Testing Processes
Stanton Champion
 
PPTX
Is Test Planning a lost art in Agile? by Michelle Williams
QA or the Highway
 
PPTX
Agile Testing - presentation for Agile User Group
suwalki24.pl
 
PDF
How to use selenium successfully
TEST Huddle
 
PPTX
Introduction to Agile Testing
vodQA
 
PPTX
How to get Automated Testing "Done"
TEST Huddle
 
PPTX
Agile Testing Analytics
QASymphony
 
PPTX
Agile testing presentation
Komal Garg
 
PPT
Agile testing
Yogita patil
 
PPTX
(Agile) engineering best practices - What every project manager should know
Richard Cheng
 
PPTX
Agile tour ncr test360_degree - agile testing on steroids
Vipul Gupta
 
PDF
Product QA - A test engineering perspective
Imaginea
 
PPT
Eric Jimmink - The Specialized Testers of the Future
TEST Huddle
 
PDF
The New Agile Testing Quadrants: Bringing Skilled Testers and Developers Toge...
Ho Chi Minh City Software Testing Club
 
PPT
Agile Engineering Practices
Vernon Stinebaker
 
PPTX
QA/Test Engineering Perspectives
Roopesh Kohad
 
PPTX
ISTQB agile tester exam - Conclusions about Certification
Michał Dudziak
 
Why Automated Testing Matters To DevOps
dpaulmerrill
 
Agile Tester - Crash Slides
Samer Desouky
 
Trends in Agile Testing by Lisa Crispin
Directi Group
 
Optimizing Your Agile Testing Processes
Stanton Champion
 
Is Test Planning a lost art in Agile? by Michelle Williams
QA or the Highway
 
Agile Testing - presentation for Agile User Group
suwalki24.pl
 
How to use selenium successfully
TEST Huddle
 
Introduction to Agile Testing
vodQA
 
How to get Automated Testing "Done"
TEST Huddle
 
Agile Testing Analytics
QASymphony
 
Agile testing presentation
Komal Garg
 
Agile testing
Yogita patil
 
(Agile) engineering best practices - What every project manager should know
Richard Cheng
 
Agile tour ncr test360_degree - agile testing on steroids
Vipul Gupta
 
Product QA - A test engineering perspective
Imaginea
 
Eric Jimmink - The Specialized Testers of the Future
TEST Huddle
 
The New Agile Testing Quadrants: Bringing Skilled Testers and Developers Toge...
Ho Chi Minh City Software Testing Club
 
Agile Engineering Practices
Vernon Stinebaker
 
QA/Test Engineering Perspectives
Roopesh Kohad
 
ISTQB agile tester exam - Conclusions about Certification
Michał Dudziak
 

Similar to DevOps! let's change QA! DevOps Pro Lithuania (20)

PPTX
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
TEST Huddle
 
PPTX
A Roadmap to Enterprise Quality
Jeff Bramwell
 
PPTX
Agile con2014ver4
Samudra Kanankearachchi
 
PPTX
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity Software Ireland
 
PPTX
Verhaert Innovation Day - Product roadshows in an early development stage: P...
Jef Aernouts
 
PDF
Assessing Your Agility: Introducing the Comparative Agility Assessment
Mike Cohn
 
PDF
THE ROLE OF SOFTWARE TESTING IN THE ORGANIZATION’S VALUE ASSURANCE
itSMF Belgium
 
PDF
The Complexity to "Yes" in Analytics Software and the Possibilities with Dock...
Docker, Inc.
 
PPT
Trends in software testing by Eka TechServ
ekatechserv
 
PDF
Metrics-driven Continuous Delivery
Andrew Phillips
 
PDF
Software Testing Process & Trend
KMS Technology
 
PPTX
Roadmap to Enterprise Quality
Jeff Bramwell
 
PPTX
Contracting an outsourced agile test team
XBOSoft
 
PPTX
Modern software architect post the agile wave
Niels Bech Nielsen
 
PDF
Quality in Project Management
daragao
 
PDF
Agile Engineering Environment – 2017
India Scrum Enthusiasts Community
 
PDF
Agile Engineering Environment – 2017
India Scrum Enthusiasts Community
 
PDF
Agile engineering environment 50 minutes or less
Vernon Stinebaker
 
PDF
How to build confidence in your release cycle
DiUS
 
PDF
Process Guidelines V2
Imaginea
 
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
TEST Huddle
 
A Roadmap to Enterprise Quality
Jeff Bramwell
 
Agile con2014ver4
Samudra Kanankearachchi
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity Software Ireland
 
Verhaert Innovation Day - Product roadshows in an early development stage: P...
Jef Aernouts
 
Assessing Your Agility: Introducing the Comparative Agility Assessment
Mike Cohn
 
THE ROLE OF SOFTWARE TESTING IN THE ORGANIZATION’S VALUE ASSURANCE
itSMF Belgium
 
The Complexity to "Yes" in Analytics Software and the Possibilities with Dock...
Docker, Inc.
 
Trends in software testing by Eka TechServ
ekatechserv
 
Metrics-driven Continuous Delivery
Andrew Phillips
 
Software Testing Process & Trend
KMS Technology
 
Roadmap to Enterprise Quality
Jeff Bramwell
 
Contracting an outsourced agile test team
XBOSoft
 
Modern software architect post the agile wave
Niels Bech Nielsen
 
Quality in Project Management
daragao
 
Agile Engineering Environment – 2017
India Scrum Enthusiasts Community
 
Agile Engineering Environment – 2017
India Scrum Enthusiasts Community
 
Agile engineering environment 50 minutes or less
Vernon Stinebaker
 
How to build confidence in your release cycle
DiUS
 
Process Guidelines V2
Imaginea
 
Ad

Recently uploaded (20)

PPTX
OpenChain @ OSS NA - In From the Cold: Open Source as Part of Mainstream Soft...
Shane Coughlan
 
PDF
4K Video Downloader Plus Pro Crack for MacOS New Download 2025
bashirkhan333g
 
PDF
IDM Crack with Internet Download Manager 6.42 Build 43 with Patch Latest 2025
bashirkhan333g
 
PDF
Download Canva Pro 2025 PC Crack Full Latest Version
bashirkhan333g
 
PPTX
Home Care Tools: Benefits, features and more
Third Rock Techkno
 
PDF
Top Agile Project Management Tools for Teams in 2025
Orangescrum
 
PDF
Digger Solo: Semantic search and maps for your local files
seanpedersen96
 
PDF
Add Background Images to Charts in IBM SPSS Statistics Version 31.pdf
Version 1 Analytics
 
PPTX
Help for Correlations in IBM SPSS Statistics.pptx
Version 1 Analytics
 
PPTX
Comprehensive Risk Assessment Module for Smarter Risk Management
EHA Soft Solutions
 
PDF
The 5 Reasons for IT Maintenance - Arna Softech
Arna Softech
 
PDF
Technical-Careers-Roadmap-in-Software-Market.pdf
Hussein Ali
 
PDF
Empower Your Tech Vision- Why Businesses Prefer to Hire Remote Developers fro...
logixshapers59
 
PDF
MiniTool Partition Wizard 12.8 Crack License Key LATEST
hashhshs786
 
PDF
Generic or Specific? Making sensible software design decisions
Bert Jan Schrijver
 
PDF
MiniTool Power Data Recovery 8.8 With Crack New Latest 2025
bashirkhan333g
 
PDF
Driver Easy Pro 6.1.1 Crack Licensce key 2025 FREE
utfefguu
 
PPTX
Finding Your License Details in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
PDF
Odoo CRM vs Zoho CRM: Honest Comparison 2025
Odiware Technologies Private Limited
 
PPTX
Hardware(Central Processing Unit ) CU and ALU
RizwanaKalsoom2
 
OpenChain @ OSS NA - In From the Cold: Open Source as Part of Mainstream Soft...
Shane Coughlan
 
4K Video Downloader Plus Pro Crack for MacOS New Download 2025
bashirkhan333g
 
IDM Crack with Internet Download Manager 6.42 Build 43 with Patch Latest 2025
bashirkhan333g
 
Download Canva Pro 2025 PC Crack Full Latest Version
bashirkhan333g
 
Home Care Tools: Benefits, features and more
Third Rock Techkno
 
Top Agile Project Management Tools for Teams in 2025
Orangescrum
 
Digger Solo: Semantic search and maps for your local files
seanpedersen96
 
Add Background Images to Charts in IBM SPSS Statistics Version 31.pdf
Version 1 Analytics
 
Help for Correlations in IBM SPSS Statistics.pptx
Version 1 Analytics
 
Comprehensive Risk Assessment Module for Smarter Risk Management
EHA Soft Solutions
 
The 5 Reasons for IT Maintenance - Arna Softech
Arna Softech
 
Technical-Careers-Roadmap-in-Software-Market.pdf
Hussein Ali
 
Empower Your Tech Vision- Why Businesses Prefer to Hire Remote Developers fro...
logixshapers59
 
MiniTool Partition Wizard 12.8 Crack License Key LATEST
hashhshs786
 
Generic or Specific? Making sensible software design decisions
Bert Jan Schrijver
 
MiniTool Power Data Recovery 8.8 With Crack New Latest 2025
bashirkhan333g
 
Driver Easy Pro 6.1.1 Crack Licensce key 2025 FREE
utfefguu
 
Finding Your License Details in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
Odoo CRM vs Zoho CRM: Honest Comparison 2025
Odiware Technologies Private Limited
 
Hardware(Central Processing Unit ) CU and ALU
RizwanaKalsoom2
 
Ad

DevOps! let's change QA! DevOps Pro Lithuania

Editor's Notes

  • #2: Datum: 25-02-2019 Owner: Corp Comms
  • #6: Ask questions
  • #16: Voeg de key point hier toe.
  • #24: in parentheses green on it.
  • #37: Automate
  • #38: Automated Deployment of your Infrastructure
  • #42: The Testing-Checking Synergy by Del Dewar • 20th May, 2016