SlideShare a Scribd company logo
Is there a place for QA
in autonomous fast-flow teams?
Sheen Brisals
Consultant. Author. AWS Hero
COVID-19
My
Team
Product
Manager
Engineering
Manager
QA
Engineer
Engineer
Engineer
Junior
Engineer
Meet
Charlie
Name: Charles
Education: B Eng (Software)
Experience: 5 Years
Skills: Computer nerd!
Interview
Me: Could you explain your way
of working with the QA?
Charlie: Erm... Sorry, there
is no QA in our team!
Me: Oh! Who does QA?
Charlie: All the engineers do!
Signal 1
Post-COVID
Luke’s
Team
Lead Engineer
Senior QA
Engineer
Senior
Engineer
Engineer
Junior
Engineer
Product
Manager
Luke’s
Team
Lead Engineer
Senior QA
Engineer
Junior
Engineer
Senior
Engineer
Engineer
Product
Manager
Chat
Me: So, Luke, do you need a
senior or mid QA?
Luke:
Me: Erm, what do you mean?
Luke: We can operate without a QA!
I think... neither!
Signal 2
Agenda
1.QA: Then & Now
2.Team Autonomy
4.Blockers & Shifts
3.Fast Flow Operation
sheen-brisals
sheenbrisals
sbrisals.medium.com
#TheServerlessBook #TheSpeakerBook
Independent Consultant
O’Reilly Author
AWS Serverless Hero
Team Topologies Advocate
Sheen Brisals
leanpub.com/TheSpeakerBook
No QA was made
redundant while
preparing this talk!
disclaimer
1. QA: Then & Now
What is
Quality?
Fitness for Use!
Material: Steel
Build: Handcraft
Packaging: Recycle
Delivery: Sustainable
Specification Characteristics
Product
Quality Planning
Material Build Packing Delivery
Quality Assurance
QC QC QC QC
Quality Planning
Quality Assurance
Quality Control
Covers customers, requirements, tools, processes, etc.
Prevents errors with measures, standards, processes, etc.
Checks against quality requirements at process output.
SQA
Software Quality
Assurance
Software industry’s
adaptation of the
industrial QA process!
Requirements Analysis Design Coding Testing Release Maintenance
SQA
SQE
Assurance
Engineering
Principles
Procedures
Protocols
Responsibility of
conducting QA process
Software
Testing
The Waterfall Development Model
2. Team Autonomy
Big Teams
Credit: lavilo-webdesign.com
Bigger Problems
Bigger Problems
Credit: thedomaindrivendesign.io/
Big Teams
Cognitive
Load
Source: Balancing Coupling in Software Design
If you can’t feed a team with
two pizzas, it’s too large!
Jeff Bezos,
Founder, Amazon
2-Pizza
Teams
• Communication
• Collaboration
• Decision-making
• Iterative development
• Incremental delivery
• Improved velocity
• Innovation
• And many more...
2-Pizza
Teams
2-Pizza
Teams
Product Manager
Engineering Lead
Engineers (Devs)
Data Engineer(s)
UX Designer(s)
QA
Elevation
Traditional
QA Team
Autonomous Teams
QA
Elevation
Traditional
QA Team
Autonomous Teams
QA
Involvement
Ideation Analysis Design Development Testing Release Operation
Next Iteration / Increment
Every activity is a team activity
QA engineer is part of every activity
Modern Development Model
DevOps
You build it,
You run it!
Dr. Werner Vogels, CTO, Amazon.com
DevOps
Movement
Ideation Analysis Design Development Testing Release Operation
Next Iteration / Increment
Every engineer can release
Every engineer can operate
Domain: Ecommerce
System
Boundaries
With DDD
Subdomain: Products Subdomain: Customer
Subdomain: Orders Subdomain: Loyalty
Bounded
Context
BC BC BC
BC
BC BC
Bounded
Context
BC
BC
An approach to organizing
business and technology
teams for fast flow.
Team
Topologies
Is there a place for QA in autonomous fast flow teams?
Is there a place for QA in autonomous fast flow teams?
Domain: Ecommerce
True
Autonomy
Subdomain: Products Subdomain: Customer
Subdomain: Orders Subdomain: Loyalty
Bounded
Context
BC BC BC
BC
BC BC
Bounded
Context
BC
BC
Dev
Prod
Test
Pre-
prod
Autonomous Team Payments - Bounded Context Cloud Operation
Owns Operates
Autonomous Team: Development & Operation
Recap
Big teams + complex systems
experience high cognitive load.
Independent & agile teams
promote the distribution of QA.
Autonomous teams own, develop,
and operate their systems.
QA & development engineers
participate in all processes.
3. Fast Flow Operation
Iterative &
Incremental
Ideate Design Build Operate
Iterate
Test
Credit: www.pacific-research.com/
Iteration
Increment Agility
Iterative,
Incremental,
Automation
Ideate Design Build Operate
Iterate
Test
Automation
Agility Acceleration
Iterative,
Incremental,
Automation,
& Value
Ideate Design Build Operate
Iterate
Test
Value
Acceleration Fast Flow
Fast Flow
Architecture
Team
Interactions
Processes
Agile
Autonomous
Teams
• Multiple engineers release
multiple increments every day!
• Anyone can deploy to prod!
• Friday is like any other day!
Dev
Prod
Test
Pre-
prod
Autonomous Team Payments - Bounded Context Cloud Operation
Owns Operates
Autonomous Team: Development & Operation
Authoriz
ation
Pay by
Link
Cancel
Refunds
Capture
Audit
Service
Data
Gateway
Fraud
Preventi
on
Notifica
tions Reports
Payments - Bounded Context
Autonomous Team: Multiple Pipelines
Data
Gateway
Refunds
Pay by
Link
Commit Build Test Stage Release
4. The Blockers
The
QA Gate
Commit Build Test Stage Release
aka QA Sign-off
The
QA Gate
Commit Build Test Stage Release
The
QA Gate
Commit Build Test Stage Release
Cognitive Load
The
QA Gate
Small incremental changes
for the Developers, but
collectively high load
for a QA.
Cognitive Load
The
PR Gate
Commit Build Test Stage Release
Dear QA,
Please test and approve
the changes in my PR (pull
request) so that I can
merge. Thanks!
The
PR Gate
Value Stream Impact
End-to-end pipeline: 1 hour
Wait for QA: 1 day
5. The Shifts
The
Shared
Responsibility
Model
• Cloud
• Security
• Sustainability
Is there a place for QA in autonomous fast flow teams?
Autonomous Teams & Multidisciplinary Engineers
Understand stakeholder requirements
Propose architectures
Compose microservices
Implement single-purpose functions
Cloud &
Serverless
Engineers
Incorporate security measures
Employs the observability measures
Deploys and operates services
Design data model and event schema
Autonomous Teams & Multidisciplinary Engineers
Understand stakeholder requirements
Propose architectures
Compose microservices
Implement single-purpose functions
Cloud &
Serverless
Engineers
Incorporate security measures
Employs the observability measures
Deploys and operates services
Design data model and event schema
Also, write enough tests!
The Shift in Patterns
Traditional
Test
Pyramid
Unit Tests
End-to-End
Integration
If the traditional QA approach was
to find bugs, the modern approach
is to prevent bugs!
Shift in the
Mode of
Tests
Automated Tests
Manual Tests
Does a distributed event-driven
system have two distinct ends?
Shift in the
Types of
Tests
Unit tests
Load tests
Integration tests
End-to-End tests
Performance tests
Contract tests
Serverless
Team
Test
Honeycomb
Unit Tests
End-to-End
Integration
In cloud and serverless applications, not
all business logic is in function code!
Changes in
QA
Skills
Cloud
Serverless
Programming
Security
Infrastructure
SQL
NoSQL
Pipelines
Operations
Observability
Queues
Architecture
Events
Patterns
IaC
Networks
APIs
Testing strategies for cloud and
serverless mostly originate from software
engineers - not QA engineers!
Changes in
QA
Skills Dev
QA
Changes in
QA
Skills Engineer
The Balancing Act!
Maximizing stability limits how fast
features can be developed and how
quickly products can be delivered,
and dramatically increases their
cost, which in turn reduces the
number of features a team can afford
to offer.
The
Square of
Balance
Test Release
Recover Observe
The
Square of
Balance
Quality Stability
vs
Speed Test Coverage
vs
Test Coverage Observability
vs
Criticality Recoverability
vs
Recap
In a fast flow team environment,
QA sign-off acts as blocker.
Bug prevention is a priority for
modern fast flow teams.
Test, release, observe, and
recover – balance them well.
QA requires almost the same
cloud/serverless skills as Devs.
Do You Need a QA?
QA?
A. Yes!
B. No!
C. Maybe!
D. It Depends!
E. All of the above!
Does the team own UI/Experience?
QA?
Backend
Front end BFF
Yes!
Does the team own UI/Experience?
QA?
Backend
Front end BFF
Stream-aligned Team [Checkout]
Stream-aligned Team
[Products]
Yes!
Do you share your codebase?
Shared
Codebase
push
pull
clone add commit
branch
checkout merge
Staging
Test
Develop Prod
QA?
Highly regulated environment?
QA?
Yes!
Highly regulated environment?
QA? Reduce Risk
Prevent Breach
Recap
Yes – UX and interactive
applications.
Yes – Shared codebase and cloud
accounts.
Yes – Business domain with
unclear boundaries.
Yes – Highly regulated
environments.
To Close…
In enterprises one size does not fit all.
To move fast and make things, you must be
willing to experiment.
Ideas and experimentation are vital to
identifying the appropriate developmental
practices and team dynamics for success!
Who is bold to experiment?
sheen-brisals
sheenbrisals
sbrisals.medium.com
#TheServerlessBook #TheSpeakerBook
Independent Consultant
O’Reilly Author
AWS Serverless Hero
Team Topologies Advocate
Sheen Brisals
Thank
You!
leanpub.com/TheSpeakerBook

More Related Content

Similar to Is there a place for QA in autonomous fast flow teams? (20)

PDF
Why Your Next QA Job Might Be in Ops
Edward Rousseau
 
PDF
"Quality Assurance: Achieving Excellence in startup without a Dedicated QA", ...
Fwdays
 
PPTX
How to Build a Platform Team
VMware Tanzu
 
PDF
How to Build in Quality from Day 1 using Lean QA and Agile Testing
Atlassian
 
PDF
We did it!!? There is place for QAs in Agile!!?
mkujalowicz
 
PDF
Atlassian Summit 2015 Lean QA and Agile Testing
Maurizio Mancini
 
PPTX
The changing role of a QA | QualiTest Group
Qualitest
 
PPTX
ІГОР ПАВЛЕНКО «QA role in DevOps world» Online QADay 2021
QADay
 
PDF
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
PDF
Quality Built In @ Spotify
Andrii Dzynia
 
PPTX
Brave New World - A wider perspective of our opportunities
Jayathirtha Rao
 
PDF
6 Steps to Implementing a World Class Testing Ecosystem Final
Eggplant
 
PPTX
Designing delivery
Mariana Franco Ávalos
 
PDF
Karim Fanadka
CodeFest
 
PDF
Automated Testing: QA Horizons
Prottay Karim
 
PDF
Accelerating Innovation at Charles Schwab by Mike Schober and Bala Mukund
Sauce Labs
 
PDF
Встреча Quality built in @Spotify от Андрея Дзыни : как стать лучшим тестиров...
GoIT
 
PPTX
Quality 4.0 and reimagining quality
Dr. Anish Cheriyan (PhD)
 
PPTX
MGM Agile Dec 28th 2022 (003).pptx
Jalaja Raj
 
PDF
DevOps: Where in the World Is Test?
TechWell
 
Why Your Next QA Job Might Be in Ops
Edward Rousseau
 
"Quality Assurance: Achieving Excellence in startup without a Dedicated QA", ...
Fwdays
 
How to Build a Platform Team
VMware Tanzu
 
How to Build in Quality from Day 1 using Lean QA and Agile Testing
Atlassian
 
We did it!!? There is place for QAs in Agile!!?
mkujalowicz
 
Atlassian Summit 2015 Lean QA and Agile Testing
Maurizio Mancini
 
The changing role of a QA | QualiTest Group
Qualitest
 
ІГОР ПАВЛЕНКО «QA role in DevOps world» Online QADay 2021
QADay
 
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Quality Built In @ Spotify
Andrii Dzynia
 
Brave New World - A wider perspective of our opportunities
Jayathirtha Rao
 
6 Steps to Implementing a World Class Testing Ecosystem Final
Eggplant
 
Designing delivery
Mariana Franco Ávalos
 
Karim Fanadka
CodeFest
 
Automated Testing: QA Horizons
Prottay Karim
 
Accelerating Innovation at Charles Schwab by Mike Schober and Bala Mukund
Sauce Labs
 
Встреча Quality built in @Spotify от Андрея Дзыни : как стать лучшим тестиров...
GoIT
 
Quality 4.0 and reimagining quality
Dr. Anish Cheriyan (PhD)
 
MGM Agile Dec 28th 2022 (003).pptx
Jalaja Raj
 
DevOps: Where in the World Is Test?
TechWell
 

More from SheenBrisals (17)

PPTX
Eliminate the complexities of Event-Driven Architecture with Domain-Driven De...
SheenBrisals
 
PPTX
Patterns and practices for developing enterprise-scale applications with serv...
SheenBrisals
 
PPTX
Patterns and practices for an enterprise-scale adoption of serverless!
SheenBrisals
 
PPTX
How to study, think, work, and live as an Engineer!
SheenBrisals
 
PPTX
Advanced Event-Driven Patterns - AWS Community Day Dublin
SheenBrisals
 
PPTX
Enterprise Serverless Adoption. An Experience Report
SheenBrisals
 
PPTX
Sustainability In Serverless
SheenBrisals
 
PPTX
How to Grow a Serverless Team in an Enterprise
SheenBrisals
 
PDF
The Road To Event-Driven Architecture
SheenBrisals
 
PDF
Enterprise Serverless Adoption. An Experience Report
SheenBrisals
 
PDF
Shillings in Serverless
SheenBrisals
 
PDF
To Serverless And Beyond!
SheenBrisals
 
PDF
How LEGO.com Accelerates With Serverless
SheenBrisals
 
PDF
Sloppy Little Serverless Stories
SheenBrisals
 
PDF
How to Grow a Serverless Team
SheenBrisals
 
PDF
Design and Develop Serverless Applications as Set-Pieces
SheenBrisals
 
PDF
Serverless Microservices Communication with Amazon EventBridge
SheenBrisals
 
Eliminate the complexities of Event-Driven Architecture with Domain-Driven De...
SheenBrisals
 
Patterns and practices for developing enterprise-scale applications with serv...
SheenBrisals
 
Patterns and practices for an enterprise-scale adoption of serverless!
SheenBrisals
 
How to study, think, work, and live as an Engineer!
SheenBrisals
 
Advanced Event-Driven Patterns - AWS Community Day Dublin
SheenBrisals
 
Enterprise Serverless Adoption. An Experience Report
SheenBrisals
 
Sustainability In Serverless
SheenBrisals
 
How to Grow a Serverless Team in an Enterprise
SheenBrisals
 
The Road To Event-Driven Architecture
SheenBrisals
 
Enterprise Serverless Adoption. An Experience Report
SheenBrisals
 
Shillings in Serverless
SheenBrisals
 
To Serverless And Beyond!
SheenBrisals
 
How LEGO.com Accelerates With Serverless
SheenBrisals
 
Sloppy Little Serverless Stories
SheenBrisals
 
How to Grow a Serverless Team
SheenBrisals
 
Design and Develop Serverless Applications as Set-Pieces
SheenBrisals
 
Serverless Microservices Communication with Amazon EventBridge
SheenBrisals
 
Ad

Recently uploaded (20)

PDF
TheFutureIsDynamic-BoxLang witch Luis Majano.pdf
Ortus Solutions, Corp
 
PDF
유니티에서 Burst Compiler+ThreadedJobs+SIMD 적용사례
Seongdae Kim
 
PDF
IObit Driver Booster Pro 12.4.0.585 Crack Free Download
henryc1122g
 
PPTX
Agentic Automation: Build & Deploy Your First UiPath Agent
klpathrudu
 
PDF
How to Hire AI Developers_ Step-by-Step Guide in 2025.pdf
DianApps Technologies
 
PDF
Adobe Premiere Pro Crack / Full Version / Free Download
hashhshs786
 
PPTX
OpenChain @ OSS NA - In From the Cold: Open Source as Part of Mainstream Soft...
Shane Coughlan
 
PPTX
Foundations of Marketo Engage - Powering Campaigns with Marketo Personalization
bbedford2
 
PDF
Open Chain Q2 Steering Committee Meeting - 2025-06-25
Shane Coughlan
 
PPTX
Comprehensive Risk Assessment Module for Smarter Risk Management
EHA Soft Solutions
 
PDF
iTop VPN With Crack Lifetime Activation Key-CODE
utfefguu
 
PPTX
Empowering Asian Contributions: The Rise of Regional User Groups in Open Sour...
Shane Coughlan
 
PDF
MiniTool Partition Wizard 12.8 Crack License Key LATEST
hashhshs786
 
PDF
Empower Your Tech Vision- Why Businesses Prefer to Hire Remote Developers fro...
logixshapers59
 
PPTX
Hardware(Central Processing Unit ) CU and ALU
RizwanaKalsoom2
 
PDF
MiniTool Power Data Recovery 8.8 With Crack New Latest 2025
bashirkhan333g
 
PDF
Digger Solo: Semantic search and maps for your local files
seanpedersen96
 
PPTX
Homogeneity of Variance Test Options IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
PDF
MiniTool Partition Wizard Free Crack + Full Free Download 2025
bashirkhan333g
 
PDF
Build It, Buy It, or Already Got It? Make Smarter Martech Decisions
bbedford2
 
TheFutureIsDynamic-BoxLang witch Luis Majano.pdf
Ortus Solutions, Corp
 
유니티에서 Burst Compiler+ThreadedJobs+SIMD 적용사례
Seongdae Kim
 
IObit Driver Booster Pro 12.4.0.585 Crack Free Download
henryc1122g
 
Agentic Automation: Build & Deploy Your First UiPath Agent
klpathrudu
 
How to Hire AI Developers_ Step-by-Step Guide in 2025.pdf
DianApps Technologies
 
Adobe Premiere Pro Crack / Full Version / Free Download
hashhshs786
 
OpenChain @ OSS NA - In From the Cold: Open Source as Part of Mainstream Soft...
Shane Coughlan
 
Foundations of Marketo Engage - Powering Campaigns with Marketo Personalization
bbedford2
 
Open Chain Q2 Steering Committee Meeting - 2025-06-25
Shane Coughlan
 
Comprehensive Risk Assessment Module for Smarter Risk Management
EHA Soft Solutions
 
iTop VPN With Crack Lifetime Activation Key-CODE
utfefguu
 
Empowering Asian Contributions: The Rise of Regional User Groups in Open Sour...
Shane Coughlan
 
MiniTool Partition Wizard 12.8 Crack License Key LATEST
hashhshs786
 
Empower Your Tech Vision- Why Businesses Prefer to Hire Remote Developers fro...
logixshapers59
 
Hardware(Central Processing Unit ) CU and ALU
RizwanaKalsoom2
 
MiniTool Power Data Recovery 8.8 With Crack New Latest 2025
bashirkhan333g
 
Digger Solo: Semantic search and maps for your local files
seanpedersen96
 
Homogeneity of Variance Test Options IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
MiniTool Partition Wizard Free Crack + Full Free Download 2025
bashirkhan333g
 
Build It, Buy It, or Already Got It? Make Smarter Martech Decisions
bbedford2
 
Ad

Is there a place for QA in autonomous fast flow teams?