SlideShare a Scribd company logo
 
	
  
	
  
	
  
	
  
K2	
  
Keynote	
  
10/4/17	
  10:00	
  
	
  
	
  
	
  
	
  
Testing	
  and	
  DevOps:	
  Organizations	
  and	
  
Their	
  Culture	
  Must	
  Change	
  
	
  
Presented	
  by:	
  
	
  
Adam	
  Auerbach	
  
	
  Lincoln	
  Financial	
  Group	
  
	
  
Brought	
  to	
  you	
  by:	
  	
  
	
  	
  
	
  
	
  
	
  
	
  
	
  
350	
  Corporate	
  Way,	
  Suite	
  400,	
  Orange	
  Park,	
  FL	
  32073	
  	
  
888-­‐-­‐-­‐268-­‐-­‐-­‐8770	
  ·∙·∙	
  904-­‐-­‐-­‐278-­‐-­‐-­‐0524	
  -­‐	
  info@techwell.com	
  -­‐	
  http://www.starwest.techwell.com/	
  	
  	
  
	
  
	
  	
  
	
  
Adam	
  Auerbach	
  
Adam	
  Auerbach	
  is	
  the	
  Vice	
  President	
  of	
  Quality	
  and	
  DevOps	
  Engineering	
  at	
  
Lincoln	
  Financial	
  Group.	
  Adam	
  is	
  responsible	
  for	
  leading	
  the	
  implementation	
  of	
  
Continuous	
  Testing	
  and	
  Continuous	
  Delivery	
  across	
  Lincoln.	
  Prior	
  to	
  joining	
  LFG,	
  
Adam	
  was	
  the	
  senior	
  director	
  of	
  technology	
  for	
  advanced	
  testing	
  and	
  release	
  
services	
  for	
  Capital	
  One	
  Financial	
  Corporation.	
  Adam	
  led	
  Capital	
  One—
’s	
  enterprise	
  performance	
  and	
  automated	
  testing	
  departments	
  as	
  well	
  as	
  
enterprise	
  release	
  management	
  and	
  test	
  data	
  management.	
  While	
  at	
  Capital	
  
One,	
  he	
  provided	
  leadership	
  for	
  the	
  agile	
  transformation	
  of	
  their	
  quality	
  
assurance	
  group	
  and	
  led	
  the	
  enterprise	
  adoption	
  of	
  DevOps	
  and	
  acceptance	
  
test6 driven	
  development.	
  Before	
  joining	
  Capital	
  One,	
  Adam	
  was	
  with	
  Chase	
  
and	
  other	
  financial	
  and	
  insurance	
  companies,	
  in	
  various	
  leadership	
  positions	
  
focused	
  on	
  quality	
  and	
  agile	
  practices.	
  
10/17/17	
  
1	
  
Tes$ng	
  and	
  DevOps:	
  
Organiza-ons	
  and	
  their	
  culture	
  must	
  change	
  
Adam	
  Auerbach	
  
VP	
  Quality	
  and	
  DevOps	
  
Engineering	
  
	
  
Quality	
  and	
  DevOps	
  Engineering	
  @	
  Lincoln	
  Financial	
  
2	
  
Performance	
  
Tes-ng	
  
Service	
  
Virtualiza$on	
  
Automated	
  
Tes-ng	
  
DevOps	
  
Test	
  Data	
  	
  
Quality	
  Engineering	
  
Community	
  of	
  
Prac-ce	
  
@BugMan31	
  
@	
  AdamAuerbach	
  
10/17/17	
  
2	
  
Tradi$onal	
  QA	
  Organiza$on	
  
3	
  
LOB	
  
Team	
  
LOB	
  
Team	
  
LOB	
  
Team	
  
Automa$on	
  	
  
Performance	
  
Security	
  
Agile	
  
4	
  
HARDENING	
  SPRINT	
  2	
  SPRINT	
  1	
  
Test	
   Test	
  
Design	
   Design	
  
Build	
   Build	
  
Defect	
  Fix	
  
Test	
  
10/17/17	
  
3	
  
What	
  is	
  DevOps?	
  
5	
  
DevOps	
  is	
  a	
  philosophy	
  change	
  
6	
  
DELIVER	
  HIGH	
  QUALITY	
  WORKING	
  SOFTWARE	
  FASTER	
  
DevOps	
  is	
  a	
  philosophy	
  where	
  teams	
  
are	
  accountable	
  for	
  everything	
  
required	
  to	
  get	
  their	
  code	
  
developed,	
  tested	
  and	
  deployed	
  to	
  
produc-on,	
  while	
  shared	
  service	
  
teams	
  provide	
  the	
  automa-on	
  and	
  
tools	
  to	
  enable	
  them.	
  
	
  
	
  
“You	
  Build	
  it	
  You	
  Own	
  it”	
  
Agile	
  Pod	
  
Prod	
  Support	
  
Arch.	
  
Infrastructure	
  
Shared	
  Services	
  (e.g.	
  Security	
  TesAng,	
  
Perf	
  TesAng)	
  
(Dev,	
  QA,	
  PO,	
  BSA)	
  
10/17/17	
  
4	
  
DevOps	
  is	
  the	
  next	
  part	
  of	
  your	
  Agile	
  journey	
  
7	
  
Number	
  of	
  Releases	
  
SoJware	
  Quality	
  
Agile	
  
	
  
	
  
	
  
	
  
DevOps	
  
	
  
	
  
	
  
	
  
Con$nuous	
  
Delivery	
  
	
  
	
  
	
  
Waterfall	
  
We	
  are	
  here	
  
Accelerates	
  soPware	
  
development	
  with	
  
itera-ve,	
  
incremental	
  releases	
  
Enables	
  faster	
  
feedback	
  for	
  
developers	
  thru	
  
automa-on	
  and	
  
increased	
  
responsibili-es	
  
Allows	
  code	
  to	
  flow	
  via	
  
an	
  automated	
  soPware	
  
factory	
  that	
  deploys	
  
constantly	
  
8	
  
What	
  is	
  DevOps?	
  
10/17/17	
  
5	
  
9	
  
Automate	
  Everything	
  
10	
  
Fast	
  Feedback	
  
10/17/17	
  
6	
  
11	
  
Remove	
  Constraints	
  
12	
  
Collabora$on	
  early	
  and	
  oVen	
  
10/17/17	
  
7	
  
13	
  
Focus	
  on	
  flow	
  
14	
  
Agile	
  +	
  DevOps	
  
DevOps	
  
Con$nuous	
  
Integra$on	
  
Con$nuous	
  
Tes$ng	
  
Con$nuous	
  
Monitoring	
  
Con-nuous	
  
Delivery	
  Agile	
  
10/17/17	
  
8	
  
How	
  does	
  Tes$ng	
  have	
  to	
  
change?	
  
15	
  
16	
  
Pipelines	
  
Pipelines	
  
10/17/17	
  
9	
  
Real-­‐Time	
  Automa$on	
  
17	
  
ACCEPTANCE	
  TEST-­‐DRIVEN	
  DEVELOPMENT	
  (ATDD)	
  
•  Team	
  Focused	
  
•  Stress	
  on	
  Acceptance	
  Criteria	
  
•  Add	
  a	
  Test	
  
•  Run	
  all	
  Tests	
  	
  
•  Write	
  Code	
  
•  Refractor	
  Un-l	
  Added	
  Test	
  Passes	
  
BEHAVIOR-­‐DRIVEN	
  DEVELOPMENT	
  (BDD)	
  
•  Team	
  Focused	
  
•  Stress	
  on	
  Stories	
  
•  Add	
  a	
  Test	
  
•  Run	
  all	
  Tests	
  
•  Write	
  Code	
  
•  Refactor	
  Un-l	
  Added	
  Test	
  Passes	
  
TEST-­‐DRIVEN	
  DEVELOPMENT	
  (TDD)	
  
•  Developer	
  Focused	
  
•  Closer	
  to	
  Unit	
  Level	
  
•  Add	
  a	
  Test	
  
•  Run	
  all	
  Tests	
  
•  Write	
  Code	
  
•  Refactor	
  Un-l	
  Added	
  Test	
  Passes	
  
Tes$ng	
  Approach	
  
	
  	
  
	
  	
  
	
  	
  
	
  	
  
	
  	
  
	
  	
  
SoVware	
  Tes$ng	
  
Ice-­‐cream	
  Cone	
  
An$-­‐Pa^ern	
  
watermelon.com	
  
Automated	
  GUI	
  Tests	
  
Integra-on	
  Tests	
  
Unit	
  
Tests	
  
Automated	
  
GUI	
  Tests	
  
Automated	
  Unit	
  Tests	
  
Manual	
  Session	
  
Based	
  Tes-ng	
  
Automated	
  API	
  Tests	
  
Automated	
  Integra-on	
  Tests	
  
Automated	
  Component	
  Tests	
  
Manual	
  Tests	
  
Ideal	
  SoVware	
  Tes$ng	
  Pyramid	
  
watermelon.com	
  
CURRENT	
   DESTINATION	
  
10/17/17	
  
10	
  
Open	
  Source	
  Tools	
  
Environments	
  
20	
  
10/17/17	
  
11	
  
Test	
  Data	
  Management	
  
21	
  
EFFECTIVE	
  DATA	
   EFFICIENT	
  DATA	
  
PRODUCTION	
  DATA	
  
Building	
  the	
  right	
  data	
   Ge9ng	
  it	
  right	
  the	
  first	
  ;me	
  
Reduce	
  Security	
  Excep;on	
  Dependency	
  	
  	
  
1	
   2	
  
3	
  
INTEGRATED	
  ENVIRONMENT	
   VIRTUALIZED	
  ENVIRONMENT	
  
Service	
  Virtualiza$on	
  
22	
  
VS.	
  
10/17/17	
  
12	
  
Dashboards	
  
23	
  
Dashboard	
  Cont’d	
  
24	
  
10/17/17	
  
13	
  
How	
  do	
  you	
  start?	
  
25	
  
26	
  
Iden$fy	
  areas	
  for	
  improvement	
  
10/17/17	
  
14	
  
27	
  
Empower	
  people	
  to	
  drive	
  change	
  
Next	
  Stop	
  
Agile	
  Process	
   Training	
   Waterfall	
  Process	
  
Test	
  Data	
  Management	
  Tools	
  Technical	
  Processes	
  
28	
  
Build	
  a	
  community	
  
Demos	
  
Lunch	
  &	
  Learns	
   Roadshows	
  
Office	
  Hours	
  
Internal	
  Conferences	
  
10/17/17	
  
15	
  
Common	
  challenges	
  
29	
  
Lack	
  of	
  Technical	
  
resources	
  Lack	
  of	
  funding	
  
Project	
  delivery	
  mindset	
  
3rd	
  party	
  dependencies	
  
Ques-ons	
  on	
  direc-on	
  
Top	
  down	
  and	
  bo^om	
  up	
  support	
  is	
  cri$cal	
  
30	
  
Take	
  inventory	
  of	
  your	
  team	
  
SME	
  
DevOps	
  Waterfall	
   Process	
  Driven	
  
Agile	
   Innova$ve	
  Business	
  Focus	
  
YOUR	
  TEAM	
  
Programming	
  
10/17/17	
  
16	
  
Iden$fy	
  your	
  future	
  leaders	
  
31	
  PEOPLE	
  MANAGERS	
   TECHNOLOGISTS	
  
Training	
  
32	
  
Use	
  mul$ple	
  levers	
  to	
  get	
  more	
  technical	
  
Sourcing	
  
New	
  Hires	
  
Resul$ng	
  in	
  increased	
  
technical	
  team	
  
members	
  
10/17/17	
  
17	
  
33	
  
Enterprise	
  groups	
  focus	
  on	
  enablement	
  
Focus	
  on:	
  
Technology	
  &	
  
Support	
  	
  
Shippable	
  
	
  code	
  
Focus	
  on:	
  
TEAM	
  MEMBERS	
  ENTERPRISE	
  TEAMS	
  
34	
  
Embrace	
  DevOps	
  for	
  Tes$ng	
  
AUTOMATION	
  
Performance	
  Tes$ng	
  
Test	
  Data	
  
Agile	
  Team	
  
10/17/17	
  
18	
  
35	
  
Pilot	
  like	
  crazy	
  
Discovery	
  	
   Pilot	
  
36	
  
Proven	
  metrics	
  
10/17/17	
  
19	
  
Des$na$on	
  
37	
  
Enterprise	
  Products	
  
Teams	
  are	
  enabled	
  via	
  Enterprise	
  solu$ons	
  
LOB	
  
Team	
  
LOB	
  
Team	
  
LOB	
  	
  
Team	
  
Tes-ng	
  tools	
  and	
  frameworks	
   Performance	
  and	
  monitoring	
  tools	
  
Test	
  Data	
  Management	
  Tool	
   Service	
  Virtualiza-on	
   Test	
  Environment	
  tooling	
  
QUESTIONS	
  
38	
  
10/17/17	
  
20	
  
YOU	
  
THANK	
  
39	
  

More Related Content

What's hot (19)

PDF
Developing a Testing Strategy for DevOps Success
DevOps.com
 
PPTX
The Evolution of Test Automation for DevOps
TEST Huddle
 
PPTX
Dev ops continuousdeliveryforcloudproduct
Gopinath Ramachandran
 
PDF
What is DevOps? - ITSM Academy Webinar
ITSM Academy, Inc.
 
PDF
A DevOps Primer: Whole Team Approaches for Better Software Quality
TechWell
 
PPTX
DevOps Foundation
Homepree Rloy
 
PDF
Continuous delivery its not about the technology, its about the people. @sats...
Tomas Riha
 
PPTX
Agile-plus-DevOps Testing for Packaged Applications
Worksoft
 
PDF
DevOps Deep Dive Webinar: Building a business case for agile and devops
Basis Technologies
 
PPTX
Spark 2013 Presentation of making the enterprise agile
gbgruver
 
PPTX
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Puppet
 
PPTX
5 Lessons from Enterprise DevOps
XebiaLabs
 
PDF
Scaling Test first for the Enterprise
QASymphony
 
PDF
Tech Mahindra ADOPT©: Accelerate DevOps Transformation
CA Technologies
 
PDF
DevOps Transformation - technical and organizational goals
Agron Fazliu
 
PPTX
Continuous Quality: What DevOps Means for QA
Jeff Sussna
 
PPTX
AUG NYC June 12 - Event Presentations
Madhusudhan Matrubai
 
PDF
How to implement DevOps in your Organization
Dalibor Blazevic
 
PDF
DevOps: A Culture Transformation, More than Technology
CA Technologies
 
Developing a Testing Strategy for DevOps Success
DevOps.com
 
The Evolution of Test Automation for DevOps
TEST Huddle
 
Dev ops continuousdeliveryforcloudproduct
Gopinath Ramachandran
 
What is DevOps? - ITSM Academy Webinar
ITSM Academy, Inc.
 
A DevOps Primer: Whole Team Approaches for Better Software Quality
TechWell
 
DevOps Foundation
Homepree Rloy
 
Continuous delivery its not about the technology, its about the people. @sats...
Tomas Riha
 
Agile-plus-DevOps Testing for Packaged Applications
Worksoft
 
DevOps Deep Dive Webinar: Building a business case for agile and devops
Basis Technologies
 
Spark 2013 Presentation of making the enterprise agile
gbgruver
 
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Puppet
 
5 Lessons from Enterprise DevOps
XebiaLabs
 
Scaling Test first for the Enterprise
QASymphony
 
Tech Mahindra ADOPT©: Accelerate DevOps Transformation
CA Technologies
 
DevOps Transformation - technical and organizational goals
Agron Fazliu
 
Continuous Quality: What DevOps Means for QA
Jeff Sussna
 
AUG NYC June 12 - Event Presentations
Madhusudhan Matrubai
 
How to implement DevOps in your Organization
Dalibor Blazevic
 
DevOps: A Culture Transformation, More than Technology
CA Technologies
 

Similar to Testing and DevOps: Organizations and Their Culture Must Change (20)

PDF
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
PDF
How TestOps is Redefining QA Testing in DevOps.pdf
Kanika Vatsyayan
 
PDF
Keynote Evento TestingUY 2018 - The Art of Excellence Adding value as an IT p...
TestingUy
 
PPTX
Where Testers & QA Fit in the Story of DevOps
QASymphony
 
PDF
[QE 2018] Paul Gerrard – Automating Assurance: Tools, Collaboration and DevOps
Future Processing
 
PPTX
Does dev ops need continuous testing devops days des moines 2018 v1
GerieOwen
 
PDF
Helpful Practices in Agile Testing
Josiah Renaudin
 
PPTX
Test Strategy-The real silver bullet in testing by Matthew Eakin
QA or the Highway
 
PPTX
Practical Devops and Continous Delivery
Anuraj S.L
 
PDF
Value Driven Development by Dave Thomas
Naresh Jain
 
PPTX
Dev ops != Dev+Ops
Shalu Ahuja
 
PDF
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
QA or the Highway
 
PPTX
Agile Transformation: People, Process and Tools to Make Your Transformation S...
QASymphony
 
PDF
Best Practices & Tools for DevOps Testing Strategy.pdf
RohitBhandari66
 
PPTX
MGM Agile Dec 28th 2022 (003).pptx
Jalaja Raj
 
PPTX
Building Better Collaboration Between Development and Testing in a DevOps World
QASymphony
 
PDF
The DevOps Challenge: Now Is the Time to Be a Champion of Quality
TechWell
 
PPTX
Agile, DevOps & Test
Qualitest
 
PPTX
Useful stepping stones in growth towards Agile testing door Kees Blokland.
Kees Blokland
 
PDF
Enhance Software Testing with DevOps Practices.pdf
Ciente
 
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
How TestOps is Redefining QA Testing in DevOps.pdf
Kanika Vatsyayan
 
Keynote Evento TestingUY 2018 - The Art of Excellence Adding value as an IT p...
TestingUy
 
Where Testers & QA Fit in the Story of DevOps
QASymphony
 
[QE 2018] Paul Gerrard – Automating Assurance: Tools, Collaboration and DevOps
Future Processing
 
Does dev ops need continuous testing devops days des moines 2018 v1
GerieOwen
 
Helpful Practices in Agile Testing
Josiah Renaudin
 
Test Strategy-The real silver bullet in testing by Matthew Eakin
QA or the Highway
 
Practical Devops and Continous Delivery
Anuraj S.L
 
Value Driven Development by Dave Thomas
Naresh Jain
 
Dev ops != Dev+Ops
Shalu Ahuja
 
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
QA or the Highway
 
Agile Transformation: People, Process and Tools to Make Your Transformation S...
QASymphony
 
Best Practices & Tools for DevOps Testing Strategy.pdf
RohitBhandari66
 
MGM Agile Dec 28th 2022 (003).pptx
Jalaja Raj
 
Building Better Collaboration Between Development and Testing in a DevOps World
QASymphony
 
The DevOps Challenge: Now Is the Time to Be a Champion of Quality
TechWell
 
Agile, DevOps & Test
Qualitest
 
Useful stepping stones in growth towards Agile testing door Kees Blokland.
Kees Blokland
 
Enhance Software Testing with DevOps Practices.pdf
Ciente
 
Ad

More from TechWell (20)

PDF
Failing and Recovering
TechWell
 
PDF
Test Design for Fully Automated Build Architecture
TechWell
 
PDF
System-Level Test Automation: Ensuring a Good Start
TechWell
 
PDF
Build Your Mobile App Quality and Test Strategy
TechWell
 
PDF
Testing Transformation: The Art and Science for Success
TechWell
 
PDF
Implement BDD with Cucumber and SpecFlow
TechWell
 
PDF
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
PDF
Ma 15
TechWell
 
PDF
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
PDF
Transform Test Organizations for the New World of DevOps
TechWell
 
PDF
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
PDF
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
PDF
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
PDF
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
PDF
A Business-First Approach to DevOps Implementation
TechWell
 
PDF
Databases in a Continuous Integration/Delivery Process
TechWell
 
PDF
Mobile Testing: What—and What Not—to Automate
TechWell
 
PDF
Cultural Intelligence: A Key Skill for Success
TechWell
 
PDF
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 
PDF
Scale: The Most Hyped Term in Agile Development Today
TechWell
 
Failing and Recovering
TechWell
 
Test Design for Fully Automated Build Architecture
TechWell
 
System-Level Test Automation: Ensuring a Good Start
TechWell
 
Build Your Mobile App Quality and Test Strategy
TechWell
 
Testing Transformation: The Art and Science for Success
TechWell
 
Implement BDD with Cucumber and SpecFlow
TechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
Ma 15
TechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
Transform Test Organizations for the New World of DevOps
TechWell
 
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
A Business-First Approach to DevOps Implementation
TechWell
 
Databases in a Continuous Integration/Delivery Process
TechWell
 
Mobile Testing: What—and What Not—to Automate
TechWell
 
Cultural Intelligence: A Key Skill for Success
TechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 
Scale: The Most Hyped Term in Agile Development Today
TechWell
 
Ad

Recently uploaded (20)

PPTX
Hardware(Central Processing Unit ) CU and ALU
RizwanaKalsoom2
 
PDF
Top Agile Project Management Tools for Teams in 2025
Orangescrum
 
PDF
Build It, Buy It, or Already Got It? Make Smarter Martech Decisions
bbedford2
 
PPTX
AEM User Group: India Chapter Kickoff Meeting
jennaf3
 
PPTX
Migrating Millions of Users with Debezium, Apache Kafka, and an Acyclic Synch...
MD Sayem Ahmed
 
PDF
vMix Pro 28.0.0.42 Download vMix Registration key Bundle
kulindacore
 
PDF
iTop VPN With Crack Lifetime Activation Key-CODE
utfefguu
 
PDF
Thread In Android-Mastering Concurrency for Responsive Apps.pdf
Nabin Dhakal
 
PPTX
Agentic Automation Journey Series Day 2 – Prompt Engineering for UiPath Agents
klpathrudu
 
PPTX
OpenChain @ OSS NA - In From the Cold: Open Source as Part of Mainstream Soft...
Shane Coughlan
 
PDF
Unlock Efficiency with Insurance Policy Administration Systems
Insurance Tech Services
 
PDF
Digger Solo: Semantic search and maps for your local files
seanpedersen96
 
PDF
Wondershare PDFelement Pro Crack for MacOS New Version Latest 2025
bashirkhan333g
 
PPTX
Transforming Mining & Engineering Operations with Odoo ERP | Streamline Proje...
SatishKumar2651
 
PPTX
Homogeneity of Variance Test Options IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
PDF
Odoo CRM vs Zoho CRM: Honest Comparison 2025
Odiware Technologies Private Limited
 
PDF
Linux Certificate of Completion - LabEx Certificate
VICTOR MAESTRE RAMIREZ
 
PDF
Revenue streams of the Wazirx clone script.pdf
aaronjeffray
 
PPTX
Human Resources Information System (HRIS)
Amity University, Patna
 
PPTX
Change Common Properties in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
Hardware(Central Processing Unit ) CU and ALU
RizwanaKalsoom2
 
Top Agile Project Management Tools for Teams in 2025
Orangescrum
 
Build It, Buy It, or Already Got It? Make Smarter Martech Decisions
bbedford2
 
AEM User Group: India Chapter Kickoff Meeting
jennaf3
 
Migrating Millions of Users with Debezium, Apache Kafka, and an Acyclic Synch...
MD Sayem Ahmed
 
vMix Pro 28.0.0.42 Download vMix Registration key Bundle
kulindacore
 
iTop VPN With Crack Lifetime Activation Key-CODE
utfefguu
 
Thread In Android-Mastering Concurrency for Responsive Apps.pdf
Nabin Dhakal
 
Agentic Automation Journey Series Day 2 – Prompt Engineering for UiPath Agents
klpathrudu
 
OpenChain @ OSS NA - In From the Cold: Open Source as Part of Mainstream Soft...
Shane Coughlan
 
Unlock Efficiency with Insurance Policy Administration Systems
Insurance Tech Services
 
Digger Solo: Semantic search and maps for your local files
seanpedersen96
 
Wondershare PDFelement Pro Crack for MacOS New Version Latest 2025
bashirkhan333g
 
Transforming Mining & Engineering Operations with Odoo ERP | Streamline Proje...
SatishKumar2651
 
Homogeneity of Variance Test Options IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
Odoo CRM vs Zoho CRM: Honest Comparison 2025
Odiware Technologies Private Limited
 
Linux Certificate of Completion - LabEx Certificate
VICTOR MAESTRE RAMIREZ
 
Revenue streams of the Wazirx clone script.pdf
aaronjeffray
 
Human Resources Information System (HRIS)
Amity University, Patna
 
Change Common Properties in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 

Testing and DevOps: Organizations and Their Culture Must Change

  • 1.           K2   Keynote   10/4/17  10:00           Testing  and  DevOps:  Organizations  and   Their  Culture  Must  Change     Presented  by:     Adam  Auerbach    Lincoln  Financial  Group     Brought  to  you  by:                   350  Corporate  Way,  Suite  400,  Orange  Park,  FL  32073     888-­‐-­‐-­‐268-­‐-­‐-­‐8770  ·∙·∙  904-­‐-­‐-­‐278-­‐-­‐-­‐0524  -­‐  [email protected]  -­‐  http://www.starwest.techwell.com/              
  • 2. Adam  Auerbach   Adam  Auerbach  is  the  Vice  President  of  Quality  and  DevOps  Engineering  at   Lincoln  Financial  Group.  Adam  is  responsible  for  leading  the  implementation  of   Continuous  Testing  and  Continuous  Delivery  across  Lincoln.  Prior  to  joining  LFG,   Adam  was  the  senior  director  of  technology  for  advanced  testing  and  release   services  for  Capital  One  Financial  Corporation.  Adam  led  Capital  One— ’s  enterprise  performance  and  automated  testing  departments  as  well  as   enterprise  release  management  and  test  data  management.  While  at  Capital   One,  he  provided  leadership  for  the  agile  transformation  of  their  quality   assurance  group  and  led  the  enterprise  adoption  of  DevOps  and  acceptance   test6 driven  development.  Before  joining  Capital  One,  Adam  was  with  Chase   and  other  financial  and  insurance  companies,  in  various  leadership  positions   focused  on  quality  and  agile  practices.  
  • 3. 10/17/17   1   Tes$ng  and  DevOps:   Organiza-ons  and  their  culture  must  change   Adam  Auerbach   VP  Quality  and  DevOps   Engineering     Quality  and  DevOps  Engineering  @  Lincoln  Financial   2   Performance   Tes-ng   Service   Virtualiza$on   Automated   Tes-ng   DevOps   Test  Data     Quality  Engineering   Community  of   Prac-ce   @BugMan31   @  AdamAuerbach  
  • 4. 10/17/17   2   Tradi$onal  QA  Organiza$on   3   LOB   Team   LOB   Team   LOB   Team   Automa$on     Performance   Security   Agile   4   HARDENING  SPRINT  2  SPRINT  1   Test   Test   Design   Design   Build   Build   Defect  Fix   Test  
  • 5. 10/17/17   3   What  is  DevOps?   5   DevOps  is  a  philosophy  change   6   DELIVER  HIGH  QUALITY  WORKING  SOFTWARE  FASTER   DevOps  is  a  philosophy  where  teams   are  accountable  for  everything   required  to  get  their  code   developed,  tested  and  deployed  to   produc-on,  while  shared  service   teams  provide  the  automa-on  and   tools  to  enable  them.       “You  Build  it  You  Own  it”   Agile  Pod   Prod  Support   Arch.   Infrastructure   Shared  Services  (e.g.  Security  TesAng,   Perf  TesAng)   (Dev,  QA,  PO,  BSA)  
  • 6. 10/17/17   4   DevOps  is  the  next  part  of  your  Agile  journey   7   Number  of  Releases   SoJware  Quality   Agile           DevOps           Con$nuous   Delivery         Waterfall   We  are  here   Accelerates  soPware   development  with   itera-ve,   incremental  releases   Enables  faster   feedback  for   developers  thru   automa-on  and   increased   responsibili-es   Allows  code  to  flow  via   an  automated  soPware   factory  that  deploys   constantly   8   What  is  DevOps?  
  • 7. 10/17/17   5   9   Automate  Everything   10   Fast  Feedback  
  • 8. 10/17/17   6   11   Remove  Constraints   12   Collabora$on  early  and  oVen  
  • 9. 10/17/17   7   13   Focus  on  flow   14   Agile  +  DevOps   DevOps   Con$nuous   Integra$on   Con$nuous   Tes$ng   Con$nuous   Monitoring   Con-nuous   Delivery  Agile  
  • 10. 10/17/17   8   How  does  Tes$ng  have  to   change?   15   16   Pipelines   Pipelines  
  • 11. 10/17/17   9   Real-­‐Time  Automa$on   17   ACCEPTANCE  TEST-­‐DRIVEN  DEVELOPMENT  (ATDD)   •  Team  Focused   •  Stress  on  Acceptance  Criteria   •  Add  a  Test   •  Run  all  Tests     •  Write  Code   •  Refractor  Un-l  Added  Test  Passes   BEHAVIOR-­‐DRIVEN  DEVELOPMENT  (BDD)   •  Team  Focused   •  Stress  on  Stories   •  Add  a  Test   •  Run  all  Tests   •  Write  Code   •  Refactor  Un-l  Added  Test  Passes   TEST-­‐DRIVEN  DEVELOPMENT  (TDD)   •  Developer  Focused   •  Closer  to  Unit  Level   •  Add  a  Test   •  Run  all  Tests   •  Write  Code   •  Refactor  Un-l  Added  Test  Passes   Tes$ng  Approach                           SoVware  Tes$ng   Ice-­‐cream  Cone   An$-­‐Pa^ern   watermelon.com   Automated  GUI  Tests   Integra-on  Tests   Unit   Tests   Automated   GUI  Tests   Automated  Unit  Tests   Manual  Session   Based  Tes-ng   Automated  API  Tests   Automated  Integra-on  Tests   Automated  Component  Tests   Manual  Tests   Ideal  SoVware  Tes$ng  Pyramid   watermelon.com   CURRENT   DESTINATION  
  • 12. 10/17/17   10   Open  Source  Tools   Environments   20  
  • 13. 10/17/17   11   Test  Data  Management   21   EFFECTIVE  DATA   EFFICIENT  DATA   PRODUCTION  DATA   Building  the  right  data   Ge9ng  it  right  the  first  ;me   Reduce  Security  Excep;on  Dependency       1   2   3   INTEGRATED  ENVIRONMENT   VIRTUALIZED  ENVIRONMENT   Service  Virtualiza$on   22   VS.  
  • 14. 10/17/17   12   Dashboards   23   Dashboard  Cont’d   24  
  • 15. 10/17/17   13   How  do  you  start?   25   26   Iden$fy  areas  for  improvement  
  • 16. 10/17/17   14   27   Empower  people  to  drive  change   Next  Stop   Agile  Process   Training   Waterfall  Process   Test  Data  Management  Tools  Technical  Processes   28   Build  a  community   Demos   Lunch  &  Learns   Roadshows   Office  Hours   Internal  Conferences  
  • 17. 10/17/17   15   Common  challenges   29   Lack  of  Technical   resources  Lack  of  funding   Project  delivery  mindset   3rd  party  dependencies   Ques-ons  on  direc-on   Top  down  and  bo^om  up  support  is  cri$cal   30   Take  inventory  of  your  team   SME   DevOps  Waterfall   Process  Driven   Agile   Innova$ve  Business  Focus   YOUR  TEAM   Programming  
  • 18. 10/17/17   16   Iden$fy  your  future  leaders   31  PEOPLE  MANAGERS   TECHNOLOGISTS   Training   32   Use  mul$ple  levers  to  get  more  technical   Sourcing   New  Hires   Resul$ng  in  increased   technical  team   members  
  • 19. 10/17/17   17   33   Enterprise  groups  focus  on  enablement   Focus  on:   Technology  &   Support     Shippable    code   Focus  on:   TEAM  MEMBERS  ENTERPRISE  TEAMS   34   Embrace  DevOps  for  Tes$ng   AUTOMATION   Performance  Tes$ng   Test  Data   Agile  Team  
  • 20. 10/17/17   18   35   Pilot  like  crazy   Discovery     Pilot   36   Proven  metrics  
  • 21. 10/17/17   19   Des$na$on   37   Enterprise  Products   Teams  are  enabled  via  Enterprise  solu$ons   LOB   Team   LOB   Team   LOB     Team   Tes-ng  tools  and  frameworks   Performance  and  monitoring  tools   Test  Data  Management  Tool   Service  Virtualiza-on   Test  Environment  tooling   QUESTIONS   38  
  • 22. 10/17/17   20   YOU   THANK   39