SlideShare a Scribd company logo
De-mystifying DevOps
A Practitioner’s Perspective
Sept 2016
Promise
DevOps
The
Education Webinar Series
2
Joan Wrabetz
CTO
Edan Evantal
VP, Engineering Shashi Kiran
CMO
PANELISTS
MODERATOR
Have Questions?
3
Agenda
• Introduction
• DevOps Framework
• Sandboxes and Quali CloudShell
• The Quali DevOps Journey
• Challenges and Learnings
• The Road Ahead
• Summary and Best Practices
4
01
02
03
Venture-funded start-up focused on DevOps and
BizOps Automation
Delivers “Sandboxes” - Replicas of production
environments
Strong Innovation DNA – Trusted by customers
worldwide
About Quali
5
300+ customers – Cloud providers, Telcos,
Enterprises – across FSI, Retail, Healthcare and
Government
~115 employees in USA, Israel and Europe
focused on serving customers worldwide300+
Source: http://www.gartner.com/newsroom/id/2999017
By2016,DevOpswillevolvefroma
nichestrategyemployedbylarge
cloudprovidersto amainstream
strategyemployedby25percentof
theGlobal2000organizations
How We View the DevOps Lifecycle
7
Quali Cloud Sandboxes
Building Blocks for DevOps and BizOps Automation
Personalized replicas of production environments
Reservation
Self-Service with Sophisticated Modeling and Automation
BI and
Analytics
Deploy
Anywhere
Set-up and
tear down
Environment
GUI or
API-driven
Connectivity
Applications and DataPhysical or Virtual Infrastructure
Orchestrate
DevOps and
BizOps
workflows
Security
“Full Stack”
On-Prem
or Hybrid
CloudMulti-tenant
Quali Cloud Shell – Industry –Leading Sandbox
Hybrid Infrastructure
Enable Self-Service
Environments with BI
and Analytics
Provide physical/virtual
Infrastructure &
Applications (Any DC/ Cloud)
Mode & Orchestrate
Full-Stack replicas of
Production Environments
Benefits of Sandboxes to DevOps
10
Faster Release Cycles
Lower TCO
Reduced Ops Failures
Automate
Config. Setup and teardown
Integrate with CI/CD Toolsets
Decrease Risk
Dev/Test in Production Replicas
Expand scope Eg. Security
Reduce Cost
Efficient Resource Utilization
Quali Development Environment
50+ Engineers
15% Focused on
DevOps
Development Tools
Source Control
Build
Virtualization / Cloud
Test
Dev/Test Sandbox
ALM
Collaboration
Stage 1 – Implement Agile SCRUM
Implement
Agile
Quali
DevOps
Journey
7 1
2
3
4
5
6
FIX
ISSUE
• 2 weeks “sprints” create
planning overhead
• QA and test cycle = 50% of
release bloat.
• Definition of “done”
• Shift to 4 wk. sprints to
automate tests
• Implemented Kanban with
short weekly planning
We Implemented Agile Scrum framework fully
Quali Lean Development Process Today
Product Backlog Backlog grooming
“Next“ stories
Daily Scrum
Meeting – Release
Kickoff
Weekly
planning
4 weeks
Sprint
Review and Retrospective
Potentially Shippable
Product Increment
14
Efficiency 2X productive
• Agile Development
• Kanban planning
• Paired code reviews
1
Stage 2 – Increase % Automation
Implement
Agile
Increase
Automation
Quali
DevOps
Journey
7 1
2
3
4
5
6
FIX
ISSUE
• Only 40% tests automated
• Escape defects
• Reduce UI testing
• Implemented zero bug policy
• Quality sprints – zero bug
baseline release
Test Automation Composition
UI
Integration
Unit
10’s
100’s
1000’s
UI
Integration
Unit100’s
10’s
100’s
3 Years Ago Today
17
• Agile Development
• Kanban planning
• Paired code reviews
• Zero bug policy
2
Test
Automation
85%
Continuous testing 2
Stage 3 – Get Real Customer Input
Implement
Agile
Increase
Automation
Customer
Input
Quali
DevOps
Journey
7 1
2
3
4
5
6
FIX
ISSUE
• INTERNAL sprint demos at
end of 4 week releases. No
customer input till EA  too
late to make changes
• EXTERNAL sprint demos to
field and delivery
• CloudShell sandbox for
realistic config., training and
customer roadshows
Field Training and customer
demos with CloudShell
sandboxes
3
EA
Feedback
Months to
Weeks
Stage 4 – Move to DevOps
Implement
Agile
Increase
Automation
Customer
Input
Move to
DevOps
Quali
DevOps
Journey
7 1
2
3
4
5
6
FIX
ISSUE
• Obtain immediate Developer
feedback.
• Integrate CI/CD
• Create CI Pipeline  Shift left
• Created CloudShell sandboxes
mirroring customer
environments  added to
automated test flow
21
Continuous testing Developer
Feedback
Weeks to
Minutes
Continuous Integration
Cloud Sandboxes
4
Stage 5 – Engage Customer and Partner Dev.
Implement
Agile
Increase
Automation
Customer
Input
Move to
DevOps
3rd Party
Developers
Quali
DevOps
Journey
7 1
2
3
4
5
6
FIX
ISSUE
• Get customers and partners to
contribute to “shell”
development
• Collaborate - Distributed teams
• Open Source “Shells” on GitHub
• DevOps pipeline moved to
GitHub for open participation
• Developer version
• Simpler documentation
• API for 3rd party/ community
23
Open
Source
10X Innovation
Velocity
• Open Source Shells
• Source Code in GitHub
• Dev tools and docs
• API driven
5
Stage 6 – Getting to GA Faster
Implement
Agile
Increase
Automation
Customer
Input
Move to
DevOps
3rd Party
Developers
GA Release
Quality Quali DevOps
Journey
7 1
2
3
4
5
6
FIX
ISSUE
• 3-month releases
• No continuous deployment
• Impacts new feature velocity
• Live staging for EA customers
• Interim builds – with features in
development
• CloudShell demos on AWS –
experiment on early-stage
builds
25
Customer
Sat.
30% Increase
Customer Staging Sites
Demos of latest build to
EA customers speeds GA
6
Stage 7 – Increase Responsiveness
Increase
Responsiveness
Implement
Agile
Increase
Automation
Customer
Input
Move to
DevOps
3rd Party
Developers
GA Release
Quality
Quali
DevOps
Journey
7 1
2
3
4
5
6
FIX
ISSUE
• Continuous Deployment
• New features and bugs cause
disruption or get delayed by 3
months
• Series of optimizations in
progress
The Quali DevOps Journey … So Far
Increase
Responsiveness
Implement
Agile
Increase
Automation
Customer
Input
Move to
DevOps
3rd Party
Developers
GA Release
Quality
Quali
DevOps
Journey
7 1
2
3
4
5
6
2X Efficiency Increase
85% Test Automation
EA Feedback: Months to
Weeks
Developer Feedback:
Week to Minutes
Work in Progress
30% Increase in
Customer Satisfaction
10X Innovation Velocity
DevOps Progress Board
ToDo InProgress Done (?)
Eliminate release
planning - only
feature level
planning
Flexible CD for
non-SaaS
Deployments
Deliver customer code
non-disruptively on-
premise or in the cloud
Fixed scrum team
allocation. No pre-
planned backlogs
100%
Continuous
Integration
DevOps Style
Innovation
Customer and
Partner
Engagement
Feature velocity and
Faster EA customer
feedback
Community
scaling.
Test
Automation
DevOps Best Practices – It is a Journey!
Focus on Agile Development1
Take an “Automation-First” Approach – CI/ CD2
Define end-goals. Leverage Cloud Sandboxes to
Accelerate and De-risk the journey.3
Successful pioneers like Netflix, Etsy and Amazon
took 5+ years to get CD (We are in year 3).
Q & A
Future Educational Webinars
1. Accelerate Hybrid Clouds with Sandboxes
2. Enhancing Security with Cyber Ranges
3. Cloud Sandboxes – Building blocks for
DevOps Automation
4. Digitization – Key to Business Transformation
Quali Community
Blogswww.quali.com
Social Media
@Quali
@Qualisystems
33
Quali engages with its customers, partners and developers in many ways.
Stay in Touch
34
www.quali.com
THANK YOU

More Related Content

PDF
QualiSystems-Brief TestShell
Amy Ho, PMP, PMI-ACP
 
PDF
DevOps from a developer perspective
WSO2
 
PDF
Infrastructure as Code Maturity Model v1
Gary Stafford
 
PDF
Manage a Complex Test Effort with Lean and Kanban
TechWell
 
PPTX
Webinar June 2017 l Apica LoadTest to compliment HP Loadrunner
Whitney Donaldson
 
PPTX
Change Management in Hybrid landscapes 2017
Chris Kernaghan
 
PPTX
Dev ops
Gourav Varma
 
PPTX
Private Cloud Deployment Automation with XebiaLabs and OpenShift
XebiaLabs
 
QualiSystems-Brief TestShell
Amy Ho, PMP, PMI-ACP
 
DevOps from a developer perspective
WSO2
 
Infrastructure as Code Maturity Model v1
Gary Stafford
 
Manage a Complex Test Effort with Lean and Kanban
TechWell
 
Webinar June 2017 l Apica LoadTest to compliment HP Loadrunner
Whitney Donaldson
 
Change Management in Hybrid landscapes 2017
Chris Kernaghan
 
Dev ops
Gourav Varma
 
Private Cloud Deployment Automation with XebiaLabs and OpenShift
XebiaLabs
 

What's hot (19)

PDF
Agile Secure Cloud Application Development Management
Adam Getchell
 
PPTX
Quality Dashboard, an industry collaborative platform for translation quality...
TAUS - The Language Data Network
 
PPTX
Rez gateway - RezOS - innovate the future
indikaMaligaspe
 
PDF
Strong practices for rails applications continuous delivery
Robb Kidd
 
PPTX
Operating a High Velocity Large Organization with Spring Cloud Microservices
Noriaki Tatsumi
 
PDF
Agile North East Agile + DevOps by Craig Pearson of CAP Project Services
Craig Pearson
 
PDF
Shift Left with Continuous Inspection
Serena Software
 
PDF
SRE in Apiary
Ladislav Prskavec
 
PDF
FUG Agile software engineering practices
Serena Software
 
PPTX
Scheduled releases @ Commit Porto 2016
Fábio Oliveira
 
PDF
CS meetup 2020 - Introduction to DevOps
Ridwan Fadjar
 
PPTX
The art of wmb deployment automation
MidVision
 
PDF
DevOps: Find Solutions, Not More Defects
TechWell
 
PDF
Roles and Responsibilities of a DevOps Engineer
ZaranTech LLC
 
PDF
DevOps for absolute beginners
Ahmed Misbah
 
PDF
Boosting Dev and Ops Productivity
XebiaLabs
 
PPTX
Understanding the DevOps Tooling Landscape
XebiaLabs
 
PPTX
Application Performance Management
Noriaki Tatsumi
 
PDF
Overview and Demonstration of Dimensions CM 14.2 (FUG presentation track 2)
Serena Software
 
Agile Secure Cloud Application Development Management
Adam Getchell
 
Quality Dashboard, an industry collaborative platform for translation quality...
TAUS - The Language Data Network
 
Rez gateway - RezOS - innovate the future
indikaMaligaspe
 
Strong practices for rails applications continuous delivery
Robb Kidd
 
Operating a High Velocity Large Organization with Spring Cloud Microservices
Noriaki Tatsumi
 
Agile North East Agile + DevOps by Craig Pearson of CAP Project Services
Craig Pearson
 
Shift Left with Continuous Inspection
Serena Software
 
SRE in Apiary
Ladislav Prskavec
 
FUG Agile software engineering practices
Serena Software
 
Scheduled releases @ Commit Porto 2016
Fábio Oliveira
 
CS meetup 2020 - Introduction to DevOps
Ridwan Fadjar
 
The art of wmb deployment automation
MidVision
 
DevOps: Find Solutions, Not More Defects
TechWell
 
Roles and Responsibilities of a DevOps Engineer
ZaranTech LLC
 
DevOps for absolute beginners
Ahmed Misbah
 
Boosting Dev and Ops Productivity
XebiaLabs
 
Understanding the DevOps Tooling Landscape
XebiaLabs
 
Application Performance Management
Noriaki Tatsumi
 
Overview and Demonstration of Dimensions CM 14.2 (FUG presentation track 2)
Serena Software
 
Ad

Viewers also liked (20)

PDF
Mapa conceptual terminado "Evaluación"
Colegio Utatlán
 
PPTX
Apresentação11
Fernandoprotec
 
PPT
Informática - Aula 1
IBEST ESCOLA
 
PDF
Fast Bites
Iulius Caius
 
PPTX
Drogas
SigmaIczel
 
PPTX
Tactics to Kickstart Your Journey Toward DevOps
Jeff Gallimore
 
PPT
Actividad sports, animals and technological
juan camilo ledesma carrizosa
 
PPTX
Internet y navegador web
Alfredo Armando Ortega Castillo
 
PDF
Evaluatioin pdf
Jamie Mellors
 
PPT
Introducción a la biblia 1
Apoloslideshare
 
PDF
Horario de clases tercero 2016
Colegio Utatlán
 
PPTX
Le Noël en France
TeresaSousa
 
PDF
3 cap 2 - acidentes do trabalho
Zacarias Junior
 
PPTX
Hardware (basico)
SigmaIczel
 
PPTX
Trastonos depresivos niños y adolescentes 2013
Magditita
 
PPT
Blood its composition and funtions
almas naqvi
 
PPT
Dm quick evalguide design of component
manooch.ehr
 
PDF
Dossiê hsm-expomanagement-2014-prof.-isaac-martins
Isaac Martins
 
PDF
Strenght of material me-ce (gate2016.info)
Paritosh Kasaudhan
 
PDF
DevOps Operations Challenges
Vijaya K
 
Mapa conceptual terminado "Evaluación"
Colegio Utatlán
 
Apresentação11
Fernandoprotec
 
Informática - Aula 1
IBEST ESCOLA
 
Fast Bites
Iulius Caius
 
Drogas
SigmaIczel
 
Tactics to Kickstart Your Journey Toward DevOps
Jeff Gallimore
 
Actividad sports, animals and technological
juan camilo ledesma carrizosa
 
Internet y navegador web
Alfredo Armando Ortega Castillo
 
Evaluatioin pdf
Jamie Mellors
 
Introducción a la biblia 1
Apoloslideshare
 
Horario de clases tercero 2016
Colegio Utatlán
 
Le Noël en France
TeresaSousa
 
3 cap 2 - acidentes do trabalho
Zacarias Junior
 
Hardware (basico)
SigmaIczel
 
Trastonos depresivos niños y adolescentes 2013
Magditita
 
Blood its composition and funtions
almas naqvi
 
Dm quick evalguide design of component
manooch.ehr
 
Dossiê hsm-expomanagement-2014-prof.-isaac-martins
Isaac Martins
 
Strenght of material me-ce (gate2016.info)
Paritosh Kasaudhan
 
DevOps Operations Challenges
Vijaya K
 
Ad

Similar to Quali webinar de-mystifyind dev_ops-a practitioner’s perspective (20)

PPTX
What is DevOps? What is DevOps CoE?
7Targets AI Sales Assistants
 
PDF
DevOps Culture & Methodology Intro
Najib Radzuan
 
PPTX
Dev ops != Dev+Ops
Shalu Ahuja
 
PDF
DevOps Transformation: Learnings and Best Practices
QBurst
 
PPTX
DevOps 1 (1).pptx
piyushkumar613397
 
PPTX
Devops journey conference may 2016
Clive Hannon
 
PDF
Webinar: Demonstrating Business Value for DevOps & Continuous Delivery
XebiaLabs
 
PDF
DevOps Implementation Roadmap
SofiaCarter4
 
PDF
Engineering DevOps to meet Business Goals
Marc Hornbeek
 
PPTX
DevOps evolution architecting the modern software factory - cloud expo east 2017
Anand Akela
 
PDF
Enhance Software Testing with DevOps Practices.pdf
Ciente
 
PPTX
Introduction to DevOps
Cprime
 
PDF
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks
Sanjeev Sharma
 
PPTX
DevOpsGuys - How to get started with DevOps - Redgate Webinar April 2017
DevOpsGroup
 
PPTX
How to get started with DevOps
Red Gate Software
 
PDF
Luiz Fernando Testa Contador - Aplicando DevOps em grandes corporações
Agile Trends
 
PDF
Understanding the Role of DevOps in Modern Software Development.pdf
SuccessiveDigital
 
PPTX
Agile Gurgaon 2016 | Thinking Beyond :: Marry Agile and DevOps for Phenomenal...
AgileNetwork
 
PPTX
AICT_presentation.pptx
AbdullahMalik486262
 
PDF
AgileDC15 I'm Using Chef So I'm DevOps Right?
Rob Brown
 
What is DevOps? What is DevOps CoE?
7Targets AI Sales Assistants
 
DevOps Culture & Methodology Intro
Najib Radzuan
 
Dev ops != Dev+Ops
Shalu Ahuja
 
DevOps Transformation: Learnings and Best Practices
QBurst
 
DevOps 1 (1).pptx
piyushkumar613397
 
Devops journey conference may 2016
Clive Hannon
 
Webinar: Demonstrating Business Value for DevOps & Continuous Delivery
XebiaLabs
 
DevOps Implementation Roadmap
SofiaCarter4
 
Engineering DevOps to meet Business Goals
Marc Hornbeek
 
DevOps evolution architecting the modern software factory - cloud expo east 2017
Anand Akela
 
Enhance Software Testing with DevOps Practices.pdf
Ciente
 
Introduction to DevOps
Cprime
 
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks
Sanjeev Sharma
 
DevOpsGuys - How to get started with DevOps - Redgate Webinar April 2017
DevOpsGroup
 
How to get started with DevOps
Red Gate Software
 
Luiz Fernando Testa Contador - Aplicando DevOps em grandes corporações
Agile Trends
 
Understanding the Role of DevOps in Modern Software Development.pdf
SuccessiveDigital
 
Agile Gurgaon 2016 | Thinking Beyond :: Marry Agile and DevOps for Phenomenal...
AgileNetwork
 
AICT_presentation.pptx
AbdullahMalik486262
 
AgileDC15 I'm Using Chef So I'm DevOps Right?
Rob Brown
 

More from QualiQuali (12)

PPTX
Accelerating Network Transformation with Self-service Environments and Orches...
QualiQuali
 
PDF
GDPR Compliance Countdown - Is your Application environment ready?
QualiQuali
 
PDF
implanting DevOps at scale using dynamic test environments
QualiQuali
 
PDF
The holy grail of automated labs self-service with l1 switching
QualiQuali
 
PPTX
Continuous testing webinar 041017 slideshare
QualiQuali
 
PPTX
Cloud Sandboxing Solution for Cyber Ranges
QualiQuali
 
PPTX
Webinar leveraging-cloud-sandboxes-with-ansible-jenkins-j frog
QualiQuali
 
PPTX
2016 quali continuous testing quest for quality conference
QualiQuali
 
PPTX
2016 quali dev ops_delivery of things_conference
QualiQuali
 
PPTX
Mind the Gap: Crossing the DevOps Chasm
QualiQuali
 
PPTX
Mind the Gap: Crossing the DevOps Chasm
QualiQuali
 
PPTX
Heterogeneous Self-Service Automation for SDN Dev/Test
QualiQuali
 
Accelerating Network Transformation with Self-service Environments and Orches...
QualiQuali
 
GDPR Compliance Countdown - Is your Application environment ready?
QualiQuali
 
implanting DevOps at scale using dynamic test environments
QualiQuali
 
The holy grail of automated labs self-service with l1 switching
QualiQuali
 
Continuous testing webinar 041017 slideshare
QualiQuali
 
Cloud Sandboxing Solution for Cyber Ranges
QualiQuali
 
Webinar leveraging-cloud-sandboxes-with-ansible-jenkins-j frog
QualiQuali
 
2016 quali continuous testing quest for quality conference
QualiQuali
 
2016 quali dev ops_delivery of things_conference
QualiQuali
 
Mind the Gap: Crossing the DevOps Chasm
QualiQuali
 
Mind the Gap: Crossing the DevOps Chasm
QualiQuali
 
Heterogeneous Self-Service Automation for SDN Dev/Test
QualiQuali
 

Recently uploaded (20)

PPTX
MSME 4.0 Template idea hackathon pdf to understand
alaudeenaarish
 
PDF
CAD-CAM U-1 Combined Notes_57761226_2025_04_22_14_40.pdf
shailendrapratap2002
 
PDF
Zero Carbon Building Performance standard
BassemOsman1
 
PPT
Understanding the Key Components and Parts of a Drone System.ppt
Siva Reddy
 
PDF
EVS+PRESENTATIONS EVS+PRESENTATIONS like
saiyedaqib429
 
PPTX
Inventory management chapter in automation and robotics.
atisht0104
 
PDF
AI-Driven IoT-Enabled UAV Inspection Framework for Predictive Maintenance and...
ijcncjournal019
 
PPTX
IoT_Smart_Agriculture_Presentations.pptx
poojakumari696707
 
PDF
The Effect of Artifact Removal from EEG Signals on the Detection of Epileptic...
Partho Prosad
 
PDF
67243-Cooling and Heating & Calculation.pdf
DHAKA POLYTECHNIC
 
PDF
FLEX-LNG-Company-Presentation-Nov-2017.pdf
jbloggzs
 
PDF
20ME702-Mechatronics-UNIT-1,UNIT-2,UNIT-3,UNIT-4,UNIT-5, 2025-2026
Mohanumar S
 
PDF
LEAP-1B presedntation xxxxxxxxxxxxxxxxxxxxxxxxxxxxx
hatem173148
 
PDF
Construction of a Thermal Vacuum Chamber for Environment Test of Triple CubeS...
2208441
 
PDF
Unit I Part II.pdf : Security Fundamentals
Dr. Madhuri Jawale
 
PDF
2025 Laurence Sigler - Advancing Decision Support. Content Management Ecommer...
Francisco Javier Mora Serrano
 
PDF
settlement FOR FOUNDATION ENGINEERS.pdf
Endalkazene
 
PPTX
22PCOAM21 Session 2 Understanding Data Source.pptx
Guru Nanak Technical Institutions
 
PPTX
Module2 Data Base Design- ER and NF.pptx
gomathisankariv2
 
PDF
Introduction to Ship Engine Room Systems.pdf
Mahmoud Moghtaderi
 
MSME 4.0 Template idea hackathon pdf to understand
alaudeenaarish
 
CAD-CAM U-1 Combined Notes_57761226_2025_04_22_14_40.pdf
shailendrapratap2002
 
Zero Carbon Building Performance standard
BassemOsman1
 
Understanding the Key Components and Parts of a Drone System.ppt
Siva Reddy
 
EVS+PRESENTATIONS EVS+PRESENTATIONS like
saiyedaqib429
 
Inventory management chapter in automation and robotics.
atisht0104
 
AI-Driven IoT-Enabled UAV Inspection Framework for Predictive Maintenance and...
ijcncjournal019
 
IoT_Smart_Agriculture_Presentations.pptx
poojakumari696707
 
The Effect of Artifact Removal from EEG Signals on the Detection of Epileptic...
Partho Prosad
 
67243-Cooling and Heating & Calculation.pdf
DHAKA POLYTECHNIC
 
FLEX-LNG-Company-Presentation-Nov-2017.pdf
jbloggzs
 
20ME702-Mechatronics-UNIT-1,UNIT-2,UNIT-3,UNIT-4,UNIT-5, 2025-2026
Mohanumar S
 
LEAP-1B presedntation xxxxxxxxxxxxxxxxxxxxxxxxxxxxx
hatem173148
 
Construction of a Thermal Vacuum Chamber for Environment Test of Triple CubeS...
2208441
 
Unit I Part II.pdf : Security Fundamentals
Dr. Madhuri Jawale
 
2025 Laurence Sigler - Advancing Decision Support. Content Management Ecommer...
Francisco Javier Mora Serrano
 
settlement FOR FOUNDATION ENGINEERS.pdf
Endalkazene
 
22PCOAM21 Session 2 Understanding Data Source.pptx
Guru Nanak Technical Institutions
 
Module2 Data Base Design- ER and NF.pptx
gomathisankariv2
 
Introduction to Ship Engine Room Systems.pdf
Mahmoud Moghtaderi
 

Quali webinar de-mystifyind dev_ops-a practitioner’s perspective

  • 1. De-mystifying DevOps A Practitioner’s Perspective Sept 2016 Promise DevOps The Education Webinar Series
  • 2. 2 Joan Wrabetz CTO Edan Evantal VP, Engineering Shashi Kiran CMO PANELISTS MODERATOR
  • 4. Agenda • Introduction • DevOps Framework • Sandboxes and Quali CloudShell • The Quali DevOps Journey • Challenges and Learnings • The Road Ahead • Summary and Best Practices 4
  • 5. 01 02 03 Venture-funded start-up focused on DevOps and BizOps Automation Delivers “Sandboxes” - Replicas of production environments Strong Innovation DNA – Trusted by customers worldwide About Quali 5 300+ customers – Cloud providers, Telcos, Enterprises – across FSI, Retail, Healthcare and Government ~115 employees in USA, Israel and Europe focused on serving customers worldwide300+
  • 7. How We View the DevOps Lifecycle 7
  • 8. Quali Cloud Sandboxes Building Blocks for DevOps and BizOps Automation Personalized replicas of production environments Reservation Self-Service with Sophisticated Modeling and Automation BI and Analytics Deploy Anywhere Set-up and tear down Environment GUI or API-driven Connectivity Applications and DataPhysical or Virtual Infrastructure Orchestrate DevOps and BizOps workflows Security “Full Stack” On-Prem or Hybrid CloudMulti-tenant
  • 9. Quali Cloud Shell – Industry –Leading Sandbox Hybrid Infrastructure Enable Self-Service Environments with BI and Analytics Provide physical/virtual Infrastructure & Applications (Any DC/ Cloud) Mode & Orchestrate Full-Stack replicas of Production Environments
  • 10. Benefits of Sandboxes to DevOps 10 Faster Release Cycles Lower TCO Reduced Ops Failures Automate Config. Setup and teardown Integrate with CI/CD Toolsets Decrease Risk Dev/Test in Production Replicas Expand scope Eg. Security Reduce Cost Efficient Resource Utilization
  • 11. Quali Development Environment 50+ Engineers 15% Focused on DevOps Development Tools Source Control Build Virtualization / Cloud Test Dev/Test Sandbox ALM Collaboration
  • 12. Stage 1 – Implement Agile SCRUM Implement Agile Quali DevOps Journey 7 1 2 3 4 5 6 FIX ISSUE • 2 weeks “sprints” create planning overhead • QA and test cycle = 50% of release bloat. • Definition of “done” • Shift to 4 wk. sprints to automate tests • Implemented Kanban with short weekly planning We Implemented Agile Scrum framework fully
  • 13. Quali Lean Development Process Today Product Backlog Backlog grooming “Next“ stories Daily Scrum Meeting – Release Kickoff Weekly planning 4 weeks Sprint Review and Retrospective Potentially Shippable Product Increment
  • 14. 14 Efficiency 2X productive • Agile Development • Kanban planning • Paired code reviews 1
  • 15. Stage 2 – Increase % Automation Implement Agile Increase Automation Quali DevOps Journey 7 1 2 3 4 5 6 FIX ISSUE • Only 40% tests automated • Escape defects • Reduce UI testing • Implemented zero bug policy • Quality sprints – zero bug baseline release
  • 17. 17 • Agile Development • Kanban planning • Paired code reviews • Zero bug policy 2 Test Automation 85% Continuous testing 2
  • 18. Stage 3 – Get Real Customer Input Implement Agile Increase Automation Customer Input Quali DevOps Journey 7 1 2 3 4 5 6 FIX ISSUE • INTERNAL sprint demos at end of 4 week releases. No customer input till EA  too late to make changes • EXTERNAL sprint demos to field and delivery • CloudShell sandbox for realistic config., training and customer roadshows
  • 19. Field Training and customer demos with CloudShell sandboxes 3 EA Feedback Months to Weeks
  • 20. Stage 4 – Move to DevOps Implement Agile Increase Automation Customer Input Move to DevOps Quali DevOps Journey 7 1 2 3 4 5 6 FIX ISSUE • Obtain immediate Developer feedback. • Integrate CI/CD • Create CI Pipeline  Shift left • Created CloudShell sandboxes mirroring customer environments  added to automated test flow
  • 21. 21 Continuous testing Developer Feedback Weeks to Minutes Continuous Integration Cloud Sandboxes 4
  • 22. Stage 5 – Engage Customer and Partner Dev. Implement Agile Increase Automation Customer Input Move to DevOps 3rd Party Developers Quali DevOps Journey 7 1 2 3 4 5 6 FIX ISSUE • Get customers and partners to contribute to “shell” development • Collaborate - Distributed teams • Open Source “Shells” on GitHub • DevOps pipeline moved to GitHub for open participation • Developer version • Simpler documentation • API for 3rd party/ community
  • 23. 23 Open Source 10X Innovation Velocity • Open Source Shells • Source Code in GitHub • Dev tools and docs • API driven 5
  • 24. Stage 6 – Getting to GA Faster Implement Agile Increase Automation Customer Input Move to DevOps 3rd Party Developers GA Release Quality Quali DevOps Journey 7 1 2 3 4 5 6 FIX ISSUE • 3-month releases • No continuous deployment • Impacts new feature velocity • Live staging for EA customers • Interim builds – with features in development • CloudShell demos on AWS – experiment on early-stage builds
  • 25. 25 Customer Sat. 30% Increase Customer Staging Sites Demos of latest build to EA customers speeds GA 6
  • 26. Stage 7 – Increase Responsiveness Increase Responsiveness Implement Agile Increase Automation Customer Input Move to DevOps 3rd Party Developers GA Release Quality Quali DevOps Journey 7 1 2 3 4 5 6 FIX ISSUE • Continuous Deployment • New features and bugs cause disruption or get delayed by 3 months • Series of optimizations in progress
  • 27. The Quali DevOps Journey … So Far Increase Responsiveness Implement Agile Increase Automation Customer Input Move to DevOps 3rd Party Developers GA Release Quality Quali DevOps Journey 7 1 2 3 4 5 6 2X Efficiency Increase 85% Test Automation EA Feedback: Months to Weeks Developer Feedback: Week to Minutes Work in Progress 30% Increase in Customer Satisfaction 10X Innovation Velocity
  • 28. DevOps Progress Board ToDo InProgress Done (?) Eliminate release planning - only feature level planning Flexible CD for non-SaaS Deployments Deliver customer code non-disruptively on- premise or in the cloud Fixed scrum team allocation. No pre- planned backlogs 100% Continuous Integration DevOps Style Innovation Customer and Partner Engagement Feature velocity and Faster EA customer feedback Community scaling. Test Automation
  • 29. DevOps Best Practices – It is a Journey! Focus on Agile Development1 Take an “Automation-First” Approach – CI/ CD2 Define end-goals. Leverage Cloud Sandboxes to Accelerate and De-risk the journey.3 Successful pioneers like Netflix, Etsy and Amazon took 5+ years to get CD (We are in year 3).
  • 30. Q & A
  • 31. Future Educational Webinars 1. Accelerate Hybrid Clouds with Sandboxes 2. Enhancing Security with Cyber Ranges 3. Cloud Sandboxes – Building blocks for DevOps Automation 4. Digitization – Key to Business Transformation
  • 33. Blogswww.quali.com Social Media @Quali @Qualisystems 33 Quali engages with its customers, partners and developers in many ways. Stay in Touch