SlideShare a Scribd company logo
Reducing risk with continuous 
delivery 
BY JOEL CHIPPINDALE - NOVEMBER 2014
A story about FutureLearn
How many of you work in continuous 
delivery environments?
How do you explain the benefits?
What is continuous delivery?
What is continuous deployment?
What is deployment?
All the work required to make a 
new feature available to users
Release based deployment
Process
Benefits 
• QA have time to check each release 
before it goes live 
• Marketing can announce releases 
• Defined process sounds reliable
But what happens when 
something goes wrong?
• Bugs found in QA can delay ALL features. 
• Features may miss the ‘release window’ 
• How are bugs fixed that are found AFTER QA? 
• Scheduled downtime?
Big releases are complicated 
releases
The more complicated the release the greater 
the chance that something will go wrong
Continuous deployment
Process
• Bugs found in QA can delay ALL features. 
• Features may miss the ‘release window’ 
• How are bugs fixed that are found AFTER QA? 
• Scheduled downtime?
Benefits 
• Features and bug fixes available as soon 
as they are ready 
• Most deployments can be made with 
zero downtime
Continuous deployment 
vs. 
Continuous delivery
Case study 1: Etsy
Reducing risk through continuous delivery (Nov 2014)
More than 1 billion dollars worth 
of sales made on Etsy in 2012 
Source: Contniuous deployment at Etsy
How often do Etsy deploy code?
25+ times per day
Who can deploy code at Etsy?
EVERYONE
Automated tests
Fast and easy deployments
Constant monitoring
Continual bug fixing
…and gradual role out of 
features
Case study 2: gov.uk
Reducing risk through continuous delivery (Nov 2014)
50 million visits a month 
Source: GDS blog
Several deployments a day, 
thousands since launch
Automated tests
Fast and easy deployments
Constant monitoring
…and smoke tests
Case study 3: FutureLearn
Reducing risk through continuous delivery (Nov 2014)
700,000 learners
Average of 3 deployments every 
working day
Automated tests
Fast and easy deployments
Constant monitoring
Continual QA and bug fixing
…beyond Etsy, gov.uk and 
FutureLearn
Amazon
Google
Facebook
Continuous delivery works well 
with
Automated tests
Fast and easy deployments
Constant monitoring
Continual bug fixing
These are good practices for 
EVERY project
Continuous delivery: 
Reduce risk by delivering small 
changes often and monitoring 
feedback
Questions? 
@joelchippindale 
joel.chippindale@futurelearn.com 
about.futurelearn.com/blog/

More Related Content

PPTX
Continuously delivering software to big brands (fullscreen edition)
Paul Boocock
 
PDF
Fail fast! approach
Danylenko Max
 
PDF
Shifting is more than shifting left
PractiTest
 
PPTX
Pride and Prejudice and Software Testing
Conor O'Donnell
 
PDF
Is it Safe? measuring product security goodness
Justin Berman
 
PDF
Run your project like it's an OpenSource project
Ian Bull
 
PPTX
Software Localization Testing (Valeska Van Vliet And Olga Melnikova)
Olga Melnikova
 
PDF
Get testing bottlenecks out of your pipelines
lisacrispin
 
Continuously delivering software to big brands (fullscreen edition)
Paul Boocock
 
Fail fast! approach
Danylenko Max
 
Shifting is more than shifting left
PractiTest
 
Pride and Prejudice and Software Testing
Conor O'Donnell
 
Is it Safe? measuring product security goodness
Justin Berman
 
Run your project like it's an OpenSource project
Ian Bull
 
Software Localization Testing (Valeska Van Vliet And Olga Melnikova)
Olga Melnikova
 
Get testing bottlenecks out of your pipelines
lisacrispin
 

What's hot (19)

PDF
Are We Secure? Answering the Unanswerable
Justin Berman
 
PDF
The Whole Team Approach to Quality in Continuous Delivery
lisacrispin
 
PDF
Continuous delivery 101
darkofabijan
 
PPTX
Make Your UI Tests Resilient with the Next Generation of Frameworks
Satyajit Malugu
 
PPTX
Moving From Staged To Pervasive Testing
Rob Lambert
 
PPTX
Why everything is an A/B Test at Pinterest
Krishna Gade
 
PDF
Delivering High-Velocity Docs that Keep Pace with Rapid Release Cycles
Rachel Whitton
 
PPTX
IDX Broker Research & Development by Derek Rose
IDX Broker
 
PDF
You were not hired to be a fireman keep fires from starting with primavera ppt
p6academy
 
PDF
Apply A/B Testing with NGINX Routing Policy
Supachai Jaturaprom
 
PPTX
Uktmf presentation nd
Rob Lambert
 
PDF
Do you even need to automate the GUI?
Matt Heusser
 
PPTX
DevSecCon Singapore 2018 - Pushing left like a boss by Tanya Janca
DevSecCon
 
PPTX
Microservices Summit - The Human Side of Services
Yelp Engineering
 
PDF
Test-Driven Development
Timo Stollenwerk
 
PDF
10 Deploys a Day - A Case Study of Continuous Delivery at Envato
John Viner
 
PPTX
Making disaster routine
Peter Varhol
 
PDF
DevOps - Be Careful What You Wish For
John Viner
 
PDF
Shawn Wallace - Test automation in brownfield applications
QA or the Highway
 
Are We Secure? Answering the Unanswerable
Justin Berman
 
The Whole Team Approach to Quality in Continuous Delivery
lisacrispin
 
Continuous delivery 101
darkofabijan
 
Make Your UI Tests Resilient with the Next Generation of Frameworks
Satyajit Malugu
 
Moving From Staged To Pervasive Testing
Rob Lambert
 
Why everything is an A/B Test at Pinterest
Krishna Gade
 
Delivering High-Velocity Docs that Keep Pace with Rapid Release Cycles
Rachel Whitton
 
IDX Broker Research & Development by Derek Rose
IDX Broker
 
You were not hired to be a fireman keep fires from starting with primavera ppt
p6academy
 
Apply A/B Testing with NGINX Routing Policy
Supachai Jaturaprom
 
Uktmf presentation nd
Rob Lambert
 
Do you even need to automate the GUI?
Matt Heusser
 
DevSecCon Singapore 2018 - Pushing left like a boss by Tanya Janca
DevSecCon
 
Microservices Summit - The Human Side of Services
Yelp Engineering
 
Test-Driven Development
Timo Stollenwerk
 
10 Deploys a Day - A Case Study of Continuous Delivery at Envato
John Viner
 
Making disaster routine
Peter Varhol
 
DevOps - Be Careful What You Wish For
John Viner
 
Shawn Wallace - Test automation in brownfield applications
QA or the Highway
 
Ad

Viewers also liked (16)

PDF
Telling stories through your commits (Jan 2015)
FutureLearn
 
PDF
Keynote presentation OOFHEC2016: Mark lester
EADTU
 
PPT
Rethinking education
Rebecca Ferguson
 
PPT
Teaching in MOOCs: Unbundling the roles of the educator
Rebecca Ferguson
 
PPTX
Simon Nelson: FutureLearn
Yishay Mor
 
PDF
A Social Learning Grid for MOOCs: Exploring a FutureLearn Case
davinia.hl
 
PDF
Future Learn
BettShow
 
PPTX
R ferguson lak15
Rebecca Ferguson
 
PDF
Reflections on teaching and information behaviour in a Futurelearn MOOC
Sheila Webber
 
PDF
MOOCS and The Future of Elearning, By Future Learn
Lets learn Digital
 
PPTX
The ethics of MOOC research: why we should involve learners
Rebecca Ferguson
 
PPTX
Moocs: what the research tells us
Rebecca Ferguson
 
PPTX
Learning analytics, learning design and MOOCs
Rebecca Ferguson
 
PDF
UCD15 Talk - Lucy Blackwell - How Experiences Sell Products
UCD UK Ltd
 
PPTX
Social learning at massive scale LWMOOCs 2015 slideshare
Mike Sharples
 
PPTX
Small Group Discussion for a MOOC Platform
Mike Sharples
 
Telling stories through your commits (Jan 2015)
FutureLearn
 
Keynote presentation OOFHEC2016: Mark lester
EADTU
 
Rethinking education
Rebecca Ferguson
 
Teaching in MOOCs: Unbundling the roles of the educator
Rebecca Ferguson
 
Simon Nelson: FutureLearn
Yishay Mor
 
A Social Learning Grid for MOOCs: Exploring a FutureLearn Case
davinia.hl
 
Future Learn
BettShow
 
R ferguson lak15
Rebecca Ferguson
 
Reflections on teaching and information behaviour in a Futurelearn MOOC
Sheila Webber
 
MOOCS and The Future of Elearning, By Future Learn
Lets learn Digital
 
The ethics of MOOC research: why we should involve learners
Rebecca Ferguson
 
Moocs: what the research tells us
Rebecca Ferguson
 
Learning analytics, learning design and MOOCs
Rebecca Ferguson
 
UCD15 Talk - Lucy Blackwell - How Experiences Sell Products
UCD UK Ltd
 
Social learning at massive scale LWMOOCs 2015 slideshare
Mike Sharples
 
Small Group Discussion for a MOOC Platform
Mike Sharples
 
Ad

Similar to Reducing risk through continuous delivery (Nov 2014) (20)

PPTX
DevOps - Understanding Core Concepts
Nitin Bhide
 
PPTX
6 Ways to Speed Up App Testing
Perfecto by Perforce
 
PPTX
Agile Gurgaon 2016 | Thinking Beyond :: Marry Agile and DevOps for Phenomenal...
AgileNetwork
 
PDF
Methodology: IT test
Jean-François Nguyen
 
PDF
Continuous delivery is more than dev ops
Agile Montréal
 
PPTX
DevOps - Understanding Core Concepts (Old)
Nitin Bhide
 
PDF
Continuous Delivery - the missing parts - Paul Stack
JAXLondon_Conference
 
PDF
Solving the 3 Biggest Questions in Continuous Testing
Perfecto by Perforce
 
PPTX
Bugtracking
Skills Matter
 
PDF
Achieving Continuous Delivery with Puppet
Devoteam Revolve
 
PDF
Puppet Camp Paris 2014: Achieving Continuous Delivery and DevOps with Puppet
Puppet
 
PDF
NYC MeetUp 10.9
Solano Labs
 
PPTX
How google crush Quality Assurance
MadurangaDeSilva1
 
PDF
The Continuous delivery Value @ codemotion 2014
David Funaro
 
PDF
The Continuous delivery value - Funaro
Codemotion
 
PDF
Boston MeetUp 10.10
Solano Labs
 
PDF
Continuous Delivery Distilled
Matt Callanan
 
PPTX
Pushing the Bottleneck: Predicting and Addressing the Next, Next Thing
IBM UrbanCode Products
 
PDF
The Rationale for Continuous Delivery (The culture and practice of good softw...
C4Media
 
PPTX
The Evolution of Test Automation for DevOps
TEST Huddle
 
DevOps - Understanding Core Concepts
Nitin Bhide
 
6 Ways to Speed Up App Testing
Perfecto by Perforce
 
Agile Gurgaon 2016 | Thinking Beyond :: Marry Agile and DevOps for Phenomenal...
AgileNetwork
 
Methodology: IT test
Jean-François Nguyen
 
Continuous delivery is more than dev ops
Agile Montréal
 
DevOps - Understanding Core Concepts (Old)
Nitin Bhide
 
Continuous Delivery - the missing parts - Paul Stack
JAXLondon_Conference
 
Solving the 3 Biggest Questions in Continuous Testing
Perfecto by Perforce
 
Bugtracking
Skills Matter
 
Achieving Continuous Delivery with Puppet
Devoteam Revolve
 
Puppet Camp Paris 2014: Achieving Continuous Delivery and DevOps with Puppet
Puppet
 
NYC MeetUp 10.9
Solano Labs
 
How google crush Quality Assurance
MadurangaDeSilva1
 
The Continuous delivery Value @ codemotion 2014
David Funaro
 
The Continuous delivery value - Funaro
Codemotion
 
Boston MeetUp 10.10
Solano Labs
 
Continuous Delivery Distilled
Matt Callanan
 
Pushing the Bottleneck: Predicting and Addressing the Next, Next Thing
IBM UrbanCode Products
 
The Rationale for Continuous Delivery (The culture and practice of good softw...
C4Media
 
The Evolution of Test Automation for DevOps
TEST Huddle
 

Recently uploaded (20)

PDF
The Evolution of KM Roles (Presented at Knowledge Summit Dublin 2025)
Enterprise Knowledge
 
PDF
Make GenAI investments go further with the Dell AI Factory
Principled Technologies
 
PDF
A Day in the Life of Location Data - Turning Where into How.pdf
Precisely
 
PDF
Accelerating Oracle Database 23ai Troubleshooting with Oracle AHF Fleet Insig...
Sandesh Rao
 
PDF
Get More from Fiori Automation - What’s New, What Works, and What’s Next.pdf
Precisely
 
PPTX
The-Ethical-Hackers-Imperative-Safeguarding-the-Digital-Frontier.pptx
sujalchauhan1305
 
PDF
The Future of Mobile Is Context-Aware—Are You Ready?
iProgrammer Solutions Private Limited
 
PDF
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
PPTX
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
PDF
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
 
PDF
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
 
PPTX
IT Runs Better with ThousandEyes AI-driven Assurance
ThousandEyes
 
PPTX
cloud computing vai.pptx for the project
vaibhavdobariyal79
 
PDF
Brief History of Internet - Early Days of Internet
sutharharshit158
 
PDF
Doc9.....................................
SofiaCollazos
 
PPTX
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
PDF
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 
PDF
CIFDAQ's Market Wrap : Bears Back in Control?
CIFDAQ
 
PDF
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
The Evolution of KM Roles (Presented at Knowledge Summit Dublin 2025)
Enterprise Knowledge
 
Make GenAI investments go further with the Dell AI Factory
Principled Technologies
 
A Day in the Life of Location Data - Turning Where into How.pdf
Precisely
 
Accelerating Oracle Database 23ai Troubleshooting with Oracle AHF Fleet Insig...
Sandesh Rao
 
Get More from Fiori Automation - What’s New, What Works, and What’s Next.pdf
Precisely
 
The-Ethical-Hackers-Imperative-Safeguarding-the-Digital-Frontier.pptx
sujalchauhan1305
 
The Future of Mobile Is Context-Aware—Are You Ready?
iProgrammer Solutions Private Limited
 
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
 
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
 
IT Runs Better with ThousandEyes AI-driven Assurance
ThousandEyes
 
cloud computing vai.pptx for the project
vaibhavdobariyal79
 
Brief History of Internet - Early Days of Internet
sutharharshit158
 
Doc9.....................................
SofiaCollazos
 
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 
CIFDAQ's Market Wrap : Bears Back in Control?
CIFDAQ
 
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 

Reducing risk through continuous delivery (Nov 2014)