SlideShare a Scribd company logo
IMPROVING QUALITY BY PARTNERING WITH YOUR
CUSTOMERS:
A “HOW TO” STORY
Armand Spoto
Director, Professional Services
 May 23, 2016
AgendaBackground
Overview
Agile Development vs Delivery
Case Study (Phase 1)
Interactive Exercise
Case Study (Phase 2)
Summary
Background
20 years of experience in professional services industry
Provided strategy, project management, and
implementation of large scale programs for a number of
Fortune 500 companies
10 years providing Training and Development solutions to
the Life Science Industry
Full time Project Management and PMO responsibility for
past 7 years
Scrum master since 2014
M.S. in Industrial/Organizational Psychology in 1997 from
Radford University.
Who Are We?
~400 employees across three Continents
~175 P.S. employees
Project Management
Business Analysis, Insurance Domain
.Net Development
QA/Testing
80+ Carrier, Financial Inst. and Distribution
Implementations
Average 20 Deployments Weekly
Key Partners
SDLC
Implementation Phase Initiation Phase
Phase 3
Agile Development / Agile Delivery
Customer Success – Rollout Plan/Producer On Boarding/Training
Rollout Plan / Producer on Boarding/ Training
SSO –SAML
E-Submission
Other Integrations
Development
Initiation Phase
Workflow
Screen Flow
Forms matrix
Business Rules
Product Specs
Screen Mockups
Draft
Specification.
SSO, Submission,
e-Signature
Test Strategy
Phase 1

CustomerCustomer
            
LiveLive
iPipelineActivityiPipelineActivity
Common Screens
Parties, Payments
Term Life
E-app Screens
E-Signature
Phase 2
Integrations
E-Submission
IntegrationTest
Initiation Phase
Workflow
Screen Flow
Forms matrix
Business Rules
Screen Mockups
Draft
Specification.
SSO, Submission,
e-Signature
Test Strategy
IntegrationTest
LiveLive
IntegrationTest
LiveLive
Sprint Functional Testing
iPipeline Agile Implementation
Requirements clearly understood and documented
Business & Product Rules Defined in Initiation
Collaborative Planning
Release & Sprint Planning, aligning on integration
Continuous Involvement
Testing (End Users, Business and Project Team)
Project
Scoping
High
Level
Req.
Prioritization
Final
Assembly
Final
UAT
Delivery
Support
Agile
Sprint Sprint Sprint Sprint
Customer
Review
Customer
Review
Customer
Review
A
D C
T
A
D C
T
A
D C
T
A
D C
T
Customer
Review
Phase 1
THE PROJECT THAT WOULDN’T END
The Situation
Phase 1
•Build 4 Insurance Illustrations Products
• Two Term
• Two Guarantee Universal Life
•Develop and Test
• User Interface Screens
• Calculate Engine
• Crystal Reports (Output)
•Planned Start: February 2014
•Planned Finish: October 2014
•Budget: $475,000
Phase 1: Client Defects per Month
Phase 1: # of Requirement Changes
What is Your RCA?
Break up into small groups
•Spend ~10 minutes brainstorming what do you think went
wrong and why?
•What are impacts on:
• Team?
• Client?
• Budget?
•Ask any clarification question
The Lightbulb Moment
Phase 1
Results
•Averaged ~15 defects per sprint
•Mountain of missing/ambiguous requirements
•Actual Finish: March 2015 (six months over due)
•Actual Costs: $968,000
•Client very unhappy
•Team felt demoralized and frustrated
Phase 1: Project Debrief
“Lack of Transparency” was a direct cause to many of
the project’s issues
Incomplete regression test beds
No test cases/checkers
No visibility into requirements
Too much leverage of JIRA to document requirement
update and discrepancies
Phase 1: Project DebriefAdjusted Three Key Processes
Phase 2
The Redemption
The Situation
Phase 2
•Build 12 Insurance Illustrations Products
• Eight Indexed Universal Life
• Four Universal Life
• Client wanted to complete all Crystal Reports (Output) Work
•Created two full-teams
• 1 FTE Business Analyst
• 1 FTE User Interface Developer
• 2.5 FTE Calc Engine Developers
• 2 FTE Quality Assurance
•Planned Start: March 2015
•Planned Finish: April 2016
•Budget: $1,025,000
Requirements Gathering
Client’s “Business” has to sign-off on their requirements
Used to create developer Requirements, which is signed
off between both parties
Focus on the completion of a specific Feature/Function
of a specific product
BRD Document Walkthrough
 Functional Overview
 Requirements
 User Stories
 User Story Details
 UI Definitions (Windows, Menus,
Toolbars)
 Calculation Engine Checkers
 Report Design
 Configuration Settings
 iGO Integration Impacts
 Base/R&D Integration Impacts
 Content Impacts
Client Input Required
• Detailed Technical Design
• Code Review
• Unit Test Review
• Test Plans and Requirements Traceability
• Issues List
Testing Strategy
 Development begins on that signed-off set of features
 Develop to Checkers
 Execute testing based on firm test cases and checkers provided by client
 Regression is run twice per sprint
 Features are released to UAT based on QA results
Communication
Client attends all Agile Ceremonies
•Scrums
•Scope Overviews
•Sprint Planning
•Bi-weekly QA Meeting
•See all backlog items/burndowns in VersionOne
Additional touch-points
•Quarterly on-site visits
•Bi-weekly Executive touch-point
•Distribute 3 sprint Release plan every sprint
Phase 2: Client Defects per Month
Phase 2: # of Requirement Changes
Results
Strengthening the partnership
New work projects through 2017
More strategic discussions w/ Executives
Virtually eliminated all escalation issues
 Exposed ownership of issues to be unblocked
Broadened conversation to address issues
Remove blockers
Improve velocity
Summary
Exposing your dirty laundry elevates everyone’s game
Open to trying new processes, and modifying when
necessary
Your metrics aren’t my metrics
Someone has to be out of the weeds, or you’ll always be
lost
Client culture is key to understand how to modify your
processes

More Related Content

PPT
Sqa V And V Share
guest0b67e9
 
PPT
SQA V And V Intro & History
Douglas Gabel
 
PDF
Marval Release Management - the political process
Marval Software
 
PDF
10 Steps to Shift Left - Guiding Principles in QA
Jim Spillson
 
PPTX
2. project initiation
Mad Jutt
 
PDF
IT Software - Release cycle & Delivery roadmap
Jean-François Nguyen
 
PDF
Quality Assurance and mobile applications!
Bagaria Swati
 
PDF
Agile Release Management for Fast Moving Enterprises
Dreamforce
 
Sqa V And V Share
guest0b67e9
 
SQA V And V Intro & History
Douglas Gabel
 
Marval Release Management - the political process
Marval Software
 
10 Steps to Shift Left - Guiding Principles in QA
Jim Spillson
 
2. project initiation
Mad Jutt
 
IT Software - Release cycle & Delivery roadmap
Jean-François Nguyen
 
Quality Assurance and mobile applications!
Bagaria Swati
 
Agile Release Management for Fast Moving Enterprises
Dreamforce
 

What's hot (20)

PPTX
Introduction to Software Quality & its' Challenges
International Turneky Systems
 
PPTX
Release Management: Successful Software Releases Start with a Plan
connielharper
 
PDF
6 sigma LTE release management process improvement
Jeffrey Gardner CMgr FCMI IEng MIET
 
PDF
Case study on functional testing
360logica Software Testing Services (A Saksoft Company)
 
PPTX
Salesforce1 ELEVATE Workshop - Dublin
Joshua Hoskins
 
PDF
Shift left - find defects earlier through automated test and deployment
Claudia Ring
 
PDF
Quality Control in Development
Salesforce Developers
 
PDF
Shift Left Mobile Application Testing
Josiah Renaudin
 
PDF
Best practices in release management
Abhinav Sabharwal- Business Analyst Mumbai
 
PPT
Software Quality Challenge
Helmy Satria
 
PDF
Taking Release Management to the Next Level
XebiaLabs
 
PPSX
Blackbaud project kick off summary
Theodore Van Patten, Jr.
 
PPTX
Release Management: Managing Your Internal Releases
Joshua Hoskins
 
PDF
TDX19 - Untangle Your Org with Salesforce Developer Tools
Doug Ayers
 
PPTX
Importance of software quality assurance
Maveric Systems
 
PPTX
Dev11
Daniel Oliveira
 
PPT
Digite - Release Management Training
Digite, Inc.
 
DOCX
Jamie Resume Revised
Jamie (Missi) Burke
 
PPTX
Presentation -Quality Metrics For Agile Development
Nabilahmed Patel
 
Introduction to Software Quality & its' Challenges
International Turneky Systems
 
Release Management: Successful Software Releases Start with a Plan
connielharper
 
6 sigma LTE release management process improvement
Jeffrey Gardner CMgr FCMI IEng MIET
 
Salesforce1 ELEVATE Workshop - Dublin
Joshua Hoskins
 
Shift left - find defects earlier through automated test and deployment
Claudia Ring
 
Quality Control in Development
Salesforce Developers
 
Shift Left Mobile Application Testing
Josiah Renaudin
 
Best practices in release management
Abhinav Sabharwal- Business Analyst Mumbai
 
Software Quality Challenge
Helmy Satria
 
Taking Release Management to the Next Level
XebiaLabs
 
Blackbaud project kick off summary
Theodore Van Patten, Jr.
 
Release Management: Managing Your Internal Releases
Joshua Hoskins
 
TDX19 - Untangle Your Org with Salesforce Developer Tools
Doug Ayers
 
Importance of software quality assurance
Maveric Systems
 
Digite - Release Management Training
Digite, Inc.
 
Jamie Resume Revised
Jamie (Missi) Burke
 
Presentation -Quality Metrics For Agile Development
Nabilahmed Patel
 
Ad

Viewers also liked (14)

PDF
CONGDS (presentación)
Alejandra Martínez Mayans
 
PPTX
Http Karem Yanelli
Giovani Rodriguez
 
PPT
Nelson Mandela Adri G
Pedro Lobato
 
PDF
Tipo de promociones
Alejandra Martínez Mayans
 
DOCX
Ciencia tecnologia y_sociedad_yesid_y_araque
Yezid Monroy Zambrano
 
PPTX
República bolivariana de venezuela
elplomo
 
DOCX
Ebs plantilla creación proyecto_etwinning
María Elena Bote Serano
 
PPTX
Como educar al hijo adolescente
CATHERINE AYBAR QUESADA
 
PPTX
South korea
Sinan Majeed
 
PDF
Jazz & Rib Fest 2017 Sponsorship Opportunities
SciotoMile
 
DOCX
Proyecto de Inventario de Archivo
susanahoria
 
PDF
Pda física 1 nacional
BLAS GUERRERO
 
PPTX
Фармаконадзор в локальных клинических исследованиях
idkpharma
 
PPTX
Reforms Needed to Canada's Business Immigration System
danxherman
 
CONGDS (presentación)
Alejandra Martínez Mayans
 
Http Karem Yanelli
Giovani Rodriguez
 
Nelson Mandela Adri G
Pedro Lobato
 
Tipo de promociones
Alejandra Martínez Mayans
 
Ciencia tecnologia y_sociedad_yesid_y_araque
Yezid Monroy Zambrano
 
República bolivariana de venezuela
elplomo
 
Ebs plantilla creación proyecto_etwinning
María Elena Bote Serano
 
Como educar al hijo adolescente
CATHERINE AYBAR QUESADA
 
South korea
Sinan Majeed
 
Jazz & Rib Fest 2017 Sponsorship Opportunities
SciotoMile
 
Proyecto de Inventario de Archivo
susanahoria
 
Pda física 1 nacional
BLAS GUERRERO
 
Фармаконадзор в локальных клинических исследованиях
idkpharma
 
Reforms Needed to Canada's Business Immigration System
danxherman
 
Ad

Similar to HeartofAgile_Presentation_v3 (20)

PPTX
Eliminate Bottlenecks in Software Development & Delivery
Micro Focus
 
DOC
Abhishek_Banerjee_Functional _Testing
Abhishek Banerjee
 
DOC
Abhishek_Banerjee_Functional _Testing
Abhishek Banerjee
 
PPT
Integrating agile into sdlc presentation pmi v2
pmimkecomm
 
PPT
Sample Product Management Lifecycle Presentation
Julie Grosse
 
DOC
Divya Chopde_ Test Analyst_1
Divya Chopde
 
DOC
Sumi jain_Resume
sumi jain
 
PDF
Gtm development framework aug 2017
Daniel Thuraiappah
 
PPTX
PM TEMPLATE_ PRODUCT ddgge33ROADMAP.pptx
Kishlai1
 
PDF
Driving Ambiguities Out of Requirements through Stronger Elicitation Techniques
Susan Schanta
 
DOC
Profile Sumana_Sen
Sumana Sengupta
 
PPTX
You_Exec_-_Ultimate_Project_Management_Toolbox_Free.pptx
FlixEduardoIbarraDeL
 
PPTX
Methodology Overviewwwwwwwwwwwwwwww.pptx
znqvmd57f7
 
RTF
Deepti Debnath_Citi Corp-2015
deepti Debnath
 
PPT
Risk Driven Testing
Jorge Boria
 
DOC
puneet_pall_resume
puneet pall
 
DOC
Srinithya_Software Testing resume
Srinithya Kumar
 
DOCX
Rachana Resume To be sent
Rachana PMP,SSGB, SSBB,ITIL
 
DOC
Rakesh Resume
Rakesh Singh Thakur
 
PPT
Agile adoption julen c. mohanty
Julen Mohanty
 
Eliminate Bottlenecks in Software Development & Delivery
Micro Focus
 
Abhishek_Banerjee_Functional _Testing
Abhishek Banerjee
 
Abhishek_Banerjee_Functional _Testing
Abhishek Banerjee
 
Integrating agile into sdlc presentation pmi v2
pmimkecomm
 
Sample Product Management Lifecycle Presentation
Julie Grosse
 
Divya Chopde_ Test Analyst_1
Divya Chopde
 
Sumi jain_Resume
sumi jain
 
Gtm development framework aug 2017
Daniel Thuraiappah
 
PM TEMPLATE_ PRODUCT ddgge33ROADMAP.pptx
Kishlai1
 
Driving Ambiguities Out of Requirements through Stronger Elicitation Techniques
Susan Schanta
 
Profile Sumana_Sen
Sumana Sengupta
 
You_Exec_-_Ultimate_Project_Management_Toolbox_Free.pptx
FlixEduardoIbarraDeL
 
Methodology Overviewwwwwwwwwwwwwwww.pptx
znqvmd57f7
 
Deepti Debnath_Citi Corp-2015
deepti Debnath
 
Risk Driven Testing
Jorge Boria
 
puneet_pall_resume
puneet pall
 
Srinithya_Software Testing resume
Srinithya Kumar
 
Rachana Resume To be sent
Rachana PMP,SSGB, SSBB,ITIL
 
Rakesh Resume
Rakesh Singh Thakur
 
Agile adoption julen c. mohanty
Julen Mohanty
 

HeartofAgile_Presentation_v3

  • 1. IMPROVING QUALITY BY PARTNERING WITH YOUR CUSTOMERS: A “HOW TO” STORY Armand Spoto Director, Professional Services  May 23, 2016
  • 2. AgendaBackground Overview Agile Development vs Delivery Case Study (Phase 1) Interactive Exercise Case Study (Phase 2) Summary
  • 3. Background 20 years of experience in professional services industry Provided strategy, project management, and implementation of large scale programs for a number of Fortune 500 companies 10 years providing Training and Development solutions to the Life Science Industry Full time Project Management and PMO responsibility for past 7 years Scrum master since 2014 M.S. in Industrial/Organizational Psychology in 1997 from Radford University.
  • 4. Who Are We? ~400 employees across three Continents ~175 P.S. employees Project Management Business Analysis, Insurance Domain .Net Development QA/Testing 80+ Carrier, Financial Inst. and Distribution Implementations Average 20 Deployments Weekly Key Partners
  • 6. Phase 3 Agile Development / Agile Delivery Customer Success – Rollout Plan/Producer On Boarding/Training Rollout Plan / Producer on Boarding/ Training SSO –SAML E-Submission Other Integrations Development Initiation Phase Workflow Screen Flow Forms matrix Business Rules Product Specs Screen Mockups Draft Specification. SSO, Submission, e-Signature Test Strategy Phase 1  CustomerCustomer              LiveLive iPipelineActivityiPipelineActivity Common Screens Parties, Payments Term Life E-app Screens E-Signature Phase 2 Integrations E-Submission IntegrationTest Initiation Phase Workflow Screen Flow Forms matrix Business Rules Screen Mockups Draft Specification. SSO, Submission, e-Signature Test Strategy IntegrationTest LiveLive IntegrationTest LiveLive Sprint Functional Testing
  • 7. iPipeline Agile Implementation Requirements clearly understood and documented Business & Product Rules Defined in Initiation Collaborative Planning Release & Sprint Planning, aligning on integration Continuous Involvement Testing (End Users, Business and Project Team) Project Scoping High Level Req. Prioritization Final Assembly Final UAT Delivery Support Agile Sprint Sprint Sprint Sprint Customer Review Customer Review Customer Review A D C T A D C T A D C T A D C T Customer Review
  • 8. Phase 1 THE PROJECT THAT WOULDN’T END
  • 9. The Situation Phase 1 •Build 4 Insurance Illustrations Products • Two Term • Two Guarantee Universal Life •Develop and Test • User Interface Screens • Calculate Engine • Crystal Reports (Output) •Planned Start: February 2014 •Planned Finish: October 2014 •Budget: $475,000
  • 10. Phase 1: Client Defects per Month
  • 11. Phase 1: # of Requirement Changes
  • 12. What is Your RCA? Break up into small groups •Spend ~10 minutes brainstorming what do you think went wrong and why? •What are impacts on: • Team? • Client? • Budget? •Ask any clarification question
  • 14. Phase 1 Results •Averaged ~15 defects per sprint •Mountain of missing/ambiguous requirements •Actual Finish: March 2015 (six months over due) •Actual Costs: $968,000 •Client very unhappy •Team felt demoralized and frustrated
  • 15. Phase 1: Project Debrief “Lack of Transparency” was a direct cause to many of the project’s issues Incomplete regression test beds No test cases/checkers No visibility into requirements Too much leverage of JIRA to document requirement update and discrepancies
  • 16. Phase 1: Project DebriefAdjusted Three Key Processes
  • 18. The Situation Phase 2 •Build 12 Insurance Illustrations Products • Eight Indexed Universal Life • Four Universal Life • Client wanted to complete all Crystal Reports (Output) Work •Created two full-teams • 1 FTE Business Analyst • 1 FTE User Interface Developer • 2.5 FTE Calc Engine Developers • 2 FTE Quality Assurance •Planned Start: March 2015 •Planned Finish: April 2016 •Budget: $1,025,000
  • 19. Requirements Gathering Client’s “Business” has to sign-off on their requirements Used to create developer Requirements, which is signed off between both parties Focus on the completion of a specific Feature/Function of a specific product
  • 20. BRD Document Walkthrough  Functional Overview  Requirements  User Stories  User Story Details  UI Definitions (Windows, Menus, Toolbars)  Calculation Engine Checkers  Report Design  Configuration Settings  iGO Integration Impacts  Base/R&D Integration Impacts  Content Impacts Client Input Required • Detailed Technical Design • Code Review • Unit Test Review • Test Plans and Requirements Traceability • Issues List
  • 21. Testing Strategy  Development begins on that signed-off set of features  Develop to Checkers  Execute testing based on firm test cases and checkers provided by client  Regression is run twice per sprint  Features are released to UAT based on QA results
  • 22. Communication Client attends all Agile Ceremonies •Scrums •Scope Overviews •Sprint Planning •Bi-weekly QA Meeting •See all backlog items/burndowns in VersionOne Additional touch-points •Quarterly on-site visits •Bi-weekly Executive touch-point •Distribute 3 sprint Release plan every sprint
  • 23. Phase 2: Client Defects per Month
  • 24. Phase 2: # of Requirement Changes
  • 25. Results Strengthening the partnership New work projects through 2017 More strategic discussions w/ Executives Virtually eliminated all escalation issues  Exposed ownership of issues to be unblocked Broadened conversation to address issues Remove blockers Improve velocity
  • 26. Summary Exposing your dirty laundry elevates everyone’s game Open to trying new processes, and modifying when necessary Your metrics aren’t my metrics Someone has to be out of the weeds, or you’ll always be lost Client culture is key to understand how to modify your processes