StickyMinds.com and Better Software magazine presents…
How to Build a Testing Center of Excellence
Sponsored by QAProgrammer
This event aired on July 8, 2008.
Testing centers of Excellence
Building
© Confidential
TCOE
© Confidential
Agenda
Testing CoE
ď‚§ Voice of Customers
ď‚§ TCoE Models
ď‚§ Scope
ď‚§ Activities
ď‚§ Critical Success Factors
ď‚§ Key Considerations
TCoE Ecosystem
Q&A
Testing
Process CoE
• Definition | Development |
Maintenance of test processes,
standards & templates
• Facilitation of Test Management
Community
• Metrics Reporting &
Management
• Test Process Training
• Continuous Process
Improvement (CPI)
• Provision | Administration |
Support of Test Infrastructure
and Test Tools
• Provision of NFT Services &
Test Automation Services
• Technical Test Consultancy
• Provision of Functional, UAT
& liaison services
• Flexible resource pool creation
• Provision of specialized testing
services
Testing
Tools/
Infrastructure
CoE
NFT &
Automation CoE
Shared
Testing Team
Decentralized
centralized
• Process definitions & Roll-out
• Process facilitation & maintenance
• Process Compliance Audit
• Facilitation of Test management community
• Continuous process improvement
Services
• Assessment of existing process assets
• Define/Refine and standardize processes
• Institute metrics framework
• Usage guidelines and communication plan
• Establish centralized process framework
PreSetup
Activities
• Organizational strategy alignment
• Effective Communication & Training
• Effective Piloting and Evaluation
• Process compliance review mechanism
Critical Success Factors
• Representation of key stakeholders from various
groups
• Seed change agents to facilitate propagation
• Closed loop feedback mechanism
Key Considerations
Testing Process CoE
• Communicating, Piloting & Training
• Process audits
• Change management
• Industry benchmarking
PostSetup
• Tool evaluation
• Testing tools technical support
• Test tool license management & administration
• Tool process standardization
• Tool optimization
Services
• Tools inventory
• Tool evaluation
• Capacity planning & Platform optimization
• ROI Analysis
• Tool licensing & procurement policy
PreSetup
Activities
• Clear understanding of opportunities for operational
efficiencies
• Demand forecasting mechanism
• Tool/Infrastructure utilization & Optimization
• Service Level Agreements
Critical Success Factors
• Tool standardization for testing activities such as
requirement management, defect management etc.
• Leverage vendor organization’s tool partnership
• Tool set integration
• Alternative tool pricing model
Key Considerations
Infrastructure & Tools CoE
• Maintain tools inventory
• Tool administration, upgrades, license
management & tools training
• Monitoring & maintenance
• Incident management workflow
PostSetup
Confidential
• Review/Refine & publish scripting standards and
guidelines
• Resource sharing & allocation models
• ROI Analysis
• Team identification
PreSetup
Activities
• Uniform Automation/Performance Testing guidelines
& scripting standards
• Reusable Automation/Performance testing framework
& work load models
• Defined Non Functional/automation testing
requirements
Critical Success Factors
• Scope for Regression & Test Automation based on
scheduled releases
• Utilize Tools CoE for standards & guidelines
definition
• Utilize Process CoE for propagation of best practices
Key Considerations
NFT & Automation CoE
• Feasibility analysis & Proof of concepts
• Construct reusable frameworks
• Technical Training/Support
• Technical test consulting
PostSetup
Services
• Performance testing
• Security testing
• Usability testing
• Workload Modeling
NFT
• Test Automation
• Framework design and Implementation
Automation
Value-Adds
• Technical consultancy
• Feasibility analysis
Confidential
• Establish test management office
• Scope analysis & demand forecasting
• Engagement & Sourcing model
• Institute training program
• KPI definition
PreSetup
Activities
• Identification of core vs. non-core business functions.
• Strong Governance Model
• KPI identifications
• Management by Metrics
Critical Success Factors
• Tracking mechanism to measure achievements over
period of time against established goals
• Cross-functional training
• Effective collaboration of Business Analysts and QA
Key Considerations
Shared Testing Team
• Resource allocation
• Skill assessment and training
• Test program management
• Construct knowledge assets
PostSetup
Services
• Functional testing
• System testing/SIT
• Acceptance testing
Basic
Specialized
Support &
Consultancy
• Defect Management
• Test Life Cycle
modeling
• Test Strategy
conceptualization
• Compliance testing
• DW testing
• Agile testing
• SOA testing
• Product/Package testing
Confidential
Confidential
Piloting for Success
Shared Testing Tools
Defined basic processes Standardized tool management
Defined scope and schedule Tool licensing & procurement policy
System Testing
System Integration Testing
UAT support
3-6 months 4-8 weeks
High Medium
Data Generation & Sanitization Reporting utilities, portlets
Knowledge Repository
Dash-boards
Increased Test Coverage Traceability
Established Quality gates Effective defect management
Objective Go/No-Go decisions
Improved productivity & test effectiveness
Reduced defect leakage
Cycle time reduction
Quality Gains
New project OR AVM Project Existing projects
Pilot Accelerators
Project types
BenefitRealization
Test Management
Management by metrics
Short-term
Long Term
Pre-requisites
Scope
Pilot Length
Business Disruption
Piloting for Success
Automation Non-functional testing
Defined automation scripting standards
&guidelines
Defined NFT requirements
Tools Inventory Defined NFT scripting standards & guidelines
Tool Evaluation Feasibility analysis
Tool licensing & procurement policy
Feasibility Analysis
ROI Analysis Performance
Proof of Concepts Security (Application Vulnerability Assessment &
Reusable framework Usability
Proof of concepts
Minimum 4 releases per year 6-8 weeks
Low Medium
Automation framework Tool driven testing
Skilled resources Leveraging existing labs
Skilled resources
Consistency Identifying bottlenecks & vulnerabilities
Improved Coverage
Reusability Enhanced user experience
Reduced maintenance Customer retention
Cost Savings
Release-based New projects AND Web-based
Short-term
Long Term
Pre-requisites
Scope
Pilot Length
Business Disruption
Pilot Accelerators
Project types
BenefitRealization
Test
Planning &
Estimation
Test Design
&
Build
Test
Execution &
Management
Test
Reporting
Test
Metrics
Management
Test
Program
Management
Testing
Center of
Excellence
Infrastructure &
Tools COE
ď‚§ Tool Maintenance &
Support
ď‚§ Test Automation
ď‚§ Tool Implementation
ď‚§ Tool Provision
Process COE
ď‚§ Process Maintenance
ď‚§ Process Definition
ď‚§ Metrics Program
ď‚§ Test Process Training
ď‚§ Continuous Process
Improvement
ď‚§ Best Practice
implementation
>
>
T e s t i n g C e n t e r O f E x c e l l e n c e
Service Spectrum
System Testing
System
Integration
testing
Regression
Testing
Test
Automation
UAT
Core – Flexible
resourcing
Standard process
& Frameworks
Common Tools,
Infrastructure &
Automation
Solution
Accelerations/
Best practices
Governance
structure
>
TCoE Ecosystem
Good Luck
on your TCOE Journey
Have a question for the speaker?
Ask now.
Qaprogrammer.com , +9140-65 70 57 57 or +91- 93 92 91 89 89
support@qaprogrammer.com
Q & A

kalyanasundaram,sripriya_tcoepresentation

  • 1.
    StickyMinds.com and BetterSoftware magazine presents… How to Build a Testing Center of Excellence Sponsored by QAProgrammer This event aired on July 8, 2008.
  • 2.
    Testing centers ofExcellence Building © Confidential TCOE
  • 3.
    © Confidential Agenda Testing CoE Voice of Customers  TCoE Models  Scope  Activities  Critical Success Factors  Key Considerations TCoE Ecosystem Q&A
  • 4.
    Testing Process CoE • Definition| Development | Maintenance of test processes, standards & templates • Facilitation of Test Management Community • Metrics Reporting & Management • Test Process Training • Continuous Process Improvement (CPI) • Provision | Administration | Support of Test Infrastructure and Test Tools • Provision of NFT Services & Test Automation Services • Technical Test Consultancy • Provision of Functional, UAT & liaison services • Flexible resource pool creation • Provision of specialized testing services Testing Tools/ Infrastructure CoE NFT & Automation CoE Shared Testing Team Decentralized centralized
  • 5.
    • Process definitions& Roll-out • Process facilitation & maintenance • Process Compliance Audit • Facilitation of Test management community • Continuous process improvement Services • Assessment of existing process assets • Define/Refine and standardize processes • Institute metrics framework • Usage guidelines and communication plan • Establish centralized process framework PreSetup Activities • Organizational strategy alignment • Effective Communication & Training • Effective Piloting and Evaluation • Process compliance review mechanism Critical Success Factors • Representation of key stakeholders from various groups • Seed change agents to facilitate propagation • Closed loop feedback mechanism Key Considerations Testing Process CoE • Communicating, Piloting & Training • Process audits • Change management • Industry benchmarking PostSetup
  • 6.
    • Tool evaluation •Testing tools technical support • Test tool license management & administration • Tool process standardization • Tool optimization Services • Tools inventory • Tool evaluation • Capacity planning & Platform optimization • ROI Analysis • Tool licensing & procurement policy PreSetup Activities • Clear understanding of opportunities for operational efficiencies • Demand forecasting mechanism • Tool/Infrastructure utilization & Optimization • Service Level Agreements Critical Success Factors • Tool standardization for testing activities such as requirement management, defect management etc. • Leverage vendor organization’s tool partnership • Tool set integration • Alternative tool pricing model Key Considerations Infrastructure & Tools CoE • Maintain tools inventory • Tool administration, upgrades, license management & tools training • Monitoring & maintenance • Incident management workflow PostSetup Confidential
  • 7.
    • Review/Refine &publish scripting standards and guidelines • Resource sharing & allocation models • ROI Analysis • Team identification PreSetup Activities • Uniform Automation/Performance Testing guidelines & scripting standards • Reusable Automation/Performance testing framework & work load models • Defined Non Functional/automation testing requirements Critical Success Factors • Scope for Regression & Test Automation based on scheduled releases • Utilize Tools CoE for standards & guidelines definition • Utilize Process CoE for propagation of best practices Key Considerations NFT & Automation CoE • Feasibility analysis & Proof of concepts • Construct reusable frameworks • Technical Training/Support • Technical test consulting PostSetup Services • Performance testing • Security testing • Usability testing • Workload Modeling NFT • Test Automation • Framework design and Implementation Automation Value-Adds • Technical consultancy • Feasibility analysis Confidential
  • 8.
    • Establish testmanagement office • Scope analysis & demand forecasting • Engagement & Sourcing model • Institute training program • KPI definition PreSetup Activities • Identification of core vs. non-core business functions. • Strong Governance Model • KPI identifications • Management by Metrics Critical Success Factors • Tracking mechanism to measure achievements over period of time against established goals • Cross-functional training • Effective collaboration of Business Analysts and QA Key Considerations Shared Testing Team • Resource allocation • Skill assessment and training • Test program management • Construct knowledge assets PostSetup Services • Functional testing • System testing/SIT • Acceptance testing Basic Specialized Support & Consultancy • Defect Management • Test Life Cycle modeling • Test Strategy conceptualization • Compliance testing • DW testing • Agile testing • SOA testing • Product/Package testing Confidential
  • 9.
    Confidential Piloting for Success SharedTesting Tools Defined basic processes Standardized tool management Defined scope and schedule Tool licensing & procurement policy System Testing System Integration Testing UAT support 3-6 months 4-8 weeks High Medium Data Generation & Sanitization Reporting utilities, portlets Knowledge Repository Dash-boards Increased Test Coverage Traceability Established Quality gates Effective defect management Objective Go/No-Go decisions Improved productivity & test effectiveness Reduced defect leakage Cycle time reduction Quality Gains New project OR AVM Project Existing projects Pilot Accelerators Project types BenefitRealization Test Management Management by metrics Short-term Long Term Pre-requisites Scope Pilot Length Business Disruption
  • 10.
    Piloting for Success AutomationNon-functional testing Defined automation scripting standards &guidelines Defined NFT requirements Tools Inventory Defined NFT scripting standards & guidelines Tool Evaluation Feasibility analysis Tool licensing & procurement policy Feasibility Analysis ROI Analysis Performance Proof of Concepts Security (Application Vulnerability Assessment & Reusable framework Usability Proof of concepts Minimum 4 releases per year 6-8 weeks Low Medium Automation framework Tool driven testing Skilled resources Leveraging existing labs Skilled resources Consistency Identifying bottlenecks & vulnerabilities Improved Coverage Reusability Enhanced user experience Reduced maintenance Customer retention Cost Savings Release-based New projects AND Web-based Short-term Long Term Pre-requisites Scope Pilot Length Business Disruption Pilot Accelerators Project types BenefitRealization
  • 11.
    Test Planning & Estimation Test Design & Build Test Execution& Management Test Reporting Test Metrics Management Test Program Management Testing Center of Excellence Infrastructure & Tools COE  Tool Maintenance & Support  Test Automation  Tool Implementation  Tool Provision Process COE  Process Maintenance  Process Definition  Metrics Program  Test Process Training  Continuous Process Improvement  Best Practice implementation > > T e s t i n g C e n t e r O f E x c e l l e n c e Service Spectrum System Testing System Integration testing Regression Testing Test Automation UAT Core – Flexible resourcing Standard process & Frameworks Common Tools, Infrastructure & Automation Solution Accelerations/ Best practices Governance structure > TCoE Ecosystem
  • 12.
    Good Luck on yourTCOE Journey
  • 13.
    Have a questionfor the speaker? Ask now. Qaprogrammer.com , +9140-65 70 57 57 or +91- 93 92 91 89 89 [email protected] Q & A

Editor's Notes