Curiosity Software, Infuse and Kumoco present: The Democratisation of Testing
Download as PPTX, PDF0 likes91 views
The document summarizes a webinar about how Infuse and Kumoco collaborated to build a quality engineering framework. They used business process modeling to generate test designs that increased test coverage by 50% and speed by 80%. This allowed generating 30-50 automated tests per day, a 15x increase in productivity. The approach democratized testing by enabling business users to utilize the automation. A demo showed generating tests from process models and integrating them into test management and automation tools. Benefits included increased coverage, speed, and productivity as well as democratized testing.
Curiosity Software, Infuse and Kumoco present: The Democratisation of Testing
- 1. The Democratisation of Testing
- 2. What you will get out of this Webinar Learn how Infuse and Kumoco teamed up to build a Quality Engineering framework where BAās, Tester and Developers collaborate to build SIT and E2E testing through Business Process Models The benefits were ā¢ Test Coverage increased by 50% through automated analysis of BPMN and generation of test designs into Jira/X-Ray using an inbuilt algorithm ā¢ Speed increased by 80%: The analysis work of 5-testers for 4-weeks was reduced to 2-testers for 1-week 15x increase in test automation productivity by generating 30-50 automated tests per day vs a typical 2-4 automated tests per day ā¢ The democratisation of testing by getting business users to use the automation During this webinar, we will demonstrate the processes and tools in action as well as articulate the benefits of this approach, and how you can apply this to your programmes
- 3. Presenters - Nalin - Infuse Nalin founded Infuse in Feb 2002 - Infuse celebrated itās 19th birthday 5-days ago ! Infuseās mission and vision is to help customers get the most of out their software. Infuse is focused on modernising software delivery. Nalin has worked on hundreds of projects across the globe and has over 21+ years of experience in software engineering delivery. Nalin has a BSc in Statistics, Computers, Operational Research and Mathematics and did his postgraduate studies in Advanced Information Technology. When not evangelising modern software delivery. Nalin is married with 2 children living in Central London. He is also a Rugby coach for Blackheath Rugby Club U11ās.
- 4. Presenters - Terry Terry has more than 30 years in IT and from developer origins has spent most of his career as a leader and manager of delivery teams. He has worked in the UK, USA, Oman, UAE, Scandinavia and much of Europe in a wide range of industries including Military, Healthcare, Telecoms, Retail, Insurance, Banking, and Event Management. COO and Co-Founder of Kumoco an international Service Integrator and Transformation partner.
- 5. Presenters - James ā¢ In 2017, Curiosity Software launched with technologies and expertise built on decades of experience. ā¢ Weāve built test data solutions since 1995, when our MD founded the first of 5 pioneering vendors. ā¢ We specialise in requirements modelling, test data automation, and model-based testing, and are launching the first Open Testing Platform.
- 6. Customer Business Background ā¢ $300m Start up 5g telco business built from the ground up ā¢ Constantly evolving business requirements and business process modeling ā¢ Complex system architecture ā¢ 10 major vendors to integrate ā¢ Demand from investors and shareholders to launch on time
- 7. Technical Stack and Architecture ā¢ Cloud first modern architecture, with all sensitive data held on an on-prem Openstack private cloud. ā¢ Multiple saas products are in use with a bespoke mobile application. Digital Platform / Security Gateway / Active Directory ERP Customer Data Hub BSS Payment Portal Data Warehouse Fraud Management / Revenue Assurance Data Analytics / Campaign API Gateway Comms Gateway Network Domain / Provisioning Gateway Comms Gateway DMaaP Mediation Interconnect Billing OCS Paymen t Gatewa y LEGEND Zentity Mobileum Ericsson 3rd Party IconX Openet Kumoco Netcracker Digital Platform / Security Gateway / Active Directory ERP Customer Data Hub BSS Payment Portal Data Warehouse Fraud Management / Revenue Assurance Data Analytics / Campaign API Gateway Comms Gateway Network Domain / Provisioning Gateway Comms Gateway DMaaP Mediation Interconnect Billing OCS Payment Gateway LEGEND Kumoco Contact Center Police
- 8. The Challenge ā¢ How do we ā¢ Keeping up-to-date with End-to-End Testing with changing requirements ā¢ Test Quickly and and maximise the opportunities in Test Automation ā¢ How do I enable shift left ? ā¢ Complex integration architecture ā¢ 163 items in the Master integration list (and counting) Digital Platform / Security Gateway / Active Directory ERP Customer Data Hub BSS Payment Portal Data Warehouse Fraud Management / Revenue Assurance Data Analytics / Campaign API Gateway Comms Gateway Network Domain / Provisioning Gateway Comms Gateway DMaaP Mediation Interconnect Billing OCS Paymen t Gatewa y LEGEND Zentity Mobileum Ericsson 3rd Party IconX Openet Kumoco Netcracker Digital Platform / Security Gateway / Active Directory ERP Customer Data Hub BSS Payment Portal Data Warehouse Fraud Management / Revenue Assurance Data Analytics / Campaign API Gateway Comms Gateway Network Domain / Provisioning Gateway Comms Gateway DMaaP Mediation Interconnect Billing OCS Payment Gateway LEGEND Kumoco Contact Center Police
- 9. The Approach
- 10. Modern Software Delivery Architecture
- 11. Tools ā¢ Signavio - Business Process Modelling tool ā¢ Modeller - Model based test design tool ā¢ X-Ray Jira - Test Management System ā¢ Confluence - Portal for sharing reports and dashboards ā¢ useMango - Test Automation Tool & Framework ā¢ Jenkins - Scheduling system for Test Automation
- 12. Managing End-to-End Testing with changing requirements ā¢ Trust the business has got it right ā¢ Leverage the BPML as an engineering artefact ā¢ Generate the Test Designs in X-Ray and useMango using a risk based algorithm
- 13. Test Quickly Outputs: Manual Test āAreas in red are auto generated from the Signavio business process data āIf the business process changes the test case can be regenerated āConsistent information across all artefacts āSignificantly reduce test maintenance time Signavio process generates test design
- 14. Maximise the opportunities in Test Automation ā Everyone can automate, not just high-skill, high cost automation engineers ā Significant time-savings compared to manually scripting tests ā generate test scripts in one click! ā Maintain test scripts in minutes ā Automation saves more time and cost than it requires
- 15. How do I enable shift left ? ā¢ True shift left starts with architecture business process model design ā¢ Critically modelling requirements identifies bugs during the design phase. āShift leftā reduces remediation costs while avoiding the time wasted on miscommunication.
- 16. The Democratisation of Testing
- 17. Democratisation: Business Users Reuse the automation
- 18. Democratisation: Business Users Reuse the automation Move from building 1-2 automated tests per day to 30-50 automated tests per day
- 19. Risk based Testing ā Suggested categories ā Impact of failure; financial, reputational; operational, regulatory ā Probability of failure (based on SIT data): Low, Medium, High ā Stakeholder impact: Customers, Customers and Business, Business This algorithm will be setup in X-Ray based on input from earlier test phases Very High High Medium Low Very Often Often Sometimes Rarely PROBABILITY OF FAILURE FREQUENCY OF USE 1 2 3 4 5 6 7
- 20. Demo
- 21. Demo 1 ā Showing process in Signavio 2 ā Importing into Test Modeller 3 ā Generating test cases from biz design and pushing to X-Ray and reviewing them 4 ā Looping back to model ā Introducing and overlaying useMango automation 5 ā Test Execution in useMango 6 ā What happens when things change?
- 22. Benefits ā¢ Test Coverage increased by 50% through automated analysis of BPMN and generation of test designs into Jira/X-Ray using an inbuilt algorithm ā¢ Speed increased by 80%: The analysis work of 5-testers for 4-weeks was reduced to 2- testers for 1-week 15x increase in test automation productivity by generating 30-50 automated tests per day vs a typical 2-4 automated tests per day ā¢ The democratisation of testing by getting business users to use the automation
- 23. Any Questions?
- 24. What next?
- 25. Carry on the conversation ā¢ Try what youāve seen today - head to TestModeller.io and useMango.co.uk for a free trial ā¢ Book a web meeting with Curiosity or an Infuse expert. ā¢ Get in touch with your questions and feedback ā¢ [email protected] ā¢ [email protected] ā¢ [email protected] ā¢ Weāll email you the slides, webinar recording and a short demo video. Please share with your friends and colleagues!