How AI and ML Can Accelerate and Optimize Software Development and Testing
- 1. How AI and ML Can Accelerate and Optimize Software Development and Testing Eran Kinsbruner Best-Selling Author, TechBeacon Top 30 Test Automation Leader & the Chief Evangelist and Senior Director at Perforce Software Tom Hartig Webinar Coordinator, Information Technology Zone Information Technology Zone June 15th, 2022 9:30 am PT 12:30 pm ET 5:30 pm BST With &
- 2. Rollbar is the leading continuous code improvement platform that enables developers to proactively discover and resolve issues in their code. Rollbar integrates with a development team's existing toolchain to give greater coverage and insights into broken code, across the software lifecycle. With Rollbar, developers focus on deploying better software faster, knowing they can quickly recover from critical errors as they happen. Thousands of companies, including Twilio, Salesforce, Twitch, and Duolingo, use Rollbar for their most critical applications, ensuring happier customers and more productive development teams. To learn more about how Rollbar can help you, visit Rollbar.com 02
- 3. TO USE YOUR COMPUTER'S AUDIO: When the webinar begins, you will be connected to audio using your computer's microphone and speakers (VoIP). A headset is recommended. TO USE YOUR TELEPHONE: You must select "Use Telephone" after joining and call in using the numbers below. United States: +1 (562) 247-8422 Access Code: 345-410-448 Audio PIN: Shown after joining the webinar 03 --OR-- Click on the Questions panel to interact with the presenters Information Technology Zone
- 4. 04 Eran Kinsbruner Best-Selling Author, TechBeacon Top 30 Test Automation Leader & the Chief Evangelist and Senior Director at Perforce Software How AI and ML Can Accelerate and Optimize Software Development and Testing Information Technology Zone
- 5. © Perforce Software, Inc. Presenter • 22+ years of experience in software development & testing • Inventor, author, speaker, blogger Social : @ek121268 : https://www.linkedin.com/in/erankinsbruner/ Blog : continuoustesting.dev/ Author of • The Digital Quality Handbook • Continuous Testing for DevOps Professionals • Accelerating Software Quality • A Front-End Web Developer’s Guide to Testing My List of Books on Digital Quality
- 6. © Perforce Software, Inc. 6 AI & ML Core Benefits
- 7. © Perforce Software, Inc. 7 AI & ML Investments https://www.jpmorgan.com/technology/artificial-intelligence Approximately three out of every four organizations (76%) in DevOps.com 2021 report said they are prioritizing AI/ML over other IT initiatives, with 28% reporting that it is their top priority overall
- 8. © Perforce Software, Inc. Top AI Startups in 2020-2021 CBINSIGHTS
- 9. © Perforce Software, Inc. 9 AI & ML In DEVOPS! Source: cloudthat
- 10. © Perforce Software, Inc. 10 The Coding Phase
- 11. © Perforce Software, Inc. 11 AI & ML In DEVOPS – Coding Phase!
- 12. © Perforce Software, Inc. 12 https://aws.amazon.com/codeguru/ AI & ML In DEVOPS – Coding Phase!
- 13. © Perforce Software, Inc. 13 https://cloud.google.com/ai-platform/training/pricing AI & ML In DEVOPS – Coding Phase! Use the AI Platform Training to train your machine learning models using the resources of Google Cloud.
- 14. © Perforce Software, Inc. 14 The Build Phase
- 15. © Perforce Software, Inc. 15 https://www.diffblue.com/products/ AI & ML In DEVOPS – Build Phase!
- 16. © Perforce Software, Inc. 16 The Testing Phase
- 17. © Perforce Software, Inc. 17 AI & ML In DEVOPS – Test Phase! AppVance
- 18. © Perforce Software, Inc. 18 AI & ML In DEVOPS – Test Phase! DIFFERENTIAL VISUAL DECLARATIVE Classifications of AI and ML Tools Image-Based Learning • Screen Comparisons • Look and Feel • UI Design, Accessibility Comparing application versions over builds: • Recognizing changes • Classifying the differences • Bugs vs. features ANALYTICS SELF-HEALING Specifying Test Intent • Goal-Based Automation • Natural Language Processing • Domain-Specific Languages Autocorrecting Test Scripts • Element Location • Improved Maintenance • Improved Robustness Autocorrecting Test Scripts • Root Cause Analysis • Test Selection/Prioritization • Test Flakiness
- 19. © Perforce Software, Inc. 19 AI & ML In DEVOPS – Test Phase! Autonomous & Agnostic to the Dev Framework • Sophisticated locators – Picked up autonomously. Doesn’t require user input. • Each element identified by a multi locator adaptive scoring system. • Most mobile frameworks don’t expose unique IDs – Perfecto Scriptless has its own locator system, agnostic to the framework. Discover & Manage System Messages • Stable on real devices too: Manage unpredictable messages that can fail tests randomly. Adaptive to Screen Load Time • Identifying progress bars and synchronizing actions to when screens are loaded and ready.
- 20. © Perforce Software, Inc. 20 The Operate Phase
- 21. © Perforce Software, Inc. 21 AIOps, (artificial intelligence for IT operations) is the application of artificial intelligence (AI) to enhance IT operations. Specifically, AIOps uses big data, analytics, and machine learning capabilities to do the following: • Collect and aggregate the huge and ever-increasing volumes of operations data generated by multiple IT infrastructure components, applications, and performance-monitoring tools. • Intelligently sift ‘signals’ out of the ‘noise’ to identify significant events and patterns related to system performance and availability issues (detect business anomalies). • Automatically diagnose root causes and report them to IT for rapid response and remediation — or, in some cases, automatically resolve these issues without human intervention. AI & ML In DEVOPS – Test Phase!
- 22. © Perforce Software, Inc. 22 APM – Application Performance Management ITIM – IT Infrastructure Monitoring ITSM – IT Service Monitoring APM + ITIM + ITSM =AIOPS
- 23. © Perforce Software, Inc. 23 AIOps Maturity Model
- 24. © Perforce Software, Inc. 24 • Enhance organizations digital transformation • Achieve faster MTTR (focus on real issues instead of noise) • Go from reactive to proactive to predictive management (predictive alerting) • Modernize your IT operations and your IT operations team (focus on innovation rather then KTLO) AIOps Benefits
- 25. © Perforce Software, Inc. 25 AIOps Objectives
- 26. © Perforce Software, Inc. 26 AIOps Solution Example Source: https://www.validatek.com/technologies/ai-ops • Key Features: • Event correlation • Noise reduction (filters, blacklisting, etc.) • Collaboration between security and operations • Ecosystem automation (auto-ticketing, auto-diagnostics, escalation, etc.) • Flexible implementation options (SaaS, on-premise, hybrid) • Integration with third party tools (Splunk, Remedy, SolarWinds)
- 27. © Perforce Software, Inc. 27 Future of AIOps • Integral part of DevOps and IT management • Shorter DevOps and production issues cycles • Higher code quality continuously, more emphasis on shift-right processes • Better cross-function collaboration (Dev, QA, Ops, Business)
- 28. © Perforce Software, Inc. 28 The Monitor Phase
- 29. © Perforce Software, Inc. 29 AI & ML In DEVOPS: Monitor/Observability
- 30. © Perforce Software, Inc. 30 AI & ML In DEVOPS: API Cybersecurity Identification
- 31. © Perforce Software, Inc. 31 CONCULSION Identify the most painful area within your process Start with a single problem and a single solution Prove value and continue down the stream Maximize the benefits from AI/ML to automate and enhance your velocity!
- 32. /in/erankinsbruner/ informationtechnologyzone.com Q&A Eran Kinsbruner Tom Hartig Webinar Coordinator Information Technology Zone Best-Selling Author, TechBeacon Top 30 Test Automation Leader & the Chief Evangelist and Senior Director at Perforce Software Information Technology Zone