Continuous testing - GUERLAIS ARGOT - Air France KLM Sogeti- Soirée du Test Logiciel Sophia 2019
1 like•252 views
1. The document discusses continuous testing practices at Air France/KLM, including: - Automated testing of backend, frontend, mobile, and API systems across multiple locations in France and the Netherlands. 2. Continuous testing principles are explained, with the goal of synchronizing development and testing, running daily regression tests, and obtaining immediate feedback on software releases through automatic reporting. 3. Examples of integrated test automation are provided, including using Robot Framework for process execution, testing message queue files, mobile testing with Appium, API testing, Cucumber for behavior-driven development, and the Xray test management plugin for Jira.
Continuous testing - GUERLAIS ARGOT - Air France KLM Sogeti- Soirée du Test Logiciel Sophia 2019
- 1. Florence GUERLAIS & Marc ARGOT Air France/KLM 17/10/19 Soirée du Test Logiciel STLS2019 1
- 2. Merci à nos sponsors 17/10/19 Soirée du Test Logiciel STLS2019 2
- 3. CONTINUOUS TESTING Service Center Test, Marc Argot Sophia-Antipolis, October 17th 2019
- 4. CONTINUOUS TESTING Implement automated test into continuous development and integration. …as part of the software delivery pipeline, in order to obtain immediate feedback on the business risks, associated with a software release candidate.
- 5. By Marc ARGOT, Test Engineer
- 6. SUMMARY 1. Air France - Service Center Test (SCT) 2. Continuous Testing principles 3. Integrated test examples 4. Conclusion
- 7. 1. Service Center Test (SCT) 1
- 8. Air France SCT services1 Project Data / GDPR Mobile SecurityPerformance Management Agile/DevOps Automatisation Virtualisation Environments Tools IoTMore to come… Functional Coordination E2E - API
- 9. Air France SCT applies…1 Project …On: • Back-end • Front-end • Mobile • API …In: • Sophia Antipolis • Toulouse • Paris • Bordeaux • + KLM / Netherlands Paris Bordeaux Toulouse Sophia Antipolis
- 11. Continuous Testing : Goal2 Before After Not synchronized Dev/Test Not regular Regression Test Manual reporting Low visibility Synchronized Dev/Test Daily Regression Test Automatic reporting High visibility
- 12. Continuous Testing : Workflow2 Various types of test: Functional Regression MMI Performance Etc
- 13. Continuous Testing : Variety of automated test2
- 14. 2 Maven Project: the ‘test pack’ The idea : Share a single Maven project for multiple projects and test types using Java and other languages
- 15. Continuous Integration Server: Plan & perform2 Plan Deploy Run Report History
- 16. Continuous Integration Server: Run tests in parallel2 When test cases are independent of each other
- 17. Continuous Integration Server: Report & History2 Plan Deploy Run Report History
- 18. Continuous Testing : Benefits2 Suitable for your Agile team Early detection of bugs Periodic regression test Various trigerring (nightly run, after a deployment or code change, on demand) Reduce the risks Better project visibility Availability for the whole team (run and result)
- 19. Continuous Testing : Returns2 Bamboo runs on a bundled Apache Tomcat. It requires several resources as servers, database, repositories… Implementing a Bamboo Plan requires some effort Automatic test might be disturbed by unstable environment Long runs might be aborted Frequent survey: check result daily and after each commit Do not postpone issues fixing
- 20. So Continuous Testing is Applicable Easy to control Efficient 2
- 21. 3. Integrated Test Examples 3
- 22. Integrated test examples a) Process execution b) MQ File c) Mobile device d) API e) Cucumber project f) Xray 3
- 23. Process execution: SSH Library for Robot Framework3a Execute commands on remote computers over an SSH connection Supports files transfer using SFTP Documentation: http://robotframework.org/SSHLibrary/SSHLibrary.html Delivery: https://github.com/robotframework/SSHLibrary Some RF Keywords for SSH:
- 24. Process execution – Demo: verify checksum Maven container Copy fileCalculate checksumCompare checksumCopy fileLoginLogout 3a Test script
- 25. 3a Project Process execution: Demo script
- 26. MQ File: What is MQ?3b
- 27. MQ File: Testing MQ file3b
- 28. Mobile testing3c • Appium is an open-source tool for automating native, mobile web, and hybrid applications on iOS mobile, Android mobile, and Windows desktop platforms. • Appium Support different programming languages • Appium provides a single wrapper composed of a set of APIs to manipulate the native resources of each mobile platform (iOS…)
- 29. 3c For iOS mobile, XCUITest driver works via the installation of an helper application called Web Driver Agent-Runner onto the device. (UiAutomator for Android) Mobile testing
- 30. Mobile – Example of a mobile app for stewarts3c
- 31. API (Application Programming Interface) Interface 3d
- 32. Cucumber Java oriented Test framework Dedicated to functional test writing BDD (Behavior-Driven Development) Test description Gherkins • Given … • When … • Then … 3e
- 33. Selenium – Cargo Quote & Book3e Project
- 34. Test Management Tool Integration: Xray A Jira plug-in for: • Test planning • Test description • Test reporting Integration with: • Jira • Bamboo 3f
- 35. Xray flow Tested by feature Export feature(s) Update resultDisplay result of tests 3f project (run the project) project
- 36. Xray in Jira : some displays3f
- 37. Test and Tools Integration: Reminder Automatic tests can apply to a high variety of topics Automatic tests can be implemented with various technologies Test planning/reporting may be linked to Continuous Integration tools 3 ROBOT FRAMEWORK
- 38. 4. A few words to conclude… 4
- 39. Integration server: the heart of Continuous Testing Bamboo (or Jenkins) = Continuous Integration Server (independently of virtual or hardware platforms) Many advantages: • Early detection of bugs • Availability • Visibility and Reporting Dialog/Control/Drive your Continuous Integration Server (e-mail in case of failure, launch Test on Demand, plan test campaigns...) 4 Deploy TestReport Develop Continuous Integration Server
- 40. Q&A – Ideas sharing Thanks for your attention.