Mobile Application Testing
- 1. © Sun Technologies Inc. 1 MOBILE APPLICATION TESTING
- 2. MOBILE APPLICATION TESTING • is a process by which a developed application of a mobile device is tested for its functionality , consistency and usability. • Application distribution platforms-app store, google play • Designed and tested on emulators before the field testing • Ex calendar , contacts, email, games ….. © Sun Technologies Inc. 2
- 3. © Sun Technologies Inc. 3 Mobile App Challenges Mobile application testing is a quite different which involves many things like, • Wide varieties of mobile devices • Different mobile operating system • Different mobile network operators • Input method • Memory usage • Usability
- 4. © Sun Technologies Inc. 4 Mobile Platforms • Android • iOS • Symbian(Nokia) • J2ME • RIM(Blackberry) • BREW • Windows Mobile • Bada(Samsung)
- 5. © Sun Technologies Inc. 5 Types of mobile devices • Candy bar phones • Touch Screen phones • Slider phones • Clamshell devices(flip phones) • Phones with QWERTY keyboard
- 6. © Sun Technologies Inc. 6 Types of mobile application Native apps •Runs on device os and firmware •Android, iOS Web app •Browser app , web capable mobile devices •HTML, JavaScript Hybrid app •Combination of native and web apps •Has cross platform comptability
- 7. © Sun Technologies Inc. 7 Mobile App Testing Approach Installation /uninstallation –download and delete Workflows and Feature Testing • Functional –specs and requirements • Data-different types of data • Regression • Performance-quick and responsive • Localization- handle different languages Scenarios •Credible usage stories and workflows Device interactions(web , network , apps) •Wi-Fi, Cellular Network ,apps
- 8. © Sun Technologies Inc. 8 • Installation • Application Start/stop Behavior • Application Credentials • Interruptions-Voice calls • Interruptions-SMS • Auto start • No disruption to key device applications Testcase Strategies
- 9. © Sun Technologies Inc. 9 • UI testing-color ,menu , style • Performance and stress-under low resources • compatibility testing • Interruption testing-voice calls,sms,low memory notification • Adhoc testing • Low network/no network Usability testing • Security testing Types Of Mobile App Testing
- 10. © Sun Technologies Inc. 10 • Automation is a process ,which includes the development of scripts to run the test cases automatically with out manual intervention and to log results. Why Automation? • Manual Testing of all workflow ,all negative scenarios is time and cost consuming • It does not require human intervention. • It increases speed of test execution and test coverage. Automation
- 11. © Sun Technologies Inc. 11 Aagfyhjc sccAAuto Growing mobile apps Agile development cycle Mobile Landscape Complexities Globalization: Apps releasing in multiple languages Need of Automation in Mobile Testing Automation Is the key
- 12. © Sun Technologies Inc. Mobile Automation Tools 12
- 13. © Sun Technologies Inc. 13 RIGHT TOOL Preference to free/paid tool Which app to automate: Android/iOS or both? Time Crunch Flexibility of tester with the scripting languages Community support First party/Third Party Choose The Right Tool
- 14. © Sun Technologies Inc. 14 Monkey Runner Android app only Basic UI testing Time Crunch Low effort/investment UI Automator Android app only Intensive UI testing. Don’t want to use third party tool. Have time to build a stable automation solution. Monkey Talk Android & iOS app app doesn’t supports web view. Image comparison requirement. Can install agents in your app / can invest money per month Appium Android & iOS app Intensive UI testing Don’t have code / Don’t want to install any agent. Stable automation solution (free) for suite of apps Use case scenario
- 15. © Sun Technologies Inc. 14 Key Features Components of this tool • Provides an API for writing programs to control an Android device/emulator. • Can be used for both functional and UI testing. • Entirely based on coordinates based automation. • MonkeyRunner • MonkeyDevice • MonkeyImage Monkey Runner
- 16. Monkey Runner © Sun Technologies Inc. 16 Strengths Easy to set-up. Test multiple devices at a time. Appropriate for regression testing of a basic app. Random testing. Limitations Only supports Android. Different script for different device. Even slight change in UI breaks the script.
- 17. UI Automator Key Features © Sun Technologies Inc. 17 • It is a java library containing API’s to create customized functional UI tests. • Integrated with Google’s own Android development IDE • Entirely based on object based automation. Components of this tool • Uiautomatorviewer • API framework
- 18. © Sun Technologies Inc. 18 Strengths One of the best tools for testing android apps. Comes bundled with Android Studio IDE. Appropriate for UI testing of any android app. Limitations Only supports Android (versions > 4.3). Lack of support for Web view. Lack methods for some gestures like long press on an element. UI Automator
- 19. Monkey Talk © Sun Technologies Inc. 19 • MonkeyTalk IDE • MonkeyTalk Agent • It is an integrated environment for recording, customizing and managing test suites. • Open source, eclipse based IDE. • Used for automation of both iOS & Android apps. • Limited features are available in the free version of this tool. Paid version is costly. Components of this tool Key Features
- 20. Monkey Talk © Sun Technologies Inc. 20 Strengths Supports both iOS and Android apps. Test multiple devices at a time. Open source Image comparison is supported Limitations The essential features are available in the paid version. Doesn’t support web view. Agent needs to be installed in the app which needs to be tested. Limited Xpath support.
- 21. APPIUM © Sun Technologies Inc. 21 • It is a HTTP server that takes HTTP commands from the test script and executes the command on the device. • Based on WebDriver JSON protocol. • Used for automation of both iOS & Android apps. • Totally derived from selenium code + mobile gesture handling Key Features Components of this tool • Appium Server • Appium Client libraries • Appium Inspector
- 22. APPIUM © Sun Technologies Inc. 22 Strengths Supports both iOS and Android apps. One of the most versatile tools for testing any native, hybrid and mobile web apps. Doesn’t require code access or recompiling the app. Test multiple android devices at a time. Limitations No support for parallel test for iOS apps. No support for Android version < 4.1 (selendroid can be used) No Image comparison. No option to switch off network connection.
- 23. The Process: Recipe of Success © Sun Technologies Inc. 23 Know your mobile app. Identify the right automation tool. Write test script to cover all the testing workflows in the app. Run the script for the test pass. Next Release: Update the script. Repeat until the app lives on the app store.
- 24. Test cases which are not suitable for automation are as follows: • Test cases that are newly designed and not executed manually at least once • Test cases for which the requirements are changing frequently • Test cases which are executed on adhoc basis 24© Sun Technologies Inc.