SlideShare a Scribd company logo
W8
Session
10/26/2016 11:30:00 AM
Addressing the Challenges of Mobile
Test Automation
Presented by:
Pradeep Macharla
Inmar Inc.
Brought to you by:
350 Corporate Way, Suite 400, Orange Park, FL 32073
888-­‐268-­‐8770 ·∙ 904-­‐278-­‐0524 - info@techwell.com - http://www.starcanada.techwell.com/
Pradeep Macharla
Inmar Inc.
Pradeep Macharla is a passionate technical and business leader with over 13
years of experience managing, coaching and growing teams. Pradeep currently
leads DevOps & Automation Practices at Inmar Inc. His background and
experience has made him a highly sought after technical leader and mentor,
consulting or working at the senior leadership and executive level. Pradeep has
an MBA degree from Duke University that complements his technical ability to
engage both business leaders and technical architects that brings clarity and
simplicity to conversations.
Automate All The Things()
Mobile Test Automation
- Pradeep Macharla
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
What is the first word that comes to mind?
2
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Internet of Things (IoT)
3
 If we think testing is hard
now, what about 50biillion
smart objects interconnected
on the planet.
 Sooner or later, someone has
to test the solutions in the IoT
space.
 Manual Testing cannot scale
at the rate of things added to
internet
Source: Amsix
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Mobile Device(s) – Consumer Interface to IoT
4
 ~4B – Mobile users
 ~51% - Mobile Penetration
 ~7.09B – Total mobile
subscriptions
 Increasing exponentially..
Source: We are social 2015
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
‘Mobile’ doesn’t mean mobile
(Mobile devices are used everywhere, not just when people are mobile)
5
 Primary interface – Social, Cloud, Voice, Text, Identity (MFA)…
 Can you live without a smart phone? (adjust for demographics)
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Form Factors
6
 Getac
 Time Clocks
 Fitbit
 Industrial devices
 Smart Phones
Source: Flurry Analytics
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Mobile Software
7
 Ecosystems – Apple, Google,
Windows etc.
 iOS, Android, FirefoxOS,
Windows etc.
 Native, WebApp, Hybrid
 API levels, SDKs etc.
Source: Gartner, Statista
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Mobile Test Strategy
8
 Manual vs. Automation
 Scalable (think of AWS, Netflix)
 Volume, Variety, Velocity
 Cost (Open Source vs. Non)
 Virtualization (Emulators)
 Test Pyramid
 Design & Frameworks
Source: www.seleniumframework.com
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Mobile Test Automation tools
9
 Programming language – Start with
known, tend towards most collaborative
 Inside-out / Outside-in (focus on end-user)
 Don’t boil the ocean – Pick one and pivot
 Interoperability - Cloud & on-premises infra
 Tend towards using Real Devices
 Appium, espresso & XCTest
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Mobile Test Execution Environment - CSFs
10
 Hardware – Variety,
accessibility, form factors,
own vs. lease
 Software – On-premises,
cloud, open standard, lightly
coupled
 Support – Stack Overflow,
self-service
Source: Suresh Vadigi, Capital One
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Scope for Improvement
11
 External app context support (e.g. upload photos)
 Parallel execution on multiple devices/OSes
 Richer Test Execution Reports
 GPS location Simulation
 Global coverage with devices and operating systems
 Performance Testing
 Simplify networking (understand and isolate network segments)
 Security Testing
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Reference Pattern #Appium CI/CD/CT
12
 Build-Deploy-Test Feedback
loop
 Keep the automated tests
updated with changing
requirements
 Self-service execution (&
feedback)
 Access to source code
 Version your app
 Centralize Dependency
management
Source: https://leanpub.com/ci-mobile-app
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Reference Pattern #Appium Architecture
13
 Client-Server Architecture
 Session based
 Desired Capabilities (JSON over
wire)
 Appium.app, Appium.exe
 Multi-language support client
side
 Relies on Android OS and SDK
support for interaction
 GUI vs. headless server
Source: https://leanpub.com/ci-mobile-app
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Reference Pattern #Appium Device Lab
14
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Reference Pattern #Appium BDD framework
15
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Reference Pattern #Appium Code Behind
16
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Demo
17
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Reference Architecture #Appium iOS
18
 Appium server talks to UI
Automation
 UI Automation translates into
click, set, get
 GUI vs. headless server
 Future UIAutomation support
dropped by Apple, but still
available from Instruments
Source: https://leanpub.com/ci-mobile-app
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Parallel Execution – At Scale
19
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
Recommendation(s)
20
 Automation has little value without being idempotent
 Mobile Automation requires increased focus on details (compared to web)
 Utilize Cloud based solutions before buying devices (trials are free)
 Build and Deploy tasks should be self-serviced (automated)
 Be curious but do your groundwork upfront
 Participate and contribute to online forums (people are nicer if you can
articulate with context)
Most of the technology challenges are easier to solve
Focus on collaboration and democratic sharing of information within your
team
Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016
References
21
Speaker Pradeep Macharla
Email pradeep@seleniumframework.com
pradeep.macharla@inmar.com
Github https://github.com/machzqcq
Twitter @macharla
Book https://leanpub.com/ci-mobile-app
Cell +1.919.491.1239
Website https://www.seleniumframework.com

More Related Content

What's hot (20)

PDF
Embrace DevSecOps and Enjoy a Significant Competitive Advantage!
DevOps.com
 
PPTX
The Human Side of DevSecOps
Jules Pierre-Louis
 
PDF
Practical appsec lessons learned in the age of agile and DevOps
Priyanka Aash
 
PDF
10 Steps To Secure Agile Development
Checkmarx
 
PPTX
DevOps: Security's Big Opportunity
Timothy Jarrett
 
PDF
Testing in an Agile World: The Current State and Future Possibilities
TechWell
 
PPTX
Building an AppSec Pipeline: Keeping your program, and your life, sane
weaveraaaron
 
PDF
Shifting Security Left - The Innovation of DevSecOps - ValleyTechCon
Tom Stiehm
 
PDF
Dev secops. Real experience.
Vitaly Balashov
 
PDF
Testing in a Continuous Delivery Pipeline: Faster, Better, Cheaper
TechWell
 
PDF
Barriers to Container Security and How to Overcome Them
WhiteSource
 
PPTX
Failure is inevitable but it isn't permanent
Tom Stiehm
 
PDF
Shifting Security Left - The Innovation of DevSecOps - AgileDC
Tom Stiehm
 
PPTX
Shifting Security Left from the Lean+Agile 2019 Conference
Tom Stiehm
 
PDF
Texto de Ayuda Un2_Taller de ingles
Meztli Valeriano Orozco
 
PPTX
The Coming Earthquake in IIS and SQL Configuration Management
Jules Pierre-Louis
 
PPTX
Continuous Delivery Pipeline in the Cloud – How to Achieve Continous Everything
CA Technologies
 
PDF
Full Spectrum Engineering – The New Full-stack
Deborah Schalm
 
PDF
Shifting Left…AND Right to Ensure Full Application Security Coverage
DevOps.com
 
PPTX
Shifting security all day dev ops
Tom Stiehm
 
Embrace DevSecOps and Enjoy a Significant Competitive Advantage!
DevOps.com
 
The Human Side of DevSecOps
Jules Pierre-Louis
 
Practical appsec lessons learned in the age of agile and DevOps
Priyanka Aash
 
10 Steps To Secure Agile Development
Checkmarx
 
DevOps: Security's Big Opportunity
Timothy Jarrett
 
Testing in an Agile World: The Current State and Future Possibilities
TechWell
 
Building an AppSec Pipeline: Keeping your program, and your life, sane
weaveraaaron
 
Shifting Security Left - The Innovation of DevSecOps - ValleyTechCon
Tom Stiehm
 
Dev secops. Real experience.
Vitaly Balashov
 
Testing in a Continuous Delivery Pipeline: Faster, Better, Cheaper
TechWell
 
Barriers to Container Security and How to Overcome Them
WhiteSource
 
Failure is inevitable but it isn't permanent
Tom Stiehm
 
Shifting Security Left - The Innovation of DevSecOps - AgileDC
Tom Stiehm
 
Shifting Security Left from the Lean+Agile 2019 Conference
Tom Stiehm
 
Texto de Ayuda Un2_Taller de ingles
Meztli Valeriano Orozco
 
The Coming Earthquake in IIS and SQL Configuration Management
Jules Pierre-Louis
 
Continuous Delivery Pipeline in the Cloud – How to Achieve Continous Everything
CA Technologies
 
Full Spectrum Engineering – The New Full-stack
Deborah Schalm
 
Shifting Left…AND Right to Ensure Full Application Security Coverage
DevOps.com
 
Shifting security all day dev ops
Tom Stiehm
 

Viewers also liked (18)

PDF
Boost Test Coverage with Automated Visual Testing
Josiah Renaudin
 
PDF
Innovations in Mobile Testing: Expanding Your Test Plan
Josiah Renaudin
 
PDF
Better Together: Group Exploratory Testing
TechWell
 
PDF
Combine Test Automation Code with Product Code: The Good, the Bad, and the Le...
Josiah Renaudin
 
PDF
Anti-Patterns for Automated Testing
Josiah Renaudin
 
PDF
Design for Testability in Practice
TechWell
 
PDF
IoT Integrity: A Guide to Robust Endpoint Testing
Josiah Renaudin
 
PDF
Analyze, Diagnose, and Prevent Test Flakiness
Josiah Renaudin
 
PDF
Become an Influential Tester: Learn How to Be Heard
TechWell
 
PDF
A Tester’s Experience with User Experience Mapping
Josiah Renaudin
 
PDF
Build a Quality Engineering and Automation Framework
Josiah Renaudin
 
PDF
Implement Combinatorial Test Patterns for Better Mobile and IoT Testing
Josiah Renaudin
 
PDF
IoT and Embedded Testing: A Roku Case Study
TechWell
 
PDF
Mindmaps: Agile and Lightweight Documentation for Testing
TechWell
 
PDF
How to Build a Fully Open Source Test Automation Framework
TechWell
 
PDF
Acceptance- and Behavior-Driven Development with Cucumber: Three Case Studies
Josiah Renaudin
 
PDF
Accessibility Standards and Testing Techniques: Be Inclusive or Be Left Behind
TechWell
 
PDF
Budgeting, Estimation, Planning, and #NoEstimates: They All Make Sense for Ag...
Josiah Renaudin
 
Boost Test Coverage with Automated Visual Testing
Josiah Renaudin
 
Innovations in Mobile Testing: Expanding Your Test Plan
Josiah Renaudin
 
Better Together: Group Exploratory Testing
TechWell
 
Combine Test Automation Code with Product Code: The Good, the Bad, and the Le...
Josiah Renaudin
 
Anti-Patterns for Automated Testing
Josiah Renaudin
 
Design for Testability in Practice
TechWell
 
IoT Integrity: A Guide to Robust Endpoint Testing
Josiah Renaudin
 
Analyze, Diagnose, and Prevent Test Flakiness
Josiah Renaudin
 
Become an Influential Tester: Learn How to Be Heard
TechWell
 
A Tester’s Experience with User Experience Mapping
Josiah Renaudin
 
Build a Quality Engineering and Automation Framework
Josiah Renaudin
 
Implement Combinatorial Test Patterns for Better Mobile and IoT Testing
Josiah Renaudin
 
IoT and Embedded Testing: A Roku Case Study
TechWell
 
Mindmaps: Agile and Lightweight Documentation for Testing
TechWell
 
How to Build a Fully Open Source Test Automation Framework
TechWell
 
Acceptance- and Behavior-Driven Development with Cucumber: Three Case Studies
Josiah Renaudin
 
Accessibility Standards and Testing Techniques: Be Inclusive or Be Left Behind
TechWell
 
Budgeting, Estimation, Planning, and #NoEstimates: They All Make Sense for Ag...
Josiah Renaudin
 
Ad

Similar to Addressing the Challenges of Mobile Test Automation (20)

PPT
Mobile Apps Testing - Part 2
Maira Bay de Souza
 
PDF
Top 12 challenges in Mobile Testing
Aspire Systems
 
PDF
Top Practices for Successful Mobile Test Automation
TechWell
 
PDF
Mobile Automation: Lessons From The Trenches
Ashok Karania
 
PPTX
Hyper-connected apps: Hyper-Connected Apps: Testing Peripherals and Mobile Ap...
Infostretch
 
PDF
Top Best Practices for Successful Mobile Test Automation
Fred Beringer
 
PPTX
b4usolution_Appium Mobile Automation Testing Made Awesome
b4usolution .
 
PDF
Appium - Reality check on the world’s leading Open Source Framework for Mobil...
Asaf Saar
 
PPTX
Appium meet up noida
Amit Rawat
 
PDF
Mastering the Art of Mobile Testing by Akshita Puram
QA or the Highway
 
PDF
Mobile Testing Trends and Innovations
TechWell
 
PDF
Proven Approaches to AI-Powered E2E Testing.pdf
Applitools
 
PDF
Mobile Testing: What—and What Not—to Automate
TechWell
 
PPTX
PPT from Geekle QA Global Summit 2025 conference
SUPARNA KHAMARU
 
PDF
Achieving 100% mobile test coverage perfecto mobile
Perfecto Mobile
 
PDF
Experitest & Capgemini Co-webinar -
Experitest
 
PPTX
SeeTestAutomation - Mobile Test Automation Tool by Experitest
Experitest
 
PPTX
Device lab trials and tribulations
Heemeng Foo
 
PDF
Get Ready for the Apple Watch
Keynote Mobile Testing
 
PPTX
Raleigh User Forum Presentation
Perfecto Mobile
 
Mobile Apps Testing - Part 2
Maira Bay de Souza
 
Top 12 challenges in Mobile Testing
Aspire Systems
 
Top Practices for Successful Mobile Test Automation
TechWell
 
Mobile Automation: Lessons From The Trenches
Ashok Karania
 
Hyper-connected apps: Hyper-Connected Apps: Testing Peripherals and Mobile Ap...
Infostretch
 
Top Best Practices for Successful Mobile Test Automation
Fred Beringer
 
b4usolution_Appium Mobile Automation Testing Made Awesome
b4usolution .
 
Appium - Reality check on the world’s leading Open Source Framework for Mobil...
Asaf Saar
 
Appium meet up noida
Amit Rawat
 
Mastering the Art of Mobile Testing by Akshita Puram
QA or the Highway
 
Mobile Testing Trends and Innovations
TechWell
 
Proven Approaches to AI-Powered E2E Testing.pdf
Applitools
 
Mobile Testing: What—and What Not—to Automate
TechWell
 
PPT from Geekle QA Global Summit 2025 conference
SUPARNA KHAMARU
 
Achieving 100% mobile test coverage perfecto mobile
Perfecto Mobile
 
Experitest & Capgemini Co-webinar -
Experitest
 
SeeTestAutomation - Mobile Test Automation Tool by Experitest
Experitest
 
Device lab trials and tribulations
Heemeng Foo
 
Get Ready for the Apple Watch
Keynote Mobile Testing
 
Raleigh User Forum Presentation
Perfecto Mobile
 
Ad

More from TechWell (20)

PDF
Failing and Recovering
TechWell
 
PDF
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
PDF
Test Design for Fully Automated Build Architecture
TechWell
 
PDF
System-Level Test Automation: Ensuring a Good Start
TechWell
 
PDF
Build Your Mobile App Quality and Test Strategy
TechWell
 
PDF
Testing Transformation: The Art and Science for Success
TechWell
 
PDF
Implement BDD with Cucumber and SpecFlow
TechWell
 
PDF
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
PDF
Ma 15
TechWell
 
PDF
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
PDF
Transform Test Organizations for the New World of DevOps
TechWell
 
PDF
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
PDF
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
PDF
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
PDF
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
PDF
A Business-First Approach to DevOps Implementation
TechWell
 
PDF
Databases in a Continuous Integration/Delivery Process
TechWell
 
PDF
Cultural Intelligence: A Key Skill for Success
TechWell
 
PDF
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 
PDF
Scale: The Most Hyped Term in Agile Development Today
TechWell
 
Failing and Recovering
TechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
Test Design for Fully Automated Build Architecture
TechWell
 
System-Level Test Automation: Ensuring a Good Start
TechWell
 
Build Your Mobile App Quality and Test Strategy
TechWell
 
Testing Transformation: The Art and Science for Success
TechWell
 
Implement BDD with Cucumber and SpecFlow
TechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
Ma 15
TechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
Transform Test Organizations for the New World of DevOps
TechWell
 
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
A Business-First Approach to DevOps Implementation
TechWell
 
Databases in a Continuous Integration/Delivery Process
TechWell
 
Cultural Intelligence: A Key Skill for Success
TechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 
Scale: The Most Hyped Term in Agile Development Today
TechWell
 

Recently uploaded (20)

PPTX
Help for Correlations in IBM SPSS Statistics.pptx
Version 1 Analytics
 
PPTX
Empowering Asian Contributions: The Rise of Regional User Groups in Open Sour...
Shane Coughlan
 
PDF
Technical-Careers-Roadmap-in-Software-Market.pdf
Hussein Ali
 
PDF
MiniTool Partition Wizard Free Crack + Full Free Download 2025
bashirkhan333g
 
PDF
MiniTool Power Data Recovery 8.8 With Crack New Latest 2025
bashirkhan333g
 
PDF
AI + DevOps = Smart Automation with devseccops.ai.pdf
Devseccops.ai
 
PDF
Wondershare PDFelement Pro Crack for MacOS New Version Latest 2025
bashirkhan333g
 
PPTX
Agentic Automation Journey Session 1/5: Context Grounding and Autopilot for E...
klpathrudu
 
PPTX
Agentic Automation: Build & Deploy Your First UiPath Agent
klpathrudu
 
PDF
The 5 Reasons for IT Maintenance - Arna Softech
Arna Softech
 
PDF
Driver Easy Pro 6.1.1 Crack Licensce key 2025 FREE
utfefguu
 
PPTX
Foundations of Marketo Engage - Powering Campaigns with Marketo Personalization
bbedford2
 
PPTX
Home Care Tools: Benefits, features and more
Third Rock Techkno
 
PDF
vMix Pro 28.0.0.42 Download vMix Registration key Bundle
kulindacore
 
PDF
4K Video Downloader Plus Pro Crack for MacOS New Download 2025
bashirkhan333g
 
PDF
Build It, Buy It, or Already Got It? Make Smarter Martech Decisions
bbedford2
 
PPTX
Coefficient of Variance in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
PDF
Digger Solo: Semantic search and maps for your local files
seanpedersen96
 
PPTX
OpenChain @ OSS NA - In From the Cold: Open Source as Part of Mainstream Soft...
Shane Coughlan
 
PPTX
Finding Your License Details in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
Help for Correlations in IBM SPSS Statistics.pptx
Version 1 Analytics
 
Empowering Asian Contributions: The Rise of Regional User Groups in Open Sour...
Shane Coughlan
 
Technical-Careers-Roadmap-in-Software-Market.pdf
Hussein Ali
 
MiniTool Partition Wizard Free Crack + Full Free Download 2025
bashirkhan333g
 
MiniTool Power Data Recovery 8.8 With Crack New Latest 2025
bashirkhan333g
 
AI + DevOps = Smart Automation with devseccops.ai.pdf
Devseccops.ai
 
Wondershare PDFelement Pro Crack for MacOS New Version Latest 2025
bashirkhan333g
 
Agentic Automation Journey Session 1/5: Context Grounding and Autopilot for E...
klpathrudu
 
Agentic Automation: Build & Deploy Your First UiPath Agent
klpathrudu
 
The 5 Reasons for IT Maintenance - Arna Softech
Arna Softech
 
Driver Easy Pro 6.1.1 Crack Licensce key 2025 FREE
utfefguu
 
Foundations of Marketo Engage - Powering Campaigns with Marketo Personalization
bbedford2
 
Home Care Tools: Benefits, features and more
Third Rock Techkno
 
vMix Pro 28.0.0.42 Download vMix Registration key Bundle
kulindacore
 
4K Video Downloader Plus Pro Crack for MacOS New Download 2025
bashirkhan333g
 
Build It, Buy It, or Already Got It? Make Smarter Martech Decisions
bbedford2
 
Coefficient of Variance in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
Digger Solo: Semantic search and maps for your local files
seanpedersen96
 
OpenChain @ OSS NA - In From the Cold: Open Source as Part of Mainstream Soft...
Shane Coughlan
 
Finding Your License Details in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 

Addressing the Challenges of Mobile Test Automation

  • 1. W8 Session 10/26/2016 11:30:00 AM Addressing the Challenges of Mobile Test Automation Presented by: Pradeep Macharla Inmar Inc. Brought to you by: 350 Corporate Way, Suite 400, Orange Park, FL 32073 888-­‐268-­‐8770 ·∙ 904-­‐278-­‐0524 - [email protected] - http://www.starcanada.techwell.com/
  • 2. Pradeep Macharla Inmar Inc. Pradeep Macharla is a passionate technical and business leader with over 13 years of experience managing, coaching and growing teams. Pradeep currently leads DevOps & Automation Practices at Inmar Inc. His background and experience has made him a highly sought after technical leader and mentor, consulting or working at the senior leadership and executive level. Pradeep has an MBA degree from Duke University that complements his technical ability to engage both business leaders and technical architects that brings clarity and simplicity to conversations.
  • 3. Automate All The Things() Mobile Test Automation - Pradeep Macharla
  • 4. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 What is the first word that comes to mind? 2
  • 5. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Internet of Things (IoT) 3  If we think testing is hard now, what about 50biillion smart objects interconnected on the planet.  Sooner or later, someone has to test the solutions in the IoT space.  Manual Testing cannot scale at the rate of things added to internet Source: Amsix
  • 6. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Mobile Device(s) – Consumer Interface to IoT 4  ~4B – Mobile users  ~51% - Mobile Penetration  ~7.09B – Total mobile subscriptions  Increasing exponentially.. Source: We are social 2015
  • 7. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 ‘Mobile’ doesn’t mean mobile (Mobile devices are used everywhere, not just when people are mobile) 5  Primary interface – Social, Cloud, Voice, Text, Identity (MFA)…  Can you live without a smart phone? (adjust for demographics)
  • 8. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Form Factors 6  Getac  Time Clocks  Fitbit  Industrial devices  Smart Phones Source: Flurry Analytics
  • 9. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Mobile Software 7  Ecosystems – Apple, Google, Windows etc.  iOS, Android, FirefoxOS, Windows etc.  Native, WebApp, Hybrid  API levels, SDKs etc. Source: Gartner, Statista
  • 10. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Mobile Test Strategy 8  Manual vs. Automation  Scalable (think of AWS, Netflix)  Volume, Variety, Velocity  Cost (Open Source vs. Non)  Virtualization (Emulators)  Test Pyramid  Design & Frameworks Source: www.seleniumframework.com
  • 11. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Mobile Test Automation tools 9  Programming language – Start with known, tend towards most collaborative  Inside-out / Outside-in (focus on end-user)  Don’t boil the ocean – Pick one and pivot  Interoperability - Cloud & on-premises infra  Tend towards using Real Devices  Appium, espresso & XCTest
  • 12. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Mobile Test Execution Environment - CSFs 10  Hardware – Variety, accessibility, form factors, own vs. lease  Software – On-premises, cloud, open standard, lightly coupled  Support – Stack Overflow, self-service Source: Suresh Vadigi, Capital One
  • 13. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Scope for Improvement 11  External app context support (e.g. upload photos)  Parallel execution on multiple devices/OSes  Richer Test Execution Reports  GPS location Simulation  Global coverage with devices and operating systems  Performance Testing  Simplify networking (understand and isolate network segments)  Security Testing
  • 14. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Reference Pattern #Appium CI/CD/CT 12  Build-Deploy-Test Feedback loop  Keep the automated tests updated with changing requirements  Self-service execution (& feedback)  Access to source code  Version your app  Centralize Dependency management Source: https://leanpub.com/ci-mobile-app
  • 15. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Reference Pattern #Appium Architecture 13  Client-Server Architecture  Session based  Desired Capabilities (JSON over wire)  Appium.app, Appium.exe  Multi-language support client side  Relies on Android OS and SDK support for interaction  GUI vs. headless server Source: https://leanpub.com/ci-mobile-app
  • 16. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Reference Pattern #Appium Device Lab 14
  • 17. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Reference Pattern #Appium BDD framework 15
  • 18. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Reference Pattern #Appium Code Behind 16
  • 19. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Demo 17
  • 20. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Reference Architecture #Appium iOS 18  Appium server talks to UI Automation  UI Automation translates into click, set, get  GUI vs. headless server  Future UIAutomation support dropped by Apple, but still available from Instruments Source: https://leanpub.com/ci-mobile-app
  • 21. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Parallel Execution – At Scale 19
  • 22. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 Recommendation(s) 20  Automation has little value without being idempotent  Mobile Automation requires increased focus on details (compared to web)  Utilize Cloud based solutions before buying devices (trials are free)  Build and Deploy tasks should be self-serviced (automated)  Be curious but do your groundwork upfront  Participate and contribute to online forums (people are nicer if you can articulate with context) Most of the technology challenges are easier to solve Focus on collaboration and democratic sharing of information within your team
  • 23. Inmar confidential – do not copy, distribute or use without Inmar written permission, 2016 References 21 Speaker Pradeep Macharla Email [email protected] [email protected] Github https://github.com/machzqcq Twitter @macharla Book https://leanpub.com/ci-mobile-app Cell +1.919.491.1239 Website https://www.seleniumframework.com