SlideShare a Scribd company logo
| HELLO, REAL WORLD.
Whitebox testing for BlackBox Testers;
Simplifying API Testing
DJ Frank
| HELLO, REAL WORLD.
DJ Frank
Senior Product Engineer
QASymphony
Agenda
Introduction to APIs
Significance of APIs in Digital Business
API Management
Why even test APIs?
Test Early; Test Often
INSERT PHOTO ON TOP
Application Programing Interface
• Representational State Transfer
is the software architectural style
designed for distributed
systems, and particularly, the
World Wide Web.
• But what does that even mean?
Uniform RESTful Constraints
1. Identification of resources as
‘requests’
2. Manipulation of resources
3. Self-descriptive messages
4. Hypermedia
What is an API?
API: The pipes that carry data between any number of
systems. Think of them as veins and arteries carrying blood
from your heart to other organs.
API Provider: Who build, owns, and maintains the APIs
that are being used.
API Consumer: You! Any developer, company, or end
users accessing information via the API
A is for “Application”
• Web-based Systems
• Operating Systems
• DB Systems
• Computer Hardware
• Software Libraries
Whitebox Testing for Blackbox Testers: Simplifying API Testing
What does an API look like?
Whitebox Testing for Blackbox Testers: Simplifying API Testing
Significance of APIs in
Digital Business
“Software is eating the
world.”
“It’s an application
economy.”
Marc Andreessen
“Every business will be in
software business.”Satya Nadella
Marc Benioff
Whitebox Testing for Blackbox Testers: Simplifying API Testing
• Location Services
• Notifications
• Payment Processing
• Promotional
Advertising
Whitebox Testing for Blackbox Testers: Simplifying API Testing
50% 60% 90%
API Digital Value Chain Revenue
Source: TechCrunch, The Rise of APIs 2016
• Low Friction Sales
Model
• Scalable, Capital –
Efficient
• Recurring Revenue
• Diversification of
Customer
Concentration
APIs are the Nexus of the Digital World
Factors of a good API
Whitebox Testing for Blackbox Testers: Simplifying API Testing
Whitebox Testing for Blackbox Testers: Simplifying API Testing
Pitfalls of Poor API
Management
Cost of Failures
SOURCES: The State of API 2016. Smartbear. | The Cost of Poor Quality, QASymphony.
Less Than 10%
API issues resolved within
24 hours
1 in 4
Issues remain unresolved
for one week or more
$7,900 Per Minute
estimated average cost
of downtime
4%
Average drop in stock price
following a newsworthy failure
Fundamentals of API Testing:
The Root Issue
The Performance Testing Umbrella
| HELLO, REAL WORLD.
Test Early;
Test Often;
Test Everything!
Thank You !
DJ Frank
djfrank@qasymphony.com
Q&A
| HELLO, REAL WORLD.
Quality Jam LondonOctober 11, 2017 – The Brewery, London
Email Marketing@qasymphony.com to be entered to win a free ticket
| HELLO, REAL WORLD.
Quality Jam LondonOctober 11, 2017 – The Brewery, London
Email Marketing@qasymphony.com to be entered to win a free ticket
Next Webinar
RESTful API Testing Using
Postman, Newman, and Jenkins
October 4th, 2pm ET
Register Now at QASymphony.com/resources
Visit support.qasymphony.com
See How Leading Organizations Use qTest APIs for Traceability, Test Automation, and Visibility

More Related Content

What's hot (20)

PDF
Security with the Speed of Continuous Delivery
Tapabrata Pal
 
PDF
Voxxed Days Thessaloniki 2016 - Continuous Delivery: Jenkins, Docker and Spri...
Voxxed Days Thessaloniki
 
PDF
Measuring your way_to_successful_automation_webinar
Sauce Labs
 
PDF
Deeper Root Cause Analysis to App Performance Bottlenecks with Appvance APM I...
Clever Moe
 
PDF
Banking on Innovation and DevOps
Tapabrata Pal
 
PDF
Better Governance Banking on Continuous Delivery
Tapabrata Pal
 
PDF
Use Jenkins For Continuous Load Testing And Mobile Test Automation
Clever Moe
 
PDF
Api testing and steps to do it
Zoe Gilbert
 
ODP
API Testing With Katalon Studio
Knoldus Inc.
 
PPTX
Use Automation to Assist -Not Replace- Manual Testing
SmartBear
 
PDF
Testing APIs in the Cloud
SmartBear
 
PPTX
Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...
Mike Villiger
 
PDF
Testing Ajax, Mobile Apps the Agile Way
Clever Moe
 
PDF
Gartner starting and scaling dev ops
Tapabrata Pal
 
PDF
STARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test Automation
Clever Moe
 
PPT
ATAGTR2017 Bee-Hive approach for Big Data Testing [End to End Continuous Test...
Agile Testing Alliance
 
PDF
Metrics-driven Continuous Delivery
Andrew Phillips
 
PDF
Running JMeter Tests In Appvance PerformanceCloud
Clever Moe
 
PDF
Continuous Integration, Deploy, Test From Beginning To End 2014
Clever Moe
 
PDF
API Testing
Bikash Sharma
 
Security with the Speed of Continuous Delivery
Tapabrata Pal
 
Voxxed Days Thessaloniki 2016 - Continuous Delivery: Jenkins, Docker and Spri...
Voxxed Days Thessaloniki
 
Measuring your way_to_successful_automation_webinar
Sauce Labs
 
Deeper Root Cause Analysis to App Performance Bottlenecks with Appvance APM I...
Clever Moe
 
Banking on Innovation and DevOps
Tapabrata Pal
 
Better Governance Banking on Continuous Delivery
Tapabrata Pal
 
Use Jenkins For Continuous Load Testing And Mobile Test Automation
Clever Moe
 
Api testing and steps to do it
Zoe Gilbert
 
API Testing With Katalon Studio
Knoldus Inc.
 
Use Automation to Assist -Not Replace- Manual Testing
SmartBear
 
Testing APIs in the Cloud
SmartBear
 
Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...
Mike Villiger
 
Testing Ajax, Mobile Apps the Agile Way
Clever Moe
 
Gartner starting and scaling dev ops
Tapabrata Pal
 
STARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test Automation
Clever Moe
 
ATAGTR2017 Bee-Hive approach for Big Data Testing [End to End Continuous Test...
Agile Testing Alliance
 
Metrics-driven Continuous Delivery
Andrew Phillips
 
Running JMeter Tests In Appvance PerformanceCloud
Clever Moe
 
Continuous Integration, Deploy, Test From Beginning To End 2014
Clever Moe
 
API Testing
Bikash Sharma
 

Viewers also liked (14)

PPTX
Debugging Your Testing Team
QASymphony
 
PDF
BHIM App Case Study
99tests
 
PPTX
Succeeding as an Introvert
QASymphony
 
PDF
Best Practices In Exploratory Testing
99tests
 
PPTX
Knowing Where to Tap
QASymphony
 
PDF
Operate 24x7
Astegic
 
PDF
Future Of Software Testing
99tests
 
PPTX
Modernizing Your Testing Tools
QASymphony
 
PPTX
TUI & qTest: Why, How and Where Next
QASymphony
 
PDF
Best practices for test case creation & maintenance
99tests
 
PDF
Product Teardown for SaaS companies at #SaaSx4
ProductNation/iSPIRT
 
PPTX
Manual Testing is Dead. Long Live Manual Testing
QASymphony
 
PPTX
RESTful API Testing using Postman, Newman, and Jenkins
QASymphony
 
PPTX
Building Better Collaboration Between Development and Testing in a DevOps World
QASymphony
 
Debugging Your Testing Team
QASymphony
 
BHIM App Case Study
99tests
 
Succeeding as an Introvert
QASymphony
 
Best Practices In Exploratory Testing
99tests
 
Knowing Where to Tap
QASymphony
 
Operate 24x7
Astegic
 
Future Of Software Testing
99tests
 
Modernizing Your Testing Tools
QASymphony
 
TUI & qTest: Why, How and Where Next
QASymphony
 
Best practices for test case creation & maintenance
99tests
 
Product Teardown for SaaS companies at #SaaSx4
ProductNation/iSPIRT
 
Manual Testing is Dead. Long Live Manual Testing
QASymphony
 
RESTful API Testing using Postman, Newman, and Jenkins
QASymphony
 
Building Better Collaboration Between Development and Testing in a DevOps World
QASymphony
 

Similar to Whitebox Testing for Blackbox Testers: Simplifying API Testing (20)

PDF
Open Bank Project Presentation Tel Aviv CA 4th April 2017
simonredfern
 
PDF
I Love APIs Europe 2015: Technical Sessions
Apigee | Google Cloud
 
PDF
Open Ap Is State Of The Market
ConSanFrancisco123
 
PPTX
Smartone v1.0
Jinyean Tan
 
PDF
APIdays Paris 2018 - Autonomous APIs, Zdenek Nemec, Founder, Good API
apidays
 
PDF
APC Hackathon 2017 Open Bank Project workshop
simonredfern
 
PDF
API Management Building Blocks and Business value
WSO2
 
PDF
The Business of APIs 2009 - ProgrammableWeb.com
Mashery
 
PPTX
API Pricing Strategy Webinar (Benchmark Data)
Alex Walling
 
PDF
An Open Bank Project / Sofit deck for the Open Up Challenge
simonredfern
 
PPTX
Intro to Azure Api Management - With Cats
Xamariners
 
PPT
Api management introduction and product overview v1.0 2014.08.28
floridawusergroup
 
PDF
Introduction to The 6 Insights of API Practice (Bill Doerrfeld)
Nordic APIs
 
PPTX
EVOLVE'14 | Keynote | Sal Visca | How APIs are Revolutionizing Commerce in th...
Evolve The Adobe Digital Marketing Community
 
PPTX
Craft Conference 2015 - Evolution of the PayPal API: Platform & Culture
Deepak Nadig
 
PDF
KPIs for APIs (and how API Calls are the new Web Hits, and you may be measuri...
John Musser
 
PPTX
API Product Opportunity Responsibility Nicolas Sierro 2015.pptx
Blockchainizator
 
PPTX
Asynchronous API Testing: Trends, Tools & More | Calidad Infotech
Calidad Infotech
 
PDF
apidays LIVE Paris - The Business of APIs by Jed Ng
apidays
 
PPTX
Pain Points In API Development? They’re Everywhere
Nordic APIs
 
Open Bank Project Presentation Tel Aviv CA 4th April 2017
simonredfern
 
I Love APIs Europe 2015: Technical Sessions
Apigee | Google Cloud
 
Open Ap Is State Of The Market
ConSanFrancisco123
 
Smartone v1.0
Jinyean Tan
 
APIdays Paris 2018 - Autonomous APIs, Zdenek Nemec, Founder, Good API
apidays
 
APC Hackathon 2017 Open Bank Project workshop
simonredfern
 
API Management Building Blocks and Business value
WSO2
 
The Business of APIs 2009 - ProgrammableWeb.com
Mashery
 
API Pricing Strategy Webinar (Benchmark Data)
Alex Walling
 
An Open Bank Project / Sofit deck for the Open Up Challenge
simonredfern
 
Intro to Azure Api Management - With Cats
Xamariners
 
Api management introduction and product overview v1.0 2014.08.28
floridawusergroup
 
Introduction to The 6 Insights of API Practice (Bill Doerrfeld)
Nordic APIs
 
EVOLVE'14 | Keynote | Sal Visca | How APIs are Revolutionizing Commerce in th...
Evolve The Adobe Digital Marketing Community
 
Craft Conference 2015 - Evolution of the PayPal API: Platform & Culture
Deepak Nadig
 
KPIs for APIs (and how API Calls are the new Web Hits, and you may be measuri...
John Musser
 
API Product Opportunity Responsibility Nicolas Sierro 2015.pptx
Blockchainizator
 
Asynchronous API Testing: Trends, Tools & More | Calidad Infotech
Calidad Infotech
 
apidays LIVE Paris - The Business of APIs by Jed Ng
apidays
 
Pain Points In API Development? They’re Everywhere
Nordic APIs
 

More from QASymphony (19)

PDF
Saying Goodbye to Quality Center
QASymphony
 
PPTX
Kick-Starting BDD for Your Organization
QASymphony
 
PPTX
BizDevOps – Delivering Business Value Quickly at Scale
QASymphony
 
PPTX
Making the Switch from HP Quality Center to qTest
QASymphony
 
PDF
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
QASymphony
 
PDF
Quality Jam 2017: Jesse Reed & Kyle McMeekin "Test Case Management & Explorat...
QASymphony
 
PDF
Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"
QASymphony
 
PDF
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
QASymphony
 
PDF
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
QASymphony
 
PDF
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
QASymphony
 
PDF
Quality Jam 2017: Keith Klain "Debugging Your Test Team"
QASymphony
 
PPTX
Where Testers & QA Fit in the Story of DevOps
QASymphony
 
PPTX
Closing the Requirements and Testing Loop Webinar
QASymphony
 
PPTX
Streamlining Automation Scripts and Test Data Management
QASymphony
 
PPTX
Agile Testing Analytics
QASymphony
 
PPTX
Making the Move to Behavior Driven Development
QASymphony
 
PPTX
Software Testing Metrics with qTest Insights - QASymphony Webinar
QASymphony
 
PPTX
Using JIRA for Risk Based Testing - QASymphony Webinar
QASymphony
 
PPTX
Evolve or Die: Healthcare IT Testing | QASymphony Webinar
QASymphony
 
Saying Goodbye to Quality Center
QASymphony
 
Kick-Starting BDD for Your Organization
QASymphony
 
BizDevOps – Delivering Business Value Quickly at Scale
QASymphony
 
Making the Switch from HP Quality Center to qTest
QASymphony
 
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
QASymphony
 
Quality Jam 2017: Jesse Reed & Kyle McMeekin "Test Case Management & Explorat...
QASymphony
 
Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"
QASymphony
 
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
QASymphony
 
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
QASymphony
 
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
QASymphony
 
Quality Jam 2017: Keith Klain "Debugging Your Test Team"
QASymphony
 
Where Testers & QA Fit in the Story of DevOps
QASymphony
 
Closing the Requirements and Testing Loop Webinar
QASymphony
 
Streamlining Automation Scripts and Test Data Management
QASymphony
 
Agile Testing Analytics
QASymphony
 
Making the Move to Behavior Driven Development
QASymphony
 
Software Testing Metrics with qTest Insights - QASymphony Webinar
QASymphony
 
Using JIRA for Risk Based Testing - QASymphony Webinar
QASymphony
 
Evolve or Die: Healthcare IT Testing | QASymphony Webinar
QASymphony
 

Recently uploaded (20)

PDF
Alarm in Android-Scheduling Timed Tasks Using AlarmManager in Android.pdf
Nabin Dhakal
 
PPTX
An Introduction to ZAP by Checkmarx - Official Version
Simon Bennetts
 
DOCX
Import Data Form Excel to Tally Services
Tally xperts
 
PPTX
Tally_Basic_Operations_Presentation.pptx
AditiBansal54083
 
PPTX
Migrating Millions of Users with Debezium, Apache Kafka, and an Acyclic Synch...
MD Sayem Ahmed
 
PPTX
Fundamentals_of_Microservices_Architecture.pptx
MuhammadUzair504018
 
PPT
MergeSortfbsjbjsfk sdfik k
RafishaikIT02044
 
PDF
HiHelloHR – Simplify HR Operations for Modern Workplaces
HiHelloHR
 
PPTX
A Complete Guide to Salesforce SMS Integrations Build Scalable Messaging With...
360 SMS APP
 
PDF
Thread In Android-Mastering Concurrency for Responsive Apps.pdf
Nabin Dhakal
 
PDF
vMix Pro 28.0.0.42 Download vMix Registration key Bundle
kulindacore
 
PPTX
3uTools Full Crack Free Version Download [Latest] 2025
muhammadgurbazkhan
 
PPTX
Java Native Memory Leaks: The Hidden Villain Behind JVM Performance Issues
Tier1 app
 
PDF
Linux Certificate of Completion - LabEx Certificate
VICTOR MAESTRE RAMIREZ
 
PPTX
Revolutionizing Code Modernization with AI
KrzysztofKkol1
 
PDF
Why Businesses Are Switching to Open Source Alternatives to Crystal Reports.pdf
Varsha Nayak
 
PPTX
Agentic Automation Journey Session 1/5: Context Grounding and Autopilot for E...
klpathrudu
 
PDF
Streamline Contractor Lifecycle- TECH EHS Solution
TECH EHS Solution
 
PPTX
Writing Better Code - Helping Developers make Decisions.pptx
Lorraine Steyn
 
PPTX
Human Resources Information System (HRIS)
Amity University, Patna
 
Alarm in Android-Scheduling Timed Tasks Using AlarmManager in Android.pdf
Nabin Dhakal
 
An Introduction to ZAP by Checkmarx - Official Version
Simon Bennetts
 
Import Data Form Excel to Tally Services
Tally xperts
 
Tally_Basic_Operations_Presentation.pptx
AditiBansal54083
 
Migrating Millions of Users with Debezium, Apache Kafka, and an Acyclic Synch...
MD Sayem Ahmed
 
Fundamentals_of_Microservices_Architecture.pptx
MuhammadUzair504018
 
MergeSortfbsjbjsfk sdfik k
RafishaikIT02044
 
HiHelloHR – Simplify HR Operations for Modern Workplaces
HiHelloHR
 
A Complete Guide to Salesforce SMS Integrations Build Scalable Messaging With...
360 SMS APP
 
Thread In Android-Mastering Concurrency for Responsive Apps.pdf
Nabin Dhakal
 
vMix Pro 28.0.0.42 Download vMix Registration key Bundle
kulindacore
 
3uTools Full Crack Free Version Download [Latest] 2025
muhammadgurbazkhan
 
Java Native Memory Leaks: The Hidden Villain Behind JVM Performance Issues
Tier1 app
 
Linux Certificate of Completion - LabEx Certificate
VICTOR MAESTRE RAMIREZ
 
Revolutionizing Code Modernization with AI
KrzysztofKkol1
 
Why Businesses Are Switching to Open Source Alternatives to Crystal Reports.pdf
Varsha Nayak
 
Agentic Automation Journey Session 1/5: Context Grounding and Autopilot for E...
klpathrudu
 
Streamline Contractor Lifecycle- TECH EHS Solution
TECH EHS Solution
 
Writing Better Code - Helping Developers make Decisions.pptx
Lorraine Steyn
 
Human Resources Information System (HRIS)
Amity University, Patna
 

Whitebox Testing for Blackbox Testers: Simplifying API Testing

  • 1. | HELLO, REAL WORLD. Whitebox testing for BlackBox Testers; Simplifying API Testing DJ Frank
  • 2. | HELLO, REAL WORLD. DJ Frank Senior Product Engineer QASymphony
  • 3. Agenda Introduction to APIs Significance of APIs in Digital Business API Management Why even test APIs? Test Early; Test Often
  • 4. INSERT PHOTO ON TOP Application Programing Interface • Representational State Transfer is the software architectural style designed for distributed systems, and particularly, the World Wide Web. • But what does that even mean?
  • 5. Uniform RESTful Constraints 1. Identification of resources as ‘requests’ 2. Manipulation of resources 3. Self-descriptive messages 4. Hypermedia
  • 6. What is an API? API: The pipes that carry data between any number of systems. Think of them as veins and arteries carrying blood from your heart to other organs. API Provider: Who build, owns, and maintains the APIs that are being used. API Consumer: You! Any developer, company, or end users accessing information via the API
  • 7. A is for “Application” • Web-based Systems • Operating Systems • DB Systems • Computer Hardware • Software Libraries
  • 9. What does an API look like?
  • 11. Significance of APIs in Digital Business
  • 12. “Software is eating the world.” “It’s an application economy.” Marc Andreessen “Every business will be in software business.”Satya Nadella Marc Benioff
  • 14. • Location Services • Notifications • Payment Processing • Promotional Advertising
  • 16. 50% 60% 90% API Digital Value Chain Revenue Source: TechCrunch, The Rise of APIs 2016
  • 17. • Low Friction Sales Model • Scalable, Capital – Efficient • Recurring Revenue • Diversification of Customer Concentration APIs are the Nexus of the Digital World
  • 18. Factors of a good API
  • 21. Pitfalls of Poor API Management
  • 22. Cost of Failures SOURCES: The State of API 2016. Smartbear. | The Cost of Poor Quality, QASymphony. Less Than 10% API issues resolved within 24 hours 1 in 4 Issues remain unresolved for one week or more $7,900 Per Minute estimated average cost of downtime 4% Average drop in stock price following a newsworthy failure
  • 23. Fundamentals of API Testing: The Root Issue
  • 25. | HELLO, REAL WORLD. Test Early; Test Often; Test Everything!
  • 27. | HELLO, REAL WORLD. Quality Jam LondonOctober 11, 2017 – The Brewery, London Email [email protected] to be entered to win a free ticket
  • 28. | HELLO, REAL WORLD. Quality Jam LondonOctober 11, 2017 – The Brewery, London Email [email protected] to be entered to win a free ticket
  • 29. Next Webinar RESTful API Testing Using Postman, Newman, and Jenkins October 4th, 2pm ET Register Now at QASymphony.com/resources
  • 30. Visit support.qasymphony.com See How Leading Organizations Use qTest APIs for Traceability, Test Automation, and Visibility

Editor's Notes

  • #2: BlackBox Testing – checking inuts and outputs WhiteBot Testing – internal operations testing – logic layer
  • #5: SOAP v REST – Postcard v. Envelope; Today we will only be focusing on REST ~75% of all public facing APIs
  • #6: Requests – simply way that is understood independent of original language or interpretation Manipulation – Create, modify, delete data Self-desctriptive – the Api request is complete as an entity and in itself can describe how it ca be processed Hypermedia – no other actions will be assumed besides those described REST Properties: Performance Scalability Simplicity Modifiability Reliability Additional non uniform contraints: Client-server separation Stateless Cacheable Layered Systems Code on demand
  • #11: Interface to the business Monetize digital assets Extend value proposition with partners Connect with more customers
  • #14: Realizing business value Google did not even consider google maps to be a core asset until it opened up its APIs and allowed third parties to show store locations IBM has set aside 1B to commercialize Watson’s potential through APIs
  • #15: Focusing on core competencies – save thousands of hours and $ Google maps for GPS Twilio for SMS notifications Braintree for Payment Processing Send Grid for email platform Core focus: Finding new drivers Finding new users Pricing Expanding to new cities
  • #16: TCM is our core competency APIs for Automation Stack, Performance testing, load testing, API testing etc Defect Management Requirement Management
  • #17: Shift from internal to external exchange of information
  • #18: SaaS Big Data Microservices AI Moving beyond single-application silos
  • #20: Applying psychology to APIs Create Manage Secure Analyze Scale
  • #23: Cost of a developer or QA.