SlideShare a Scribd company logo
WSO2 API Manager analytics
Chanaka Fernando
WSO2 Inc.
Agenda
• APIM Analytics architecture
• Analytics at API Publisher
• Analytics at API Store
• Log analysis
• Real time notifications
• Purging analytics data
APIM Analytics architecture
WSO2 Data Analytics Server
Data processing pipeline
Collect Data
- Define Data Model
- Specify Schema
- Pick a protocol
- Define a Receiver
- Push events
Analyze Data
- Select type of analysis
needed
- Create the relevant analytics
component
- Receive and analyze events
Communicate Results
- Define result stream
definition
- Create publisher & link to
output stream definition to
publisher
- Push results to publisher
APIM Analytics architecture
• Gateway publishes metadata events through thrift
protocol to Analytics component
• Analytics component stores the raw events in database
• Real-time processing component (siddhi runtime)
process these events and send notifications
• Stored events are processed by batch analytics scripts
(spark) and indexed by lucene and processed data
stored in a separate database
• API Publisher and Store retrieves this processed data
and show in the UI
API Publisher statistics
• Created APIs Over Time
• API Usage
• API Last Access Times
• Usage by Resource
Path
• Usage by Destination
• API Usage Comparison
• API Throttled Requests
• Faulty Invocations
• API Latency Time
• API Usage Across Geo
Locations
• API Usage Across User
Agent
• App Throttled Requests
API Publisher statistics
• Applications Created
Over Time
• API Subscriptions
• Developer Sign-ups
Over Time
• Subscriptions Created
Over Time
• API Usage per
Application
• Top Users per Application
• Resource Usage per
Application
• Faulty Invocations per
Application
• Availability of APIs
API Publisher Statistics Demo
API Store statistics
• API Usage: The usage of the API per application.
• Top Users: Users who make the most API invocations per application
and the number of registered users per application.
• Resource Usage: The usage of an API and from which resource path
per application.
• Faulty Invocations: The number of faulty API invocations per
application.In a faulty API invocation, the message is mediated though the
fault sequence. By default, the API Manager considers an API invocation to
be faulty when the backend service is unavailable.
API Store Statistics Demo
Analysing logs using APIM analytics
• Live log viewer
• Overview
• Application errors
• API Deployment stats
• Login errors
• Number of API failures
• Access token errors
Log analyser Demo
Real-time alerts
• Abnormal response time
• Abnormal backend time
• Abnormal request counts
• Abnormal resource access pattern
• Unseen source IP address
• Frequent tier limit hitting (tier crossing)
• Abnormal API usage
• Availability of APIs (health monitoring)
Purging analytics data
• Remove historical data from analytics tables
• Delete only the stream data generated from
APIM
• Using analytics management console
• Using configuration file

More Related Content

PDF
Wso2 api microgateway deployment patterns
Chanaka Fernando
 
PDF
Federated api management with wso2 api manager
Chanaka Fernando
 
PDF
Api management best practices with wso2 api manager
Chanaka Fernando
 
PDF
WSO2 API microgateway introduction
Chanaka Fernando
 
PDF
WSO2 Enterprise Integrator Deployment Patterns
WSO2
 
PDF
Stream Processing in Action
WSO2
 
PDF
How to Enable Monetization of Your API Ecosystem
WSO2
 
PDF
[WSO2Con EU 2018] WSO2 API Manager - Why, What, How, and What's Next
WSO2
 
Wso2 api microgateway deployment patterns
Chanaka Fernando
 
Federated api management with wso2 api manager
Chanaka Fernando
 
Api management best practices with wso2 api manager
Chanaka Fernando
 
WSO2 API microgateway introduction
Chanaka Fernando
 
WSO2 Enterprise Integrator Deployment Patterns
WSO2
 
Stream Processing in Action
WSO2
 
How to Enable Monetization of Your API Ecosystem
WSO2
 
[WSO2Con EU 2018] WSO2 API Manager - Why, What, How, and What's Next
WSO2
 

What's hot (20)

PDF
Miten API management toimii
Ambientia
 
PDF
Getting Started with the WSO2 manager
WSO2
 
PDF
WSO2 Product Release Webinar - Whats new in the WSO2 API Manager
WSO2
 
PDF
Getting Started with the WSO2 API Manager
WSO2
 
PDF
API Management 101: The New API Experience with WSO2
WSO2
 
PDF
API Design Essentials - Akana Platform Overview
Akana
 
PDF
Extend soa with api management Doag18
Vinay Kumar
 
PDF
Introducing WSO2 API Manager for Mobile Applications and Rapid Integration
WSO2
 
PDF
Partner Webinar: Why Is Open Source the Smartest Choice for Hybrid Integration?
WSO2
 
PDF
WSO2 Product Release Webinar Introducing WSO2 API Manager for Complete API ...
WSO2
 
PDF
Api centric enterprises
WSO2
 
PDF
How to Build, Manage, and Promote APIs
WSO2
 
PDF
Highlights of WSO2 API Manager 4.0.0
WSO2
 
PPTX
API Management Platform Technical Evaluation Framework
WSO2
 
PPTX
Multi-Tenant Hybrid Solution based on Hybrid Connections & App Service
Alexander Laysha
 
PPTX
Flavours of APIs
Chris Phillips
 
PDF
Explore the Latest on WSO2 Identity Server 5.11
WSO2
 
PDF
CIS14: Building a Plug-in with the PingAccess SDK
CloudIDSummit
 
PDF
Hybrid integration platform reference architecture
Chanaka Fernando
 
PDF
[WSO2 API Manager Community Call] Expose Services as Managed APIs
WSO2
 
Miten API management toimii
Ambientia
 
Getting Started with the WSO2 manager
WSO2
 
WSO2 Product Release Webinar - Whats new in the WSO2 API Manager
WSO2
 
Getting Started with the WSO2 API Manager
WSO2
 
API Management 101: The New API Experience with WSO2
WSO2
 
API Design Essentials - Akana Platform Overview
Akana
 
Extend soa with api management Doag18
Vinay Kumar
 
Introducing WSO2 API Manager for Mobile Applications and Rapid Integration
WSO2
 
Partner Webinar: Why Is Open Source the Smartest Choice for Hybrid Integration?
WSO2
 
WSO2 Product Release Webinar Introducing WSO2 API Manager for Complete API ...
WSO2
 
Api centric enterprises
WSO2
 
How to Build, Manage, and Promote APIs
WSO2
 
Highlights of WSO2 API Manager 4.0.0
WSO2
 
API Management Platform Technical Evaluation Framework
WSO2
 
Multi-Tenant Hybrid Solution based on Hybrid Connections & App Service
Alexander Laysha
 
Flavours of APIs
Chris Phillips
 
Explore the Latest on WSO2 Identity Server 5.11
WSO2
 
CIS14: Building a Plug-in with the PingAccess SDK
CloudIDSummit
 
Hybrid integration platform reference architecture
Chanaka Fernando
 
[WSO2 API Manager Community Call] Expose Services as Managed APIs
WSO2
 
Ad

Similar to Wso2 api manager analytics and reporting (20)

PDF
Azure Application insights - An Introduction
Matthias Güntert
 
PPTX
StatsCraft 2015: Introduction to monitoring - Yoav Abrahami and Mark Sonis
StatsCraft
 
PDF
API Economy, Realizing the Business Value of APIs
ColdFusionConference
 
PPTX
End user-experience monitoring
Site24x7
 
PPTX
API Design Best Practices & Tech Talk : API Craft Meetup @ Apigee
Anil Sagar
 
PPTX
Deep-Dive to Application Insights
Gunnar Peipman
 
PDF
Rocana Deep Dive OC Big Data Meetup #19 Sept 21st 2016
cdmaxime
 
PDF
(ATS6-PLAT04) Query service
BIOVIA
 
PPTX
Cloud monitoring with Applications Manager
ManageEngine, Zoho Corporation
 
PPTX
Smartone v1.0
Jinyean Tan
 
PDF
IBM Licensing: Technical fundamentals for discovery
Martin Thompson
 
PPTX
Maintaining the Front Door to Netflix
Benjamin Schmaus
 
PPTX
Hadoop Summit San Jose 2014 - Analyzing Historical Data of Applications on Ha...
Zhijie Shen
 
PPTX
Analyzing Historical Data of Applications on YARN for Fun and Profit
DataWorks Summit
 
PPTX
ATAGTR2017 Unified APM: The new age performance monitoring for production sys...
Agile Testing Alliance
 
PPTX
The cloud moved your monitoring cheese
Ken Ahrens
 
PPTX
Monitoring of distributed app hosted in Azure App Service
Alexander Laysha
 
PDF
How to Automate API Testing
Bruno Pedro
 
PPTX
Application performance monitoring with Applications Manager
ManageEngine, Zoho Corporation
 
Azure Application insights - An Introduction
Matthias Güntert
 
StatsCraft 2015: Introduction to monitoring - Yoav Abrahami and Mark Sonis
StatsCraft
 
API Economy, Realizing the Business Value of APIs
ColdFusionConference
 
End user-experience monitoring
Site24x7
 
API Design Best Practices & Tech Talk : API Craft Meetup @ Apigee
Anil Sagar
 
Deep-Dive to Application Insights
Gunnar Peipman
 
Rocana Deep Dive OC Big Data Meetup #19 Sept 21st 2016
cdmaxime
 
(ATS6-PLAT04) Query service
BIOVIA
 
Cloud monitoring with Applications Manager
ManageEngine, Zoho Corporation
 
Smartone v1.0
Jinyean Tan
 
IBM Licensing: Technical fundamentals for discovery
Martin Thompson
 
Maintaining the Front Door to Netflix
Benjamin Schmaus
 
Hadoop Summit San Jose 2014 - Analyzing Historical Data of Applications on Ha...
Zhijie Shen
 
Analyzing Historical Data of Applications on YARN for Fun and Profit
DataWorks Summit
 
ATAGTR2017 Unified APM: The new age performance monitoring for production sys...
Agile Testing Alliance
 
The cloud moved your monitoring cheese
Ken Ahrens
 
Monitoring of distributed app hosted in Azure App Service
Alexander Laysha
 
How to Automate API Testing
Bruno Pedro
 
Application performance monitoring with Applications Manager
ManageEngine, Zoho Corporation
 
Ad

More from Chanaka Fernando (12)

PDF
Designing microservices platforms with nats
Chanaka Fernando
 
PDF
Wso2 enterprise integrator deployment patterns
Chanaka Fernando
 
PDF
Exploring ballerina toolset (docker, testing, tracing, analytics, and more) ...
Chanaka Fernando
 
PDF
File processing and websockets with ballerina chanaka edited
Chanaka Fernando
 
PDF
Wso2 esb-rest-integration
Chanaka Fernando
 
PDF
Wso2 integration platform deep dive eu con 2016
Chanaka Fernando
 
PDF
Wso2 esb-maintenance-guide
Chanaka Fernando
 
PDF
Advaced training-wso2-esb
Chanaka Fernando
 
PDF
Wso2 con eu 2016 an introduction to the wso2 integration platform by chanak...
Chanaka Fernando
 
PDF
Esb 4.9.0 release webinar
Chanaka Fernando
 
PDF
Wso2 esb 5.0.0 product release webinar
Chanaka Fernando
 
PDF
Introduction to WSO2 ESB Pass-Through Transport
Chanaka Fernando
 
Designing microservices platforms with nats
Chanaka Fernando
 
Wso2 enterprise integrator deployment patterns
Chanaka Fernando
 
Exploring ballerina toolset (docker, testing, tracing, analytics, and more) ...
Chanaka Fernando
 
File processing and websockets with ballerina chanaka edited
Chanaka Fernando
 
Wso2 esb-rest-integration
Chanaka Fernando
 
Wso2 integration platform deep dive eu con 2016
Chanaka Fernando
 
Wso2 esb-maintenance-guide
Chanaka Fernando
 
Advaced training-wso2-esb
Chanaka Fernando
 
Wso2 con eu 2016 an introduction to the wso2 integration platform by chanak...
Chanaka Fernando
 
Esb 4.9.0 release webinar
Chanaka Fernando
 
Wso2 esb 5.0.0 product release webinar
Chanaka Fernando
 
Introduction to WSO2 ESB Pass-Through Transport
Chanaka Fernando
 

Recently uploaded (20)

PDF
Get More from Fiori Automation - What’s New, What Works, and What’s Next.pdf
Precisely
 
PPTX
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
PDF
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
Artjoker Software Development Company
 
PDF
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
 
PDF
The Future of Mobile Is Context-Aware—Are You Ready?
iProgrammer Solutions Private Limited
 
PDF
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
PPTX
AI in Daily Life: How Artificial Intelligence Helps Us Every Day
vanshrpatil7
 
PDF
CIFDAQ's Market Wrap : Bears Back in Control?
CIFDAQ
 
PDF
Presentation about Hardware and Software in Computer
snehamodhawadiya
 
PDF
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
PPTX
The-Ethical-Hackers-Imperative-Safeguarding-the-Digital-Frontier.pptx
sujalchauhan1305
 
PDF
A Day in the Life of Location Data - Turning Where into How.pdf
Precisely
 
PDF
A Strategic Analysis of the MVNO Wave in Emerging Markets.pdf
IPLOOK Networks
 
PDF
Unlocking the Future- AI Agents Meet Oracle Database 23ai - AIOUG Yatra 2025.pdf
Sandesh Rao
 
PDF
BLW VOCATIONAL TRAINING SUMMER INTERNSHIP REPORT
codernjn73
 
PDF
Event Presentation Google Cloud Next Extended 2025
minhtrietgect
 
PDF
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
PPTX
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
 
PDF
Security features in Dell, HP, and Lenovo PC systems: A research-based compar...
Principled Technologies
 
PDF
Google I/O Extended 2025 Baku - all ppts
HusseinMalikMammadli
 
Get More from Fiori Automation - What’s New, What Works, and What’s Next.pdf
Precisely
 
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
Artjoker Software Development Company
 
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
 
The Future of Mobile Is Context-Aware—Are You Ready?
iProgrammer Solutions Private Limited
 
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
AI in Daily Life: How Artificial Intelligence Helps Us Every Day
vanshrpatil7
 
CIFDAQ's Market Wrap : Bears Back in Control?
CIFDAQ
 
Presentation about Hardware and Software in Computer
snehamodhawadiya
 
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
The-Ethical-Hackers-Imperative-Safeguarding-the-Digital-Frontier.pptx
sujalchauhan1305
 
A Day in the Life of Location Data - Turning Where into How.pdf
Precisely
 
A Strategic Analysis of the MVNO Wave in Emerging Markets.pdf
IPLOOK Networks
 
Unlocking the Future- AI Agents Meet Oracle Database 23ai - AIOUG Yatra 2025.pdf
Sandesh Rao
 
BLW VOCATIONAL TRAINING SUMMER INTERNSHIP REPORT
codernjn73
 
Event Presentation Google Cloud Next Extended 2025
minhtrietgect
 
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
 
Security features in Dell, HP, and Lenovo PC systems: A research-based compar...
Principled Technologies
 
Google I/O Extended 2025 Baku - all ppts
HusseinMalikMammadli
 

Wso2 api manager analytics and reporting

  • 1. WSO2 API Manager analytics Chanaka Fernando WSO2 Inc.
  • 2. Agenda • APIM Analytics architecture • Analytics at API Publisher • Analytics at API Store • Log analysis • Real time notifications • Purging analytics data
  • 5. Data processing pipeline Collect Data - Define Data Model - Specify Schema - Pick a protocol - Define a Receiver - Push events Analyze Data - Select type of analysis needed - Create the relevant analytics component - Receive and analyze events Communicate Results - Define result stream definition - Create publisher & link to output stream definition to publisher - Push results to publisher
  • 6. APIM Analytics architecture • Gateway publishes metadata events through thrift protocol to Analytics component • Analytics component stores the raw events in database • Real-time processing component (siddhi runtime) process these events and send notifications • Stored events are processed by batch analytics scripts (spark) and indexed by lucene and processed data stored in a separate database • API Publisher and Store retrieves this processed data and show in the UI
  • 7. API Publisher statistics • Created APIs Over Time • API Usage • API Last Access Times • Usage by Resource Path • Usage by Destination • API Usage Comparison • API Throttled Requests • Faulty Invocations • API Latency Time • API Usage Across Geo Locations • API Usage Across User Agent • App Throttled Requests
  • 8. API Publisher statistics • Applications Created Over Time • API Subscriptions • Developer Sign-ups Over Time • Subscriptions Created Over Time • API Usage per Application • Top Users per Application • Resource Usage per Application • Faulty Invocations per Application • Availability of APIs
  • 10. API Store statistics • API Usage: The usage of the API per application. • Top Users: Users who make the most API invocations per application and the number of registered users per application. • Resource Usage: The usage of an API and from which resource path per application. • Faulty Invocations: The number of faulty API invocations per application.In a faulty API invocation, the message is mediated though the fault sequence. By default, the API Manager considers an API invocation to be faulty when the backend service is unavailable.
  • 12. Analysing logs using APIM analytics • Live log viewer • Overview • Application errors • API Deployment stats • Login errors • Number of API failures • Access token errors
  • 14. Real-time alerts • Abnormal response time • Abnormal backend time • Abnormal request counts • Abnormal resource access pattern • Unseen source IP address • Frequent tier limit hitting (tier crossing) • Abnormal API usage • Availability of APIs (health monitoring)
  • 15. Purging analytics data • Remove historical data from analytics tables • Delete only the stream data generated from APIM • Using analytics management console • Using configuration file