2022 02 Integration Bootcamp
Download as PPTX, PDF0 likes337 views
Log Analytics and Application Insights can help with monitoring and managing integration solutions built with Microsoft technologies. They provide performance monitoring of APIs, functions, logic apps and other components. While end-to-end tracing has some limitations, the tools allow for custom logging, out-of-box views of data, and testing the availability of key applications and services.
2022 02 Integration Bootcamp
- 2. App Insights & Log Analytics for Integration Solutions
- 3. About me • Microsoft MVP 12 years • Freelance Cloud Architect • Based in Newcastle, UK • https://mikestephenson.me/ • @Michael_Stephen
- 4. “How can Log Analytics and App Insights help me to build supportable integration solutions?”
- 5. What have we been up to Business • Dozens of projects • Multi-Year investment in Microsoft IPaaS • EAI Platform = Microsoft iPaaS • EDMS Platform = Microsoft Data Platform • SAP / Power Platform / Power BI / Workday / IBM Maximo / Most of the main application platforms Technical • Environments - 5 • Resources (Across all environments) • Logic Apps – 1895 • Function Apps – 116 • Integration Account – 5 • APIM – 5 • Service Bus • Event Grid • Event Hub • Synapse
- 6. ETL & ELT Security & Governance Enterprise Integration Platform Durable Messaging Data Transformation Helper Functions Storage Hybrid EAI API Enterprise Scenarios Business Rules System Workflow Human Workflow Business Users B2B Integration Management & Monitoring Power BI API Management Data Factory Key Vault Logic Apps Logic Apps Integration Account Integration Account Power Automate Azure Functions Service Bus Logic Apps Azure Functions Advisor Security Centre Storage Azure SQL DB Logic App Inline Code Data Gateway Power App Integration Services Environment Enterprise Connectors Azure Monitor Application Insights Application Configuration Cosmos DB Azure Functions Log Analytics Synapse Pipelines
- 7. Customer Manager Transport Manager Finance Manager Storage Yard Customer Scenario: Petrochemical Plant Produces Product and Ships to Customers in railcars
- 8. Customer Manager Transport Manager Finance Manager Storage Yard Customer The plant is making product and sends notifications about what it makes Plant Production
- 9. Customer Manager Transport Manager Finance Manager Storage Yard Customer Railcar gets loaded with product Loading Railcars Send notification
- 10. Customer Manager Transport Manager Finance Manager Storage Yard Customer Shipping Notification Send Shipping Railcars Can I have 1 railcar please Dispatch 1 railcar for order 1234
- 11. Customer Manager Transport Manager Finance Manager Storage Yard Customer Send shipping updates Shipping Status Updates Railcar Delivered Thanks I've got it
- 12. Plant Measurement Data Railcar Loaded Railcar Shipped Railcar Shipping Status Railcar Delivered Synapse (EDMS) Cosmos DB Dataverse Transport System
- 13. Plant Measurement Data Synapse EDMS Platform EAI Platform API Mgmt API Functions Processor Functions Cosmos DB Dataverse Transport System Logic Apps
- 14. API Management ms-bootcamp-apim API Backend Functions ms-bootcamp-func-api Service Bus Processor Functions ms-bootcamp-func-edmslink Logic App Standard ms-bootcamp-logicapp ms-bootcamp-apim Logic App Consumption Railcar-Loaded-Receiver ms-bootcamp-logs ms-bootcamp-logicapp ms-bootcamp-func-api ms-bootcamp-func-edmslink
- 15. Performance & Load Monitoring
- 16. How can we view the performance and load of my integration solution
- 17. Plant Measurement Data Synapse (EDMS)
- 18. Plant Measurement Data Synapse Plant Measurement Data EDMS Platform EAI Platform API Mgmt API Functions Processor Functions
- 19. Recap • API Management • Easy to configure App Insights on API Settings • API Backend in Functions • Using the ILogger sends data to App Insights • Set instrumentation key • Service Bus Processor Functions • Using the ILogger sends data to App Insights • Set instrumentation key
- 20. End to End Tracing
- 21. We have lots of components how can we trace activity across these components
- 22. Railcar Loaded Railcar Shipping Status Railcar Delivered Synapse (EDMS) Cosmos DB Dataverse Transport System
- 23. Plant Measurement Data EAI Platform API Mgmt API Functions CONSUMPTION Logic App Cosmos DB Dataverse Transport System STANDARD Logic App API Helpers
- 25. Its easy to use, but there is a lot of complicated logging data. What if I just want some simple log messages to help me
- 26. Railcar Loaded Synapse (EDMS) Cosmos DB Dataverse Transport System
- 27. Plant Measurement Data EAI Platform API Mgmt API Functions CONSUMPTION Logic App Cosmos DB Dataverse Transport System STANDARD Logic App API Helpers
- 28. Views on your Data
- 30. APIM ms-bootcamp-apim ms-bootcamp-logs Logic App Standard ms-bootcamp-logicapp API Functions ms-bootcamp-func-api Background Functions ms-bootcamp-func-edmslink Log Data Railcar Tracking APIM Overview Logic App Functions Overview Management Availability & SLA Dashboard
- 32. “How do I know if all of the key apps and services in my architecture are available”?
- 33. API Mgmt API Functions Test Service Bus via Logic App Health Ping Background Functions Test Logic App Test Dataverse via Logic App SAP Test Management Availability & SLA Dashboard
- 34. Summary • There’s lots of ways I can use Log Analytics and App Insights • There are a couple of limitations in end to end tracing • Be careful on the amount of data you log $$ • The data can help day to day troubleshooting • I can get lots of views on the performance of my system
- 35. More Info • Logic App Consumption + Log Analytics Out of the Box • https://www.integration-playbook.io/docs/log-analytics-out-of-the-box • Logic App + Log Analytics Custom Logging • https://www.integration-playbook.io/docs/log-analytics-data-collector-api • Logic Apps + App Insights • https://www.integration-playbook.io/docs/app-insights-with-logicapps • Logic Apps + APIM App Insights • https://www.mikestephenson.me/2021/05/01/looking-at-logic-app-use-of-apim-in-app-insights-logs/ • Deep Dive on App Insights & Log Analytics from Integrate 2021 Video • https://www.biztalk360.com/integrate-2021-remote/ (Look for my video)
- 36. Questions