Event mesh APIDays melbourne September 2019
Download as PPTX, PDF•1 like•93 views
The document discusses the evolution of payment architecture towards asynchronous and event-driven APIs, emphasizing the need for agility in digital business solutions. It highlights how traditional payment systems struggle with slow response times due to serial orchestration and presents event-driven microservices as a solution for improved speed and flexibility. Key concepts include the use of event meshes, topic routing, and wildcards for more efficient communication between microservices.
Event mesh APIDays melbourne September 2019
- 1. Making Interactions Responsive and Agile With Asynchronous and Event Driven APIs API Days, Melbourne 2019 Phil Scanlon APJ Head of Field Technology, Solace
- 2. Payments – Then vs Now H I G H V A L U E L O W V O L U M E T + 3 S E T T L E M E N T S O A , A T B E S T S I L O E D A M O N G S T P R O V I D E R S M U L T I Y E A R P R O J E C T S R E A L T I M E L O W V A L U E H I G H V O L U M E E V E N T D R I V E N F O D D E R F O R A I / M L A P I O R I E N T E D A G I L I T Y N E E D E D – I M P L E M E N T Q R C O D E I N W E E K S © Solace Proprietary & Confidential 2014 2019
- 3. Gartner – Key Trends in PaaS and Platform Architecture 2019
- 4. The Shift to Event Driven is Accelerating! 4 © Solace By 2022, 70% of new digital business solutions will require event-sourced, real-time situational awareness - Gartner Gartner: Top 10 Strategic Technology Trends for 2018: Event-Driven Model. 8 March 2018 Event-driven microservices are the optimal software design model to delivery digital business agility.
- 5. • iPaaS, Integration & API Platform • • Eventing Gartner Hybrid Integration Platform – Event Streaming Platform
- 6. Advanced Event Brokers Distributed Event Brokers Smart Routing Edge Fanout Guaranteed Delivery Network Optimization Pub Sub | Streaming Filtering | Queuing Adapters | Connectors Replay Public Cloud Private Cloud PaaS Hybrid Cloud REST AMQP JMS MQTT WebSockets Connectors Zero downtime Zero data loss Governance Security Burst Handling High Performance
- 7. An event mesh is an architectural layer that routes events from producers to consumers in a flexible, reliable and governed manner, no matter where your apps are deployed. Event Mesh API Platform REST MQTT AMQP
- 8. Challenges: Orchestrator is a bottleneck Serial = slow response time Slow time to market Difficult to leverage AI/ML – requires big changes Cloud adoption challenges APIs 1.0 - SOA and it’s challenges API GW ESB Validations Fraud Check Credit Check Core Banking Systems of Records Tracing Audit Logging Ops Clearing GWs SWIFT GW Other GWs Compliance Reg Reporting Risk SOAP/HTTP SOAP MQ MQ JMS Adapter Channels Cloud Native Storage Cloud Native Services AI ML New Services ? ? Slow causes response time impact, errors Response time is a summation of all services!
- 9. Internal APIs Microservices Lets look at a traditional payment API architecture Database as astate machine Invoke Initiation API Difficult to Change Validation Funding Risk Clearing Settlement Slow Response Time
- 10. Traditional payments architecture – decomposed further By Country Complex, Non Agile, Not API Friendly By Payment Type By Channel By Client Type Rethinking Payment Architecture - microservices and APIs? • Move away from database as astate machine • REST based microservices • Loosely coupled, better agility Invoke API Validation Funding Risk Clearing Settlement • However, Serial Orchestration – REST, so still slow response time • Fixed Choreography 0.1s 0.1s 0.1s FX 0.2s 2s 3s 5.5s
- 11. Can we get better agility? Topic Routing and Wildcards
- 12. Event Routing – the power of topics and wildcards * > # + Events have Topics: pay/init/sg/v1/qr/ocbc/casa/taxi/comfort REST URL = Topic: https://host:port/ pay/init/sg/v1/qr/ocbc/casa/taxi/comfort Events have payload: Binary | JSON| XML | Images |Anything Events can be subscribed: Wildcards: pay/> All payments – for system of record pay/init/*/v1/qr/> all payments initializations via QR for version 1 pay/clear/sg/v1/*/ocbc/> All payments clearing for OCBC gateway
- 13. Event Driven Microservices pay/valid/sg/v1/qr/ocbc/casapay/init/sg/v1/qr/> • Microservices process fine grained business logic • Microservices consume the events they can process • Microservices produce events Validation REST AMQP Event Routing with wildcards, Event Catalog Agility
- 14. QR Code support for WePay in days! pay/settle/sg/*/*/wepay/> REST DBS GW pay/settle/sg/*/*/dbs/> pay/settle/sg/*/*/ocbc/> UOB GW OCBC GW WeChat GW JMS AMQP REST MQTT pay/settle/sg/*/*/uob/> APIGW
- 15. How about Response Time? Eventual Consistency and Deferred Execution Identify the “Inline Path”, isolate the rest - Waiter Pattern 10x faster Response Time! Consistent Response Time Burst HandlingviaSlow consumer Isolation Invoke API Can Be Async, ParallelMust Be Sync, Serial AI/ML DataWarehouse Audit, Logging Others Core Business Logic Persistent Delivery Request Reply Every flow has some serial and some parallel paths à Only serial path should influence response time Pub Sub Streaming and Queuing as Lego Blocks – Eventual Consistency, Deferred Execution 0.1s 0.1s 0.1s 0.2s 2s 3s 0.5s!
- 16. Deferred Execution, Eventual Consistency, Parallel Processing Pub Sub – Parallel Event Routing Guaranteed Delivery Persistent Delivery Request Reply Parallel Processing= Event Better Throughput
- 17. Demo
- 18. Event Enabled Pricing - Callbacks Price Change EVENT ESB API Expose Price EVENT API AMQP Subscribe for Price Update EVENT Price change is an EVENT Pushed - But it is exposed as a Request Reply API – which is required Real Time – interested downstream apps subscribe to events of interest. When event happens, Event Mesh pushes it to interested applications Burst Handling – Event Mesh “Queues” and ”Throttles” events during burst Cost Effective to Scale – scale for average, rather than peak An “async” API would be better for events than “sync” APIs MQTT Subscribe for Price Update EVENT REST Webhook Subscribe for Price Update EVENT Publish Event to the Event Mesh Also exposed Request Reply APIs
- 19. External APIs
- 20. B. AsyncAPI is to Events what OpenAPI is to RESTful APIs
- 21. B. AsyncAPI - OpenAPI… AsyncAPI OpenAPI Specification Swagger Codegen Generated Code Async Specification AsyncAPI Codegen SynchronousAsynchronous … HTTP amqp, amqps, mqtt, mqtts, ws, wss Generated Code Runtime Protocol Runtime Protocol
- 22. Demo
- 23. And the full stack
- 24. © Platform Universe Proprietary & Confidential Front-End Frameworks Platform Universe Platform Universe Components with Open API Kernel UM Atomic Services Scheduling Mission Control DACM Configuration Management OCP Automated Operation ServicePortal RAPM Resource & App Monitoring Log Center Diagnosis PlatformGateway API Gateway Mobile App 3rd Party Platforms Containerized Microservice Application Framework Service Governance Event Gateway Event Governance Mini App HTML5WEB PaaS DB SQL / NON Load Balancer L4 / L7 Storage File / Object Distributed Location Service Distributed Transaction Service Big Data Service and Event Mesh Open API
- 26. Be Event Driven Phil Scanlon– APJ Head of Field Technology [email protected]
Editor's Notes
- #2: Talk Title: Async API’s, Event Mesh and the Event Portal – Real time responsive API: Simple, Modern, Governed Abstract: How data moves to and from applications is critical to the application's health and function, but it's a decision that's often-given little thought: REST-over-HTTP of course. But REST/HTTP based communication can limit the performance and functionality of modern applications and architectures – it is not a communication pattern well-suited for event-driven microservices, or for IoT and hybrid cloud use cases. This talk will explore how modern event brokers improve over today’s API approach by enabling real-time, bidirectional communication between and inside applications, across data centres, clouds and continents using the publish-subscribe architecture pattern. It will highlight key capabilities of an event broker for different use cases, and discuss features to look for such as AsyncAPI to help easily integrate with your existing DevOps tooling. You'll walk away from the session with a thorough understanding of event brokers and how to use them to enable modern apps and architectures.
- #8: Insert animated diagram on the next slide, let’s have it play on a loop while Shawn explains the concept.