[WSO2 Integration Summit San Francisco 2019] Cloud-native Integration for the Enterprise
0 likes•378 views
The Integration Summit 2019 discusses cloud-native integration frameworks that use microservices or serverless functions for application integration, emphasizing the complexities of inter-service communication and the necessity of supporting various protocols. Key features of modern integration tools include resiliency patterns, message delivery semantics, and support for complex type conversions. WSO2's integration solutions, such as the Enterprise Integrator and Ballerina, offer a code-driven and graphical approach to streamline the integration process in cloud-native environments.
[WSO2 Integration Summit San Francisco 2019] Cloud-native Integration for the Enterprise
- 1. INTEGRATION SUMMIT 2019 Cloud-native Integration for the Enterprise Kasun Indrasiri Senior Director - Integration Architecture INTEGRATION
- 2. INTEGRATION SUMMIT 2019 Cloud Native? ● Cloud native apps are composed of microservices or serverless functions ● Packaged in containers. ● Runs on a Continuous Delivery model. ● Dynamically Managed in Cloud
- 3. INTEGRATION SUMMIT 2019 Application Integration ● Cloud native application ○ A set of interconnected microservices or serverless functions Source : https://www.jitterbit.com/blog/integrating-the-modern-hybrid-cloud-architecture/
- 4. INTEGRATION SUMMIT 2019 Centralized/ESB-style Integration ● Using an ESB for integration. ● API Gateway to expose your APIs Data API Management ESB Applications and Services Systems
- 5. INTEGRATION SUMMIT 2019 Microservices - ‘Smart-endpoints and Dumb Pipes’ Integration is everywhere! API Management μ service-A μ service-B Event Broker μ service-C μ service-F μ service-D Proprietary & Legacy System Web APIs/SaaS μ service-E
- 6. INTEGRATION SUMMIT 2019 Reinventing P2P? ● Back to ‘point-to-point’ integration again?
- 7. INTEGRATION SUMMIT 2019 Integrating Microservices is hard! ● Inter-service communication is essential. ● Capabilities that ESB provided has to be implemented at each service level. ● Integration complexity is not reduced but dispersed across services. ● Proliferation of services makes it even more harder.
- 8. INTEGRATION SUMMIT 2019 Service Mesh vs Integration ● Service Mesh : An application network infrastructure to build cloud native apps. Source : https://www.infoq.com/minibooks/service-mesh/
- 9. INTEGRATION SUMMIT 2019 Cloud Native Integration
- 10. INTEGRATION SUMMIT 2019 Cloud Native Integration Consumer 1 API Service P API ServiceQ API ServiceR API ServiceS Consumers Consumer 2 Consumer 3 μ Service A Event Bus Proprietary & Legacy Systems Web API / SaaS API Services/ Edge Services Composite Service/ Integration Services Core Services/ Atomic Services μ Service I μ Service H μ Service J μ Service E μ Service C μ Service D μ Service G μ Service B API Management API Gateway
- 11. INTEGRATION SUMMIT 2019 Features of a Cloud Native Integration Framework
- 12. INTEGRATION SUMMIT 2019 Abstractions for Inter-Service communication ● Supporting high-level abstractions for inter-service communication. ● Support for multiple protocols and standards. ○ HTTP, gRPC, GraphQL, Web Sockets, Web Hooks, SOAP ○ Kafka, NATS, AMQP ○ FTP, SFTP ○ TCP, Rsocket ● Integrating with SaaS, proprietary and legacy systems ○ e.g. Salesforce, SAP, Amazon S3, SQS
- 13. INTEGRATION SUMMIT 2019 Service Composition Patterns ● Service Orchestrations/Active Compositions ● Service Choreography/Reactive Compositions ● Event Sourcing ● CQRS
- 14. INTEGRATION SUMMIT 2019 Kubernetes Native ● Runs natively within Docker and K8s. ● Fast startup time and low resource consumption. ● Application specific abstraction for Kubernetes ○ Operator to manage the application on K8s. ○ Stateful apps.
- 15. INTEGRATION SUMMIT 2019 Enabling common Integration Patterns ● Forking, Joining, Splitting, Looping, and Aggregation of messages or service calls. ● Some of the Enterprise Integration Patterns (EIPs) are now implemented at each smart endpoint. Source : https://www.enterpriseintegrationpatterns.com/patterns/messaging/ComposedMessagingWS.html
- 16. INTEGRATION SUMMIT 2019 Resiliency ● Network is unreliable.. Now and forever! ● Not all apps runs on top of a service mesh ● Resiliency may be coupled to the business logic of the service ● Patterns ○ Timeout, Retry, Circuit Breaker, Fail-fast, Bulkhead Source : https://martinfowler.com/bliki/CircuitBreaker.html
- 17. INTEGRATION SUMMIT 2019 Message Delivery Semantics ● Store and forward. ● Persistent delivery. ● Idempotent messaging Source : https://medium.com/@jaykreps/exactly-once-support-in-apache-kafka-55e1fdd0a35f
- 18. INTEGRATION SUMMIT 2019 Complex Type Conversions ● Message type mapping and transformations. ● Native support for message formats : JSON, XML, ProtoBuf, Avro ● Implemented graphically or programmatically.
- 19. INTEGRATION SUMMIT 2019 Event Oriented Architecture and Streams ● Consume a stream of events and produce a resulting event stream ● Event store backbone - Kafka, NATS ● Streaming SQL Source : https://kafka.apache.org/
- 20. INTEGRATION SUMMIT 2019 Workflows and SAGA ● Long running processes stateful processes. ● Compensation and distributed transactions - SAGA Source :Microservices for the Enterprise
- 21. INTEGRATION SUMMIT 2019 How WSO2 helps?
- 22. INTEGRATION SUMMIT 2019 WSO2 Enterprise Integrator 7.0 ● An API-centric, cloud-native integration platform.
- 23. INTEGRATION SUMMIT 2019 Ballerina Integrator A powerful, simple-to-learn, code-driven approach to programmingintegrations based on the Ballerina programming language. WSO2 Enterprise Integrator - Components Micro Integrator An intuitive low-code configuration driven integrator with a graphical drag and drop designer based on the same WSO2 EI/ESB runtime. Streaming Integrator Streaming Integrator can connect any event stream to any destination and act on streaming data using Micro Integrator.
- 24. INTEGRATION SUMMIT 2019 Ballerina Integrator ● A powerful, simple-to-learn, code-drivenapproach to programming integrations based on the Ballerina. ● Ballerina Integrator ○ Ballerina + Connectors + Integration templates/samples +Documentation + Dev tools
- 25. INTEGRATION SUMMIT 2019 Micro Integrator • Based on the same WSO2 EI/ESB runtime. • Low-code, config-driven and graphical data flow-driven integration. • Cloud native, K8s operator • Composition – All capabilities of EI 6.5 except Management console and clustering. • Backward compatible with existing EI projects.
- 26. INTEGRATION SUMMIT 2019 Streaming Integration ● A cloud-native, lightweight streaming integrator that understands streaming SQL queries to capture, analyze, process, and act on events in real-time.
- 27. INTEGRATION SUMMIT 2019 Conclusion ● Application integration is everywhere. ● Service Mesh is not for application integration. ● Selecting the best of breed technologies for application integration is vital.
- 29. INTEGRATION SUMMIT 2019 THANK YOU wso2.com