Open Source Integration with WSO2 Enterprise Service Bus
- 1. Leveraging Open Source Integration with WSO2 Enterprise Service Bus Sumedha Rubasinghe 2009 Air Force Information Technology Conference Montgomery, Atlanta
- 2. Agenda The Need Introduction Features Important Concepts Extendibility Performance Use cases Getting started & Help 2
- 3. 3
- 4. 4
- 5. 5
- 6. 6
- 7. 7
- 8. Busbar 8
- 9. 9
- 10. Introducing Mattson ... Hi.. Mattson here.. I am an architect 10
- 11. So.. What is WSO2 ESB? 11
- 12. WSO2 Enterprise Service Bus A fast,Light weight, easy-to-use Enterprise Service Bus product Open source product with commercial support (if required) Released with business friendly Apache License 2.0 Based on Apache Synapse Customizable to match the needs of your Enterprise 12
- 13. wait.. What is Apache Synapse? How is it related to WSO2 ESB? 13
- 14. Apache Synapse & WSO2 ESB Leading project developed by Apache community Some of the key committers with in WSO2 WSO2 ESB is built on top of Apache Synapse Synapse provides the core mediation capabilities WSO2 ESB uses Synapse's configuration language 14
- 15. Screenshots 15
- 16. Screen shots 16
- 17. Screen shots 17
- 18. In what type of scenarios Can I use WSO2 ESB? 18
- 19. Usage scenarios Link legacy files to messaging based systems Transform CSV or EDI formats to XML Act as a high-performance XML Gateway Content-based routing and creating virtual services Integrate FIX based trading systems with XML and non-XML backends Log, trace and audit live systems 19
- 20. Tell me some of the main features of WSO2 ESB 20
- 21. WSO2 ESB Features Message Routing Message Transformation & Mapping Scheduled Tasks Orchestration Protocol Switching Transaction Support Eventing 21
- 22. Message Routing Act as a simple Proxy 22
- 23. Message Routing Content based routing 23
- 24. Message Transformation & Mapping XSLT 24
- 25. Message Transformation & Mapping XQuery 25
- 26. Message Transformation & Mapping E4X 26
- 27. Message Transformation & Mapping Support for different file formats – EDI – flat files – CSV – COBOL/Record 27
- 28. Tasks Allow the ESB to initiate work on a timed basis Cron/simple interval Write your own tasks 28
- 29. Orchestration Aggregate 29
- 30. Orchestration Disaggregate 30
- 31. Orchestration Callout 31
- 32. Orchestration If/Then/Else 32
- 33. Orchestration BPEL Feature plug-in – Adds BPS capabilities into ESB 33
- 34. interesting... 34
- 35. Protocol Support 35
- 36. Protocol Support File, (S)FTP, HTTP(S), REST, Hessian, JSON SOAP JMS – MQSeries, AMQP/ Apache Qpid,Apache ActiveMQ – Transactional support Email, XMPP,FIX,TCP 36
- 37. Rule based Mediation Drools 37
- 38. Many more features ... Load balancing Fail-over handling Caching / Throttling Registry based Clustering WS-Reliable Messaging FIX CEP (Complex Event Processing) and many more.... 38
- 39. What if I want more? Can I extend WSO2 ESB? Yes.. you can.. Just write a mediator.. 39
- 40. Mediator ..!! what is that? 40
- 41. Important concept - Mediator • Basic component of ESB • Mediates messages going through • Core mediators – Send, Drop, Log, Property • Filter mediators – Filter, Switch, Validate, Throttle, In, Out • Transformation mediators – XSLT, Header, Fault, XQuery • Advanced mediators – Clone, Cache, Aggregate, DBLookup, Callout 41
- 42. Important concept – Send Mediator • Used to send out the messages • Used in almost all the cases • Wrapped an endpoint – if no endpoint is specified, anonymous 'To' address will be taken as the EPR 42
- 43. Important concept – Sequence • Special mediator – List of mediators to be executed in an order • Pipeline pattern • Special sequences – main – fault 43
- 44. Important concept – operation modes • Act as a proxy • Main Sequence – If none of the proxy services matches the request pattern 44
- 45. I would like to have few more mediator examples.. 45
- 46. Extendibility – Java Mediator • Class implementing the Mediator interface – Or AbstractMediator class – Custom mediator is executed through the ClassMediator in ESB – Corresponding setter methods in the custom class will be set before executing the custom mediator if any properties are specified 46
- 47. Extendibility - POJOCommand • Extends the mediation capabilities using the well known command pattern – Class implementing the Command interface or a POJO with a void execute() method – execute() method will be invoked using the Command interface or by using reflection – Sets the properties before execution and retrieves the properties after execution 47
- 48. Extendibility – Script Mediator • Enables scripting for extending mediation • Supports all the Apache BSF scripting languages – JRuby, Jython, Groovy, Java Script • Embed the script inline or can be referred to a separate script file with the function name to be executed 48
- 49. Extendibility – Spring Mediator • Spring configurations to extend the mediation • Spring bean must implement the Mediator interface • Refer to the spring application context using the key • The Spring bean is managed by the spring context at mediation time 49
- 50. Extending WSO2 ESB Registry as a repository – Loading configuration from external registry New Transports 50
- 51. So how does all of these fit together?... What happens with-in WSO2 ESB? 51
- 52. Architecture 52
- 53. Runtime 53
- 54. Deployment 54
- 55. Performance Completely asynchronous architecture internally Streaming support for messages 100% error free and zero memory leaks under heavy load Up to 4500tps out-of-the-box for proxying – Intel(R) Xeon(TM) 3.20GHz 2MB Cache – Dual Core - 2 CPU system – 2GB RAM – 1Gb Ethernet http://wso2.org/library/3740 55
- 56. Performance http://wso2.org/library/3740 56
- 57. Non-Blocking IO Synapse Incoming req Request Thread1 processing Outgoing req Socket open Socket open TIME TIME TIME TIME Incoming resp Response Thread2 processing Outgoing resp This model means: 1. Synapse threads never blocked during normal processing 2. Number of sockets open >> number of threads 57
- 58. Monitoring Monitor System statistics Running logs Message Tracing Dynamically configurable Logger Exposes statistics via JMX Dashboard – Google Gadgets 58
- 59. I would like to see some Use cases where all of these are applied... 59
- 60. Use Case 1 • Problem – I want to send a notification email whenever there is a request to a particular service which satisfies a set of conditions over the request • Solution – Filter the messages over the request and evaluate the conditions – If the conditions evaluate to true then clone the message – Send the request to the desired endpoint while forwarding a copy (may be after transformation) 60 through the mail transport
- 61. Use Case 1 61
- 62. Use Case 1 - configuration 62
- 63. Use Case 2 • Problem – I have a service exposed over HTTP transport and now I want the same service to be accessed through JMS • Solution – Expose a proxy service with JMS (and what ever transport) and switch the transport to HTTP (if not http) – Invoke the actual service with HTTP transport – Switch the transport back to JMS of the response message 63
- 64. Use Case 2 64
- 65. Use Case 2 - Configuration 65
- 66. Use Case 3 • Problem – I want the ESB to invoke several services of the same type for a request, evaluate all the responses and respond me with the best one • Solution – Clone the message and send the requests to different endpoints – Get the responses from all services and aggregate the responses – Select the best out of the aggregated responses and respond to the client 66
- 67. Use Case 3 67
- 68. Use Case 3 - Configuration 68
- 69. Use Case 3 - Configuration 69
- 70. Use Case 3 - Configuration 70
- 71. Use Case 3 - Configuration 71
- 72. Use Case 3 - Configuration 72
- 73. Use Case 4 • Problem – I have a non secure service and now I want to expose this service with security • Solution – Expose a proxy service – Add security to that proxy service and specify the policy on which you want to enforce security – Invoke the actual service without security by removing security headers in the request comes to the proxy – Add security for responses from the actual service 73 to client
- 74. Use Case 4 74
- 75. Use Case 4 - Configuration 75
- 76. Use Case 5 - FIX to HTTP transport http://wso2.org/library/3837 76
- 77. Use Case 6 - Eventing •http://wso2.org/library/articles/fusion-eventing-soa •http://wso2.org/library/articles/fusion-eventing-soa-part-2-eventing-using- synapse-wso2esb 77
- 78. Use Case 7 78
- 79. WSO2 Product Platform 79
- 80. That's lot of information... Now I would like to try these out myself. How do I get started? 80
- 81. How to get started? Download binary distribution from http://wso2.org/projects/esb/java Latest is v2.1.0 Unzip • Run bin/wso2server.sh (on Unix) or bin/wso2server.bat (on Windows) • Management console – https://localhost:9443/carbon – admin/admin 81
- 82. Help.. I messed it up... 82
- 83. How to get help? Online forum Active community of external users Ample free documentation on wso2.org If needed, we provided commercial support on – Getting started – Deployment – Custom development – Production support 83
- 84. I would like to have some URLs for reference. 84
- 85. Useful references WSO2 Oxygen Tank for Web Service Developers – http://wso2.org WSO2 ESB project page – http://wso2.org/projects/esb Performance testing – http://wso2.org/library/3740 – http://wso2.org/library/2259 – http://wso2.org/library/1721 Apache Synapse – http://synapse.apache.org 85
- 86. Summary •Hypothetical Enterprise •Brief Introduction on WSO2 ESB •Features •Important concepts – Mediators – Sequence •Extendibility •Use cases •Getting started & Help 86
- 87. Thank you [email protected] (on behalf of WSO2 ESB team) 87