Session on API auto scaling, monitoring and Log management
- 1. API Autoscaling Anypoint Monitoring Log Management 26th June 2021 Coimbatore MuleSoft Meetup Group
- 2. Organizers 2 About Organizer: • 10 years of Technical Experience. • 6+ years of Experience in the Integration Domain. • 4.5 years of Experience in MuleSoft. • Certified MuleSoft Developer and Architect. • Mule Meetup Speaker. • Coimbatore Mule Meetup Leader Ashish Pardhi Solution Architect, Apisero
- 3. Organizers 3 About Organizer: • 10+ years of Industry Experience. • 2+ years of Experience in MuleSoft • Certified Technical Instructor at MuleSoft • Integration Architect at NJC Labs. • Coimbatore Mule Meetup Leader. Anoop Ramachandran Integration Architect, NJC Labs
- 4. Organizers 4 About Organizer: • 3.7 years of Total experience in MuleSoft. • Certified MuleSoft Developer. • Solution Consultant at Apisero. • Coimbatore Mule Meetup Leader. Balkis Sajeena Solution Consultant, Apisero
- 5. Speaker 5 Shridharan Rajasekar Senior Engineer AstraZeneca About Speaker: • 10+ years of Technical Experience. • 5+ years of Experience in the Integration Domain. • Certified MuleSoft Developer. • Mule Meetup Speaker.
- 6. • Both the speaker and host are organizing this meet up in individual capacity, only. We are not representing our companies here. • This presentation is strictly for learning purpose only. Organizer/Presenter do not hold any responsibility that same solution will work for your business requirements also. • This presentation is not meant for any promotional activities. Safe Harbor Statement 6
- 7. A recording of this meetup will be uploaded to events page within 24 hours. Questions can be submitted/asked at any time in the Chat/Questions & Answers Tab. Make it more Interactive!!! Give us feedback! Rate this meetup session by filling feedback form at the end of the day. We Love Feedbacks!!! Its Bread & Butter for Meetup. Housekeeping 7
- 8. CHEERS..!! We have prizes to give away! 3 Winners a special prize is ready 8 A SHOW OF HANDS: New Members With Us.!!
- 9. API Autoscaling • When to configure • How to configure • Points to be noted while configuring Anypoint Monitoring Overview • Advantages and uses • Built-in dashboards • Custom dashboards • Reports • Alerts • Functional Monitoring Log Management • Log Search • Log Points • Log Download Agenda 9
- 10. Auto-scaling enables the Mule platform to monitor the applications and automatically update the worker configuration based on the policy we configure. Both horizontal and vertical scaling is possible. In vertical scaling, the worker size will be increased/decreased once the configured threshold is met. In horizontal scaling, the number of workers will be added/removed once the configured threshold is met. Mule Platform provides an option to create a policy in runtime manager for auto-scaling (To use this feature, your organization must have an Enterprise License Agreement (ELA)) What is Autoscaling? 10
- 11. Auto-scaling can be configured for API which expects spikes in request size/volume at certain times When and How to configure? 11 Start Open the application in Runtime manager and monitor the dashboard for last 15/30 days Check CPU utilization > 80 Check Memory utilization > 80 Autoscaling not needed Autoscaling needed Analyse and take guidance from vendor if needed Is request volume high? Is request size high? No No Yes Yes No Yes, Horizontal scaling needed Yes, Vertical Scaling needed No
- 12. Before configuring the autoscaling, check the performance of the backend system. Vertical scaling involves increasing vCore of existing worker whereas horizontal scaling involves adding/removing new instances. You can apply either horizontal/vertical scaling but not both. In vertical scaling, you can configure the min and max vCores between 0.1 vCore and 16 vCores. In horizontal scaling, you can configure the min and max workers between 1 and 4 workers. Number of workers can not be increased beyond 4. For integration API's which involve components like AMQP consume, configure vertical scaling as increasing the number of workers is not advisable. For services which have more number of requests, configure horizontal scaling as it will distribute the load between workers. For services which involves larger payload processing, configure vertical scaling as it will enhance the performance. It is recommended to do a performance testing and come up with the auto-scaling configuration parameters. Points to consider 12
- 13. 13 Anypoint Monitoring is the standard method of monitoring Mule application and API performance so that you can more quickly identify and resolve issues. Titanium subscription is needed to utilize the full capability of Anypoint Monitoring. "Enabling Monitoring and Visualizer" feature must be enabled in Runtime manager to use the monitoring feature. (This feature is enabled for runtime greater than 3.8.8) Useful for support and application maintenance team Anypoint Monitoring
- 14. 14 Built-in dashboards display deployment information about your application/API at the top of the screen and provide view to the below different metrics Built-in Dashboards API Dashboard Requests Failures Performance Client Applications Application Dashboard Inbound Outbound Flows Connectors Performance Failures JVM Infrastructure Application Network
- 15. 15 Anypoint Monitoring allows users to create their own dashboards as per the user needs apart from the inbuilt dashboards. Users can create custom dashboards for the applications deployed to cloudhub and configure the metrics and data points they are interested. The metrics can be viewed as Graph, Table, Single stat and Text. Some common use cases are: • Viewing the metrics/data points for all the API's present in the application network. • Create dashboard with the metrics and configure the alerts Custom Dashboards
- 16. 16 Reports allows users to view the metrics of all the deployed applications running in an environment. These reports are useful for Platform maintenance, ensuring application availability. Users can change the timeframe to view the reports and these reports can be viewed for upto last 90 days and exported as csv file. Different reports can be viewed are: • Requests • Performance • Failures • CPU Utilization • Memory Utilization Reports
- 17. 17 Users can create alerts in Anypoint Monitoring to indicate whether the API is working as expected or exceeds the set threshold value. Titanium subscription is needed for viewing, creating, enabling, disabling the alerts in Anypoint Monitoring. Users can create two types of alerts: Basic Alerts Alerts created on Runtime application. Limited to 100 per organization and will increase based on vCore procurement. Advanced Alerts Alerts created on top of custom dashboard. Limited to 20 per organization and can be extended. Metrics supported in Basic alerts are: Message Count Message Error Count Message Response time CPU Utilization Memory Utilization Thread count Alerts
- 18. 18 Framework for assuring the reliability, availability and quality of Private and Public APIs being used in application network. Using functional monitoring, users can monitor the API's in regular intervals using scheduler and send notification mails to recipients in case of the API becomes unavailable or in the case of unexpected API response. Functional Monitoring Private API Public API API's that are deployed in AnyPoint VPC cloudhub and is accessible to internal users API's that are deployed in cloud and accessible to any one Private API's can be monitored only from Private Location Public API's can be monitored by Private or Public Location Public location Private location A region that is shared with other Mulesoft customers. Private location is a worker that runs in cloudhub environment with in the Anypoint VPC. Available public locations are us-east-1 and us-east-2. User can create multiple private locations within the VPC. By default, the private location application consumes 0.2 vCores * 1 worker. The shortest interval you can run scheduler is 15 mins. The shortest interval you can run scheduler is 5 mins. User can configure max 5 monitors per organization and in each monitor user can configure multiple endpoints. User can configure any number of monitors in a single private location.
- 19. 19 Advantages over Runtime manager logs Logs can be investigated, and filter can be applied with application, class, environment, environment type, log level, logger, message, thread, timestamp and worker Logs can be shared with the query syntax URL Log search can be shared and viewed Log Management Runtime Manager Anypoint Monitoring Default log storage for any applications on CloudHub Log Aggregation into Monitoring module which is enabled at API level set either by property variable or via UI Logs Max storage is 100 MB or kept for last 30 days 200 GB per prod core and 50 GB per pre-prod core, but can increase this for additional cost Logs can be extracted using platform services APIs Logs cannot be programmatically extracted, but can manually download raw data using the "Raw Data" section under "Log Management" Able to search or filter the logs based on string/time interval/priority for the particular application Able to search or filter the logs based on string/time interval/priority/worker instance/environment for all the applications present in the particular business unit
- 20. 20 Log Points feature in Anypoint Monitoring allows you to generate logs for apps and APIs in real-time and without writing code. No restart is needed at the application level. Log Points can be enabled at the App/API level To use the option, user need to have access to Manage Policies in API manager and Manage Settings in Runtime Manager There might be some impact on API performance, so disable the log points once done Log Points
- 21. 21 ● You can use Anypoint Monitoring to download archived log data (raw data) collected on Mule apps that are running in CloudHub. This data is helpful for security, compliance, or other purposes where you need to examine or collect your warehoused data. To download raw data: 1.Select the Environment and Resource. The resource is a Mule app that runs in CloudHub. 2.Provide the date for the data you want to download, for example: 06/13/2021. 3.Locate and download log data that you want to examine. Log Download
- 22. Demo Time!!!
- 23. Q&A
- 24. Get ready to WIN a Special Gift from MuleSoft Community Quiz Time
- 25. ❖ You should not be a meetup leader. ❖ In last 30 days you shouldn’t own any trivia quiz in any meetup. Important Instructions for the attendees to play Trivia quiz
- 26. 1. Log in to www.kahoot.it via your mobile phone 2. Click on “Play” on top right hand side of the web page 3. Enter the game pin that is displayed on the quiz master’s screen 4. Give your complete name as the nickname 5. You will be getting your questions on your laptop screen with option. 6. For every questions you will get 20
- 27. 27 Share: ○ Tweet your pictures using the hashtag #CoimbatoreMuleSoftMeetup ○ Invite your network to join: https://meetups.mulesoft.com/coimbatore/ Feedback: ○ Fill out the survey feedback and suggest topics for upcoming events ○ Contact MuleSoft at [email protected] for ways to improve the program What’s next?
- 28. 28 What is SSL, What is One-Way SSL & Two-Way SSL? On Sat, July 03, 11.00 AM (IST) by Ashish Pardhi, Solution Architect, Apisero https://meetups.mulesoft.com/events/details/mulesoft-coimbatore-presents-what-is-ssl-what-is- one-way-ssl-two-way-ssl/ Anypoint Platform CLI On Sat, July 17, 11.00 AM (IST) by Jivan Nalavade Lead Engineer, Apisero https://meetups.mulesoft.com/events/details/mulesoft-coimbatore-presents-anypoint-platform-cli/ Next Meetups
- 29. Thank you