From Event to Action: Accelerate Your Decision Making with Real-Time Automation
0 likes25 views
The document outlines a webinar discussing real-time automation in decision making using FME Flow. It covers the benefits of real-time event processing, integration sources, spatial data applications, and showcases customer success stories. The presentation emphasizes the importance of automating workflows for improved productivity and better data-driven insights.
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
- 1. From Event to Action: AccelerateYour Decision Making with Real-Time Automation
- 2. Matt Meeboer Technical Support Specialist, FME Flow Stewart Harper VP of Product Development Don Murray Co-Founder & CEO Meet our Team
- 3. Welcome to Livestorm. A few ways to engage with us during the webinar: Audio issues? Click this for 4 simple troubleshooting steps.
- 4. How to download slides 1. Hover over the slide deck in the webinar room 2. Click this button
- 5. Agenda 1 What are Real-Time Events? 2 What are sources of Real-Time Events 3 Benefits of Automation and Real-Time Events 4 Spatial Data and Real-Time Events 5 Customer Stories 6 Demos 7 Conclusion, Resources & Next Steps 8 Q&A Agenda
- 6. Flash Demo
- 7. Poll: How frequently does your company currently use real-time data for decision-making?
- 9. Batch, Event, and Stream Processing Batch Processing Low High Event Processing Stream Processing Data Velocity April 16, 2024 Webinar March 13, 2024 Webinar Today’s Webinar Automations
- 10. Real-Time Events Application Integration, data integration and real-time data processing.
- 11. 2 What are sources of Real-Time Events?
- 12. Some Common Event Sources Application Events ● Database Trigger (update, insert) ● Record inserted/updated (Webhook Trigger) ● Polling of Legacy Application. ● ... Data Arrival Events ● Email arrives ● Data in Directory ● Data in object store (AWS, Azure, Google) ● FTP (or variant) ● .... Device/IoT and other Events ● Scheduled event ● JMS message ● FME Flow Stream ● FME Flow App ● SQS, SNS or Azure Event Grid ● ....
- 13. 3 Benefits of Automation and Real-Time Events.
- 14. Benefits of Real Time Event processing with Automations ● Application Integration: Connect applications so an update in one application causes an update in other applications. ● Data Integration: Integrate data as it arrives. From IoT event data, to large data arrivals in the cloud, to immediate QA on data. ● Unrivalled Productivity: No-code interface so your team can create real-time data flows quickly and easily. ● Save Time & Have a Happier Team: Automate monotonous tasks so your team is happier doing more valuable work. ● Better Insights: Up to date information for everyone means more informed decision making.
- 15. Capabilities of Real Time Event processing with Automations Scalable ● Scale processing to move mountains of data quickly. Flexible ● Large number of triggers to automate your entire enterprise. Powerful Orchestration ● Use parallel processing, distributed processing or both in the same automation to specify how,where and when tasks are done.
- 16. 4 Spatial Data and Real-Time Events
- 17. The world we live in is Spatial. How many ways have you used spatial today without even thinking about it? Yet many organizations do not use spatial in their day to day decision making.
- 18. Spatial Data is critical to get from digital optimization to digital transformation. ● Spatial data reveals new relationships and insights to make better decisions. ● Without spatial data you miss opportunities, allocate resources poorly, and fall behind your competitors. ● Spatial Data streams enables you to see when and where events occur.
- 19. Unrivalled Data Type support Spatial Data is Everywhere
- 20. One platform, two technologies FME Form FME Flow Build Event Processing workflows. Automation with Event Processing FME Flow Hosted Safe Software managed FME Flow fme.safe.com/platform FME Enterprise Integration Platform Safe & FME
- 21. FME Flow is Automation Events drive Automations
- 23. Customer Stories ● Electra deploys IoT sensors to improve power network outage response ○ Electra ● Powerlink Queensland automates spatial emergency readiness ○ Powerlink ● City of Omaha saves 1000+ hours each year with FME ○ City of Omaha Many more can be found here.
- 24. Leverage Real-Time Events for enhanced decision-making and efficiency.
- 26. FME Flow Automations FME Flow Streams ● Data Volumes: Low-Medium (<100 per minute) ● Latency: 1s and up ● Triggered by events ● Complex workflow orchestration ● Data Volumes: High (Millions of records per minute) ● Latency: Near Real-Time <1s ● ‘Always on’ and receiving data from a stream ● Single, simpler workflow focused on ingesting a lot of data quickly Workflows are authored in FME Form, regardless of how they are run on FME Flow
- 28. SFTP Dropbox System Event Azure Event Grid JMS UDP HTTP Request WebSocket FTP Logger SQS/SNS SMTP SQS/SNS Filter Merge S3 Bucket Network Event Triggers
- 29. 7 Demos
- 31. Data Integration with the FME Platform is easy ● Details of entire process are thru no-code FME Form and FME Flow interfaces. ● FME Flow Automations ensure the data import task happens immediately ● Data Validation is part of the workflow ensuring that only high quality data is imported. ● Email notifications ensure that appropriate personnel are notified immediately. Key Takeaways
- 32. Slide Title Update data warehouse with files submitted by users Goal Block Key Real-Time Data Integration Result Access to the DW and Flow, Data needs to be validated FME Flow Bucket Watch Automation Snowflake updated in real-time
- 33. Integration Architecture User uploads file (csv list of food programs) to Amazon S3 Bucket FME Form Workspace (fmw) executes on next available engine Notify of Completion FME Form Could be Dropbox, File Share, Flow Resource Folder
- 34. Demo
- 36. Application Integration enables your applications to work together seamlessly ● Webhook capability of FME Flow Automations makes connecting applications simple and fast. ● We show how easy it is to connect 3 applications. Again: no-code interface elevates productivity and improve maintainability. Key Takeaways
- 37. Slide Title Create a Service Request in CityWorks when an unsafe tree is reported via Survey123 Goal Block Key Real-Time Application Integration Result Survey123 and CityWorks are not integrated FME Flow Webhook Automation CityWorks updated in real-time & AGOL updated to reference new Service Request ID
- 38. Uni-Directional Integration Architecture Linear data flow used to repair, validate, and replicate data from system A to system B ● Triggers can vary from files being received to schedules and webhooks. Dynamic data flow(s) used to integrate multiple systems by synchronizing changes between 2 (or more) systems. ● Typically driven by an action being performed in either system for near real time processing via webhooks or topics/notifications. Bi | Multi-Directional
- 39. FME Flow Automation Triggered (Webhook Received from Survey123) Integrate AGOL and Cityworks via REST API User submits Survey Published FME Workspace (.fmw)
- 40. Published FME Workspace executes and synchronizes changes to features from Cityworks, Salesforce, and ArcGIS Online FME Flow Automation Triggered Record inserted, updated, or deleted Record inserted, updated, or deleted
- 41. Demo
- 43. Different systems hold different information. You want to want to leverage one system to “enrich” the data of another system. ● Automations can also connect to external services, like ChatGPT (OpenAI), to enrich your data ● Automations perform this enrichment as data arrives, providing better data for better insights. Automations don’t just save you time, they do things you couldn’t afford to do without them. Key Takeaways
- 44. Slide Title Add additional details about a new customer lead in Salesforce Goal Block Key Real-Time Data Enrichment Result Sales doesn’t have time - too many leads to chase FME Flow Webhook Automation with ChatGPT as our research assistant Salesforce updated in real-time
- 45. FME Flow Automation Triggered (Webhook Received from Salesforce) User enters lead into Salesforce Published FME Workspace (.fmw)
- 46. Demo
- 47. 8 Conclusion
- 48. FME Flow Automations FME Flow Streams ● Data Volumes: Low-Medium (<100 per minute) ● Latency: 100s of ms and up ● Triggered by events ● Powerful workflow orchestration ● Data Volumes: Medium-High (Millions of records per minute or more) ● Latency: Near Real-Time ● ‘Always on’ and receiving data from the stream ● Simple workflow focused on ingesting data quickly Workflows are authored in FME Form, regardless of how they are run on FME Flow April 16, 2024 Webinar Today’s Webinar Summary - Real Time
- 49. 29+ 27K+ 128 190 20K+ years of solving data challenges FME Community members countries with FME customers organizations worldwide global partners with FME services 30+ 29K+ 128 140+ 25K+ years of solving data challenges FME Community members countries with FME customers organizations worldwide global partners with FME services 200K+ users worldwide Safe & FME
- 50. Deploy Anywhere Processing close to the data Unrivalled Productivity No-code environment Restaurant Model Customer experience & quality product that keep you coming back Subscription Every component, Every capability. You get it all. Largest Ecosystem Only Integration Vendor with Geospatial Our Differentiators
- 52. One platform, two technologies FME Form FME Flow Build and run data workflows Automate data workflows FME Flow Hosted Safe Software managed instance fme.safe.com/platform FME Enterprise Integration Platform Safe & FME
- 53. We are the only All Data Enterprise Integration Platform
- 54. 9 Resources
- 55. Get our Ebook Spatial Data for the Enterprise fme.ly/gzc Guided learning experiences at your fingertips academy.safe.com FME Academy Resources Check out how-to’s & demos in the knowledge base support.safe.com Knowledge Base Webinars Upcoming & on-demand webinars safe.com/webinars
- 56. p Resources Check out our podcasts on-demand. featuring special guest speakers over at EM360
- 57. 10 Next Steps
- 58. We’d love to help you get started. Get in touch with us at [email protected] Experience the FME Accelerator Contact Us A world where data is not just a commodity but a catalyst for real change. fme.safe.com/accelerator Next Steps
- 59. ClaimYour Community Badge & Dive into the new Community! ● Get community badges for watching webinars ● community.safe.com ● Today’s code: 2K1RXA Join the Community today!
- 60. 11 Q&A
- 61. ThankYou Recap of Next Steps 1 Join the FME Community 2 Contact us 3 Experience the FME Accelerator Please fill out our webinar survey