Serverless Patterns by Jesse Butler
0 likes298 views
The document discusses serverless patterns and design. It begins with an overview of serverless computing and examples of how serverless architectures can be used to build web/mobile backends, extend existing applications, process streams/files in real-time, connect IoT devices, run batch jobs, and automate DevOps tasks. It then covers serverless concepts like events, execution models, and error handling. The document emphasizes that serverless applications should be broken into small, single-purpose functions and that functions should be separated and simplified for observability.
Serverless Patterns by Jesse Butler
- 1. ive cloudnative.oracle.com Serverless Patterns Jesse Butler Cloud Developer Advocate, Oracle Cloud Infrastructure @jlb13 Design and Use Patterns in Serverless
- 2. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Level Set • Roles in the room? • Serverless users? • In production? • Lambda? Azure? Something Else? 2
- 3. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Monolithic Applications Users Application Database
- 4. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Monolithic Applications Users Application Database
- 5. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 5 Abstractions Decreasing concern (and control) over infrastructure implementation Virtual machines Containers Bare Metal Virtualization and Consolidation @jlb13 To the Cloud
- 6. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Microservices Load balancer Service Service Database Service Queue Deploying Code to Systems We Build in the Cloud with Containers and Kubernetes
- 7. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Serverless Load balancer Service Service Database Service Queue Deploying Code to Systems We Build in the Cloud with Containers and Kubernetes
- 8. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 8 Abstractions Infrastructure implementation and maintenance responsibility Virtual machines Functions Containers Bare Metal Trend towards Serverless @jlb13 To the Cloud
- 9. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 9 Serverless is a Spectrum @jlb13 Container Orchestration Kubernetes Nomad Docker Swarm Ideally managed, but still infrastructure you care about Managed Serverless AWS Lambda Azure Functions Google Functions Oracle Functions Fully managed platform for hosting and executing code Container Services ECS, Fargate Azure CS GCP Cloud Run Managed service provision containers, abstracts infrastructure you care about DIY FaaS OpenFaaS Fn Project Leverage container management system under the covers, introduce Functions architecture Awareness of infrastructureFully aware Invisible
- 10. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 10 Containers are the new Process Model, Right? @jlb13
- 11. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 11 Containers are the new Process Model, Right? @jlb13
- 12. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 12 Don’t Conflate Requirements with Complexity Aversion @jlb13
- 13. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. What Is Serverless • Event-driven architecture • Invisible infrastructure • Automatic scaling on demand • Granular billing for execution time • Fault tolerant and highly available 13@jlb13
- 14. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Serverless Deployment, the Duck Test 14 Upload Function Source Code Configure Function Trigger Function is invoked when triggered Pay for execution time, not idle time
- 15. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 15 Serverless is Not Really a Spectrum @jlb13 Container Orchestration Kubernetes Nomad Docker Swarm Ideally managed, but still infrastructure you care about Managed Serverless AWS Lambda Azure Functions Google Functions Oracle Functions Fully managed platform for hosting and executing code Container Services ECS, Fargate Azure CS GCP Cloud Run Managed service provision containers, abstracts infrastructure you care about DIY FaaS OpenFaaS Fn Project Leverage container management system under the covers, introduce Functions architecture Awareness of infrastructureFully aware Invisible
- 16. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 16 What Is Serverless, Distilled @jlb13
- 17. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. What Is Serverless Not • It’s not magic, it’s a choice • Brownfield: You need to break the monolith apart regardless • Greenfield: You need a solid design • Nothing is free 17@jlb13
- 18. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Hype Cycle – Productive Adoption Cloud Computing
- 19. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Hype Cycle – Serverless in Waves Serverless Computing
- 20. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Get Through This Quickly…
- 21. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 …And Get Here
- 22. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 22 Serverless From 30k Feet Event Sources Triggers Function Execution Backend Services Business Intelligence Analytics Databases Compute, Network, Storage Kubernetes, Docker, and/or Hypervisor F(n)F(n) F(n) F(n) @jlb13
- 23. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Function Example • Different projects and products differ in use and workflow • Just the code, configured against any number of event triggers • Basically follow microservices rules of engagement • As with microservices, applications are composed of many functions @jlb13
- 24. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Events and Execution Models • Events are driven by context • Execution model is your choice @jlb13
- 25. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Events, Determined by Context • Changes in data • API Invocations • Requests on endpoints • Changes in resources • Timers, Alarms, Direct Invocation… @jlb13
- 26. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Using Events • Events are configured differently per platform • Inform the platform as to what event(s) should invoke this function • Function can consume the event and do the things • CNCF Serverless WG has drafted a CloudEvents specification @jlb13
- 27. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Execution Models • Synchronous • Asynchronous • Streaming @jlb13
- 28. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Error Handling by Model • Synchronous –Calling code handles the error • Asynchronous –System retries based upon timeline • Streaming –System retries based upon data efficacy @jlb13
- 29. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. What Can We Build With Serverless? • Web and Mobile Backends • Any other backend API implementations • Real-time Processing of Files, Streams • Batch Processing • Glueing up SaaS things • Kind of anything @jlb13
- 30. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Web and Mobile Backends 30 Identity Process dataTrigger functions Functions Web, Mobile Apps API Platform Mobile Data persisted Database Storage
- 31. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 31 Extend and Enhance Existing Applications SaaS App Analytics Visualize data Enrich data and send to Analytics service Use data for analytics and insights Inventory create / update Another App Trigger functionsSupport incident create / update Functions @jlb13
- 32. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Real-Time Stream Processing 32 Messaging/ Streaming Database Perform user sentiment analysis Trigger functions Functions Data from multiple sources – Product Reviews and Ratings, Customer Service Interactions, Social Media, etc. Records saved in database Dashboards with user sentiment analysis trends
- 33. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Real-Time File Processing 33 Storage Database Generate images of different resolutions and sizes Trigger functions Functions High resolution product image uploaded to storage Storage Images saved in Storage, metadata in Database Generated images displayed on various pages and devices
- 34. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 34 Internet of Things Check data against thresholds. If exceeded, raise support incidents, send notifications Ingest Trigger functions Functions Devices and things streaming sensor data Incident created in Service Cloud, notification sent to the technician Mobile Technician App Service Cloud Executive Dashboard @jlb13
- 35. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. @jlb13 Batch Processing 35 Database Database Calculate bonus points Functions Utility consumption Storage Bonus points updated Utility bill PDF file Transaction details Scheduled batch job Functions Database Generate utility bill PDF file PDF files saved in Storage Consumption details Scheduled batch job Loyalty bonus receivedCredit card transactions
- 36. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. 36 DevOps Automation Compute State Change or a Timer Storage Other - Check tags - Check security roles - Patch or update - Modify/kill resource - Vulnerability assess - Check for idle … @jlb13
- 37. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Big Ideas Around the Code • Don’t own what you don’t have to • Serverless is all about APIs • When you do implement, simplify • Plan ahead for observability @jlb13
- 38. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Choose a Pattern that Helps you Minimize • Less is more: shoot for a single handler per module • If one function does more than one discrete thing, break it up • Better to proliferate than to decompensate • Observability and triage become infinitely easier at the boundaries @jlb13
- 39. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Separate and Simplify • Simplify application estate as well • Events can and probably should define application boundaries • Share libraries between functions and applications, not execution context @jlb13
- 40. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Code Reuse • Not long ago, Serverless function deployments were zip files • Now, many Serverless platforms expose a container image to you • Others use layering which mimics the container image stacking @jlb13
- 41. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Observability • Metrics – Aggregate data regarding the behavior of a thing over time • Tracing – Instrumentation which provides an instance of an action, traversing the entire stack • Logging – Developer breadcrumbs we leave to give context for a certain code path @jlb13
- 42. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Triaging Issues • Monolith in a VM – log into the host, look at logs, run a debugger • Containers in Kubernetes – Istio, Jaeger, Prometheus, Grafana, et al • Serverless… is complicated. Logging is there, but that’s not very useful at scale • OpenTracing & Jaeger is a possibility @jlb13
- 43. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Observability Solutions From Your Provider @jlb13 Cloudwatch, X-ray, Stackdriver, OCI Monitoring and Logging, Azure Insights, IBM Monitoring, and others
- 44. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Observability Solutions From Other Experts @jlb13 Honeycomb, IO|Pipe, DataDog, Dashbird, Thundra, Epsagon, Splunk, Lightstep, Solo, and others (sorry if I missed yours!)
- 45. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Use Services and SaaS When Possible @jlb13 • DBaaS • Identity, Auth, Forms • Storage Services • Email, SMS • Maps, GPS • Media Streaming • Chat and Chatbots
- 46. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Worries • Don’t worry too much about cold starts • Do worry about data egress and migration • Pay attention to the system you are integrating with, keep it open if possible @jlb13
- 47. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Is Serverless Simpler? • In a word, no • But that doesn’t mean it’s not better • Serverless doesn’t really mean less complexity • Resolving complexity is generally directly related to your core business @jlb13
- 48. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Is Serverless Better? • In a word, yes • Less toil in deployment and maintenance of systems is beneficial to focus • OpEx reductions can be profound • Tradeoff: we depend upon third parties to address issues as they arise @jlb13
- 49. Copyright © 2019, Oracle and/or its affiliates. All rights reserved. Final Thoughts • Put Serverless on your radar – Greenfield – Brownfield migration • Often a POC becomes production • Resist the urge to compare DevOps and Serverless. Apples to Apple Pie. • Build stuff! @jlb13