Azure Service Fabric Overview
Download as PPTX, PDF•10 likes•4,541 views
The document provides an overview of Microsoft Azure Service Fabric, a platform for building reliable and hyperscale microservice-based applications. It details key features such as stateful services, container orchestration, and various programming models, including reliable actors and reliable services APIs. The document also covers deployment strategies, emphasizing automatic scaling, health monitoring, and high availability.
Azure Service Fabric Overview
- 1. Azure Service FabricPREVIEW Overview João Pedro Martins 26.Mar.2016
- 2. João Pedro “jota” Martins Software Architect Microsoft Azure Insider + Advisor Co-founder - GASP + APPU TechEd 2006 – “Iron Architect” Winner BizTalk Server MVP 2006-2011
- 3. Ground Rules and Expectations This is based on a non-RTM SDK: there will be problems This is a different way of architecting software: there will be many disagreements There is a lot to say: there won’t be enough time
- 4. What’s this session about? Microsoft Azure Service Fabric = A platform for reliable, hyperscale, microservice-based applications = PaaS v2 + Stateful Services/Actors = Platform for applications BORN FOR THE CLOUD, not Lift&Shift’ed
- 5. the platform
- 6. MicrosoftAzure Service Fabric A platformfor reliable,hyperscale,microservice-basedapplications Microservices Azure Windows Server Linux Hosted Clouds Windows Server Linux Service Fabric Private Clouds Windows Server Linux High Availability Hyper-Scale Hybrid Operations High Density Rolling Upgrades Stateful services Low Latency Fast startup & shutdown Container Orchestration & lifecycle management Replication & Failover Simple programming models Load balancing Self-healingData Partitioning Automated Rollback Health Monitoring Placement Constraints
- 7. Battle-hardened for over 5 years … and the Halo 4 multiplayer as “Project Orleans”
- 8. ServiceFabricCapabilities Application deployment services: Rolling update with rollback Strong versioning Side-by-side support Leadership election Name service for discovery of applications High density Partitioningsupport Load balancing and placement constraints Consistent state replication framework Reliable distributed key/value store, collections and queues
- 9. Service Fabric Microservices A microservice is whatever you want it to be: ASP.NET, node.js, Java VMs, an arbitrary .exe Stateless microservices A microservice that has state where the state is persisted to external storage, such as Azure databases or Azure storage Stateful microservices Reliability of state through replication and local persistence Reduces the complexity and number of components in traditional three-tier architecture
- 10. Service Fabric vs. Cloud Services Cloud Services Service Fabricevolution
- 11. Cluster: A federationof machines Node Node Node Node Node Node
- 12. Cluster: System view System Services Failover manager Cluster manager Naming Image store
- 13. Reconfiguration Types of reconfiguration – Primary failover – Removing a failed secondary – Adding recovered replica – Building a new secondary P S S S S S Must be safe in the presence of cascading failures B P X Failed X Failed
- 14. Upgrading Services withzero downtime FD – Failure Domain; UD – Upgrade Domain
- 15. Basics for devs Download from WebPI Sets up local dev cluster with 5 nodes by default Includes service fabric explorer + powershell cmdlets Same code that runs on Azure
- 18. What is a microservice? Is (logic + state) that is independently versioned, deployed, and scaled Has a unique name that can be resolved (e.g. fabric:/myapplication/myservice) Interacts with other microservices over well defined interfaces and protocols like REST Remains always logically consistent in the presence of failures Hosted inside a “container” node (code + config) Can be written in any language/framework (node.js, Java VMs, any EXE) Developed by a small engineering team
- 19. Types of microservices Stateless microservice – Has either no state or it can be retrievedfrom an external store – There can be N instances – e.g. web frontends, protocol gateways, Azure Cloud Services etc. Stateful microservice – Maintain hard, authoritative state – N consistent copies achieved through replication and local persistence – e.g. database, documents, workflow, user profile, shopping cart, IoT devices, multiplayer games, etc.
- 20. Queues Storage 3-Tier service pattern Front End (Stateless Web) Stateless Middle-tier Compute Cache • Scale with partitioned storage • Increase reliability with queues • Reduce read latency with caches • Manage your own transactions for state consistency • Many moving parts each managed differently Load Balancer
- 21. Stateful Middle-tier Compute Stateful services: Simplifydesign, reduce latency Front End (Stateless Web) data stores used for analytics and disaster recovery • Application state lives in the compute tier • Low Latency reads and writes • Partitions are first class for scale-out • Built in transactions • Fewer moving parts Load Balancer
- 23. Service Fabric Programming Models Reliable Actors APIReliable Services API Azure Private Clouds Applications composed of microservices High Availability Hyper-Scale Hybrid Operations High Density Rolling Upgrades Stateful services Low Latency Fast startup & shutdown Container Orchestration & lifecycle management Replication & Failover Simple programming models Load balancing Self-healingData Partitioning Automated Rollback Health Monitoring Placement Constraints Service Fabric
- 24. Reliable Services API Build stateless services using existing technologies such as ASP.NET Build stateful services using reliable collections • ReliableDictionary<T>, ReliableQueue<T> • Data Contract Serializer Manage the concurrency and granularity of state changes using transactions Communicate with services using the technology of your choice • e.g. WebAPI , WCF Collections • Single machine • Single threaded Concurrent Collections • Single machine • Multi threaded Reliable Collections •Multi machine •Multi threaded •Replicated (HA) •Persistence •Asynchronous •Transactional
- 26. Service Fabric Programming Models Reliable Actors APIReliable Services API Azure Private Clouds Applications composed of microservices High Availability Hyper-Scale Hybrid Operations High Density Rolling Upgrades Stateful services Low Latency Fast startup & shutdown Container Orchestration & lifecycle management Replication & Failover Simple programming models Load balancing Self-healingData Partitioning Automated Rollback Health Monitoring Placement Constraints Service Fabric
- 27. Reliable Actors API Build reliable stateless and stateful objects with a virtual actor programming model • Finally, we have Object-Oriented Microservices Suitable for applications with multiple independent units of state and compute Automatic activation management Automatic state management and turn based concurrency (single threaded execution)
- 29. ShipGateway BoltAsteroid Fire! Turn You are launchedGet state • Ships • Asteroids • Bolts • Scores • Velocity • Health • Position • Name • Velocity • Decay • Position • Velocity • Position • IsEvil? Get state Join a session Actoroids Architecturalexample commands Accelerate/brake Get state Get state You hit something You are destroyed You are destroyed Get state move move evil? chase() move() makes all kinds of decisions
- 30. Azure Compute Continuum Ultimate Control Rapid Development VMs / VM Scale Sets VM Extensions Service Fabric / Batch Web Apps/ App Service IaaS PaaS
- 31. ServiceFabricRoadmap Azure Service GA H1 2016 Windows Server 2012 R2/Windows Server 2016 TP1 Public preview Feb 2016 GA June 2016 for WS2012R2 and WS2016 RTM (Includes integration with Windows containers) Azure Stack Targeting H2 2016 Linux (Includes integration with Docker containers) Private preview April 2016 Public preview H2 2016 GA H2 2016
- 32. References Service Fabric • http://aka.ms/ServiceFabric Service Fabric Documentation • http://aka.ms/ServiceFabricdocs Service Fabric Samples • https://azure.microsoft.com/en-us/documentation/samples/?service=service-fabric • https://github.com/Azure-Samples/service-fabric-dotnet-getting-started Akka.net (the other .Net implementation of the Actor Model) • http://getakka.net/ Actor Model (1973) • https://en.wikipedia.org/wiki/Actor_model Martin Fowler on Microservices • http://martinfowler.com/articles/microservices.html
- 33. João Pedro “jota” Martins [email protected] (+351) 96 782 5537 blog.joaopedromartins.net @lokijota pt.linkedin.com/in/joaopedromartins/ THANK YOU! QUESTIONS?
Editor's Notes
- #4: The demos are based in software that is in preview. Problems are to be expected. The programming model underlying this approach is different from what has been the best practice in the age of SOA. Questions: [Hands raised] Who has used Azure Web and Worker Roles? Who has developed services-driven systems with stateless services?
- #5: Service Fabric enables you to build and manage scalable and reliable applications composed of microservices running at very high density on a shared pool of machines (commonly referred to as a Service Fabric cluster). Powers a huge set of Microsoft Services: Azure SQL Database, Azure DocumentDB, Cortana, Power BI, Microsoft Intune, Azure Event Hubs, Skype for Business and others It provides a sophisticated runtime for building distributed, scalable stateless and stateful microservices. Also provides comprehensive application management capabilities for provisioning, deploying, monitoring, upgrading/patching, and deleting deployed applications. Service Fabric is tailored to creating “born in the cloud” services that can start small, as needed, and grow to massive scale with hundreds or thousands of machines, creating Service Fabric clusters across availability sets in a region or across regions.
- #7: Service Fabric enables you to build and manage scalable and reliable applications composed of microservices running at very high density on a shared pool of machines (commonly referred to as a Service Fabric cluster). Powers a huge set of Microsoft Services: Azure SQL Database, Azure DocumentDB, Cortana, Power BI, Microsoft Intune, Azure Event Hubs, Skype for Business and others It provides a sophisticated runtime for building distributed, scalable stateless and stateful microservices. Also provides comprehensive application management capabilities for provisioning, deploying, monitoring, upgrading/patching, and deleting deployed applications. Service Fabric is tailored to creating “born in the cloud” services that can start small, as needed, and grow to massive scale with hundreds or thousands of machines, creating Service Fabric clusters across availability sets in a region or across regions.
- #24: There are two programming models available in Service Fabric to build applications: Reliable services: An API to build stateless and stateful services based on StatelessService and StatefulService .NET classes and store state in .NET reliable collections (dictionary and queue). They also have the ability to plug in a variety of communication stacks, such as Web API and Windows Communication Foundation. This programming model is suitable for applications where you need to perform compute across multiple units of state. Reliable actors: An API to build stateless and stateful objects through the virtual actor programming model that is suitable for applications with multiple independent units of state and compute.
- #25: https://azure.microsoft.com/en-us/documentation/articles/service-fabric-reliable-services-reliable-collections/ Reliable Collections can be thought of as the natural evolution of the System.Collectionsclasses: a new set of collections that are designed for the cloud and multi-computer applications without increasing complexity for the developer. As such, Reliable Collections are: Replicated: State changes are replicated for high availability. Persisted: Data is persisted to disk for durability against large-scale outages (for example, a datacenter power outage). Asynchronous: APIs are asynchronous to ensure that threads are not blocked when incurring IO. Transactional: APIs utilize the abstraction of transactions so you can manage multiple Reliable Collections within a service easily. Reliable Collections provide strong consistency guarantees out of the box in order to make reasoning about application state easier. Strong consistency is achieved by ensuring transaction commits finish only after the entire transaction has been applied on a quorum of replicas, including the primary. To achieve weaker consistency, applications can acknowledge back to the client/requester before the asynchronous commit returns. The Reliable Collections APIs are an evolution of concurrent collections APIs (found in theSystem.Collections.Concurrent namespace): Asynchronous: Returns a task since, unlike concurrent collections, the operations are replicated and persisted. No out parameters: Uses ConditionalResult to return a bool and a value instead of out parameters. ConditionalResult is like Nullable but does not require T to be a struct. Transactions: Uses a transaction object to enable the user to group actions on multiple Reliable Collections in a transaction.
- #35: Logo font: Monserrat Regular Logo color: #9a8e5e (154,142,94)