Multi-tenancy: Winning formula for a PaaS
Download as PPTX, PDF•6 likes•3,185 views
Srinath Perera discusses multi-tenancy and why it is crucial for implementing a Platform as a Service (PaaS). He outlines four levels of multi-tenancy maturity and how WSO2's Carbon platform achieves tenant isolation through separate security domains, databases, and execution contexts while maintaining performance and scalability. Implementing multi-tenancy requires balancing tenant isolation with efficient resource sharing and introduces challenges around data security, tenant migration, and scaling to large numbers of tenants.
Multi-tenancy: Winning formula for a PaaS
- 1. Multi-tenancy: Winning formula for a PaaSbySrinath Perera, Ph.D. Senior Software Architect WSO2 Inc.
- 2. Next 45 Minutes …Brief Introduction to Cloud and PaaS
- 3. What and Why Multi-tenancy?
- 7. Scaling Up
- 8. ConclusionPhoto by Bruno Girin on Flickr, http://www.flickr.com/photos/brunogirin/27981693/, Licensed under CC
- 9. Cloud ComputingAbility to buy computations power, storage, or execution services as an Utility, on demand.
- 10. For more details read “A View of Cloud Computing, Communications of the ACM, 2010”Cloud Computing (contd.)Best way to explain it is by comparing it to Electricity
- 11. Idea is a big pool of servers and share.
- 12. Economics of scale through Optimize large scale operations.
- 14. No need for capacity planning, start small and grow as needed.
- 15. Outsource and enabling specialization. photo by LoopZilla on Flickr, http://www.flickr.com/photos/loopzilla/2328231843/sizes/m/in/photostream/, Licensed under CC
- 16. Cloud Offerings
- 17. Why PaaS?IaaS only provides limited saving to someone who needs to outsource their IT functions
- 18. SaaS is great when they can be used
- 19. They are usually very specific (e.g. email, CRM ..)
- 20. If they match, then great, but if they are not, not much choice for the user.
- 21. PaaS stays in the middle ground
- 22. Framework to host your apps
- 23. Hopefully you can move your apps as it is (well not the case with Azure or App Engine, but it is possible with WSO2 Stratos !!!). What is Multi-tenancy ?Many Parties share the same set of resources, while giving each one his own spaceWhy Multi-tenancy? 1. Increased sharing Cloud shares resources across a large pool of users.
- 24. Now sharing happens in the application level as oppose to sharing at OS level for multiple processes and sharing at HW level with VMs.
- 25. That can bring greater savings “There is no delight in owning anything unshared.” Seneca (Roman philosopher, mid-1st century AD)photo by Ben Gray on Flickr, http://www.flickr.com/photos/ben_grey/4582294721/, Licensed under CC
- 26. Why Multi-tenancy? 2. Provide “pay for what you use” Often there will be many accounts in a PaaS or a SaaS, but only a fraction of them will be in use.
- 27. We cannot allocate runtime resource per account (disk may be ok, as it is cheap). For example, we cannot run a VM per account.
- 28. By sharing the same server with many users, Multi-tenancy provides much reduced runtime cost per server. Flexibility
- 29. Multi-tenancy vs. Virtual MachinesMulti-tenancy provides much fine grained sharing by many applications sharing the same server.
- 30. Say there are 100k accounts, but 10k active users at a time. VM based model needs 100k VMs, which means there is a cost incurred per account.
- 31. With Multi-tenancy one server can handle many accounts, and by mixing and matching heavy and light users, Multi-tenancy can operate with much less number of servers. photo by hans s on Flickr, http://www.flickr.com/photos/archeon/2359334908/
- 33. To fulfill Cloud Promise: Implementing PaaSAs discussed it is crucial in supporting “Pay as you go” in a Platform as a Service (PaaS)PromiseFor example (within Stratos)
- 34. Web Service Hosting as a Service ,Web Application Hosting as a Service, Message Mediation Execution as a Service (ESB), Governance as a Service, Workflow as a Service SMBs (Small and Medium size Business) Most SMBs can not afforded to run their own SOA technologies. This stops them from going to the next level. Workflow, Service and Web hosting as a service can enable multiple SMBs to share the same infrastructure. This will lower the bar of SOA/ Middleware use, and enable SMBs to move to the next level. photo by Olaf on Flickr http://www.flickr.com/photos/okreitz/3073783437/, Licensed under CC
- 35. E-Science GatewaysScientific workflows has been identified as enabling technology for E-Science.
- 36. Idea is to let scientists visually compose workflows and run them.
- 37. There are many gateways that do this. Enable multiple science gateways to share the same infrastructure thus reducing the maintenance cost and resource sharing . Same would work for most e-Gov stuff and for most organizations. photo by Image Editor on Flickr, http://www.flickr.com/photos/11304375@N07/2769519295/, Licensed under CC
- 38. How Good is this Multi-Tenancy implementation?
- 39. Multi-tenancy Maturity ModelsModel is Defined by Chong et al.
- 40. (F. Chong and G. Carraro, “Architecture strategies for catching the long tail,” MSDN Library, Microsoft Corporation, 2006.)
- 41. Provide a way to understand Multi-tenant implementations.
- 42. Level1: Instance per Client
- 43. Level 2: Configurable instance per Client
- 44. Level 3: Single instance can serve multiple Clients
- 45. Level 4: Scaling up Level 3 by running multiple instances and distributing the load. Implementing Multi-Tenancy
- 46. Goals of Multi-tenancy Sharing – maximize the resource sharing across multiple tenants. Isolation – hide the fact other users are also in the same server. Execution – enforce security. Make sure one tenant can’t call other tenants executable logic. Data – make sure one tenant can’t see other’s data Performance - make sure performance is not affected by existence of other tenants. ScaleServer is distributed and it can handle larger load by adding more nodes. photo by John TrainoronFlickr http://www.flickr.com/photos/trainor/2902023575/, Licensed under CC
- 47. It is about trading off Isolation vs. Sharing As often the case in research, implementing Multi-tenancy is a tradeoff photo by Todd Anderson on Flickr, http://www.flickr.com/photos/toddography/12034661/, Licensed under CC
- 49. WSO2 Platform ArchitectureWe break multi-tenancy into three parts (Based on Chang et al.).
- 50. Execution: Business Processes, Workflows and Mashups
- 51. Security: ownership and authorization of both data, as well as executions in the framework
- 52. Data : User data and system runtime dataMulti-tenancy Architecture
- 53. Achieving Tenant IsolationEach Tenant is given a Security Domain
- 54. Each domain may have its own User Store and Permissions, thus have a set of users and permissions enabling users to access resources
- 55. Each domain is isolated and do not have access to other domainsImplementing Data Multi-tenancy Separate DB
- 56. Separate Schema
- 57. Shared SchemaSeparate DatabasesIf you have no control over the code, then this is the only solution
- 58. Horizontally scalable, but relatively expensive9/13/11Tenant 4Tenant 8Tenant 1Vertical scaling is challenging but solvable
- 59. WSO2 Relational Storage Service uses this models to provide users with DBs 25
- 60. Separate SchemaRelatively easy to implement
- 61. Some databases have ways to support this directly but many don’t
- 62. Failure difficult to handle
- 64. Shared Databases, Shared SchemaMost efficient storage-wise and scales very well for large number of tenants
- 65. Requires all accesses to qualify with tenant
- 67. (Stratos uses this approach internally for all provide isolation within WSO2 Registry)9/13/1127
- 68. Implementing Execution IsolationAll executions are based on Axis2
- 69. Axis2 have stateless executions and keep all state in a Context.
- 70. So if we create different context for each tenant, they are isolated. Implementing Execution Isolation (Contd.)
- 71. Implementing Execution Isolation (Contd.)We use Java Security to make sure one tenant cannot access or temper with other tenant’s data structures, file system data etc.
- 72. Example
- 73. Tenant ID value in the context Performance Isolation Performance isolation is a challenging issue.
- 74. We currently relay on monitoring and auditing where we can kill CPU hogging processes
- 75. We are exploring the possibility of changing the priority of CPU hogging processes in the work queues (e.g. workflow engine, ESB etc.). photo Fortes by on Flickr, http://www.fotopedia.com/items/flickr-3193056200
- 76. Scaling Up
- 77. Scaling Multi-tenant Middleware So far we talked about building a single Multi-tenant Node (That is Level 3)
- 78. To reach Level 4, we have to scale.
- 79. To do that
- 80. We have to run this with many nodes, and we have to partition.
- 81. We have to replicate or partition. But we are talking about 1000s of tenants, likely one tenant can not hold all of them.
- 82. So We need to partition
- 83. We also need load balancing, and it should know about tenants.
- 86. Workflow Performance Setup Multi-tenant and non-multi-tenant versions Run 200 workflows from each clientOverhead is minimalMT supports only add few additional lookups and checksJava Security does not come in to play as we do not run user provided code.
- 87. For more details (Publications on the topic)A. Azeez and S. Perera et al., WSO2 Stratos: An Industrial Stack to Support Cloud Computing, IT: Methods and Applications of Informatics and Information Technology Journal, the special Issue on Cloud Computing, 2011.
- 88. AfkhamAzeez, Srinath Perera, DimuthuGamage, Ruwan Linton, PrabathSiriwardana, DimuthuLeelaratne, SanjivaWeerawarana, Paul Fremantle, "Multi-Tenant SOA Middleware for Cloud Computing" 3rd International Conference on Cloud Computing, Florida, 2010
- 89. MilindaPathirage, Srinath Perera, SanjivaWeerawarana, Indika Kumara, A Multi-tenant Architecture for Business Process Execution, 9th International Conference on Web Services (ICWS), 2011ConclusionWe discussed what is Multi-tenancy and why it is crucial for implementing a PaaS.
- 90. We discussed details about implementing it
- 91. Isolation (Data, Execution) .. Isolation vs. sharing tradeoff
- 92. Four level’s of multi-tenancy
- 93. Scaling Design
- 94. Lot of open questions yet to be solved. Your thoughts and code both are welcome.
- 95. Data Security (Encryption, Delegation etc. ), Tenant Migration , Scaling, Lazy loading …Questions?