Scaling Multi-Cloud Deployments with Denodo: Automated Infrastructure Management
0 likes135 views
The document discusses the concept of a logical data fabric as the future of data management and analytics, emphasizing its role in enabling multi-cloud deployments and addressing integration challenges. It highlights Denodo's solutions, including the Solution Manager, which supports automated cloud mode for simplifying deployments across hybrid environments. The key takeaways include future enhancements to support Azure, containerized deployments, and improved provisioning and management features.
Scaling Multi-Cloud Deployments with Denodo: Automated Infrastructure Management
- 2. Logical Data Fabric: The Future of Data Management and Analytics #DenodoDataFest
- 3. #DenodoDataFest Scaling Multi-Cloud Deployments with Denodo: Automated Infrastructure Management SVP Data Architectures & Chief Evangelist, Denodo Technologies Paul Moxon Sales Engineer, Denodo Technologies Senthil Ramesh JV
- 4. Agenda 1. Collect or Connect? 2. The Need for a Logical Data Fabric 3. Multi-Cloud Deployment Challenges 4. The Role of Denodo Solution Manager 5. Denodo Platform Demo 6. Summary 7. Q&A
- 5. 5 Move Your Data into a Single… Data Warehouse Data Lake Cloud
- 6. 6 Data Anti-Gravity ▪ Geography ▪ Ownership ▪ Technology
- 7. 7 Denodo Cloud Survey 2020 • More than 75% of companies already have projects in cloud • Over 15% are Cloud-First and/or are in “advanced” state • Only 3.97% do not have plans for Cloud in the short term • More than 53% have hybrid integration needs • Key Use Cases include: Analytics (50%), Data Lake (31%), AI/ML (28%) • Less than 9% of on-prem systems are decommissioned (Forrester estimates 8%) • Key Technologies in Cloud Journey: Cloud Platform Tools (56%), Data Virtualization (49.5%), Data Lake Technology (48%) Source: Denodo Global Cloud Survey 2020
- 8. 8 DV is a Distributed and Logical Architecture ▪ Distributed: Data resides in multiple systems / locations ▪ Data today is too big and distributed ▪ Modern analytics needs are too diverse: one size never fits all ▪ Hybrid and multi-cloud ▪ Logical: Consumers access data through semantic models, decoupled from data location and physical schemas ▪ Semantic models adapt to consumer needs and enforce common policies ▪ Not necessarily virtual/federated access: any delivery style including replication when needed ▪ Allows for technology evolution and infrastructure changes (e.g. cloud transition)
- 9. 9 This is a Key Idea in a Data Fabric design • A data fabric is a distributed and logical architecture • A Data fabric enables multiple data integration strategies • Needs to empower the user to apply the strategy that better fits the scenario • Sometimes federation works great, others replication is best
- 10. 10 Role of the Denodo Solution Manager
- 11. 11 Role of the Solution Manager (Cont’d) • Solution Manager supports many functionalities • License management • Product updates and version consistency • Monitoring environments • Defining environment configurations • Creation and management of configuration revisions • Promotion of revisions between environments • Solution Manager is key component for DevOps
- 12. 12 Automation in the Cloud • Cloud infrastructures provide automation configuration and deployment capabilities • Launchable images • Configurable storage options • Auto-scaling groups/Scale sets to scale up down • Configurable load balancers • Security groups • Centralized logging • Available via APIs (e.g. AWS API)
- 13. 13 Solution Manager – Automated Cloud Mode • Configure hybrid, multi-Cloud Denodo Platform deployments • Environments on-premises and in Cloud • Managed from a single place • Configure Cloud infrastructure components of Denodo Platform deployment • AMIs to launch for VDP Servers, Denodo Data Catalog, and Denodo Scheduler • Load balancers, Auto-scaling groups, Storage options, Security groups, Denodo logging configurations • Automatically launch and shutdown infrastructure components • e.g. launch/shutdown AMI instances containing VDP Servers
- 15. 15 In this demo, we will learn how to … • Configure the AWS credentials in Solution Manager • Configure the support credentials in Solution Manager • Configure the logging on S3 buckets • Create an Environment through the automated mode using AWS credentials • Create a cluster that consists of a VDP instance • Understand the cluster creation events • Understand how to start/stop/restart the instances from the solution manager
- 16. 16 We will also see how to… • Install Updates on the Denodo Platform components directly from the solution manager. • From Support Site • From S3 Bucket • Login to the Design Studio of the new instance and do basic queries • Setup the authentication for the solution manager components including LDAP and Single Sign on • Overview on Promotions and deployments between the environments that are on-prem or in cloud.
- 17. Conclusions
- 18. 18 Key Takeaways • Denodo Platform 8.0’s new Automated Cloud Mode simplifies hybrid and Cloud deployments • Define Denodo environment for AWS from Solution Manager • Define images to be launched • Define autoscaling groups • Define Elastic Load Balancers • Define storage options • Define Security Group settings • Define logging configuration
- 19. 19 Future Enhancements • Support for Automated Cloud Mode for Microsoft Azure – Q4, 2021 • Support for Automated Mode for on-premise containerized deployments (Kubernetes) – H1, 2022 • Assign IAM policies to instances provisioned via Solution Manager – Q4, 2021 • Assign customizable tags to instance provisioned by Solution Manager – H1, 2022 • Migrations via Solution Manager with externalized Metadata repository – Q4, 2021 and H1, 2022
- 20. Any announcement or transition message #DenodoDataFest
- 24. © Copyright Denodo Technologies. All rights reserved Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written authorization from Denodo Technologies. Thank You!