SlideShare a Scribd company logo
Docker Practice in Alibaba Cloud
Yi Li
Alibaba Cloud Architect
Agenda
• Cloud and Docker Status Update in China
• Successful Stories
• Aliyun Container Service
• Dedicated Cloud Powered By Container
• Scalable Docker Image Distribution
Alibaba Cloud: A Global Player for Cloud Computing
US West
Europe
Russia
CN North
CN East
Japan
Hong Kong
CN South
Singapore
Middle East
Existed
Planned
US East
Alibaba Cloud: 93 Cloud Services Public Available
Cloud and Docker Status Update in China
China cloud relative to the West – DB
 China’s cloud spending to reach 24.5% of the West by 2018 from 5.7% in 2015
 More than 80% respondents are already using or plan to use containers, but only 10% used in production environment.
Survey result from 350+ feedbacks by Alibaba Cloud, June 2016
Docker Adoption in China
version: '2'
services:
wordpress:
image: wordpress:4.5
restart: always
links:
- 'db:mysql'
volumes:
- 'wp_upload:/var/www/html/wp-content/uploads'
environment:
- WORDPRESS_DB_USER=blog
- WORDPRESS_DB_PASSWORD=xxxxxx
- WORDPRESS_DB_NAME=wordpress
- availability:az==2
labels:
aliyun.probe.url: http://container
aliyun.routing.port_80: http://wordpress
aliyun.scale: '3'
aliyun.log_store_wordpress: stdout
db:
external:
host: rdsxxxxxx.mysql.rds.aliyuncs.com
ports:
- 3306
volumes:
wp_upload:
driver: ossfs
driver_opts:
bucket: acs-sample-wordpress
Load Balancing
Service
MySQL Instance
from RDS
Aliyun Container Service
From container to cloud native application
OSSFS OSSFS OSSFS
• Fully compatible to Docker Compose/Swarm
Bucket from
Object Store ServiceOne click to deploy in cloud
AZ-a AZ-b
Cluster of VM nodes
http://wordpress.alicontainer.com
version: '2'
services:
wordpress:
image: wordpress:4.5
restart: always
links:
- 'db:mysql'
volumes:
- 'wp_upload:/var/www/html/wp-content/uploads'
environment:
- WORDPRESS_DB_USER=blog
- WORDPRESS_DB_PASSWORD=xxxxxx
- WORDPRESS_DB_NAME=wordpress
- availability:az==2
labels:
aliyun.probe.url: http://container
aliyun.routing.port_80: http://wordpress
aliyun.scale: '3'
aliyun.log_store_wordpress: stdout
db:
external:
host: rdsxxxxxx.mysql.rds.aliyuncs.com
ports:
- 3306
volumes:
wp_upload:
driver: ossfs
driver_opts:
bucket: acs-sample-wordpress
Load Balancing
Service
Aliyun Container Service
From container to cloud native application
OSSFS OSSFS OSSFS
• Fully compatible to Docker Compose/Swarm
• Assemble the container and cloud services in declarative way
MySQL Instance
from RDS
Bucket from
Object Store ServiceOne click to deploy in cloud
AZ-a AZ-b
Cluster of VM nodes
http://wordpress.alicontainer.com
version: '2'
services:
wordpress:
image: wordpress:4.5
restart: always
links:
- 'db:mysql'
volumes:
- 'wp_upload:/var/www/html/wp-content/uploads'
environment:
- WORDPRESS_DB_USER=blog
- WORDPRESS_DB_PASSWORD=xxxxxx
- WORDPRESS_DB_NAME=wordpress
- availability:az==2
labels:
aliyun.probe.url: http://container
aliyun.routing.port_80: http://wordpress
aliyun.scale: '3'
aliyun.log_store_wordpress: stdout
db:
external:
host: rdsxxxxxx.mysql.rds.aliyuncs.com
ports:
- 3306
volumes:
wp_upload:
driver: ossfs
driver_opts:
bucket: acs-sample-wordpress
Load Balancing
Service
MySQL Instance
from RDS
Aliyun Container Service
From container to cloud native application
OSSFS OSSFS OSSFS
• Fully compatible to Docker Compose/Swarm
• Assemble the container and cloud services in declarative way
• Enable micro-service architecture
Bucket from
Object Store ServiceOne click to deploy in cloud
AZ-a AZ-b
Cluster of VM nodes
http://wordpress.alicontainer.com
Aliyun Container Service
Application
Monitoring
Logging
Application App
Governance
Access
Control
Application
Load balancing, Routing
路由
Service Registration, Discovery Auto Scaling
Rolling update, A/B test, Canary
… Service
Container Orchestration OrchestrationScheduling Cluster Management
Docker Engine
Container
Docker Image
Compose template
Repository
Storage
Block Storage, Network FS, Object Storage
Networking
Classic/VPC, Hybrid Cloud,
Public Cloud Dedicate Cloud
Access
Configuration
Management
Caching
Service
DBaaS
MySQL,,
Mongo …
Messaging
Service
CI/CD
SCM
Middleware
Services
DevOps
3rd
Extensions
ExtensionsExtensions
3rd
Extensions
Aliyun Container Service
Application
Monitoring
Logging
Application App
Governance
Access
Control
Application
Load balancing, Routing
路由
Service Registration, Discovery Auto Scaling
Rolling update, A/B test, Canary
… Service
Container Orchestration OrchestrationScheduling Cluster Management
Docker Engine
Container
Docker Image
Compose template
Repository
Storage
Block Storage, Network FS, Object Storage
Networking
Classic/VPC, Hybrid Cloud,
Public Cloud Dedicate Cloud
Access
Configuration
Management
Caching
Service
DBaaS
MySQL,,
Mongo …
Messaging
Service
CI/CD
SCM
Middleware
Services
DevOps
3rd
Extensions
ExtensionsExtensions
3rd
Extensions
Fully compatible to Docker ecosystem
Optimized volume/networking for Alibaba Cloud
Enables micro-service architecture
Supports different workload
Web/Mobile, HPC, Event-driven, etc.
Integrateswithcloudservices
DevOpsbydesign
Secure,Controllable,andExtensible
Reference Customers and Partners
Apsara Stack- Full Stack Dedicated Cloud
Open API (REST, SDK, Orchestration Template)
Customer-owned Infrastructure
ManagementandOperation
Distributed Coordination
Service
Distributed storage Service
Distributed resource
management and scheduling
Distributed Data Center Management
Elastic Compute Storage Services VPC Database Services
Big Data Security Services Application Services
Internet Scale
Middleware Services
EnterpriseSecurityFramework
Challenges
 Deliver the full stack cloud
efficiently
 Minimize the resource overhead
 HA and self-managed system
 Continuing evolution
Apsara Kernel : Unified, large scale, distributed computing framework
100+ controller services developed by different teams
Each service has different dependencies of runtimes and libs
Deploy Dedicated Cloud in Few Person Days
Docker
Image
Registry
Configuration
Management
Data Center
Management
Unified service description for all controller services
(In Docker Compose style format with extensions)
Properties
Requirements (depends)
Capabilities (provides)
Probes
Healthy & monitoring
Constrains
HA, placement, …
Image
S1
S3 S4
S5
S7S6
Determine execution plan by resolving the
dependencies among services automatically
S2
1
Lookup
configuration2
3
X86 Server
X86 Server
X86 Server
Linux (AliOS)
Docker Engine (Docker with Ali Extensions)
VXLAN/
VLAN
Network
Plugin
Management
Agent
n + 1 hot backup
Recover node failure in minutes
Clone the controller nodes from base
OS image with Docker Engine
Deploy and configure service controllers
as Docker containers4
Service Controller
Container
Service Controller
Container
Service
Controller
Container
X86 Server
X86 Server
Clone the worker nodes from base OS image, deploy and configure
the service workers on baremetal
X86 Server
Linux (AliOS)
Service Worker (Elastic Computing, Storage, Big Data, etc.)
Management
Agent
5
Scalable Docker Image Distribution in Alibaba Group
Docker
Registry with
Index Server Massive, secure and highly reliable
object storage service
Mirror
OSS
OSS
tracker
CI/CD
DC 1 DC 2
Other data centers in China
and around the world …
Headquarter
10K+ servers concurrent
pulling image within one
Data Center
30% faster layer download
through p2p distribution
Docker Engine enhanced with private registry mirror
Docker
Proxy with P2P
minion client
Docker
Proxy with P2P
minion client
Docker
Proxy with P2P
minion client
Docker
Proxy with P2P
minion client
Mirror
OSS
Docker
Proxy with P2P
minion client
Docker
Proxy with P2P
minion client
Docker
Proxy with P2P
minion client
Docker
Proxy with P2P
minion client
tracker
Thank you!

More Related Content

PDF
Highly Available Persistent Applications in Containers by Kendrick Coleman, E...
Docker, Inc.
 
PPTX
Docker Datacenter Overview and Production Setup Slides
Docker, Inc.
 
PPTX
Docker and Microsoft - Windows Server 2016 Technical Deep Dive
Docker, Inc.
 
PPTX
Docker Roadshow 2016
Docker, Inc.
 
PDF
Infinit's Next Generation Key-value Store - Julien Quintard and Quentin Hocqu...
Docker, Inc.
 
PPTX
Photon Controller: An Open Source Container Infrastructure Platform from VMware
Docker, Inc.
 
ODP
Practical Container Security by Mrunal Patel and Thomas Cameron, Red Hat
Docker, Inc.
 
PPTX
Docker Meetup 08 03-2016
Docker
 
Highly Available Persistent Applications in Containers by Kendrick Coleman, E...
Docker, Inc.
 
Docker Datacenter Overview and Production Setup Slides
Docker, Inc.
 
Docker and Microsoft - Windows Server 2016 Technical Deep Dive
Docker, Inc.
 
Docker Roadshow 2016
Docker, Inc.
 
Infinit's Next Generation Key-value Store - Julien Quintard and Quentin Hocqu...
Docker, Inc.
 
Photon Controller: An Open Source Container Infrastructure Platform from VMware
Docker, Inc.
 
Practical Container Security by Mrunal Patel and Thomas Cameron, Red Hat
Docker, Inc.
 
Docker Meetup 08 03-2016
Docker
 

What's hot (20)

PDF
Docker Datacenter - CaaS
Harish Jayakumar
 
PPTX
Docker Bday #5, SF Edition: Introduction to Docker
Docker, Inc.
 
PPTX
Docker Basic to Advance
Paras Jain
 
PDF
Production Ready Containers from IBM and Docker
Docker, Inc.
 
PPTX
Docker SF Meetup January 2016
Patrick Chanezon
 
PDF
On-the-Fly Containerization of Enterprise Java & .NET Apps by Amjad Afanah
Docker, Inc.
 
PPTX
What's New in Docker - February 2017
Patrick Chanezon
 
PDF
Proof of Concept: Serverless with Swarm by Nirmal Mehta, Booz Allen Hamilton
Docker, Inc.
 
PPTX
DockerCon 16 General Session Day 2
Docker, Inc.
 
PPTX
Docker Azure Friday OSS March 2017 - Developing and deploying Java & Linux on...
Patrick Chanezon
 
PPTX
Docker introduction & benefits
Amit Manwade
 
PPTX
Dockercon 2017 EU Recap
Ajeet Singh Raina
 
PDF
DockerCon EU 2015: Day 1 General Session
Docker, Inc.
 
PDF
Docker Containers Deep Dive
Will Kinard
 
PDF
Modernizing Java Apps with Docker
Docker, Inc.
 
PDF
Practical Design Patterns in Docker Networking
Docker, Inc.
 
PDF
The Docker Ecosystem
Dmitry Skaredov
 
PDF
DCEU 18: Docker Enterprise Platform and Architecture
Docker, Inc.
 
PPTX
Introduction to Docker - 2017
Docker, Inc.
 
PDF
Microservices + Events + Docker = A Perfect Trio by Docker Captain Chris Rich...
Docker, Inc.
 
Docker Datacenter - CaaS
Harish Jayakumar
 
Docker Bday #5, SF Edition: Introduction to Docker
Docker, Inc.
 
Docker Basic to Advance
Paras Jain
 
Production Ready Containers from IBM and Docker
Docker, Inc.
 
Docker SF Meetup January 2016
Patrick Chanezon
 
On-the-Fly Containerization of Enterprise Java & .NET Apps by Amjad Afanah
Docker, Inc.
 
What's New in Docker - February 2017
Patrick Chanezon
 
Proof of Concept: Serverless with Swarm by Nirmal Mehta, Booz Allen Hamilton
Docker, Inc.
 
DockerCon 16 General Session Day 2
Docker, Inc.
 
Docker Azure Friday OSS March 2017 - Developing and deploying Java & Linux on...
Patrick Chanezon
 
Docker introduction & benefits
Amit Manwade
 
Dockercon 2017 EU Recap
Ajeet Singh Raina
 
DockerCon EU 2015: Day 1 General Session
Docker, Inc.
 
Docker Containers Deep Dive
Will Kinard
 
Modernizing Java Apps with Docker
Docker, Inc.
 
Practical Design Patterns in Docker Networking
Docker, Inc.
 
The Docker Ecosystem
Dmitry Skaredov
 
DCEU 18: Docker Enterprise Platform and Architecture
Docker, Inc.
 
Introduction to Docker - 2017
Docker, Inc.
 
Microservices + Events + Docker = A Perfect Trio by Docker Captain Chris Rich...
Docker, Inc.
 
Ad

Similar to Docker Practice in Alibaba Cloud by Li Yi (Mark) & Zuhe Li (Sogo) (20)

PDF
DockerCon US 2016 - Docker Practice in Alibaba Cloud
Li Yi
 
PPTX
Docker Demystified - Virtual VMs without the Fat
Erik Osterman
 
PDF
Evolution of container orchestration in Alibaba Cloud
Li Yi
 
PDF
Alibaba Cloud Conference 2016 - Docker Enterprise
John Willis
 
PPTX
Docker Enterprise Workshop - Intro
Patrick Chanezon
 
PPTX
Docker Container As A Service - March 2016
Patrick Chanezon
 
PPTX
Containers as a Service with Docker
Docker, Inc.
 
PDF
Microservices Architecture with AWS @ AnyMind Group
Giang Tran
 
PDF
AnyMind Group Tech Talk - Microservices architecture with AWS
Nhân Nguyễn
 
PDF
Dessi docker kubernetes paas cloud
Massimiliano Dessì
 
PDF
Come costruire una Platform As A Service con Docker, Kubernetes Go e Java
Codemotion
 
PPTX
Dockercon EU 2015
John Fiedler
 
PPTX
How to be successful running Docker in Production
Docker, Inc.
 
PPTX
DockerCon 2017: Docker in China
Zhimin Tang
 
PDF
DCSF19 Containers for Beginners
Docker, Inc.
 
PPTX
4 Success stories in 3 years - A Docker Production Journey
Yun Zhi Lin
 
PDF
Journey to Docker Production: Evolving Your Infrastructure and Processes - Br...
Docker, Inc.
 
PPTX
Docker Demystified for SB JUG
Erik Osterman
 
PDF
Docker and Cloud - Enables for DevOps - by ACA-IT
Stijn Wijndaele
 
PDF
'DOCKER' & CLOUD: ENABLERS For DEVOPS
ACA IT-Solutions
 
DockerCon US 2016 - Docker Practice in Alibaba Cloud
Li Yi
 
Docker Demystified - Virtual VMs without the Fat
Erik Osterman
 
Evolution of container orchestration in Alibaba Cloud
Li Yi
 
Alibaba Cloud Conference 2016 - Docker Enterprise
John Willis
 
Docker Enterprise Workshop - Intro
Patrick Chanezon
 
Docker Container As A Service - March 2016
Patrick Chanezon
 
Containers as a Service with Docker
Docker, Inc.
 
Microservices Architecture with AWS @ AnyMind Group
Giang Tran
 
AnyMind Group Tech Talk - Microservices architecture with AWS
Nhân Nguyễn
 
Dessi docker kubernetes paas cloud
Massimiliano Dessì
 
Come costruire una Platform As A Service con Docker, Kubernetes Go e Java
Codemotion
 
Dockercon EU 2015
John Fiedler
 
How to be successful running Docker in Production
Docker, Inc.
 
DockerCon 2017: Docker in China
Zhimin Tang
 
DCSF19 Containers for Beginners
Docker, Inc.
 
4 Success stories in 3 years - A Docker Production Journey
Yun Zhi Lin
 
Journey to Docker Production: Evolving Your Infrastructure and Processes - Br...
Docker, Inc.
 
Docker Demystified for SB JUG
Erik Osterman
 
Docker and Cloud - Enables for DevOps - by ACA-IT
Stijn Wijndaele
 
'DOCKER' & CLOUD: ENABLERS For DEVOPS
ACA IT-Solutions
 
Ad

More from Docker, Inc. (20)

PDF
Containerize Your Game Server for the Best Multiplayer Experience
Docker, Inc.
 
PDF
How to Improve Your Image Builds Using Advance Docker Build
Docker, Inc.
 
PDF
Build & Deploy Multi-Container Applications to AWS
Docker, Inc.
 
PDF
Securing Your Containerized Applications with NGINX
Docker, Inc.
 
PDF
How To Build and Run Node Apps with Docker and Compose
Docker, Inc.
 
PDF
Hands-on Helm
Docker, Inc.
 
PDF
Distributed Deep Learning with Docker at Salesforce
Docker, Inc.
 
PDF
The First 10M Pulls: Building The Official Curl Image for Docker Hub
Docker, Inc.
 
PDF
Monitoring in a Microservices World
Docker, Inc.
 
PDF
COVID-19 in Italy: How Docker is Helping the Biggest Italian IT Company Conti...
Docker, Inc.
 
PDF
Predicting Space Weather with Docker
Docker, Inc.
 
PDF
Become a Docker Power User With Microsoft Visual Studio Code
Docker, Inc.
 
PDF
How to Use Mirroring and Caching to Optimize your Container Registry
Docker, Inc.
 
PDF
Monolithic to Microservices + Docker = SDLC on Steroids!
Docker, Inc.
 
PDF
Kubernetes at Datadog Scale
Docker, Inc.
 
PDF
Labels, Labels, Labels
Docker, Inc.
 
PDF
Using Docker Hub at Scale to Support Micro Focus' Delivery and Deployment Model
Docker, Inc.
 
PDF
Build & Deploy Multi-Container Applications to AWS
Docker, Inc.
 
PDF
From Fortran on the Desktop to Kubernetes in the Cloud: A Windows Migration S...
Docker, Inc.
 
PDF
Developing with Docker for the Arm Architecture
Docker, Inc.
 
Containerize Your Game Server for the Best Multiplayer Experience
Docker, Inc.
 
How to Improve Your Image Builds Using Advance Docker Build
Docker, Inc.
 
Build & Deploy Multi-Container Applications to AWS
Docker, Inc.
 
Securing Your Containerized Applications with NGINX
Docker, Inc.
 
How To Build and Run Node Apps with Docker and Compose
Docker, Inc.
 
Hands-on Helm
Docker, Inc.
 
Distributed Deep Learning with Docker at Salesforce
Docker, Inc.
 
The First 10M Pulls: Building The Official Curl Image for Docker Hub
Docker, Inc.
 
Monitoring in a Microservices World
Docker, Inc.
 
COVID-19 in Italy: How Docker is Helping the Biggest Italian IT Company Conti...
Docker, Inc.
 
Predicting Space Weather with Docker
Docker, Inc.
 
Become a Docker Power User With Microsoft Visual Studio Code
Docker, Inc.
 
How to Use Mirroring and Caching to Optimize your Container Registry
Docker, Inc.
 
Monolithic to Microservices + Docker = SDLC on Steroids!
Docker, Inc.
 
Kubernetes at Datadog Scale
Docker, Inc.
 
Labels, Labels, Labels
Docker, Inc.
 
Using Docker Hub at Scale to Support Micro Focus' Delivery and Deployment Model
Docker, Inc.
 
Build & Deploy Multi-Container Applications to AWS
Docker, Inc.
 
From Fortran on the Desktop to Kubernetes in the Cloud: A Windows Migration S...
Docker, Inc.
 
Developing with Docker for the Arm Architecture
Docker, Inc.
 

Recently uploaded (20)

PDF
GDG Cloud Munich - Intro - Luiz Carneiro - #BuildWithAI - July - Abdel.pdf
Luiz Carneiro
 
PDF
A Strategic Analysis of the MVNO Wave in Emerging Markets.pdf
IPLOOK Networks
 
PPTX
IT Runs Better with ThousandEyes AI-driven Assurance
ThousandEyes
 
PPTX
Agile Chennai 18-19 July 2025 | Emerging patterns in Agentic AI by Bharani Su...
AgileNetwork
 
PDF
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
PPTX
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
PDF
Economic Impact of Data Centres to the Malaysian Economy
flintglobalapac
 
PDF
The Future of Mobile Is Context-Aware—Are You Ready?
iProgrammer Solutions Private Limited
 
PDF
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
 
PPTX
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
PDF
AI-Cloud-Business-Management-Platforms-The-Key-to-Efficiency-Growth.pdf
Artjoker Software Development Company
 
PDF
Brief History of Internet - Early Days of Internet
sutharharshit158
 
PPTX
Agile Chennai 18-19 July 2025 Ideathon | AI Powered Microfinance Literacy Gui...
AgileNetwork
 
PPTX
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
 
PPTX
Introduction to Flutter by Ayush Desai.pptx
ayushdesai204
 
PDF
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
PDF
Orbitly Pitch Deck|A Mission-Driven Platform for Side Project Collaboration (...
zz41354899
 
PDF
MASTERDECK GRAPHSUMMIT SYDNEY (Public).pdf
Neo4j
 
PDF
OFFOFFBOX™ – A New Era for African Film | Startup Presentation
ambaicciwalkerbrian
 
PDF
How ETL Control Logic Keeps Your Pipelines Safe and Reliable.pdf
Stryv Solutions Pvt. Ltd.
 
GDG Cloud Munich - Intro - Luiz Carneiro - #BuildWithAI - July - Abdel.pdf
Luiz Carneiro
 
A Strategic Analysis of the MVNO Wave in Emerging Markets.pdf
IPLOOK Networks
 
IT Runs Better with ThousandEyes AI-driven Assurance
ThousandEyes
 
Agile Chennai 18-19 July 2025 | Emerging patterns in Agentic AI by Bharani Su...
AgileNetwork
 
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
Economic Impact of Data Centres to the Malaysian Economy
flintglobalapac
 
The Future of Mobile Is Context-Aware—Are You Ready?
iProgrammer Solutions Private Limited
 
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
 
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
AI-Cloud-Business-Management-Platforms-The-Key-to-Efficiency-Growth.pdf
Artjoker Software Development Company
 
Brief History of Internet - Early Days of Internet
sutharharshit158
 
Agile Chennai 18-19 July 2025 Ideathon | AI Powered Microfinance Literacy Gui...
AgileNetwork
 
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
 
Introduction to Flutter by Ayush Desai.pptx
ayushdesai204
 
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
Orbitly Pitch Deck|A Mission-Driven Platform for Side Project Collaboration (...
zz41354899
 
MASTERDECK GRAPHSUMMIT SYDNEY (Public).pdf
Neo4j
 
OFFOFFBOX™ – A New Era for African Film | Startup Presentation
ambaicciwalkerbrian
 
How ETL Control Logic Keeps Your Pipelines Safe and Reliable.pdf
Stryv Solutions Pvt. Ltd.
 

Docker Practice in Alibaba Cloud by Li Yi (Mark) & Zuhe Li (Sogo)

  • 1. Docker Practice in Alibaba Cloud Yi Li Alibaba Cloud Architect
  • 2. Agenda • Cloud and Docker Status Update in China • Successful Stories • Aliyun Container Service • Dedicated Cloud Powered By Container • Scalable Docker Image Distribution
  • 3. Alibaba Cloud: A Global Player for Cloud Computing US West Europe Russia CN North CN East Japan Hong Kong CN South Singapore Middle East Existed Planned US East
  • 4. Alibaba Cloud: 93 Cloud Services Public Available
  • 5. Cloud and Docker Status Update in China China cloud relative to the West – DB  China’s cloud spending to reach 24.5% of the West by 2018 from 5.7% in 2015  More than 80% respondents are already using or plan to use containers, but only 10% used in production environment. Survey result from 350+ feedbacks by Alibaba Cloud, June 2016 Docker Adoption in China
  • 6. version: '2' services: wordpress: image: wordpress:4.5 restart: always links: - 'db:mysql' volumes: - 'wp_upload:/var/www/html/wp-content/uploads' environment: - WORDPRESS_DB_USER=blog - WORDPRESS_DB_PASSWORD=xxxxxx - WORDPRESS_DB_NAME=wordpress - availability:az==2 labels: aliyun.probe.url: http://container aliyun.routing.port_80: http://wordpress aliyun.scale: '3' aliyun.log_store_wordpress: stdout db: external: host: rdsxxxxxx.mysql.rds.aliyuncs.com ports: - 3306 volumes: wp_upload: driver: ossfs driver_opts: bucket: acs-sample-wordpress Load Balancing Service MySQL Instance from RDS Aliyun Container Service From container to cloud native application OSSFS OSSFS OSSFS • Fully compatible to Docker Compose/Swarm Bucket from Object Store ServiceOne click to deploy in cloud AZ-a AZ-b Cluster of VM nodes http://wordpress.alicontainer.com
  • 7. version: '2' services: wordpress: image: wordpress:4.5 restart: always links: - 'db:mysql' volumes: - 'wp_upload:/var/www/html/wp-content/uploads' environment: - WORDPRESS_DB_USER=blog - WORDPRESS_DB_PASSWORD=xxxxxx - WORDPRESS_DB_NAME=wordpress - availability:az==2 labels: aliyun.probe.url: http://container aliyun.routing.port_80: http://wordpress aliyun.scale: '3' aliyun.log_store_wordpress: stdout db: external: host: rdsxxxxxx.mysql.rds.aliyuncs.com ports: - 3306 volumes: wp_upload: driver: ossfs driver_opts: bucket: acs-sample-wordpress Load Balancing Service Aliyun Container Service From container to cloud native application OSSFS OSSFS OSSFS • Fully compatible to Docker Compose/Swarm • Assemble the container and cloud services in declarative way MySQL Instance from RDS Bucket from Object Store ServiceOne click to deploy in cloud AZ-a AZ-b Cluster of VM nodes http://wordpress.alicontainer.com
  • 8. version: '2' services: wordpress: image: wordpress:4.5 restart: always links: - 'db:mysql' volumes: - 'wp_upload:/var/www/html/wp-content/uploads' environment: - WORDPRESS_DB_USER=blog - WORDPRESS_DB_PASSWORD=xxxxxx - WORDPRESS_DB_NAME=wordpress - availability:az==2 labels: aliyun.probe.url: http://container aliyun.routing.port_80: http://wordpress aliyun.scale: '3' aliyun.log_store_wordpress: stdout db: external: host: rdsxxxxxx.mysql.rds.aliyuncs.com ports: - 3306 volumes: wp_upload: driver: ossfs driver_opts: bucket: acs-sample-wordpress Load Balancing Service MySQL Instance from RDS Aliyun Container Service From container to cloud native application OSSFS OSSFS OSSFS • Fully compatible to Docker Compose/Swarm • Assemble the container and cloud services in declarative way • Enable micro-service architecture Bucket from Object Store ServiceOne click to deploy in cloud AZ-a AZ-b Cluster of VM nodes http://wordpress.alicontainer.com
  • 9. Aliyun Container Service Application Monitoring Logging Application App Governance Access Control Application Load balancing, Routing 路由 Service Registration, Discovery Auto Scaling Rolling update, A/B test, Canary … Service Container Orchestration OrchestrationScheduling Cluster Management Docker Engine Container Docker Image Compose template Repository Storage Block Storage, Network FS, Object Storage Networking Classic/VPC, Hybrid Cloud, Public Cloud Dedicate Cloud Access Configuration Management Caching Service DBaaS MySQL,, Mongo … Messaging Service CI/CD SCM Middleware Services DevOps 3rd Extensions ExtensionsExtensions 3rd Extensions
  • 10. Aliyun Container Service Application Monitoring Logging Application App Governance Access Control Application Load balancing, Routing 路由 Service Registration, Discovery Auto Scaling Rolling update, A/B test, Canary … Service Container Orchestration OrchestrationScheduling Cluster Management Docker Engine Container Docker Image Compose template Repository Storage Block Storage, Network FS, Object Storage Networking Classic/VPC, Hybrid Cloud, Public Cloud Dedicate Cloud Access Configuration Management Caching Service DBaaS MySQL,, Mongo … Messaging Service CI/CD SCM Middleware Services DevOps 3rd Extensions ExtensionsExtensions 3rd Extensions Fully compatible to Docker ecosystem Optimized volume/networking for Alibaba Cloud Enables micro-service architecture Supports different workload Web/Mobile, HPC, Event-driven, etc. Integrateswithcloudservices DevOpsbydesign Secure,Controllable,andExtensible
  • 12. Apsara Stack- Full Stack Dedicated Cloud Open API (REST, SDK, Orchestration Template) Customer-owned Infrastructure ManagementandOperation Distributed Coordination Service Distributed storage Service Distributed resource management and scheduling Distributed Data Center Management Elastic Compute Storage Services VPC Database Services Big Data Security Services Application Services Internet Scale Middleware Services EnterpriseSecurityFramework Challenges  Deliver the full stack cloud efficiently  Minimize the resource overhead  HA and self-managed system  Continuing evolution Apsara Kernel : Unified, large scale, distributed computing framework 100+ controller services developed by different teams Each service has different dependencies of runtimes and libs
  • 13. Deploy Dedicated Cloud in Few Person Days Docker Image Registry Configuration Management Data Center Management Unified service description for all controller services (In Docker Compose style format with extensions) Properties Requirements (depends) Capabilities (provides) Probes Healthy & monitoring Constrains HA, placement, … Image S1 S3 S4 S5 S7S6 Determine execution plan by resolving the dependencies among services automatically S2 1 Lookup configuration2 3 X86 Server X86 Server X86 Server Linux (AliOS) Docker Engine (Docker with Ali Extensions) VXLAN/ VLAN Network Plugin Management Agent n + 1 hot backup Recover node failure in minutes Clone the controller nodes from base OS image with Docker Engine Deploy and configure service controllers as Docker containers4 Service Controller Container Service Controller Container Service Controller Container X86 Server X86 Server Clone the worker nodes from base OS image, deploy and configure the service workers on baremetal X86 Server Linux (AliOS) Service Worker (Elastic Computing, Storage, Big Data, etc.) Management Agent 5
  • 14. Scalable Docker Image Distribution in Alibaba Group Docker Registry with Index Server Massive, secure and highly reliable object storage service Mirror OSS OSS tracker CI/CD DC 1 DC 2 Other data centers in China and around the world … Headquarter 10K+ servers concurrent pulling image within one Data Center 30% faster layer download through p2p distribution Docker Engine enhanced with private registry mirror Docker Proxy with P2P minion client Docker Proxy with P2P minion client Docker Proxy with P2P minion client Docker Proxy with P2P minion client Mirror OSS Docker Proxy with P2P minion client Docker Proxy with P2P minion client Docker Proxy with P2P minion client Docker Proxy with P2P minion client tracker

Editor's Notes

  • #10: Optimize for application lifecycle in Cloud Micro-service architecture Orchestrate container and cloud services Secure and controlled DevOps by design
  • #11: Optimize for application lifecycle in Cloud Micro-service architecture Orchestrate container and cloud services Secure and controlled DevOps by design
  • #14: Service Lifecycle: DB Init, DB upgrade, 幂等 Container Lifecycle Service Healthy Check: Service Ready, Service Update AG Container: Standard for delivery and running Placement: SSD, Affinity, Failover: Common Infrastructure Service: DNS, NTP, Yum, Clone Admin Gatway SLB, RDS, Monitoring, Storage, ECS, BigData OSPF 10G Switch 100+ Services, 700+ Containers, 100 DB