The age of orchestration: from Docker basics to cluster management
4 likes2,422 views
The document discusses the concepts of Docker and orchestration tools, highlighting their roles in managing applications and infrastructure. It describes various Docker tools such as Docker Machine, Docker Compose, and Docker Swarm, providing insights into their functionalities and applications. The presentation emphasizes the efficiency of Docker containers over traditional virtual machines and introduces strategies for deploying and managing containerized applications in a cluster environment.
![20
TOOL NR.1
Docker machine
Simple command line tool to provision local
and remote hosts with Docker installed.
Fantastic to get up and running fast. It has
drivers for many Internet service providers
and PaaS.
Docker machine
$ docker-machine create -d v
INFO[0000] Downloading boot2
INFO[0001] Creating SSH key.
INFO[0001] Creating VirtualB
INFO[0006] Starting VirtualB
INFO[0007] Waiting for VM to
INFO[0041] "dev" has been cr](https://image.slidesharecdn.com/paolucci-javazone-2015-age-of-orchestration-150911085935-lva1-app6892/85/The-age-of-orchestration-from-Docker-basics-to-cluster-management-21-320.jpg)
![• Provision a machine with
Docker installed and ready
• Pull a minimal image
• Run a few docker commands
• Tear down the machine
Docker machine DEMO
$ docker-machine create -d virtualb
INFO[0000] Downloading boot2docker.
INFO[0001] Creating SSH key...
INFO[0001] Creating VirtualBox VM..
INFO[0006] Starting VirtualBox VM..
INFO[0007] Waiting for VM to start.
INFO[0041] "dev" has been created a](https://image.slidesharecdn.com/paolucci-javazone-2015-age-of-orchestration-150911085935-lva1-app6892/85/The-age-of-orchestration-from-Docker-basics-to-cluster-management-22-320.jpg)
![• “docker-machine create” to provision the host, locally or remotely
• “docker-machine ls” to list the machines
• “docker-machine stop/rm” to stop and remove
Recap of what you saw
$ docker-machine create -d
INFO[0000] Downloading boo
INFO[0001] Creating SSH ke
INFO[0001] Creating Virtua
INFO[0006] Starting Virtua
INFO[0007] Waiting for VM
INFO[0041] "dev" has been](https://image.slidesharecdn.com/paolucci-javazone-2015-age-of-orchestration-150911085935-lva1-app6892/85/The-age-of-orchestration-from-Docker-basics-to-cluster-management-23-320.jpg)
![• Alpine Linux provides a minimal
container image of 5MB
• It includes BusyBox and a
package manager
• OpenJDK 7 is already on it…
• Resulting in a 123MB Java image
Start with a smaller base image
FROM alpine:3.2
RUN apk --update add openjdk7-jre
CMD ["/usr/bin/java", "-version"]](https://image.slidesharecdn.com/paolucci-javazone-2015-age-of-orchestration-150911085935-lva1-app6892/85/The-age-of-orchestration-from-Docker-basics-to-cluster-management-36-320.jpg)
The age of orchestration: from Docker basics to cluster management
- 1. The age of orchestration NICOLA PAOLUCCI • DEVELOPER INSTIGATOR • ATLASSIAN • @DURDN From Docker basics to cluster management
- 2. 2 Time me and ring a bell if I am over it. Just kidding I’ll be over by a bit but it’s ok. We’re friends. Three minute Docker intro?
- 3. 3 BINS/LIBS GUEST OS HYPERVISOR HOST OS SERVER ROBUST MONOLITHIC SLOW TO BOOT HEAVY OVERHEAD APP A BINS/LIBS GUEST OS APP B DEFINITIONS Traditional Virtual Machines
- 4. 4 DOCKER ENGINE HOST OS SERVER LEAN LIGHTWEIGHT ISOLATED PORTABLE EFFICIENT BINS/LIBS APP A BINS/LIBS APP B DEFINITIONS Docker Containers
- 5. 5 DEFINITIONS Seen from another angle, the core of Docker is four distinct things Clearly defined interfaces Central registry of ready images Caching mechanism to re-use steps A standard format to package applications
- 6. 6 DO WE USE IT? We have embraced Docker on two fronts For our internal PaaS In our products NOT PART OF THIS SESSION
- 7. @durdn Our internal PaaS, called Micros
- 9. 9 File infrastructure numbers Containers spun per conversion 5 9
- 10. 10 File infrastructure numbers Containers spun per month M6 10
- 11. @durdn
- 12. @durdn Orchestration is the next arena
- 13. What’s Orchestration? 13 Services YOUR APPLICATION Orchestration FRAMEWORKS Data Center PHYSICAL INFRA
- 14. What’s Orchestration? 13 Services YOUR APPLICATION Orchestration FRAMEWORKS Data Center PHYSICAL INFRA
- 15. @durdn
- 16. @durdn
- 17. @durdn
- 18. 17
- 19. 18 Docker’s Own Orchestration Tools Docker machine Docker compose Docker swarm Docker network
- 20. Where is the DEMO Lebowski?
- 21. 20 TOOL NR.1 Docker machine Simple command line tool to provision local and remote hosts with Docker installed. Fantastic to get up and running fast. It has drivers for many Internet service providers and PaaS. Docker machine $ docker-machine create -d v INFO[0000] Downloading boot2 INFO[0001] Creating SSH key. INFO[0001] Creating VirtualB INFO[0006] Starting VirtualB INFO[0007] Waiting for VM to INFO[0041] "dev" has been cr
- 22. • Provision a machine with Docker installed and ready • Pull a minimal image • Run a few docker commands • Tear down the machine Docker machine DEMO $ docker-machine create -d virtualb INFO[0000] Downloading boot2docker. INFO[0001] Creating SSH key... INFO[0001] Creating VirtualBox VM.. INFO[0006] Starting VirtualBox VM.. INFO[0007] Waiting for VM to start. INFO[0041] "dev" has been created a
- 23. • “docker-machine create” to provision the host, locally or remotely • “docker-machine ls” to list the machines • “docker-machine stop/rm” to stop and remove Recap of what you saw $ docker-machine create -d INFO[0000] Downloading boo INFO[0001] Creating SSH ke INFO[0001] Creating Virtua INFO[0006] Starting Virtua INFO[0007] Waiting for VM INFO[0041] "dev" has been
- 24. 24 TOOL NR.2 Docker compose Docker compose Describe the relation of your components in a simple YAML file called docker-compose.yml and docker-compose takes care of starting them and linking them in order. 1 stash: 2 image: atlassian/stash 3 ports: 4 - "7990:7990" 5 - "7999:7999" 6 volumes: 7 - /root/orchestration/stash-data:/ 8 links: 9 - db 10 user: root 11 privileged: true 12 db: 13 image: postgres 14 environment: 15 POSTGRES_PASSWORD: somepassword
- 25. • Provision a machine on a PaaS • Pull PostgreSQL and a Java app from the Registry • Use Compose to start the app • Tear down the machine Docker compose DEMO $ docker-compose up -d
- 26. • “docker-machine create” to provision the host • Edit “docker-compose.yml” to describe our app • “docker-compose up -d” to start our application • “docker-machine rm compose-demo“ to remove it Recap of what you saw $ docker-compose up -d
- 27. 28 TOOL NR.3 Docker swarm Deploy images and run containers on a full clusters as if you’re handling a single machine Docker swarm $ docker pull swarm $ docker run --rm swarm create 6856663cdefdec325839a4b7e1de38e8
- 28. @durdn Docker swarm swarm master swarm node swarm node swarm node container container container container container container discovery service High level architecture scheduler
- 29. • Strategies • Spread • Binpack • Random • Filters • Constraint • Affinity • Port • Dependency • Health Swarm comes with strategies and filters $ docker run -e constraint:instance==database --name db
- 30. • Provision a Docker swarm • Made up of three hosts • Master node • Node with 2gb of RAM • simple Node • Use labels to deploy to nodes • Run Java app and PostgreSQL on different nodes The plan for the Swarm DEMO $ docker pull swarm $ docker run --rm swarm create 6856663cdefdec325839a4b7e1de38e8
- 31. @durdn After Step 1 demo-master node-1 node-2 label: java discovery service Current Architecture scheduler RAM: 2GB label: database RAM: 512MB
- 32. @durdn After Step 2 demo-master node-1 node-2 label: java discovery service Current Architecture scheduler RAM: 2GB label: database RAM: 512MB PostgreSQL
- 33. @durdn After Step 3 demo-master node-1 node-2 label: java discovery service Current Architecture scheduler RAM: 2GB label: database RAM: 512MB PostgreSQLJava App
- 34. • We created a 3-node cluster with “docker-machine” • We tagged the nodes with labels • We started our components using label constraints and not machine names Recap of Swarm DEMO $ docker pull swarm $ docker run --rm swarm create 6856663cdefdec325839a4b7e1de38e8
- 35. 39 COROLLARY Docker Java Images Are Big The default Java image is 800+MB ?! $ docker pull java REPOSITORY IMAGE ID VIRTUAL SIZE java 5282faca75e8 817.6 MB
- 36. • Alpine Linux provides a minimal container image of 5MB • It includes BusyBox and a package manager • OpenJDK 7 is already on it… • Resulting in a 123MB Java image Start with a smaller base image FROM alpine:3.2 RUN apk --update add openjdk7-jre CMD ["/usr/bin/java", "-version"]
- 37. For Oracle Java 8 you have to roll it your own http://bit.do/minimal-java
- 38. I hope you are hyped as I am for all this coolness, come talk to me afterwards!
- 39. Thank you! NICOLA PAOLUCCI • DEVELOPER INSTIGATOR • ATLASSIAN • @DURDN Twitter: @durdn