DevOps for Scala
Download as PPTX, PDF•18 likes•4,282 views
This document discusses DevOps for Scala projects using Mosaico, an open source starter kit. Mosaico helps create an AWS cloud using CloudFormation, install Docker and Docker Swarm with Ansible for orchestration, and build Docker images with Jenkins and SBT. It addresses issues with customizing existing distributions and outlines four steps: 1) building the cloud infrastructure, 2) deploying Docker Swarm, 3) building Docker images with Jenkins, and 4) orchestrating services with Docker Compose. The goal is an easy to customize, orchestrate, and cost-effective cloud solution for Scala projects.
DevOps for Scala
- 1. DEVOPS FOR SCALA Cloud Building for Scala Enthusiasts Michele SciabarrĂ [email protected]
- 4. What I tried Cloudera Distribution DC/OS Ambari Tectonic
- 5. Tuning your requirements What they sell What you need
- 6. The problem with customisation Amount of Customisation Effort Home Grown Third Part
- 7. What I want • What I want: – Everything in AWS – Everything in Docker – Everything built with Jenkins • And, of course: – Easy customizability – Easy orchestration – Cheapest solution in the cloud
- 8. What I do NOT want • What I DO NOT want: – Hadoop • (even if I like it) – Unused components eating precious memory in the cloud – Be stuck to one version of a component
- 9. Introducing Mosaico • It is not a distribution! • It is not a framework! • Open Source http://github.com /sciabarra/Mosaico • It is a "starter kit" for – creating a cloud in AWS with CloudFormation – Installing Docker and Docker Swarm with Ansible – Building Images with Jenkins and SBT – Orchestrating services with Docker ComposeAmmonite Warning: documentation not yet ready!
- 10. Building on the shoulders of giants Ammonite
- 11. The real life of a DevOps
- 12. How I feel when I script with BASH SCALA
- 13. Ammonite Introducing by Li Haoyi Used as REPL in Dotty (Scala 3.0)
- 15. How a DevOps DevEnv Looks like
- 16. But we can do a bit better
- 18. An Ammonite script to rule it all
- 21. The base Image • Built on top of Alpine Linux – an "in-memory" ultrasmall linux distro • Daemontools – provides monitoring of applications • Augeas – Configuration file helper • Serf – Provides autodiscovery and inter-container communication
- 22. What is wrong about Dockerfile? • Why do I need SBT to build images? • No preprocessing available – download – move files around • No dependencies between containers • No builds using other containers • No configuration files • No profiles
- 24. MosaicoDocker SBT Plugin • Extends SBT- DOCKER • Model dependencies between containers • Can script Dockerfile generation in scala • External configuration files • Downloading of files before building the image • Ability to compile and build packages using other images • Smart "unpacking" of archives (removing unnesessary files)
- 25. Four Steps to the Enlightment 1 2 3 4
- 26. Step 1: building the cloud Ammonite Actually: creating the VMs....
- 27. Cloud Formation
- 29. how you create the VMs
- 31. Step 2 Deploying Docker Swarm Ammonite
- 32. How ansible looks like A collection of tasks An inventory file (generated)
- 33. Ansible & Swarm
- 34. Ansible & Swarm
- 35. Step 3. Building Docker Images
- 37. Create a Jenkins Job to build 4
- 39. Final Result
- 41. Orchestrate
- 42. Orchestration
- 43. Thank You!