From Code to Kubernetes
9 likes1,767 views
The document outlines a presentation about the transition from code to Kubernetes, discussing architecture, technologies, challenges, and results of implementing infrastructure as code. It details the use of various tools such as Terraform, SaltStack, and WeaveScope for CI/CD pipelines and application debugging, highlighting the automated provisioning and management of cloud resources. Future improvements are suggested, including error handling and credentials management, to enhance the deployment and operational processes.
From Code to Kubernetes
- 1. From Code to Kubernetes
- 2. About Us Art Richards CTO - truckin.io
- 3. About Me Daniel Oliveira Devops Engineer danieloliv79 danieloliveira079 [email protected]
- 4. Agenda
- 5. ● Scenario and Architecture ● Technologies ● Challenges ● Results ● Foundations ● Infrastructure as Code ● Configuration Management ● Building and Deployments ● Application Debugging using Weavescope ● Demo - From code to Kubernetes ● Future ● QA
- 6. git push
- 11. One man's operations team Priorities vs Resources
- 14. 8 Projects Frontend, Backend API, Android Development, Test, Staging, Demo and Production
- 15. Weekly Production deployments (mobile, frontend and backend)
- 16. Technologies
- 17. Applications
- 18. Infrastructure
- 19. Challenges
- 20. ● CI/CD Pipeline ● Infrastructure as Code ● Isolated Environments (Dev, Test, Demo, Staging, Production) ● Unified orchestrator for builds and deployments processes ● Integrations ● Easy application debugging ● Automation
- 21. Results
- 23. Foundations
- 24. IaaS Cloud Provider Resources Network, Instances, IAM, Disk, Registry, Kubernetes Cluster Software, Packages and Configs Salt Master, Salt Minion, Docker, Postgresql and Elasticsearch ProvisioningOrder Desired State Minions, API, Reactor, Integrations
- 28. IaaS Cloud Provider Resources Network, Instances, IAM, Disk, Registry, Kubernetes Cluster Software, Packages and Configs Salt Master, Salt Minion, Docker, Postgresql and Elasticsearch ProvisioningOrder Desired State Minions, API, Reactor, Integrations
- 29. Terraform by Hashicorp https://www.terraform.io
- 30. Basic network resources configuration file variable ● Command line tool (apply, plan, destroy) ● Multiples Providers ● Config based resources ● Usage of Variables ● Dependencies Graph ● Execution Plan ● Resource Creation in Parallel ● Multiples Provisioners ● Detailed Output dependency Terraform output
- 31. Configure 'Em All Network, Firewall, Subnetworks, Instances, Buckets, Disks, Kubernetes Cluster, Services Accounts and IAM
- 33. IaaS Cloud Provider Resources Network, Instances, IAM, Disk, Registry, Kubernetes Cluster Software, Packages and Configs Salt Master, Salt Minion, Docker, Postgresql and Elasticsearch ProvisioningOrder Desired State Minions, API, Reactor, Integrations
- 35. SaltStack Open Source https://docs.saltstack.com/en/latest/ Master MinionOperator Minion Postgresql Minion Builder MinionElastic G@roles:builder and G@environment:test
- 36. Selectors Master Minion Builder Executed imperatively via command line or reactively via Salt Reactor. salt cli selector command
- 37. Salt Pillars "Offer global values that can be distributed to minions"
- 40. Salt States "The SLS is a representation of the state in which a system should be in, and is set up to contain this data in a simple format."
- 43. Using defined pillars within states ● Introducing the map.jinja file ● Passing pillars values when compiling states
- 45. Output to MinionParse + Merge SaltStack Compilation Process + =Pillars dictionaries States jinja2 Low Data Parse
- 46. Gitfs "The gitfs backend allows Salt to serve files from git repositories."
- 49. Desired State ● 8 VMs ○ Salt Master ○ Operator ○ Builder ○ Postgresql ○ Elasticsearch ○ 3 Kubernetes nodes ● 2 Persistent Data Disks: 500GB attached to PG and ELS ● 1 Kubernetes Cluster ● Network ○ Required Firewall Rules ○ 2 Subnets ● 2 IAM/Service Accounts: Pull/Push Docker Registry
- 50. Complete Cloud Provision Flow Network Firewall, Subnets, Static IPs, ... Instances Salt Master, Salt Minion, Postgresql, Elasticsearch, Builder, Operator Kubernetes Cluster Nodes, Firewall Rules, K8S Master and Workers ● $ terraform apply Salt states are applied just after an instance is created, based on its "role" specified in the grains config Core resources are created during this phase Creates the initial cluster state based on the number of nodes specified
- 52. Work is done!
- 53. Google Cloud Admin Panel
- 60. Show me the flow!
- 63. Kubernetes Objects "Kubernetes Objects are persistent entities in the Kubernetes system. Kubernetes uses these entities to represent the state of your cluster."
- 64. Kubernetes objects ● Abstracts: deployments, services, replica sets, ingress, ... ● Generated on the fly by Salt using templates ● Final .yaml file compiled including pillars and arguments ● $ kubectl apply -f mysite-development.yaml ● Garbage collector
- 66. Builder 1 2 3 4 5 6 7 8 Code to Image Flow Registry Reactor push state.apply notify notify notify push notify
- 67. Operator Kubernetes Deployment Flow Registry Reactor (Post Build) Pullkubectlstate.apply1 2 4 notify 3 5 notify 6
- 69. Build Build
- 70. Rollback
- 76. Demo Live from code to Kubernetes!
- 77. Future What must be improved? ● Error Handling ● Credentials Management ● Logging and Monitoring ● On Demand Environments ● Terraform File Refactoring ● Implement Production ● Rollout Deployments ● Postgresql Cluster ● Elasticsearch Cluster ● ...
- 78. Wrap up What I've seen so far? ● Automated provision ● Infrastructure as Code ● Event driven environment ● Fast delivery cycle ● Isolated environments ● Application Debugging ● ChatOps
- 79. Final Words
- 80. Doesn't have to be perfect from day 0!
- 81. Pick up the right people "When you get into one of these groups, there's only a couple of ways you can get out: one is death, the other is mental institutions..." - Devops Engineer testimonial
- 82. Links Saltstack - https://saltstack.com Salt States - https://docs.saltstack.com/en/latest/topics/tutorials/starting_states.html Salt Pillars - https://docs.saltstack.com/en/latest/topics/pillar/ Terraform - https://www.terraform.io/intro/index.html Weavescope - https://www.weave.works/products/weave-scope Kubernetesio - http://kubernetes.io Jenkins CI - https://jenkins.io Docker - https://docker.com Google Cloud Platform - cloud.google.com GCP Calculator - https://cloud.google.com/products/calculator/
- 83. Danke Schön!
- 84. Questions?