Atmosphere Conference 2015: Taming the Modern Datacenter
0 likes165 views
The document discusses the increasing complexity of modern data centers and the evolution of deployment models such as IaaS, PaaS, and SaaS. It highlights the importance of automation, infrastructure as code (IaC), and tools like Terraform for managing resources efficiently. The focus is on creating immutable infrastructure and using modern configuration management to facilitate rapid application deployment and maintenance.
![AMI
DNS
Load Balancer
Deploy
OPERATORSDEVELOPERS
[]
PRODUCTION
M](https://image.slidesharecdn.com/sethvargo-tamingthemoderndatacenter-150602133418-lva1-app6892/85/Atmosphere-Conference-2015-Taming-the-Modern-Datacenter-120-320.jpg)
![AMI
DNS
Load Balancer
Deploy
OPERATORSDEVELOPERS
[]
PRODUCTION
MU](https://image.slidesharecdn.com/sethvargo-tamingthemoderndatacenter-150602133418-lva1-app6892/85/Atmosphere-Conference-2015-Taming-the-Modern-Datacenter-121-320.jpg)
![AMI
DNS
Load Balancer
Deploy
OPERATORSDEVELOPERS
[]
PRODUCTION
MU](https://image.slidesharecdn.com/sethvargo-tamingthemoderndatacenter-150602133418-lva1-app6892/85/Atmosphere-Conference-2015-Taming-the-Modern-Datacenter-122-320.jpg)
![AMI
DNS
Load Balancer
Deploy
OPERATORSDEVELOPERS
[]
PRODUCTION
MU](https://image.slidesharecdn.com/sethvargo-tamingthemoderndatacenter-150602133418-lva1-app6892/85/Atmosphere-Conference-2015-Taming-the-Modern-Datacenter-123-320.jpg)
![AMI
DNS
Load Balancer
Deploy
OPERATORSDEVELOPERS
[]
PRODUCTION
MU](https://image.slidesharecdn.com/sethvargo-tamingthemoderndatacenter-150602133418-lva1-app6892/85/Atmosphere-Conference-2015-Taming-the-Modern-Datacenter-124-320.jpg)
![AMI
DNS
Load Balancer
Deploy
OPERATORSDEVELOPERS
[]
PRODUCTION
MU
U](https://image.slidesharecdn.com/sethvargo-tamingthemoderndatacenter-150602133418-lva1-app6892/85/Atmosphere-Conference-2015-Taming-the-Modern-Datacenter-125-320.jpg)
![AMI
DNS
Load Balancer
Deploy
OPERATORSDEVELOPERS
[]
PRODUCTION
MU
U](https://image.slidesharecdn.com/sethvargo-tamingthemoderndatacenter-150602133418-lva1-app6892/85/Atmosphere-Conference-2015-Taming-the-Modern-Datacenter-126-320.jpg)
![AMI
DNS
Load Balancer
Deploy
OPERATORSDEVELOPERS
[]
PRODUCTION
MU
U](https://image.slidesharecdn.com/sethvargo-tamingthemoderndatacenter-150602133418-lva1-app6892/85/Atmosphere-Conference-2015-Taming-the-Modern-Datacenter-127-320.jpg)
Atmosphere Conference 2015: Taming the Modern Datacenter
- 1. TAMING THE MODERN DATA CENTER A Hybrid Talk for a Hybrid World
- 4. DC EVOLUTION How did we get here?
- 7. RISING DATACENTER COMPLEXITY DC VM VMVM VM VM VMVM VM VM VMVM VM VM VMVM VM
- 8. RISING DATACENTER COMPLEXITY DC VM VMVM VM VM VMVM VM VM VMVM VM VM VMVM VM C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C C
- 9. RISING DATACENTER COMPLEXITY DC DNS Database CDN
- 10. RISING DATACENTER COMPLEXITY DC-01 DC-02
- 11. RISING DATACENTER COMPLEXITY DC-01 DC-02 VM VMVM VM VM VMVM VM C C C C C C C C C C C C C C C C C C C C C C C C
- 12. RISING DATACENTER COMPLEXITY IaaS PaaS SaaS
- 14. TAMING THE DC Deployment + Maintenance
- 16. ACQUIRE PROVISION UPDATE DESTROY
- 17. ACQUIRE PROVISION UPDATE DESTROY G’ U VENDOR
- 18. ACQUIRE PROVISION UPDATE DESTROY G U ’ U ’ U VENDOR DC OPS
- 19. ACQUIRE PROVISION UPDATE DESTROY G U ’ U ’ U U ’ U VENDOR DC OPS SYSADMIN
- 20. ACQUIRE PROVISION UPDATE DESTROY G U ’ U ’ U U ’ U U ’ U VENDOR DC OPS SYSADMIN DC OPS
- 21. ACQUIRE PROVISION UPDATE DESTROY VENDOR DC OPS SYSADMIN DC OPS WEEKS DAYS DAYS DAYS c c c c
- 22. PRESENTLY The elasBc compute and _aaS era
- 23. ACQUIRE PROVISION UPDATE DESTROY WEEKS DAYS DAYS DAYS c c c c ElasBc Compute
- 24. ACQUIRE PROVISION UPDATE DESTROY WEEKS DAYS DAYS DAYS c c c c ElasBc Compute
- 25. ACQUIRE PROVISION UPDATE DESTROY MINUTES DAYS DAYS SECONDS c c c c ElasBc Compute
- 26. CapEx # OpEx #
- 27. _aaS
- 28. ACQUIRE PROVISION UPDATE DESTROY DAYS DAYS c c ConfiguraBon Management MINUTES SECONDS c c
- 29. ACQUIRE PROVISION UPDATE DESTROY DAYS DAYS c c ConfiguraBon Management MINUTES SECONDS c c
- 30. ACQUIRE PROVISION UPDATE DESTROY MINUTES SECONDS c c ConfiguraBon Management MINUTES SECONDS c c
- 31. ACQUIRE PROVISION UPDATE DESTROY SaaS ProliferaBon ACQUIRE PROVISION UPDATE DESTROY https://specialized.com
- 32. RISING DATACENTER COMPLEXITY DC DNS Database CDNVM VMVM VM VM VMVM VM C C C C C C C C C C C C C C C C C C
- 34. WHY? What was our original goal?
- 35. EFFECTIVELY DELIVER AND MAINTAIN APPLICATIONS
- 36. MOVE FAST AND DON’T BREAK THINGS
- 37. h-ps:// d250n10lsq5j8r.cloudfront.n et/assets/atlas/runAme-‐ develop-‐icon-‐color-‐ ebf4ccf5f2ca3513e495bccb e9320d45.png Consistent Shareable Readily Available High production parity h-ps:// d250n10lsq5j8r.cloudfront.n et/assets/atlas/runAme-‐ deploy-‐icon-‐ color-‐1c39f618b3b5ead204 dda4646bb2410e.png Start and configure servers / services Deploy and run application Update servers or applications Reconfigure, feature flag Monitor health Orchestrate complex changes DEVELOP DEPLOY MAINTAIN
- 39. TERRAFORM Build, Combine, and Launch Infrastructure
- 41. How do I provision resources? compute? storage? network?
- 42. How do I manage resource lifecycles?
- 43. How do I balance service providers providing core technology for my datacenter?
- 44. How do I enforce policy across all these resources?
- 45. How do I automate and share those configuraBons?
- 46. TERRAFORM'S GOAL
- 47. PROVIDE A SINGLE WORKFLOW
- 48. WITH A UNIFIED VIEW
- 49. USING INFRASTRUCTURE AS CODE
- 50. THAT CAN BE ITERATED AND CHANGED SAFELY
- 51. CAPABLE OF COMPLEX N-TIER APPLICATIONS
- 52. DIGITAL OCEAN DROPLET WITH DNS USING DNS SIMPLE resource "digitalocean_droplet" "web" { name = "tf-web" size = "512mb" image = "centos-5-8-x32" region = "sfo1" } resource "dnsimple_record" "hello" { domain = "example.com" name = "test" value = "${digitalocean_droplet.web.ipv4_address}" type = "A" }
- 53. DIGITAL OCEAN DROPLET WITH DNS USING DNS SIMPLE resource "digitalocean_droplet" "web" { name = "tf-web" size = "512mb" image = "centos-5-8-x32" region = "sfo1" } resource "dnsimple_record" "hello" { domain = "example.com" name = "test" value = "${digitalocean_droplet.web.ipv4_address}" type = "A" }
- 54. DIGITAL OCEAN DROPLET WITH DNS USING DNS SIMPLE resource "digitalocean_droplet" "web" { name = "tf-web" size = "512mb" image = "centos-5-8-x32" region = "sfo1" } resource "dnsimple_record" "hello" { domain = "example.com" name = "test" value = "${digitalocean_droplet.web.ipv4_address}" type = "A" }
- 55. DIGITAL OCEAN DROPLET WITH DNS USING DNS SIMPLE resource "digitalocean_droplet" "web" { name = "tf-web" size = "512mb" image = "centos-5-8-x32" region = "sfo1" } resource "dnsimple_record" "hello" { domain = "example.com" name = "test" value = "${digitalocean_droplet.web.ipv4_address}" type = "A" }
- 56. HUMAN-FRIENDLY CONFIG* * JSON-COMPATIBLE FOR NON-HUMANS
- 58. ENTIRE INFRASTRUCTURE... IN A SINGLE TEXT FILE
- 59. TERRAFORM GRAPH
- 60. COMPOSE N-TIERS / PROVIDERS
- 63. EXPOSE ("PROVIDE") A RESOURCE
- 64. EXPOSE ("PROVIDE") A RESOURCE aws_instance dnssimple_record
- 65. CRUD API
- 67. C C C C C C VM VM VM IAAS (OpenStack, etc) PHYSICAL "LAYER CAKE" PROVIDER PER LAYER UNIFIED CONFIGURATION
- 69. All logos and trademarks are copyright their respective owners
- 70. TERRAFORM PLAN
- 71. $ terraform plan + digitalocean_droplet.web backups: "" => "<computed>" image: "" => "centos-5-8-x32" ipv4_address: "" => "<computed>" ipv4_address_private: "" => "<computed>" name: "" => "tf-web" private_networking: "" => "<computed>" region: "" => "sfo1" size: "" => "512mb" status: "" => "<computed>" + dnsimple_record.hello domain: "" => "example.com" domain_id: "" => "<computed>" hostname: "" => "<computed>" name: "" => "test" priority: "" => "<computed>"
- 72. $ terraform plan + digitalocean_droplet.web backups: "" => "<computed>" image: "" => "centos-5-8-x32" ipv4_address: "" => "<computed>" ipv4_address_private: "" => "<computed>" name: "" => "tf-web" private_networking: "" => "<computed>" region: "" => "sfo1" size: "" => "512mb" status: "" => "<computed>" + dnsimple_record.hello domain: "" => "example.com" domain_id: "" => "<computed>" hostname: "" => "<computed>" name: "" => "test" priority: "" => "<computed>"
- 73. $ terraform plan + digitalocean_droplet.web backups: "" => "<computed>" image: "" => "centos-5-8-x32" ipv4_address: "" => "<computed>" ipv4_address_private: "" => "<computed>" name: "" => "tf-web" private_networking: "" => "<computed>" region: "" => "sfo1" size: "" => "512mb" status: "" => "<computed>" + dnsimple_record.hello domain: "" => "example.com" domain_id: "" => "<computed>" hostname: "" => "<computed>" name: "" => "test" priority: "" => "<computed>"
- 74. $ terraform plan + digitalocean_droplet.web backups: "" => "<computed>" image: "" => "centos-5-8-x32" ipv4_address: "" => "<computed>" ipv4_address_private: "" => "<computed>" name: "" => "tf-web" private_networking: "" => "<computed>" region: "" => "sfo1" size: "" => "512mb" status: "" => "<computed>" + dnsimple_record.hello domain: "" => "example.com" domain_id: "" => "<computed>" hostname: "" => "<computed>" name: "" => "test" priority: "" => "<computed>"
- 75. backups: "" => "<computed>" image: "" => "centos-5-8-x32" ipv4_address: "" => "<computed>" ipv4_address_private: "" => "<computed>" name: "" => "tf-web" private_networking: "" => "<computed>" region: "" => "sfo1" size: "" => "512mb" status: "" => "<computed>" + dnsimple_record.hello domain: "" => "example.com" domain_id: "" => "<computed>" hostname: "" => "<computed>" name: "" => "test" priority: "" => "<computed>" ttl: "" => "<computed>" type: "" => "A" value: "" => "${digitalocean_droplet.web.ipv4_address}"
- 76. backups: "" => "<computed>" image: "" => "centos-5-8-x32" ipv4_address: "" => "<computed>" ipv4_address_private: "" => "<computed>" name: "" => "tf-web" private_networking: "" => "<computed>" region: "" => "sfo1" size: "" => "512mb" status: "" => "<computed>" + dnsimple_record.hello domain: "" => "example.com" domain_id: "" => "<computed>" hostname: "" => "<computed>" name: "" => "test" priority: "" => "<computed>" ttl: "" => "<computed>" type: "" => "A" value: "" => "${digitalocean_droplet.web.ipv4_address}"
- 77. SHOWS YOU WHAT WILL HAPPEN
- 79. PREVIOUSLY?
- 81. FUTURE OPS Managing tomorrow’s infrastructure
- 87. IMMUTABLE INFRASTRUCTURE ALLOWS FOR GREATER PARITY
- 89. PACKER Automated Golden Images (and more)
- 90. MACHINE IMAGES
- 91. YUCK… IMAGES?
- 92. WHY HAVE WE BEEN GENERALLY AGAINST MACHINE IMAGES?
- 93. GOLDEN IMAGES USED TO BE THE WAY
- 96. TOOLING WAS NOT MATURE COMPARED TO TODAY
- 98. OPS WITHOUT MACHINE IMAGES IS LIKE APPLICATIONS WITHOUT BINARIES
- 100. Source Code Binary ApplicaBon Lifecycle
- 101. Source Code Binary libA 1.0 libB 1.0 libC 1.0 ApplicaBon Lifecycle
- 102. Source Code Binary libA 2.0 libB 1.0 libC 1.0 ApplicaBon Lifecycle
- 103. Source Code Failure libA 2.0 libB 1.0 libC 1.0 ApplicaBon Lifecycle
- 105. New Server Ready Server Mutable Server Lifecycle
- 106. New Server Ready Server Packages Network CM Changes Mutable Server Lifecycle
- 107. New Server Network CM Changes Package Changes Mutable Server Lifecycle Ready Server
- 108. New Server Network CM Changes Package Changes Failure Mutable Server Lifecycle
- 109. New Server Packages CM Changes Network Unreliable Failure Mutable Server Lifecycle
- 110. New Server Packages Network CM Changed Failure Mutable Server Lifecycle
- 112. New Server Ready Server Machine Image Lifecycle
- 113. New Server Ready Server Machine Image Lifecycle
- 114. PACKER BUILD
- 116. TRANSITIONS FAILURES FROM RUN-TIME TO BUILD-TIME
- 117. ENFORCES PARITY WITH STAGING
- 118. … AND EVEN DE ELOPMENT
- 119. WHAT DOES THE FUTURE LOOK LIKE?