From Dev to DevOps - Codemotion ES 2012
10 likes2,319 views
The document discusses the transition from traditional development practices to DevOps, emphasizing the importance of agile methodologies and the need for collaboration between developers and operations teams. It highlights the role of tools like Puppet and Vagrant in automating infrastructure management and deployment processes, while also addressing challenges and best practices associated with new solutions. Additionally, it provides examples of implementation and configuration for various services and environments.
![Puppet
exec { "maven-untar":
manifests command => "tar xf /tmp/x.tgz",
cwd => "/opt",
creates => "/opt/apache-maven-${version}",
ruby-like path => ["/bin"],
} ->
ERB templates file { "/usr/bin/mvn":
ensure => link,
target => "/opt/apache-maven-${version}/bin/mvn",
}
file { "/usr/local/bin/mvn":
ensure => absent,
require => Exec["maven-untar"],
}
file { "$home/.mavenrc":
mode => "0600",
owner => $user,
content => template("maven/mavenrc.erb"),
require => User[$user],
}](https://image.slidesharecdn.com/2012-03fromdevtodevops-codemotion-120324072333-phpapp01/85/From-Dev-to-DevOps-Codemotion-ES-2012-37-320.jpg)
![Vagrant
Vagrant::Config.run do |config|
# Every Vagrant virtual environment requires a box to build off of.
config.vm.box = "centos-6.0-x86_64"
# The url from where the 'config.vm.box' box will be fetched
config.vm.box_url = "http://dl.dropbox.com/u/1627760/centos-6.0-x86_64.box"
# Boot with a GUI so you can see the screen. (Default is headless)
#config.vm.boot_mode = :gui
# Assign this VM to a host only network IP, allowing you to access it via the IP.
# config.vm.network "33.33.33.10"
# Forward a port from the guest to the host, which allows for outside
# computers to access the VM, whereas host only networking does not.
config.vm.forward_port "sonar", 9000, 19000
# Enable provisioning with Puppet stand alone.
config.vm.share_folder("templates", "/tmp/vagrant-puppet/templates", "templates")
config.vm.provision :puppet do |puppet|
puppet.manifest_file = "base.pp"
puppet.module_path = "mymodules"
puppet.options = ["--templatedir","/tmp/vagrant-puppet/templates"]
puppet.options = "-v -d"
end
end](https://image.slidesharecdn.com/2012-03fromdevtodevops-codemotion-120324072333-phpapp01/85/From-Dev-to-DevOps-Codemotion-ES-2012-45-320.jpg)
![ordering
file {'/tmp/test1':
ensure => present,
content => "Hi.",
}
notify {'/tmp/test1 has already
been synced.':
require => File['/tmp/test1'],
}](https://image.slidesharecdn.com/2012-03fromdevtodevops-codemotion-120324072333-phpapp01/85/From-Dev-to-DevOps-Codemotion-ES-2012-55-320.jpg)
![facts
host {'self':
ensure => present,
name => $::fqdn,
host_aliases => ['puppet', $::hostname],
ip => $::ipaddress,
}
file {'motd':
ensure => file,
path => '/etc/motd',
mode => 0644,
content => "Welcome to ${::hostname},na $
{::operatingsystem} island in the sea of ${::domain}.
n",
}](https://image.slidesharecdn.com/2012-03fromdevtodevops-codemotion-120324072333-phpapp01/85/From-Dev-to-DevOps-Codemotion-ES-2012-58-320.jpg)
![class definition
class ntp {
package { 'ntp':
ensure => installed,
}
service { 'ntp':
name => 'ntpd',
ensure => running,
enable => true,
subscribe => File['ntp.conf'],
}
}](https://image.slidesharecdn.com/2012-03fromdevtodevops-codemotion-120324072333-phpapp01/85/From-Dev-to-DevOps-Codemotion-ES-2012-60-320.jpg)
![templating
file {'/etc/foo.conf':
ensure => file,
require => Package['foo'],
content => template('foo/foo.conf.erb'),
}](https://image.slidesharecdn.com/2012-03fromdevtodevops-codemotion-120324072333-phpapp01/85/From-Dev-to-DevOps-Codemotion-ES-2012-63-320.jpg)
![spec/hosts/ db_spec.pp & www_spec.pp
require 'rspec-puppet'
describe 'db.acme.com' do
it { should contain_package('postgres') }
end
require 'rspec-puppet'
describe 'www55.acme.com' do
it 'should have valid config file' do
content = catalogue.resource('file', '/etc/acme.conf').send
(:parameters)[:content]
content.should match /db.acme.com/
content.should match /password = web/
end
end](https://image.slidesharecdn.com/2012-03fromdevtodevops-codemotion-120324072333-phpapp01/85/From-Dev-to-DevOps-Codemotion-ES-2012-72-320.jpg)
From Dev to DevOps - Codemotion ES 2012
- 1. From Dev to DevOps Carlos Sanchez @csanchez http://carlossanchez.eu http://maestrodev.com
- 2. Apache @csanchez Maven Apache ASF Archiva Member Apache Eclipse IAM Continuum blog.carlossanchez.eu
- 3. Dev... What?
- 4. Agile planning iterative development continuous integration release soon, release often
- 6. DevQaOps ?
- 8. DevOps addresses Fear of change Risky deployments It works on my machine! Siloisation Dev Change vs. Ops stability
- 9. Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan
- 10. Our highest priority is to satisfy the customer through early and continuous delivery of valuable software. Welcome changing requirements, even late in development. Agile processes harness change for the customer's competitive advantage. Deliver working software frequently, from a couple of weeks to a couple of months, with a preference to the shorter timescale. Business people and developers must work together daily throughout the project. The most efficient and effective method of conveying information to and within a development team is face-to-face conversation. Agile processes promote sustainable development. The sponsors, developers, and users should be able to maintain a constant pace indefinitely.
- 12. Dev
- 16. What developers do today to specify target environments is NOT enough
- 19. Ops
- 20. requirements Operating System config files packages installed multi stage configurations dev QA pre-production production
- 21. Deployment How do I deploy this? documentation manual steps prone to errors
- 22. Cloud How do I deploy this? to hundreds of servers
- 23. DevOps
- 25. Should I worry about my OPS job?
- 26. yes my job is to make other people’s jobs unnecessary
- 27. yes no you should see the NOOPS guys
- 29. DevOps is NOT about the tools
- 30. Nice, BUT how can I implement IT
- 31. Tools can enable change in behavior and eventually change culture Patrick Debois
- 32. DevOps tools everyone is intelligent enough every tool is cloud enabled every tool is DevOps(tm)
- 33. DevOps tools: infrastructure automation infrastructure as code it’s all invented, now it’s standardized
- 34. Infrastructure as Code New solutions bring new challenges Follow development best practices tagging branching releasing dev, QA, production
- 35. New solutions bring new problems DEVOPS “MY MACHINES ARE BEING PROVISIONED”
- 37. Puppet exec { "maven-untar": manifests command => "tar xf /tmp/x.tgz", cwd => "/opt", creates => "/opt/apache-maven-${version}", ruby-like path => ["/bin"], } -> ERB templates file { "/usr/bin/mvn": ensure => link, target => "/opt/apache-maven-${version}/bin/mvn", } file { "/usr/local/bin/mvn": ensure => absent, require => Exec["maven-untar"], } file { "$home/.mavenrc": mode => "0600", owner => $user, content => template("maven/mavenrc.erb"), require => User[$user], }
- 38. Puppet infrastructure IS code package { 'openssh-server': ensure => present, }
- 39. Puppet declarative model state vs process no scripting service { 'ntp': name => 'ntpd', ensure => running, }
- 41. Vagrant
- 42. Vagrant Oracle VirtualBox cmdline automation Easy Puppet and Chef provisioning Keep VM configuration for different projects Share boxes and configuration files across teams base box + configuration files
- 43. Vagrant base boxes www.vagrantbox.es anywhere! just (big) files
- 44. using Vagrant $ gem install vagrant $ vagrant box add centos-6.0-x86_64 http://dl.dropbox.com/u/1627760/centos-6.0-x86_64.box $ vagrant init myproject $ vagrant up $ vagrant ssh $ vagrant suspend $ vagrant resume $ vagrant destroy
- 45. Vagrant Vagrant::Config.run do |config| # Every Vagrant virtual environment requires a box to build off of. config.vm.box = "centos-6.0-x86_64" # The url from where the 'config.vm.box' box will be fetched config.vm.box_url = "http://dl.dropbox.com/u/1627760/centos-6.0-x86_64.box" # Boot with a GUI so you can see the screen. (Default is headless) #config.vm.boot_mode = :gui # Assign this VM to a host only network IP, allowing you to access it via the IP. # config.vm.network "33.33.33.10" # Forward a port from the guest to the host, which allows for outside # computers to access the VM, whereas host only networking does not. config.vm.forward_port "sonar", 9000, 19000 # Enable provisioning with Puppet stand alone. config.vm.share_folder("templates", "/tmp/vagrant-puppet/templates", "templates") config.vm.provision :puppet do |puppet| puppet.manifest_file = "base.pp" puppet.module_path = "mymodules" puppet.options = ["--templatedir","/tmp/vagrant-puppet/templates"] puppet.options = "-v -d" end end
- 46. manifests/base.pp package { jdk: ensure => installed, name => $operatingsystem ? { centOS => "java-1.6.0-openjdk-devel", Ubuntu => "openjdk-6-jdk", default => "jdk", }, }
- 47. VeeWee
- 48. VeeWee easily build Vagrant base boxes https://github.com/jedi4ever/veewee
- 49. using VeeWee $ gem install veewee $ vagrant basebox templates $ vagrant basebox define 'my-ubuntu-server' 'ubuntu-11.04-server-amd64' # customize definitions/my-ubuntu-server $ vagrant basebox build 'my-ubuntu-server' $ vagrant basebox validate 'my-ubuntu-server' $ vagrant basebox export 'my-ubuntu-server' $ vagrant box add 'my-ubuntu-server' 'my-ubuntu-server.box' $ vagrant init 'my-ubuntu-server'
- 50. Geppetto
- 52. Puppet DSL
- 53. Puppet resources user { 'dave': ensure => present, uid => '507', gid => 'admin', shell => '/bin/zsh', home => '/home/dave', managehome => true, }
- 54. Puppet standalone $ puppet apply my_test_manifest.pp
- 55. ordering file {'/tmp/test1': ensure => present, content => "Hi.", } notify {'/tmp/test1 has already been synced.': require => File['/tmp/test1'], }
- 56. ordering file {'/tmp/test1': ensure => present, content => "Hi.", } -> notify {'/tmp/test1 has already been synced.':}
- 57. variables $longthing = "Imagine I have something really long in here. Like an SSH key, let's say." file {'authorized_keys': path => '/root/.ssh/authorized_keys', content => $longthing, }
- 58. facts host {'self': ensure => present, name => $::fqdn, host_aliases => ['puppet', $::hostname], ip => $::ipaddress, } file {'motd': ensure => file, path => '/etc/motd', mode => 0644, content => "Welcome to ${::hostname},na $ {::operatingsystem} island in the sea of ${::domain}. n", }
- 59. conditionals case $operatingsystem { centos, redhat: { $apache = "httpd" } debian, ubuntu: { $apache = "apache2" } default: { fail("Unrecognized operating system for webserver") } } $apache = $operatingsystem ? { centos => 'httpd', redhat => 'httpd', /(?i)(ubuntu|debian)/ => "apache2-$1", # (Don't actually use that package name.) default => undef, }
- 60. class definition class ntp { package { 'ntp': ensure => installed, } service { 'ntp': name => 'ntpd', ensure => running, enable => true, subscribe => File['ntp.conf'], } }
- 61. parameterized classes class paramclassexample ($value1, $value2 = "Default value") { notify {"Value 1 is ${value1}.":} notify {"Value 2 is ${value2}.":} } class {'paramclassexample': value1 => 'Something', value2 => 'Something else', } class {'paramclassexample': value1 => 'Something', }
- 62. modules {module}/ files/ lib/ manifests/ init.pp {class}.pp {defined type}.pp {namespace}/ {class}.pp {class}.pp templates/ tests/
- 63. templating file {'/etc/foo.conf': ensure => file, require => Package['foo'], content => template('foo/foo.conf.erb'), }
- 64. templates/foo.conf.erb OS is <%= $::operatingsystem %>
- 65. node configuration # nodes.pp node 'someserver.domain.com' inherits basenode { $web_fqdn = 'www.domain.com' include genericwebserver include some_other_service } node 'ldapmaster.domain.com' inherits basenode { include s_ldap::master } node 'humanresources.domain.com' inherits basenode { include c_humanresources }
- 66. Examples
- 67. Tomcat cluster + postgres postgres database db.acme.com tomcat servers www1.acme.com www2.acme.com ... webapp
- 68. Modules required git clone https://github.com/maestrodev/puppet-postgres modules/postgres git clone https://github.com/camptocamp/puppet-tomcat modules/tomcat git clone https://github.com/maestrodev/puppet-maven modules/maven
- 69. modules/example/database.pp class 'database' ($db_password = 'password') { class { "postgres" : password => 'postgres' } -> postgres::initdb{ "initdb": } -> postgres::enable { "enable": } -> postgres::user { "web": passwd => $db_password } -> postgres::createdb { "web": owner=> "web" } }
- 70. modules/example/webserver.pp class 'webserver'($db_server = 'localhost', $db_password = 'password') { package { "java-1.6.0-openjdk-devel": ensure => "latest" } class { 'tomcat': } -> tomcat::instance {"mytomcat": } -> class { 'maven::maven': } -> maven { "/srv/tomcat/${mytomcat}/webapps/mywebapp.war": id => "com.acme:mywebapp:1.0:war", } file { '/etc/acme.conf': content => "db = ${db_server} password = ${db_password}", } }
- 71. manifests/site.pp node 'base' { $db_password = 'web' } node 'db.acme.com' inherits base { class {'database': db_password => $db_password } } # www1.acme.com, www2.acme.com, www3.acme.com,... node /^wwwd+.acme.com$/ inherits base { class {'webserver': db_server => 'db.acme.com', db_password => $db_password, } }
- 72. spec/hosts/ db_spec.pp & www_spec.pp require 'rspec-puppet' describe 'db.acme.com' do it { should contain_package('postgres') } end require 'rspec-puppet' describe 'www55.acme.com' do it 'should have valid config file' do content = catalogue.resource('file', '/etc/acme.conf').send (:parameters)[:content] content.should match /db.acme.com/ content.should match /password = web/ end end
- 73. Example code and slides Available at http://slideshare.carlossanchez.eu http://github.carlossanchez.eu http://blog.carlossanchez.eu https://github.com/maestrodev/puppet-modules
- 75. Photo Credits Son of Man Lego - Alex Eylar http://www.flickr.com/photos/hoyvinmayvin/4702772452/ Brick wall - Luis Argerich http://www.flickr.com/photos/lrargerich/4353397797/ Agile vs. Iterative flow - Christopher Little http://en.wikipedia.org/wiki/File:Agile-vs-iterative-flow.jpg DevOps - Rajiv.Pant http://en.wikipedia.org/wiki/File:Devops.png Pimientos de Padron - Howard Walfish http://www.flickr.com/photos/h-bomb/4868400647/ Compiling - XKCD http://xkcd.com/303/ Printer in 1568 - Meggs, Philip B http://en.wikipedia.org/wiki/File:Printer_in_1568-ce.png Relativity - M. C. Escher http://en.wikipedia.org/wiki/File:Escher%27s_Relativity.jpg Teacher and class - Herald Post http://www.flickr.com/photos/heraldpost/5169295832/