SlideShare a Scribd company logo

Test-Driven Puppet Development - PuppetConf 2014

Puppet
Puppet

This document discusses testing driven development of Puppet modules. It covers using puppet-lint to check style, puppet-syntax to validate code, and rspec-puppet to test catalogs and verify relationships. Packer is used to build consistent virtual machine images, Vagrant manages virtual environments for testing, and Beaker runs acceptance tests across multiple platforms. The goal is to create a virtuous cycle of testing, validation, and development feedback to continuously improve module quality.

Technology
1 of 45
Downloaded 32 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
Testing Driven Puppet Modules [Nan Liu @sesshin] Copyright 2014 1 / 45
Overview 2 / 45
Overview Who This talk is not for people who: Write perfect code (manifests) Never upgrade Puppet Don't have SLA Used Puppet since 0.2x 3 / 45
Overview Who Why Testing Puppet on Production is __ 4 / 45
Overview Who Why Positive feedback loop: 5 / 45
Overview Who Why Creating a virtuous cycle: 6 / 45
Overview Who Why Creating a virtuous cycle: 7 / 45
Overview Who Why What Developing Puppet Modules Development feedback puppet-lint puppet-syntax rspec-puppet Testing Packer Vagrant beaker 8 / 45
Development Feedback 9 / 45
Development puppet-lint Manifest lint check: $ puppet lint manifests/**/* WARNING: top-scope variable being used without an explicit namespace on line 4 WARNING: class inheriting from params class on line 26 WARNING: class not documented on line 1 WARNING: line has more than 80 characters on line 52 10 / 45
Development puppet-lint Manifest lint cleanup: $ puppet-lint -f demo.pp FIXED: string containing only a variable on line 1 FIXED: variable not enclosed in {} on line 5 FIXED: indentation of => is not properly aligned on line 2 FIXED: indentation of => is not properly aligned on line 3 FIXED: indentation of => is not properly aligned on line 5 WARNING: ensure found on line but it's not the first attribute on line 4 11 / 45
Development puppet-lint Configure puppet-lint behavior PuppetLint.configuration.disable_80chars PuppetLint.configuration.disable_arrow_alignment PuppetLint.configuration.disable_class_inherits_from_params_class PuppetLint.configuration.disable_class_parameter_defaults PuppetLint.configuration.fail_on_warnings = true PuppetLint.configuration.ignore_paths = ['spec/**/*.pp', 'pkg/**/*.pp'] 12 / 45
Development puppet-lint puppet-syntax Manifest validation: $ puppet parser validate manifests/bad.pp Error: Could not parse for environment production: Syntax error at 'demo'; expected '}' at /Users/nan/src/puppet-demo/manifests/bad.pp:4 13 / 45
Development puppet-lint puppet-syntax Rakefile require 'puppet-syntax/tasks/puppet-syntax' PuppetSyntax.exclude_paths = ["spec/fixtures/**/*"] PuppetSyntax.future_parser = true 14 / 45
Development puppet-lint puppet-syntax Puppet module folder: manifests/ tests/ Rakefile require 'puppetlabs_spec_helper/rake_tasks' PuppetLint.configuration.disable_80chars PuppetLint.configuration.disable_arrow_alignment PuppetLint.configuration.disable_class_inherits_from_params_class PuppetLint.configuration.disable_class_parameter_defaults PuppetLint.configuration.fail_on_warnings = true PuppetLint.configuration.ignore_paths = ['spec/**/*.pp', 'pkg/**/*.pp'] require 'puppet-syntax/tasks/puppet-syntax' PuppetSyntax.exclude_paths = ["spec/fixtures/**/*"] PuppetSyntax.future_parser = true 15 / 45
Development puppet-lint puppet-syntax rspec-puppet RSpec-Puppet Compile catalog module dependency system fact class parameters Verifies catalog Class/Resource specification Relationships Expectation 16 / 45
Development puppet-lint puppet-syntax rspec-puppet .fixtures.yml fixtures: repositories: apt: "https://github.com/puppetlabs/puppetlabs-apt.git" stdlib: "https://github.com/puppetlabs/puppetlabs-stdlib.git" firewall: "https://github.com/puppetlabs/puppetlabs-firewall.git" concat: "https://github.com/puppetlabs/puppetlabs-concat.git" symlinks: postgresql: "#{source_dir}" 17 / 45
Development puppet-lint puppet-syntax rspec-puppet Supply system facts and class parameters: let(:facts) {{ :osfamily => 'redhat' }} let(:params) {{ :keys_enable => true, :keys_file => '/etc/ntp/ntp.keys', :keys_trusted => ['1', '2', '3'], :keys_controlkey => '2', :keys_requestkey => '3', }} 18 / 45
Development puppet-lint puppet-syntax rspec-puppet require 'spec_helper' describe 'ntp' do Dir.glob('tests/*.pp').each do |file| let(:facts) {{ :osfamily => 'redhat' }} context file do let(:pre_condition) { File.read(file) } it{ should compile } end end end 19 / 45
Development puppet-lint puppet-syntax rspec-puppet Puppet Class: describe 'ntp' do let(:facts) {{ :osfamily => 'RedHat' }} let(:params) {{ :iburst_enable => true, }} it do should contain_file('/etc/ntp.conf').with({ 'content' => /iburstn/, }) end end 20 / 45
Development puppet-lint puppet-syntax rspec-puppet Define Type describe 'mysql::db', :type => :define do let(:facts) {{ :osfamily => 'RedHat' }} let(:title) { 'test_db' } let(:params) { { 'user' => 'testuser', 'password' => 'testpass', } } ... end 21 / 45
Development puppet-lint puppet-syntax rspec-puppet Puppet module folder: .fixtures.yml Rakefile manifests/ tests/ spec/classes/* spec/defines/* 22 / 45
Development puppet-lint puppet-syntax rspec-puppet Gemfile source "https://rubygems.org" group :test do gem "rake" gem "puppet", ENV['GEM_PUPPET_VERSION'] gem "puppet-lint" gem "rspec-puppet", :git => 'https://github.com/rodjek/rspec-puppet.git' gem "puppet-syntax" gem "puppetlabs_spec_helper" end 23 / 45
Development puppet-lint puppet-syntax rspec-puppet Customize How many modules do you have? modulesync 24 / 45
Development puppet-lint puppet-syntax rspec-puppet Customize Gem::Specification.new do |s| ... if facter_version = ENV['GEM_FACTER_VERSION'] s.add_runtime_dependency 'facter', facter_version else s.add_runtime_dependency 'facter' end if puppet_version = ENV['GEM_PUPPET_VERSION'] || ENV['PUPPET_GEM_VERSION'] s.add_runtime_dependency 'puppet', puppet_version else s.add_runtime_dependency 'puppet' end s.add_runtime_dependency 'rake' s.add_runtime_dependency 'rspec', '~> 2.11.0' s.add_runtime_dependency 'mocha', '~> 0.10.5' s.add_runtime_dependency 'puppetlabs_spec_helper', '0.7' s.add_runtime_dependency 'rspec-puppet' s.add_runtime_dependency 'puppet-lint', '~> 1.0' s.add_runtime_dependency 'puppet-syntax' s.files = Dir.glob('lib/**/*') + %w(LICENSE) s.require_path = 'lib' end 25 / 45
Development puppet-lint puppet-syntax rspec-puppet Customize Gemfile group :development, :test do gem 'bodeco_module_helper', :git => 'https://github.com/bodeco/bodeco_module_helper.git' end Rakefile require 'bodeco_module_helper/rake_tasks' 26 / 45
Development puppet-lint puppet-syntax rspec-puppet Customize $ rake -T rake beaker # Run beaker acceptance tests rake beaker_nodes # List available beaker nodesets rake build # Build puppet module package rake clean # Clean a built module package rake coverage # Generate code coverage inform... rake help # Display the list of available... rake lint # Check puppet manifests with p... rake spec # Run spec tests in a clean fix... rake spec_clean # Clean up the fixtures directory rake spec_prep # Create the fixtures directory rake spec_standalone # Run spec tests on an existing... rake syntax # Syntax check Puppet manifests... rake syntax:hiera # Syntax check Hiera config files rake syntax:manifests # Syntax check Puppet manifests rake syntax:templates # Syntax check Puppet templates rake validate # Check syntax of Ruby files an... 27 / 45
Development puppet-lint puppet-syntax rspec-puppet Summary puppet-lint: style enforcer puppet-syntax: code parse rspec-puppet: catalog verify pin your versions 28 / 45
Testing 29 / 45
Testing Packer Say no to mystery boxes Virtualbox or VMware fusion/workstation Amazon, Digital Ocean, GCE, ... 30 / 45
Testing Packer "builders": [{ "vm_name": "centos70", "type": "vmware-iso", "guest_os_type": "centos-64", "http_directory": "http", "iso_url": "{{ user `iso_url` }}", "iso_checksum": "{{ user `iso_checksum` }}", "tools_upload_flavor": "linux", "boot_command": [ "<tab> text ks=http://{{ .HTTPIP }}:{{ .HTTPPort}}/ks7.cfg<enter>" ], "disk_size": 10140, "vmx_data": { "memsize": "512", "numvcpus": "1", "cpuid.coresPerSocket": "1" } }] 31 / 45
Testing Packer "provisioners": [{ "type": "shell", "environment_vars": [ "CM={{user `cm`}}", "CM_VERSION={{user `cm_version`}}", "CM_SET_PATH={{user `cm_set_path`}}", "CLEANUP_PAUSE={{user `cleanup_pause`}}" ], "execute_command": "echo 'vagrant' | {{.Vars}} sudo -E -S bash '{{.Path}}'", "scripts": [ "script/fix-slow-dns.sh", "script/sshd.sh", "script/vagrant.sh", "script/vmtool.sh", "script/cmtool.sh", "script/cleanup.sh" ] }], 32 / 45
Testing Packer https://github.com/puppetlabs/puppet-vagrant-boxes https://github.com/mitchellh/veewee-to-packer https://github.com/box-cutter https://github.com/hashicorp/puppet-bootstrap 33 / 45
Testing Packer Vagrant Vagrant.configure('2') do |conf| conf.vm.define 'demo' do |mod| mod.vm.box = 'centos64.box' mod.vm.synced_folder './modules', "/opt/puppet/share/puppet/modules" mod.vm.synced_folder './manifests', "/etc/puppetlabs/puppet/manifests" mod.vm.synced_folder './data', "/etc/puppetlabs/puppet/data" mod.vm.provision :puppet do |p| p.module_path = 'spec/fixtures/modules' p.manifests_path = 'manifests' p.manifest_file = ENV['VAGRANT_MANIFEST'] || 'init.pp' p.options = '--verbose' end end end 34 / 45
Testing Packer Vagrant https://github.com/adrienthebo/vagrant-config_builder $ vagrant plugin install vagrant-config_builder ├── config │ ├── roles.yaml │ └── vms.yaml └── Vagrantfile --- vms: - name: db private_networks: [ {ip: '10.20.1.2'} ] box: centos-5-i386 hostname: db.puppetlabs.vm synced_folders: - host_path: '.' guest_path: '/vagrant' disabled: true provisioners: - type: puppet manifests_path: 'tests' module_path: 'spec/fixtures/modules' manifest_file: <%= ENV['VAGRANT_MANIFEST'] || 'init.pp' %> 35 / 45
Testing Packer Vagrant def vm(opt) module_name = opt.fetch(:module).to_s || raise(ArgumentError, 'Must provide puppet module hostname = opt.fetch(:hostname, module_name).to_s memory = opt.fetch(:memory, 512) cpu = opt.fetch(:cpu, 1) os_type = opt.fetch(:type, :linux) Vagrant.configure('2') do |conf| conf.vm.network(:forwarded_port, guest: port, host: port, auto_correct: true) if port if os_type == :windows conf.ssh.username = 'vagrant' conf.winrm.username = 'vagrant' conf.winrm.password = 'vagrant' end ... 36 / 45
Testing Packer Vagrant vm( :hostname => 'oel', :module => 'application', :memory => 8096, :box => 'oracle65-pe3.2.3', :port => 8080 ) 37 / 45
Testing Packer Vagrant $ vagrant up $ vagrant provision $ vagrant ssh $ vagrant destroy 38 / 45
Testing Packer Vagrant Beaker Puppet Labs testing framework spec/acceptance ├── class_spec.rb ├── disable_monitoring_spec.rb ├── nodesets │ ├── centos-59-x64.yml │ ├── centos-64-x64-pe.yml │ ├── centos-64-x64.yml │ ├── centos-65-x64.yml │ ├── default.yml │ ├── fedora-18-x64.yml │ ├── sles-11-x64.yml │ ├── ubuntu-server-10044-x64.yml │ ├── ubuntu-server-12042-x64.yml │ └── ubuntu-server-1404-x64.yml ├── ntp_config_spec.rb ├── ntp_install_spec.rb ├── ntp_parameters_spec.rb ├── ntp_service_spec.rb ├── preferred_servers_spec.rb ├── restrict_spec.rb └── unsupported_spec.rb 39 / 45
Testing Packer Vagrant Beaker HOSTS: centos-64-x64: roles: - master platform: el-6-x86_64 box : centos-64-x64-vbox4210-nocm box_url : http://puppet-vagrant-boxes.puppetlabs.com/centos-64-x64-vbox4210-nocm.box hypervisor : vagrant CONFIG: type: foss 40 / 45
Testing Packer Vagrant Beaker it 'should run successfully' do pp = "class { 'ntp': }" # Apply twice to ensure no errors the second time. apply_manifest(pp, :catch_failures => true) do |r| expect(r.stderr).not_to match(/error/i) end apply_manifest(pp, :catch_failures => true) do |r| expect(r.stderr).not_to eq(/error/i) expect(r.exit_code).to be_zero end end 41 / 45
Testing Packer Vagrant Beaker it 'starts the service' do pp = <<-EOS class { 'ntp': service_enable => true, service_ensure => running, service_manage => true, service_name => '#{servicename}' } EOS apply_manifest(pp, :catch_failures => true) end describe service(servicename) do it { should be_running } it { should be_enabled } end 42 / 45
Testing Packer Vagrant Beaker Summary Packer: VM build Vagrant: VM clone and testing Beaker: Automated testing 43 / 45
Questions 44 / 45
Thank You! [nan@bodeco.io] 45 / 45

More Related Content

What's hot (18)

PDF
Puppet @ Seat
Alessandro Franceschi
 
PDF
Puppet Continuous Integration with PE and GitLab
Alessandro Franceschi
 
KEY
Crafting Beautiful CLI Applications in Ruby
Nikhil Mungel
 
PDF
OlinData Puppet Presentation for MOSC 2012
Walter Heck
 
PDF
DevOps(4) : Ansible(2) - (MOSG)
Soshi Nemoto
 
PDF
Fabric workshop(1) - (MOSG)
Soshi Nemoto
 
PDF
What you need to remember when you upload to CPAN
charsbar
 
PDF
Take control of your Jenkins jobs via job DSL.
Łukasz Proszek
 
PDF
Vagrant + Rouster at salesforce.com - PuppetConf 2013
Puppet
 
PDF
Using Puppet to Create a Dynamic Network - PuppetConf 2013
Puppet
 
PDF
DevOps(3) : Ansible - (MOSG)
Soshi Nemoto
 
PDF
Bangpypers april-meetup-2012
Deepak Garg
 
PDF
DevOps(2) : Vagrant - (MOSG)
Soshi Nemoto
 
PDF
Ansible 實戰：top down 觀點
William Yeh
 
PDF
Puppet loves RSpec, why you should, too
Dennis Rowe
 
PDF
Preparation study of_docker - (MOSG)
Soshi Nemoto
 
PPTX
Test-Driven Infrastructure with Ansible, Test Kitchen, Serverspec and RSpec
Martin Etmajer
 
PDF
Puppet: What _not_ to do
Puppet
 
Puppet @ Seat
Alessandro Franceschi
 
Puppet Continuous Integration with PE and GitLab
Alessandro Franceschi
 
Crafting Beautiful CLI Applications in Ruby
Nikhil Mungel
 
OlinData Puppet Presentation for MOSC 2012
Walter Heck
 
DevOps(4) : Ansible(2) - (MOSG)
Soshi Nemoto
 
Fabric workshop(1) - (MOSG)
Soshi Nemoto
 
What you need to remember when you upload to CPAN
charsbar
 
Take control of your Jenkins jobs via job DSL.
Łukasz Proszek
 
Vagrant + Rouster at salesforce.com - PuppetConf 2013
Puppet
 
Using Puppet to Create a Dynamic Network - PuppetConf 2013
Puppet
 
DevOps(3) : Ansible - (MOSG)
Soshi Nemoto
 
Bangpypers april-meetup-2012
Deepak Garg
 
DevOps(2) : Vagrant - (MOSG)
Soshi Nemoto
 
Ansible 實戰：top down 觀點
William Yeh
 
Puppet loves RSpec, why you should, too
Dennis Rowe
 
Preparation study of_docker - (MOSG)
Soshi Nemoto
 
Test-Driven Infrastructure with Ansible, Test Kitchen, Serverspec and RSpec
Martin Etmajer
 
Puppet: What _not_ to do
Puppet
 

Similar to Test-Driven Puppet Development - PuppetConf 2014 (20)

PDF
20140406 loa days-tdd-with_puppet_tutorial
garrett honeycutt
 
PDF
TDD with Puppet Tutorial presented at Cascadia IT Conference 2014-03-07
garrett honeycutt
 
PDF
Test Driven Development with Puppet - PuppetConf 2014
Puppet
 
PDF
Puppet Camp Paris 2014: Test Driven Development
Puppet
 
PDF
20140408 tdd puppetcamp-paris
Johan De Wit
 
KEY
modern module development - Ken Barber 2012 Edinburgh Puppet Camp
Puppet
 
PDF
Puppet Loves RSpec, Why You Should, Too
Puppet
 
PDF
Puppet Development Workflow
Jeffery Smith
 
PPTX
Puppet
Seenaah Seenaahzadeh
 
PDF
How to Develop Puppet Modules: From Source to the Forge With Zero Clicks
Puppet
 
KEY
Stanford Hackathon - Puppet Modules
Puppet
 
PDF
Testing your infallibleness
Corey Osman
 
PDF
Test Driven Development with Puppet
Puppet
 
PPTX
Puppet meetup testing
Phil Zimmerman
 
PPTX
Automated Puppet Testing - PuppetCamp Chicago '12 - Scott Nottingham
Puppet
 
PPTX
Puppet camp chicago-automated_testing2
nottings
 
KEY
Puppet for Java developers - JavaZone NO 2012
Carlos Sanchez
 
PDF
20090514 Introducing Puppet To Sasag
garrett honeycutt
 
PDF
Greenfield Puppet: Getting it right from the start
David Danzilio
 
PDF
Puppet Camp Boston 2014: Greenfield Puppet: Getting it right from the start (...
Puppet
 
20140406 loa days-tdd-with_puppet_tutorial
garrett honeycutt
 
TDD with Puppet Tutorial presented at Cascadia IT Conference 2014-03-07
garrett honeycutt
 
Test Driven Development with Puppet - PuppetConf 2014
Puppet
 
Puppet Camp Paris 2014: Test Driven Development
Puppet
 
20140408 tdd puppetcamp-paris
Johan De Wit
 
modern module development - Ken Barber 2012 Edinburgh Puppet Camp
Puppet
 
Puppet Loves RSpec, Why You Should, Too
Puppet
 
Puppet Development Workflow
Jeffery Smith
 
Puppet
Seenaah Seenaahzadeh
 
How to Develop Puppet Modules: From Source to the Forge With Zero Clicks
Puppet
 
Stanford Hackathon - Puppet Modules
Puppet
 
Testing your infallibleness
Corey Osman
 
Test Driven Development with Puppet
Puppet
 
Puppet meetup testing
Phil Zimmerman
 
Automated Puppet Testing - PuppetCamp Chicago '12 - Scott Nottingham
Puppet
 
Puppet camp chicago-automated_testing2
nottings
 
Puppet for Java developers - JavaZone NO 2012
Carlos Sanchez
 
20090514 Introducing Puppet To Sasag
garrett honeycutt
 
Greenfield Puppet: Getting it right from the start
David Danzilio
 
Puppet Camp Boston 2014: Greenfield Puppet: Getting it right from the start (...
Puppet
 
Ad

More from Puppet (20)

PPTX
Puppet Community Day: Planning the Future Together
Puppet
 
PPTX
The Evolution of Puppet: Key Changes and Modernization Tips
Puppet
 
PPTX
Can You Help Me Upgrade to Puppet 8? Tips, Tools & Best Practices for Your Up...
Puppet
 
PPTX
Bolt Dynamic Inventory: Making Puppet Easier
Puppet
 
PPTX
Customizing Reporting with the Puppet Report Processor
Puppet
 
PPTX
Puppet at ConfigMgmtCamp 2025 Sponsor Deck
Puppet
 
PPTX
The State of Puppet in 2025: A Presentation from Developer Relations Lead Dav...
Puppet
 
PPTX
Let Red be Red and Green be Green: The Automated Workflow Restarter in GitHub...
Puppet
 
PDF
Puppet camp2021 testing modules and controlrepo
Puppet
 
PPTX
Puppetcamp r10kyaml
Puppet
 
PDF
2021 04-15 operational verification (with notes)
Puppet
 
PPTX
Puppet camp vscode
Puppet
 
PDF
Modules of the twenties
Puppet
 
PDF
Applying Roles and Profiles method to compliance code
Puppet
 
PPTX
KGI compliance as-code approach
Puppet
 
PDF
Enforce compliance policy with model-driven automation
Puppet
 
PDF
Keynote: Puppet camp compliance
Puppet
 
PPTX
Automating it management with Puppet + ServiceNow
Puppet
 
PPTX
Puppet: The best way to harden Windows
Puppet
 
PPTX
Simplified Patch Management with Puppet - Oct. 2020
Puppet
 
Puppet Community Day: Planning the Future Together
Puppet
 
The Evolution of Puppet: Key Changes and Modernization Tips
Puppet
 
Can You Help Me Upgrade to Puppet 8? Tips, Tools & Best Practices for Your Up...
Puppet
 
Bolt Dynamic Inventory: Making Puppet Easier
Puppet
 
Customizing Reporting with the Puppet Report Processor
Puppet
 
Puppet at ConfigMgmtCamp 2025 Sponsor Deck
Puppet
 
The State of Puppet in 2025: A Presentation from Developer Relations Lead Dav...
Puppet
 
Let Red be Red and Green be Green: The Automated Workflow Restarter in GitHub...
Puppet
 
Puppet camp2021 testing modules and controlrepo
Puppet
 
Puppetcamp r10kyaml
Puppet
 
2021 04-15 operational verification (with notes)
Puppet
 
Puppet camp vscode
Puppet
 
Modules of the twenties
Puppet
 
Applying Roles and Profiles method to compliance code
Puppet
 
KGI compliance as-code approach
Puppet
 
Enforce compliance policy with model-driven automation
Puppet
 
Keynote: Puppet camp compliance
Puppet
 
Automating it management with Puppet + ServiceNow
Puppet
 
Puppet: The best way to harden Windows
Puppet
 
Simplified Patch Management with Puppet - Oct. 2020
Puppet
 
Ad

Recently uploaded (20)

PDF
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
PDF
Jak MŚP w Europie Środkowo-Wschodniej odnajdują się w świecie AI
dominikamizerska1
 
PDF
Newgen 2022-Forrester Newgen TEI_13 05 2022-The-Total-Economic-Impact-Newgen-...
darshakparmar
 
PDF
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
PDF
Presentation - Vibe Coding The Future of Tech
yanuarsinggih1
 
PDF
NewMind AI - Journal 100 Insights After The 100th Issue
NewMind AI
 
PDF
Mastering Financial Management in Direct Selling
Epixel MLM Software
 
PDF
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
PDF
Fl Studio 24.2.2 Build 4597 Crack for Windows Free Download 2025
faizk77g
 
PDF
How Startups Are Growing Faster with App Developers in Australia.pdf
India App Developer
 
PDF
July Patch Tuesday
Ivanti
 
PPTX
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
PDF
POV_ Why Enterprises Need to Find Value in ZERO.pdf
darshakparmar
 
PPTX
Building Search Using OpenSearch: Limitations and Workarounds
Sease
 
PDF
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
PDF
"Beyond English: Navigating the Challenges of Building a Ukrainian-language R...
Fwdays
 
PPTX
Q2 FY26 Tableau User Group Leader Quarterly Call
lward7
 
PDF
CIFDAQ Weekly Market Wrap for 11th July 2025
CIFDAQ
 
PDF
Chris Elwell Woburn, MA - Passionate About IT Innovation
Chris Elwell Woburn, MA
 
PDF
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
Jak MŚP w Europie Środkowo-Wschodniej odnajdują się w świecie AI
dominikamizerska1
 
Newgen 2022-Forrester Newgen TEI_13 05 2022-The-Total-Economic-Impact-Newgen-...
darshakparmar
 
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
Presentation - Vibe Coding The Future of Tech
yanuarsinggih1
 
NewMind AI - Journal 100 Insights After The 100th Issue
NewMind AI
 
Mastering Financial Management in Direct Selling
Epixel MLM Software
 
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
Fl Studio 24.2.2 Build 4597 Crack for Windows Free Download 2025
faizk77g
 
How Startups Are Growing Faster with App Developers in Australia.pdf
India App Developer
 
July Patch Tuesday
Ivanti
 
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
POV_ Why Enterprises Need to Find Value in ZERO.pdf
darshakparmar
 
Building Search Using OpenSearch: Limitations and Workarounds
Sease
 
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
"Beyond English: Navigating the Challenges of Building a Ukrainian-language R...
Fwdays
 
Q2 FY26 Tableau User Group Leader Quarterly Call
lward7
 
CIFDAQ Weekly Market Wrap for 11th July 2025
CIFDAQ
 
Chris Elwell Woburn, MA - Passionate About IT Innovation
Chris Elwell Woburn, MA
 
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 

Test-Driven Puppet Development - PuppetConf 2014

  • 1. Testing Driven Puppet Modules [Nan Liu @sesshin] Copyright 2014 1 / 45
  • 3. Overview Who This talk is not for people who: Write perfect code (manifests) Never upgrade Puppet Don't have SLA Used Puppet since 0.2x 3 / 45
  • 4. Overview Who Why Testing Puppet on Production is __ 4 / 45
  • 5. Overview Who Why Positive feedback loop: 5 / 45
  • 6. Overview Who Why Creating a virtuous cycle: 6 / 45
  • 7. Overview Who Why Creating a virtuous cycle: 7 / 45
  • 8. Overview Who Why What Developing Puppet Modules Development feedback puppet-lint puppet-syntax rspec-puppet Testing Packer Vagrant beaker 8 / 45
  • 10. Development puppet-lint Manifest lint check: $ puppet lint manifests/**/* WARNING: top-scope variable being used without an explicit namespace on line 4 WARNING: class inheriting from params class on line 26 WARNING: class not documented on line 1 WARNING: line has more than 80 characters on line 52 10 / 45
  • 11. Development puppet-lint Manifest lint cleanup: $ puppet-lint -f demo.pp FIXED: string containing only a variable on line 1 FIXED: variable not enclosed in {} on line 5 FIXED: indentation of => is not properly aligned on line 2 FIXED: indentation of => is not properly aligned on line 3 FIXED: indentation of => is not properly aligned on line 5 WARNING: ensure found on line but it's not the first attribute on line 4 11 / 45
  • 12. Development puppet-lint Configure puppet-lint behavior PuppetLint.configuration.disable_80chars PuppetLint.configuration.disable_arrow_alignment PuppetLint.configuration.disable_class_inherits_from_params_class PuppetLint.configuration.disable_class_parameter_defaults PuppetLint.configuration.fail_on_warnings = true PuppetLint.configuration.ignore_paths = ['spec/**/*.pp', 'pkg/**/*.pp'] 12 / 45
  • 13. Development puppet-lint puppet-syntax Manifest validation: $ puppet parser validate manifests/bad.pp Error: Could not parse for environment production: Syntax error at 'demo'; expected '}' at /Users/nan/src/puppet-demo/manifests/bad.pp:4 13 / 45
  • 14. Development puppet-lint puppet-syntax Rakefile require 'puppet-syntax/tasks/puppet-syntax' PuppetSyntax.exclude_paths = ["spec/fixtures/**/*"] PuppetSyntax.future_parser = true 14 / 45
  • 15. Development puppet-lint puppet-syntax Puppet module folder: manifests/ tests/ Rakefile require 'puppetlabs_spec_helper/rake_tasks' PuppetLint.configuration.disable_80chars PuppetLint.configuration.disable_arrow_alignment PuppetLint.configuration.disable_class_inherits_from_params_class PuppetLint.configuration.disable_class_parameter_defaults PuppetLint.configuration.fail_on_warnings = true PuppetLint.configuration.ignore_paths = ['spec/**/*.pp', 'pkg/**/*.pp'] require 'puppet-syntax/tasks/puppet-syntax' PuppetSyntax.exclude_paths = ["spec/fixtures/**/*"] PuppetSyntax.future_parser = true 15 / 45
  • 16. Development puppet-lint puppet-syntax rspec-puppet RSpec-Puppet Compile catalog module dependency system fact class parameters Verifies catalog Class/Resource specification Relationships Expectation 16 / 45
  • 17. Development puppet-lint puppet-syntax rspec-puppet .fixtures.yml fixtures: repositories: apt: "https://github.com/puppetlabs/puppetlabs-apt.git" stdlib: "https://github.com/puppetlabs/puppetlabs-stdlib.git" firewall: "https://github.com/puppetlabs/puppetlabs-firewall.git" concat: "https://github.com/puppetlabs/puppetlabs-concat.git" symlinks: postgresql: "#{source_dir}" 17 / 45
  • 18. Development puppet-lint puppet-syntax rspec-puppet Supply system facts and class parameters: let(:facts) {{ :osfamily => 'redhat' }} let(:params) {{ :keys_enable => true, :keys_file => '/etc/ntp/ntp.keys', :keys_trusted => ['1', '2', '3'], :keys_controlkey => '2', :keys_requestkey => '3', }} 18 / 45
  • 19. Development puppet-lint puppet-syntax rspec-puppet require 'spec_helper' describe 'ntp' do Dir.glob('tests/*.pp').each do |file| let(:facts) {{ :osfamily => 'redhat' }} context file do let(:pre_condition) { File.read(file) } it{ should compile } end end end 19 / 45
  • 20. Development puppet-lint puppet-syntax rspec-puppet Puppet Class: describe 'ntp' do let(:facts) {{ :osfamily => 'RedHat' }} let(:params) {{ :iburst_enable => true, }} it do should contain_file('/etc/ntp.conf').with({ 'content' => /iburstn/, }) end end 20 / 45
  • 21. Development puppet-lint puppet-syntax rspec-puppet Define Type describe 'mysql::db', :type => :define do let(:facts) {{ :osfamily => 'RedHat' }} let(:title) { 'test_db' } let(:params) { { 'user' => 'testuser', 'password' => 'testpass', } } ... end 21 / 45
  • 22. Development puppet-lint puppet-syntax rspec-puppet Puppet module folder: .fixtures.yml Rakefile manifests/ tests/ spec/classes/* spec/defines/* 22 / 45
  • 23. Development puppet-lint puppet-syntax rspec-puppet Gemfile source "https://rubygems.org" group :test do gem "rake" gem "puppet", ENV['GEM_PUPPET_VERSION'] gem "puppet-lint" gem "rspec-puppet", :git => 'https://github.com/rodjek/rspec-puppet.git' gem "puppet-syntax" gem "puppetlabs_spec_helper" end 23 / 45
  • 24. Development puppet-lint puppet-syntax rspec-puppet Customize How many modules do you have? modulesync 24 / 45
  • 25. Development puppet-lint puppet-syntax rspec-puppet Customize Gem::Specification.new do |s| ... if facter_version = ENV['GEM_FACTER_VERSION'] s.add_runtime_dependency 'facter', facter_version else s.add_runtime_dependency 'facter' end if puppet_version = ENV['GEM_PUPPET_VERSION'] || ENV['PUPPET_GEM_VERSION'] s.add_runtime_dependency 'puppet', puppet_version else s.add_runtime_dependency 'puppet' end s.add_runtime_dependency 'rake' s.add_runtime_dependency 'rspec', '~> 2.11.0' s.add_runtime_dependency 'mocha', '~> 0.10.5' s.add_runtime_dependency 'puppetlabs_spec_helper', '0.7' s.add_runtime_dependency 'rspec-puppet' s.add_runtime_dependency 'puppet-lint', '~> 1.0' s.add_runtime_dependency 'puppet-syntax' s.files = Dir.glob('lib/**/*') + %w(LICENSE) s.require_path = 'lib' end 25 / 45
  • 26. Development puppet-lint puppet-syntax rspec-puppet Customize Gemfile group :development, :test do gem 'bodeco_module_helper', :git => 'https://github.com/bodeco/bodeco_module_helper.git' end Rakefile require 'bodeco_module_helper/rake_tasks' 26 / 45
  • 27. Development puppet-lint puppet-syntax rspec-puppet Customize $ rake -T rake beaker # Run beaker acceptance tests rake beaker_nodes # List available beaker nodesets rake build # Build puppet module package rake clean # Clean a built module package rake coverage # Generate code coverage inform... rake help # Display the list of available... rake lint # Check puppet manifests with p... rake spec # Run spec tests in a clean fix... rake spec_clean # Clean up the fixtures directory rake spec_prep # Create the fixtures directory rake spec_standalone # Run spec tests on an existing... rake syntax # Syntax check Puppet manifests... rake syntax:hiera # Syntax check Hiera config files rake syntax:manifests # Syntax check Puppet manifests rake syntax:templates # Syntax check Puppet templates rake validate # Check syntax of Ruby files an... 27 / 45
  • 28. Development puppet-lint puppet-syntax rspec-puppet Summary puppet-lint: style enforcer puppet-syntax: code parse rspec-puppet: catalog verify pin your versions 28 / 45
  • 30. Testing Packer Say no to mystery boxes Virtualbox or VMware fusion/workstation Amazon, Digital Ocean, GCE, ... 30 / 45
  • 31. Testing Packer "builders": [{ "vm_name": "centos70", "type": "vmware-iso", "guest_os_type": "centos-64", "http_directory": "http", "iso_url": "{{ user `iso_url` }}", "iso_checksum": "{{ user `iso_checksum` }}", "tools_upload_flavor": "linux", "boot_command": [ "<tab> text ks=http://{{ .HTTPIP }}:{{ .HTTPPort}}/ks7.cfg<enter>" ], "disk_size": 10140, "vmx_data": { "memsize": "512", "numvcpus": "1", "cpuid.coresPerSocket": "1" } }] 31 / 45
  • 32. Testing Packer "provisioners": [{ "type": "shell", "environment_vars": [ "CM={{user `cm`}}", "CM_VERSION={{user `cm_version`}}", "CM_SET_PATH={{user `cm_set_path`}}", "CLEANUP_PAUSE={{user `cleanup_pause`}}" ], "execute_command": "echo 'vagrant' | {{.Vars}} sudo -E -S bash '{{.Path}}'", "scripts": [ "script/fix-slow-dns.sh", "script/sshd.sh", "script/vagrant.sh", "script/vmtool.sh", "script/cmtool.sh", "script/cleanup.sh" ] }], 32 / 45
  • 33. Testing Packer https://github.com/puppetlabs/puppet-vagrant-boxes https://github.com/mitchellh/veewee-to-packer https://github.com/box-cutter https://github.com/hashicorp/puppet-bootstrap 33 / 45
  • 34. Testing Packer Vagrant Vagrant.configure('2') do |conf| conf.vm.define 'demo' do |mod| mod.vm.box = 'centos64.box' mod.vm.synced_folder './modules', "/opt/puppet/share/puppet/modules" mod.vm.synced_folder './manifests', "/etc/puppetlabs/puppet/manifests" mod.vm.synced_folder './data', "/etc/puppetlabs/puppet/data" mod.vm.provision :puppet do |p| p.module_path = 'spec/fixtures/modules' p.manifests_path = 'manifests' p.manifest_file = ENV['VAGRANT_MANIFEST'] || 'init.pp' p.options = '--verbose' end end end 34 / 45
  • 35. Testing Packer Vagrant https://github.com/adrienthebo/vagrant-config_builder $ vagrant plugin install vagrant-config_builder ├── config │ ├── roles.yaml │ └── vms.yaml └── Vagrantfile --- vms: - name: db private_networks: [ {ip: '10.20.1.2'} ] box: centos-5-i386 hostname: db.puppetlabs.vm synced_folders: - host_path: '.' guest_path: '/vagrant' disabled: true provisioners: - type: puppet manifests_path: 'tests' module_path: 'spec/fixtures/modules' manifest_file: <%= ENV['VAGRANT_MANIFEST'] || 'init.pp' %> 35 / 45
  • 36. Testing Packer Vagrant def vm(opt) module_name = opt.fetch(:module).to_s || raise(ArgumentError, 'Must provide puppet module hostname = opt.fetch(:hostname, module_name).to_s memory = opt.fetch(:memory, 512) cpu = opt.fetch(:cpu, 1) os_type = opt.fetch(:type, :linux) Vagrant.configure('2') do |conf| conf.vm.network(:forwarded_port, guest: port, host: port, auto_correct: true) if port if os_type == :windows conf.ssh.username = 'vagrant' conf.winrm.username = 'vagrant' conf.winrm.password = 'vagrant' end ... 36 / 45
  • 37. Testing Packer Vagrant vm( :hostname => 'oel', :module => 'application', :memory => 8096, :box => 'oracle65-pe3.2.3', :port => 8080 ) 37 / 45
  • 38. Testing Packer Vagrant $ vagrant up $ vagrant provision $ vagrant ssh $ vagrant destroy 38 / 45
  • 39. Testing Packer Vagrant Beaker Puppet Labs testing framework spec/acceptance ├── class_spec.rb ├── disable_monitoring_spec.rb ├── nodesets │ ├── centos-59-x64.yml │ ├── centos-64-x64-pe.yml │ ├── centos-64-x64.yml │ ├── centos-65-x64.yml │ ├── default.yml │ ├── fedora-18-x64.yml │ ├── sles-11-x64.yml │ ├── ubuntu-server-10044-x64.yml │ ├── ubuntu-server-12042-x64.yml │ └── ubuntu-server-1404-x64.yml ├── ntp_config_spec.rb ├── ntp_install_spec.rb ├── ntp_parameters_spec.rb ├── ntp_service_spec.rb ├── preferred_servers_spec.rb ├── restrict_spec.rb └── unsupported_spec.rb 39 / 45
  • 40. Testing Packer Vagrant Beaker HOSTS: centos-64-x64: roles: - master platform: el-6-x86_64 box : centos-64-x64-vbox4210-nocm box_url : http://puppet-vagrant-boxes.puppetlabs.com/centos-64-x64-vbox4210-nocm.box hypervisor : vagrant CONFIG: type: foss 40 / 45
  • 41. Testing Packer Vagrant Beaker it 'should run successfully' do pp = "class { 'ntp': }" # Apply twice to ensure no errors the second time. apply_manifest(pp, :catch_failures => true) do |r| expect(r.stderr).not_to match(/error/i) end apply_manifest(pp, :catch_failures => true) do |r| expect(r.stderr).not_to eq(/error/i) expect(r.exit_code).to be_zero end end 41 / 45
  • 42. Testing Packer Vagrant Beaker it 'starts the service' do pp = <<-EOS class { 'ntp': service_enable => true, service_ensure => running, service_manage => true, service_name => '#{servicename}' } EOS apply_manifest(pp, :catch_failures => true) end describe service(servicename) do it { should be_running } it { should be_enabled } end 42 / 45
  • 43. Testing Packer Vagrant Beaker Summary Packer: VM build Vagrant: VM clone and testing Beaker: Automated testing 43 / 45