Install Concourse CI with BOSH
2 likes2,276 views
This document discusses how to install Concourse CI using BOSH on AWS and Azure. It provides steps to set up the necessary infrastructure like VPC, security groups, install BOSH Director. It then covers uploading stemcells and releases, creating the BOSH manifest file, and deploying Concourse. The document emphasizes that BOSH allows provisioning Concourse in a production-ready, scalable way and provides samples for AWS and Azure deployments.
![IaaS Specific Configuration
vm_types:
- name: web
cloud_properties:
instance_type: t2.micro
ephemeral_disk: {size: 3000, type: gp2}
security_groups: [web, bosh]
- name: database
cloud_properties: ...
aws.yml](https://image.slidesharecdn.com/concourse-bosh-160520021529/85/Install-Concourse-CI-with-BOSH-31-320.jpg)
Install Concourse CI with BOSH
- 1. Install Concourse CI with BOSH Toshiaki Maki (@making) Sr. Solutions Architect @Pivotal 2016-‐‑‒05-‐‑‒19 Concourse CI Tokyo Meetup
- 2. Who am I ? •Toshiaki Maki (@making) •https://blog.ik.am •Sr. Solutions Architect •Spring Framework enthusiast Spring Framework 徹底⼊入⾨門 (Coming Soon?) Perfect Java EE (Coming Soon?)
- 4. How to Install •Vagrant Image •Executable Binaries •BOSH Release https://concourse.ci/installing.html Easy Hard Production Ready Local Dev
- 5. Vagrant $ vagrant init concourse/lite $ vagrant up
- 6. Vagrant
- 7. BOSH •Powerful Provisioning Tool to deploy distributed system • Monitor / Health Check • Rolling Updates • Networking • Storage Management • VM Provisioning • IaaS Agnostic • ...
- 8. Do we really need BOSH? "If you're not yet familiar with BOSH, learning it will be a bit of an investment, but it should pay off in spades" http://concourse.ci/clusters-‐‑‒with-‐‑‒bosh.html
- 10. How to install with BOSH 1. Set up IaaS 2. Install BOSH Director using bosh-‐‑‒init 3. Upload Stemcell 4. Upload Releases 5. Create manifest file 6. Deploy the system using manifest file
- 11. •Deploy Concourse to AWS •Deploy Concourse to Azure
- 13. Deploy Concourse to AWS
- 14. Prepare VPC
- 20. Create Keypair
- 21. Security Group
- 22. Manifest for bosh-‐‑‒init • https://bosh.io/docs/init-‐‑‒aws.html#create-‐‑‒manifest Copy & Paste to bosh.yml
- 23. Replace placeholders Name Value ELASTIC-‐‑‒IP <Your New EIP for Director> there are 3 places to replace SUBNET-‐‑‒ID subnet-‐‑‒xxxxxxxx public subnet AVAILABILITY-‐‑‒ZONE ap-‐‑‒northeast-‐‑‒1a ACCESS-‐‑‒KEY-‐‑‒ID xxxxxxxx SECRET-‐‑‒ACCESS-‐‑‒KEY xxxxxxxx REGION ap-‐‑‒northeast-‐‑‒1
- 24. Deploy Download from https://bosh.io/docs/install-‐‑‒bosh-‐‑‒init.html $ bosh-init deploy bosh.yml
- 25. After 20min
- 27. $ sudo gem install bosh_cli --no-ri --no-rdoc
- 28. $ bosh target 52.196.159.101 Target set to `my-bosh' Your username: admin Enter password: Logged in as `admin'
- 29. IaaS Specific Configuration az: ... vm_types: ... disk_types: ... networks: ... compilation: ... aws.yml
- 30. IaaS Specific Configuration azs: - name: z1 cloud_properties: {availability_zone: ap-northeast-1a} aws.yml
- 31. IaaS Specific Configuration vm_types: - name: web cloud_properties: instance_type: t2.micro ephemeral_disk: {size: 3000, type: gp2} security_groups: [web, bosh] - name: database cloud_properties: ... aws.yml
- 32. IaaS Specific Configuration disk_type: - name: database disk_size: 50_000 cloud_properties: {type: gp2} aws.yml
- 33. Set Iaas Config $ bosh update cloud-config aws.yml Acting as user 'admin' on 'my-bosh' Successfully updated cloud config
- 35. Upload Stemcell $ bosh upload stemcell https://bosh.io/d/stemcells/bosh-aws-xen- hvm-ubuntu-trusty-go_agent?v=3232.3
- 36. Upload Releases (garden, concourse) $ bosh upload release https://bosh.io/d/github.com/cloudfoundry- incubator/garden-linux-release?v=0.337.0 $ bosh upload release https://bosh.io/d/github.com/concourse/con course?v=1.2.0
- 37. name: concourse director_uuid: ... releases: ... stemcells: ... instance_groups: ... update: ... Create manifest for Concourse concourse.yml
- 38. Create manifest for Concourse instance_groups: ... - name: web ... - name: db ... - name: worker ... concourse.yml
- 39. Deploy Concourse CI $ bosh deployment concourse.yml $ bosh -n deploy
- 43. Scale out - name: worker instances: 3 vm_type: worker concourse.yml $ bosh -n deploy
- 46. Health Check
- 47. Health Check
- 48. Version up $ bosh upload release https://bosh.io/d/github.com/concourse/con course?v=1.3.0 $ bosh deploy
- 49. Deploy Concourse to Azure
- 53. After 1 hour ...
- 58. $ ssh [email protected] bosh@bosh:~$ bosh target Current target is https://10.0.0.4:25555 (bosh)
- 59. IaaS Specific Configuration az: ... vm_types: ... disk_types: ... networks: ... compilation: ... azure.yml
- 60. IaaS Specific Configuration vm_types: - name: web cloud_properties: instance_type: Standard_D1 - name: database cloud_properties: ... azure.yml
- 61. Set Iaas Config bosh@bosh:~$ bosh update cloud-config azure.yml Acting as user 'admin' on 'bosh' Successfully updated cloud config
- 63. Upload Stemcell $ bosh upload stemcell https://bosh.io/d/stemcells/bosh-azure- hyperv-ubuntu-trusty-go_agent?v=3232.4
- 64. Upload Releases (garden, concourse) $ bosh upload release https://bosh.io/d/github.com/cloudfoundry- incubator/garden-linux-release?v=0.337.0 $ bosh upload release https://bosh.io/d/github.com/concourse/con course?v=1.2.0
- 65. Deploy Concourse CI $ bosh deployment concourse.yml $ bosh -n deploy Manifest file is as same as AWS's
- 70. AWS Azure IaaS Setup Create VPC, NAT, Keypair, SG, EIP Use "BOSH Setup" Template (other than SG)Director • Create Manifestfile (bosh.yml) • bosh-‐‑‒init Cloud Config • Create IaaS config (aws.yml) • bosh update cloud-‐‑‒cofig • Create IaaS config (azure.yml) • bosh update cloud-‐‑‒cofig Manifest for Concourse Create manifest file (IaaS Independent) Stemcell Upload for AWS Xen Upload for Azure Hyper-‐‑‒V Release Upload • garden-‐‑‒linux • concourse Deploy bosh deploy
- 71. Installation Article (Japanese) • AWS https://blog.ik.am/entries/383 • Azure https://blog.ik.am/entries/384
- 72. Cloud Foundry Tokyo Meetup #2 http://www.meetup.com/ja-‐‑‒JP/Cloud-‐‑‒Foundry-‐‑‒Tokyo-‐‑‒Meetup/events/230285366/ Gwenn (@The_̲Shinji62) will talk about BOSH 2.0