Apache Geode Test Automation and Continuous Integration & Deployment (CI-CD)
Download as PPTX, PDF0 likes429 views
The document outlines a presentation on test automation and continuous integration/deployment practices using Apache Geode, highlighting the roles of various tools like Concourse, Ansible, and Terraform. It describes continuous integration as an automated approach to testing code changes and continuous deployment as ensuring code accessibility in production. Key components such as tasks, jobs, and pipelines in Concourse, as well as playbooks and roles in Ansible, are explained, along with a sample application case study.
Apache Geode Test Automation and Continuous Integration & Deployment (CI-CD)
- 1. Apache Geode Test Automation and Continuous Integration & Deployment Anupama Pradhan Sr Technology Architect, Health Care Service Corporation. [email protected] 1 Jeff Cherng Advisory Data Engineer, Pivotal Software Inc. [email protected] Presented by:
- 2. Special Thanks Tim Dalsing Advisory Data Engineer, Pivotal Software Inc. David Wadden Advisory Solution Architect, Pivotal Software Inc.
- 3. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ #6on Diversity MBA’s 50 Out Front for Diversity Leadership Best Places to Work for Women & Diverse Managers Operating Blue Cross and Blue Shield plans in FIVE states: IL, MT, NM, OK, TX 80+ Years of Success and Tradition 3 OUR PURPOSE To do everything in our power to stand with our members in sickness and in health® 1936 year founded +$1billion in IT spend Over 21,000 employees 15million members 2,100 IT employees 208.3million claims processed annually LARGESTcustomer-owned health insurer in the U.S. and 4th largest overall
- 4. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ What is CI/CD Continuous Integration is the practice of testing each change done to your codebase automatically and as early as possible. Continuous Deployment follows the testing that happens during Continuous Integration and pushes changes to a staging or production system. This makes sure a version of your code is accessible at all times. 4 Git Build Test package Jar binary candidate PCF
- 5. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Automation Tools Concourse is a continuous integration/continuous delivery tool created by Pivotal. It uses pipelines to define a series of jobs that can execute the Terraform and Ansible scripts, perform Maven builds, among other things. Ansible is an open source automation tool from RedHat, that automates cloud provisioning, configuration management, application deployment, intra- service orchestration, etc Terraform is an open source tool from Hashicorp, for automating infrastructure in the cloud. 5
- 6. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Concourse Basics Task: A task is a basic unit of work. It is execution of a command or script. Resources: A resource is an entity that forms the input or output of a task Jobs: A job is the configuration of tasks, input/output resources and execution criteria Pipeline: Orchestration of multiple jobs form a pipeline. Example: task.yml 6 Git Build Jar binary Resource Task Resource --- platform: linux inputs: - name: testapp-git run: path: /opt/maven/bin/mvn --settings ${ci_dir}/ci/settings.xml clean build
- 7. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Pipeline.yml resources: - name: testapp-git type: git source: uri: ((gemfire-fe-testapp-git-url)) private_key: ((gemfire-fe-testapp-ssh-key)) branch: master jobs: - name: build serial: true plan: - get: testapp-git trigger: true - task: build image: ci-image file: ci-git/ci/tasks/build/task.yml params: MAVEN_URL: ((maven-url)) MAVEN_SERVER_USERNAME: ((maven-server-username)) MAVEN_SERVER_PASSWORD: ((maven-server-password)) 7
- 8. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Ansible Basics Tasks: Tasks are basic ansible components that can manage system resources, like services, packages, files, execution of system commands, and etc.. Roles: reusable modules based on the well defined structure. Playbook: playbooks orchestrate the set of steps required to automate processes 8
- 9. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ task.yml --- - name: Update OS - upgrade all packages yum: name: '*’ state: latest 9
- 10. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ playbook.yml --- - name: rolling OS updates for gemfire locators hosts: gf_locators remote_user: centos become: true gather_facts: true serial: 1 vars: wait_for_port: 22 wait_timeout: 60 sleep_time: 10 tasks: - include_tasks: tasks/os-update.yml 10
- 11. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Sample Application : Customer Order Service 11 Locator 1 Locator 2 Server 1 Server 2 AWS App Instance 1 App Instance 2 PCF
- 12. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Walk Through Code…. 14
- 13. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Application Testing Unit Testing with Mock Integration Testing with embedded Geode 18
- 14. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Code Walk-Thru Server Components Client Components 19
- 15. Unless otherwise indicated, these slides are © 2013 -2016 Piv otal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ References https://pivotal.io/concourse https://www.ansible.com/it-automation https://www.terraform.io/ http://geode.apache.org/docs/guide/13/about_geode.html https://geode.apache.org/docs/guide/11/configuring/cluster_config/gfsh_persist.ht ml 20
- 16. Learn More. Stay Connected. 12/04 2:00PM High Performance Cloud Native APIs Using Apache Geode 12/07 9:00AM Main Stage : Keynote by Mark Ardito 12/07 11:50AM RDBMS and Apache Geode Data Movement: Low Latency ETL Pipeline By Using Cloud-Native Event Driven Microservices 21 #springone@s1p
Editor's Notes
- #6: Concource : Build components that are expressed as code to ensure versioned, transportable, and repeatable build configurations Inherently stateless and container-based builds with each task running clean in its own container, for dependable results Pipeline status that is highly visible to all so teams maintain the build process with priority Simple modeling of build-to-release processes as modular components to support arbitrarily complex projects Flexible integrations to incorporate any kind of external system into your pipeline Ansible – Chef and puppet. Learning curve is steep. - points why ansible is easy. When you have to deploy the application to multiple host, the concourse pipleline can get complex. Tools like ansible , chef and puppet provide configuration management and application deploymnet to can manage large number of server
- #7: Job can have multiple task but the share input and output from the same job. Example build and test.
- #8: - name: deploy-client serial: true plan: - aggregate: - get: testapp-git passed: [deploy-server] trigger: true - get: testapp-client-maven - put: testapp-cf params: manifest: testapp-git/client/manifest/manifest.yml path: testapp-client-maven/testapp-client-*.jar current_app_name: testapp-client