AWS User Group Sydney - Atlassian 5-10-16
2 likes•626 views
The document provides an overview of Atlassian's internal Platform as a Service (PaaS) on AWS, explaining its architecture, deployment processes, and statistics regarding services and add-ons. It discusses the importance of balancing consistency and flexibility in service management, including enforcing common logging, upgrade flows, and resource isolation. The paper also outlines best practices for a healthy PaaS that encourages microservices development, focusing on education, onboarding, and adaptation to technology trends.
AWS User Group Sydney - Atlassian 5-10-16
- 1. Micros Atlassian’s Internal PaaS on AWS JASON UMIKER • @JASONUMIKER
- 3. PaaS Overview CloudFormation RDS S3 DynamoDB EC2
- 4. Over services running right now 500
- 5. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Todo: better image Why do we need a Platform?
- 6. Data Centre JIRA & Confluence Cloud Architecture Rack Cloud instance in OpenVZ container (approx. 1500 per rack)
- 7. Breaking up the Monoliths * * Data Centre Rack BlobStore service PaaS
- 8. Breaking up the Monoliths > < Data Centre Rack PaaS _ _ - - /oo o o . .
- 9. Todo: better image What does the platform do?
- 10. + SD{ } Artifact Descriptor Deploying a Service
- 11. Deploying a Service name: Micros Workshop description: A sample app links: binary: type: npm artifactId: '@atlassian/micros-workshop' version: 0.0.1 healthcheck: uri: /healthcheck source: url: 'ssh://[email protected]/x.git' owners: - [email protected] organization: Cloud Platform Engineering
- 12. + SD{ } Artifact Descriptor https://<service>.atlassian.io Deploying a Service Compute: CloudFormation stack with: • Route 53 DNS record • Elastic Load Balancer • EC2 instances in Autoscaling group Resources: • S3, RDS, DynamoDB • Redis, Memcached, SQS…
- 14. . . cloudymccloudface.atlassian.io > micros service:deploy my-service -f service-descriptor.yml Deploying a Service
- 15. • Big cool statistic • 2,56 9 • Add-Ons in Marketplace Lessons learned: Balancing consistency & flexibility
- 16. Where to favor rules & consistency? Enforce: Common logging & monitoring infra Encourage: Structured log data
- 18. Where to favor rules & consistency? Enforce: Common logging & monitoring infra Encourage: Structured log data Enforce: Standard upgrade flow
- 20. Where to favor rules & consistency? Enforce: Common logging & monitoring infra Encourage: Structured log data Enforce: Standard upgrade flow Enforce: Limited set of persistent data stores
- 23. Where to favor rules & consistency? Enforce: Common logging & monitoring infra Encourage: Structured log data Enforce: Standard upgrade flow Enforce: Limited set of persistent data stores Encourage: Resource isolation
- 25. Where to favor rules & consistency? Enforce: Common logging & monitoring infra Encourage: Structured log data Enforce: Standard upgrade flow Enforce: Limited set of persistent data stores Enforce: Common service metadata & cost allocation Encourage: Resource isolation
- 26. Where to favor rules & consistency? Enforce: Common logging & monitoring infra Encourage: Structured log data Enforce: Standard upgrade flow Enforce: Limited set of persistent data stores Enforce: Restricted ssh access Enforce: Common service metadata & cost allocation Encourage: Resource isolation
- 27. Where to favor rules & consistency? Enforce: Common logging & monitoring infra Encourage: Structured log data Enforce: Standard upgrade flow Enforce: Limited set of persistent data stores Enforce: Statelessness & disposable compute nodes Enforce: Restricted ssh access Encourage: Resource isolation Enforce: Common service metadata & cost allocation
- 28. 12 Factor (not pets) Nodes as cattle (not pets)
- 29. Where to bend the rules / favor flexibility? Enable: Service-level technology stack flexibility
- 31. Where to bend the rules / favor flexibility? Enable: Service-level technology stack flexibility Enable: Integration with 3rd party services
- 32. Where to bend the rules / favor flexibility? Enable: Service-level technology stack flexibility Adapt to underlying platform limitations Enable: Integration with 3rd party services
- 33. Where to bend the rules / favor flexibility? Enable: Service-level technology stack flexibility Adapt: Education & on-boarding Adapt to underlying platform limitations Enable: Integration with 3rd party services
- 34. Where to bend the rules / favor flexibility? Enable: Service-level technology stack flexibility Adapt: Education & on-boarding Adapt to underlying platform limitations Enable: Integration with 3rd party services Open the platform for contributions
- 35. Contributions & Self-hosted PaaS components Bootstrapping Service Deployment orchestration service Chaos Monkey Log Analysis Service PaaS PaaS PaaS PaaS PaaS Simple Workflow integration Service cost estimation Data Pipelines Integration Service-to- service auth …
- 36. Where to bend the rules / favor flexibility? Enable: Service-level technology stack flexibility Adapt to underlying platform limitations Enable: Integration with 3rd party services Adapt: roadmap to inbound requests & technology trends Open the platform for contributions Adapt: Education & on-boarding
- 37. Organisation wide: Disaster Recovery Compliance Infra improvements: Container Clusters Serverless
- 38. Promises of Service Decomposition Choice of tech stacks Scalability Independent deployments Resilience End-to-end ownership Your platform should enable them – with heart and balance. PaaS
- 39. Healthy PaaS —> Happy Microservices! Balance consistency with flexibility Encourage / enforce “12 factor” & “nodes as cattle” Keep the barrier to entry low Tips for a healthy, balanced PaaS & a happy microservice ecosystem.
- 40. Questions?
- 41. Reuters. Chickens perch on the roof of a hennery to escape rising floodwaters after Typhoon Utor hit Maoming, Guangzhou province August 15, 2013. Typhoon Utor hit China's southern Guangdong and Guangxi provinces before easing to a tropical storm. Image Credits https://design.atlassian.com/ Courtesy of Scott Monday: - https://au.pinterest.com/pin/146085581635905884/ - http://scottmonday.com/ Copyright: velvetocean / 123RF Stock Photo – http://www.123rf.com/profile_velvetocean Copyright: feedough / 123RF Stock Photo – http://www.123rf.com/profile_feedough' Copyright: iimages / 123RF Stock Photo – http://www.123rf.com/iimages_feedough