Володимир Цап "Constraint driven infrastructure - scale or tune?"
0 likes208 views
Volodymyr Tsap discusses how to save money on infrastructure through constraint driven design. He provides examples of hardware configurations on AWS, bare metal servers, and PaaS platforms to demonstrate how costs can be optimized. Tsap also outlines ways to reduce software costs through choices in operating system, virtualization, databases, and orchestration. Infrastructure support costs depend on the complexity of the environment, with basic setups costing $500-800 per month while more advanced architectures are $4,000-6,000 per month. The overall message is that money saved through optimization can be invested in people.
Володимир Цап "Constraint driven infrastructure - scale or tune?"
- 1. Constraint Driven Infrastructure Scale and tune to save money Volodymyr Tsap Highload FWdays 2017 Volodymyr Tsap CTO at SHALB Constraint Driven Infrastructure
- 2. About Me 15 years supporting Linux for money 10 years Enterprise Java Applications and SDK’s support 8 years as a CTO in own company
- 4. Starting Startup Select the Platform
- 5. Platform Dependent Proc Extremely low price OS/Hypervisor lock out Orchestration freedom Don’t waste your time on $ calculations Dedicated Server PaaS Flexible PasYG price Does not require any system administration Failover by design Cloud Provider Price could be managed by resource freeing Unlimited scaling Rapid env. deployment using platform tools Bare Metal
- 6. Hardware Sample on AWS Dev: m4.2xlarge 8vCPU(11863PM) / 32GB / 500 GB Storage Prod: m4.xlarge 4vCPU(5931PM**) / 16GB / 100 GB Storage 10 % Change in daily snapshot 2 Elastic IP 1.5 Tb traffic $648 / Month* 27.4PM/$ * https://calculator.s3.amazonaws.com/index.html **https://www.cpubenchmark.net/cpu.php?cpu=Intel+Xeon+E5-2676+v3+%40+2.40GHz
- 7. EC2 Spot + RDS on AWS RDS(save up to 42% by upfront year payment): db.t2.medium (2СPU(2)4GB) = 48,96 $ db.m4.large (2CPU(6.5) 8GB) = 252$ Spot instances (6 hours): m4.2xlarge = 187.2 m4.xlarge = 93.6 EBS $0.10 per 600G = 60$ $514-641 / Month* 34PM/$ * https://calculator.s3.amazonaws.com/index.html * https://www.cpubenchmark.net/cpu.php?cpu=Intel+Xeon+E5-2676+v3+%40+2.40GHz
- 8. PaaS Heroku Dyno Performance-l 14GB CPU 46x(PM9073) $500/mo Or 10x Standard-2x 1GB CPU 2-8X $50/mo $500 / Month* 18PM/$ 0,65xAWS* https://devcenter.heroku.com/articles/dyno-types#available-dyno-types *https://www.quora.com/How-powerful-is-one-Heroku-dyno-Is-it-roughly-equivalent-to-an-EC2-Sm all-instance
- 9. Enterprise Server Config on OVH.com Intel 2x Xeon E5-2630v3(PM18649) / 128GB Hardware Raid 2x2TB + 2x480GB SSD 500 Mbps guaranteed bandwidth 5 TB* Remote Backup storage VMware ESXi supported * https://www.ovh.ie/dedicated_servers/enterprise/ $333 / Month* 56PM/$ 2xAWS
- 10. 2 x Soft-Raid Servers Config for OVH.com 2 servers same hardware: Intel Xeon E3-1270v6(11324PM) / 64GB SoftRaid 2x2TB 500 Mbps bandwidth 1 TB* Remote Backup storage $282 Month 80.3PM/$ 3xAWS
- 11. 2 x Desktop Hardware Dev and Prod dedicated each: AX60-SSD AMD Ryzen 7 1700X (14651PM) / 64 GB 2 x 500 GB SSD Guaranteed bandwidth 1 Gbit/s-Port $70 Month 2 TB Backup Storage - $ 12 $152 Month 192.7PM/$ 7xAWS
- 12. Hardware price needs to be taken into account DailyDaily
- 14. Daily load sample for corporate mail system
- 15. Daily load sample for E-commerce platform
- 16. Daily load sample for news website
- 17. Daily load sample for PaaS Provider
- 18. Scaling can save your money only if workload is not planar
- 20. Operating system Points to check Filesystem - ext4, xfs, noatime Memory - disable swap/swappiness Network - tcp r/wmem, buffers Process - limits, open files Prepare ready images no post-installation provisioning Compile - it could save 10-20%
- 21. Distro Selection Lifecycle RHEL/CentOS - 10 years Ubuntu LTS - 5 years Debian ~ 3 years Gentoo - rolling release Upgrade CentOS - pain Ubuntu/Debian - ok Gentoo - pain/ok Packages Available RHEL/CentOS repo - 6000 Ubuntu Universe - 23,000 Debian - 23,000 Gentoo - 19,692 OpenStack, K8, Swarm: CentOS/Ubuntu - Good Debian - Normal Lyfecycle Packages AvailableLyfecycle Upgrade procedure Platform Support
- 22. Virtualization Containerization Points to check Free and popular: KVM, Xen, Docker, ESXi* Live migration support Hosted OS requirements For licensed features fill the top of hardware limits HCL could be bypassed
- 23. Orchestration Points to check Deployment Simplicity Manageability Scalability Suitable for stateful and stateless apps Networking and multi-site support
- 24. Databases Points to check Choose the DB by the planned workload Check the CAP Theorem Fault tolerance and recovery speed Use profilers and query monitoring Buffers and pools has significant impact
- 25. How much it cost to support an infrastructure
- 26. Price depends on Number of instance types and roles Quality of automation Incident response/resolution time Number request for env. changes Mad man coefficient
- 27. Prod & Dev at same server $250 / Month
- 28. 2-3 Servers, Failover, Basic Roles $500-800 / Month
- 29. Multi DC, IaaC, CI/CD, Orchestration $1.2k-3k / Month K8/OS 3k-4k / Month
- 30. Geo Distributed Orchestration, Hybrid Clouds, Dedicated Ops $4k-6k / Month +$100 per in. type
- 31. Saved money spend on people!
- 32. Thank you! Volodymyr Tsap Co-founder/CTO at SHALB.com Email: [email protected] Skype: volodymyr.tsap Linkedin: voatsap Facebook: volodymyr.tsap