High-Performance Magento in the Cloud
23 likes8,138 views
The document discusses high-performance e-commerce solutions using Magento in cloud environments, emphasizing the importance of scaling strategies like vertical and horizontal scaling for handling varying order volumes. It highlights the use of AWS services for auto-scaling, deployment management, and efficient caching mechanisms, particularly through Varnish, to optimize application performance and minimize server load. Additionally, it addresses issues like response times, server crashes, and strategies for improving backend efficiency and database management.
![Magento
High Performance
…in the cloud
php[world] 2014 – Washington D.C.](https://image.slidesharecdn.com/highperformancemagento-141115164620-conversion-gate01/85/High-Performance-Magento-in-the-Cloud-1-320.jpg)
High-Performance Magento in the Cloud
- 1. Magento High Performance …in the cloud php[world] 2014 – Washington D.C.
- 3. fbrnc fbrnc
- 5. E-Commerce: Magento CMS: TYPO3 Portals: ZF, FLOW,… Mobile Searchperience: SOLR >120 people world-wide High Performance /Scale Global Enterprise Projects
- 6. San Francisco, CA Janine Fiona that’s me Leo
- 8. Who’s runs a shop with 10 orders/hour? Who’s runs a shop with 10 orders/min? Who’s runs a shop with 10 orders/sec? YOU...?
- 10. PC games (download) Plush toys, shirts, ...
- 11. > 24.000.000 likes > 500.000 followers Social Media Impact
- 12. your application one process of… execution time memory
- 14. that’s your server …running your application
- 15. 𝑡𝑜𝑡𝑎𝑙 𝑚𝑒𝑚𝑜𝑟𝑦 = 𝑐𝑜𝑛𝑐𝑢𝑟𝑟𝑒𝑛𝑡 𝑢𝑠𝑒𝑟𝑠 ∗ 𝑚𝑒𝑚𝑜𝑟𝑦/𝑝𝑟𝑜𝑐𝑒𝑠𝑠 256 MB /process 100 users 25 GB RAM 1000 users250 GB RAM
- 16. Option 1 Make your app “smaller” make it faster!make it consume less memory!
- 17. Option 2 Make your box “bigger” a.k.a. “vertical scaling”
- 18. Option 3 Add more boxes a.k.a. “horizontal scaling”
- 20. Single Server Multi-Server vs. Single server vs. Multi server What’s the big deal?
- 23. “Hello World! Free Shipping for everyone!”
- 25. “Hello World! Free Shipping for everyone!” “Check out our new product!” “Holiday Season!”
- 27. Waste of money
- 28. Waste of money Slow response times, server crashes,…
- 29. Auto Scaling! Pay per hour
- 30. Actually, it looks more like this
- 31. Cloud (in case you haven’t noticed…:)
- 33. Amazon EC2 Amazon S3 Amazon RDS CloudFront Route 53ElastiCache Elastic Load Balancing Cloud Services AWS Management ConsoleRightScale Amazon SWFOpsWorks AWS CloudFormation
- 34. EC2 instance
- 35. EC2 instance Server Array (or “auto-scaling group”) Based on various metrics
- 36. Server Array (or “auto-scaling group”) EC2 instance
- 37. Server Array (or “auto-scaling group”) EC2 instance
- 39. Loose Coupling No hardcoding! “RightScale API, give me all frontend servers” “ELB, here I am”
- 40. S3 Deployment X Backend Array Frontend Array Worker Array Varnish Array S3 RDSElastiCache CloudFront CloudFrontRoute 53 shop.angrybirds.com Braintree MailDRM Giftcards ELB
- 42. Deployment X+1 Worker Array nt X Route 53 ELB Backend Array Frontend Array W Varnish Array
- 44. Route 53 Backend Array Deployment X+1 Frontend Array Worker Array Varnish Array Deployment X ELB ELB
- 45. Downtime Number of lost carts Number of lost sessions and logins
- 46. 1.000.000unique visitors. per day.
- 48. Orders. 10 5 6 7 8 9 per second. Yes, per second!
- 49. AWS OpsWorks “DevOps Application Management Service”
- 50. Stacks, Layers Instances and Apps e.g. “production” Varnish PHP DB Instances
- 51. Lifecycle Events
- 52. Build InstallationDeploymentProvisioning Chef deploy cookbook before_ migrate.rb Jenkins Setup Conf Deploy
- 55. Route 53 ELB CloudFront: Theme (JS/CSS,…) CloudFront: media files Internet S3: media files S3: build packages Continuous Integration Pipeline (Jenkins) OpsWorks Availability Zone AWS CloudFormation CloudWatch ✓ ✓inherently fault tolerant ✓ ✓ ✓ ✓ ✓ Redis: Sessions Redis: Cache Backend RDS DB instance RDS DB instance standby (Multi-AZ) ✓ ✓ Auto Scaling Group Frontend Layer Backend Layer Worker Layer Varnish Layer Data Layer RDS DB Read replica (for reports) Redis: Full page cache backend ✓ Production Stack External Services (Fulfillment, DRM, Giftcards,…) SES: Transactional emails ✓ SQS: Queue ✓ OpsWorks Setup “Stack” (= Environment) “Layers” App Instances
- 56. VarnishCustom Layer Redis Cache Redis Sessions Custom Layer Magento Production, Magento Staging, Wordpress,… PHP App Layer MySQL DB Layer Minimal Setup Route 53 ELB CloudFront: Theme (JS/CSS,…) ✓ ✓ ✓ S3: build packages Continuous Integration Pipeline (Jenkins) ✓ reuse instance for multiple layers Not recommended! Just a thought experiment… < $120/month for a c3.2xlarge
- 57. AppVarnish Reverse Proxy Protecting the application Only a few requests hit your app!
- 61. Reduce Number of Requests … hitting your application
- 62. Use a CDN
- 66. Request a page (HTTP Request) deliver static page Request Delivering static content Placeholders for dynamic parts. Cache-Control headers Ajax call request dynamic parts and transfers the id of the currently visited product JSON response with dynamic content Replace placeholder Write session id to cookie Render the page Browser Varnish Application
- 68. Request a page (HTTP Request) deliver static page Request Delivering static content Placeholders for dynamic parts. Cache-Control headers Ajax call request dynamic parts and transfers the id of the currently visited product JSON response with dynamic content Replace placeholder Write session id to cookie Render the page Browser Varnish Application
- 69. 3xx 4xx 5xx Redirects Client errors Cache other status codes Server errors
- 71. Reduce Number of Requests … hitting your application Don’t AjaxDo Ajax 3xx 4xx 5xx Cache other status codes http://example.com/ ?utm_source=pw14 &utm_medium=slides Normalize URLsUse a CDN
- 72. Bottleneck Candidates Dynamic requests are still too slow?
- 73. How do you know?
- 74. StackDriver New Relic Aoe_Profiler Xdebug Server App Profile! minimal overhead Knows about Magento… Very detailed!
- 76. DatabaseThat’s not so easy… offload the database less queries (caching!) more efficient queries (indexes,…) scaling sharding master/slave Percona Toolkit (slow) query log
- 77. Growing Data Trimming the fat! Orders Promotions cms / banners Aoe_CacheCleaner Aoe_QuoteCleaner
- 78. File I/O especially on virtual machines!
- 79. lib community core local Number of *.php files by location Less file operations
- 82. Bottleneck Candidates Memory CPU File I/ODatabase External Components