Dynamic workload migration over optical backbone network to minimize data center electricity cost
1 like136 views
The document discusses dynamic workload migration over optical backbone networks to reduce electricity costs in geographically distributed data centers. It presents a proposed algorithm for dynamic workload-aware VM placement and migration, demonstrating potential savings of 20-30% by exploiting variations in electricity pricing. Future work involves exploring new virtualization platforms and identifying optimal dynamicity for cost efficiency.
![Simulation setup
5/26/201712
Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost
[15] A. K. Mishra,et al.,
“Towards Characterizing
Cloud Backend Workloads:
Insights from Google
Compute Clusters,” ACM
SIGMETRICS Performance
Evaluation Review, 2010.
[16] T. Paul, et al., “The
User Behavior in Facebook
and its Development from
2009 until 2014,” arXiv,
2015.](https://image.slidesharecdn.com/sabidur-05-19-2017-170808020825/85/Dynamic-workload-migration-over-optical-backbone-network-to-minimize-data-center-electricity-cost-12-320.jpg)
Dynamic workload migration over optical backbone network to minimize data center electricity cost
- 1. Dynamic Workload Migration Over Optical Backbone Network To Minimize Data Center Electricity Cost Sabidur Rahman*, Abhishek Gupta*, Massimo Tornatore*†, and Biswanath Mukherjee* *University of California, Davis, USA †Politecnico di Milano, Italy ONS-2: Optical Data Center Networking 5/26/20171
- 2. Agenda • Introduction to problem • Motivation • Electricity market • Formal statement • Power consumption model • Proposed algorithm • Dynamic Workload-Aware VM Placement and Migration • Results • Summary and future work 5/26/20172 Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost
- 3. 5/26/20173 Geographically distributed data centers Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost Source: http://royal.pingdom.com/2008/04/11/map-of-all-google-data-center-locations/
- 4. Annual electricity cost 5/26/20174 A. Qureshi, R. Weber, H. Balakrishnan, J. Guttag, and B. Maggs, “Cutting the electric bill for internet-scale systems,” SIGCOMM ’09, vol. 39, no. 4, pp. 123–134, Oct. 2009. Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost
- 5. Electricity market 5/26/20175 Source: http://www.isorto.org/about/default Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost • 7 major ISOs/RTOs in USA • Electricity cost varies over: • time • location (mostly due to characteristics of power sources and supply /demand behavior) Independent System Operator (ISO) Regional Transmission Organization (RTO)
- 6. Variable electricity cost 5/26/20176 A. Gupta, U. Mandal, P. Chowdhury, M. Tornatore and B. Mukherjee, “Cost-efficient live VM migration based on varying electricity cost in optical cloud networks”, Photonic Network Communications, Sep 2015 Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost
- 7. Key concepts • Exploit spatio-temporal variation of electricity prices for geographically-distributed data centers • Live VM migration • Service request re-routing (considering SLA!) • Solution for dynamic scenarios • Most existing work on static/quasi-static scenarios • Power model • Backbone network power consumption (due to VM migration) 5/26/20177 Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost
- 8. Problem statement 5/26/20178 Dynamic Optimization Dynamic Optimization Where to „serve‟ the request, or where to „migrate‟ the running service Where to „serve‟ the request, or where to „migrate‟ the running service DCs‟ current capacities DCs‟ current capacities Network state and link capacities Network state and link capacities Electricity price dataElectricity price data Service SLAService SLA Service requests Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost
- 9. DC power model 5/26/20179 Server Rack Total IT equipment Total DC VM migration power model Network nodes DC + Network VM migration Heating, cooling, ventilation, lighting, and maintenance. Heating, cooling, ventilation, lighting, and maintenance. Administrative overhead of managing VM migration Administrative overhead of managing VM migration Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost (u= server utilization) (n= total # of bits, Ci,j cost of electricity)
- 10. Algorithm Dynamic Workload-Aware VM Placement and Migration (DWVPM) Step I (initial placement) where to place new requests? 5/26/201710 Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost StartStart At arrival of a new service, find lowest cost DC available At arrival of a new service, find lowest cost DC available Place the incoming service and update DC status Place the incoming service and update DC status Step II (migration of services) where to migrate running services? For already running service, calculate cost of migration to candidate DCs For already running service, calculate cost of migration to candidate DCs Epoch expired? Epoch expired? Migration saves cost? Migration saves cost? Move service to lowest cost DC availableMove service to lowest cost DC available Done with all running services? Done with all running services? No Yes No Yes Yes No
- 11. Novelties of approach • Epoch makes the migration frequency variable • epoch dynamically adjusts migration frequency • Dynamic service arrival and duration • We use practical values from DC workload traces studied in prior works • Combination of backbone network and server power consumption • Per-Rack VM consolidation in DCs which further reduces the electricity cost 5/26/201711
- 12. Simulation setup 5/26/201712 Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost [15] A. K. Mishra,et al., “Towards Characterizing Cloud Backend Workloads: Insights from Google Compute Clusters,” ACM SIGMETRICS Performance Evaluation Review, 2010. [16] T. Paul, et al., “The User Behavior in Facebook and its Development from 2009 until 2014,” arXiv, 2015.
- 13. Results: normalized cost vs. load 5/26/201713 Higher load, lower cost savings Higher load, lower cost savings VM migration helps to minimize cost VM migration helps to minimize cost Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost
- 14. Results: impact of DC capacity (for fixed transport capacity) 5/26/201714 More VMs to migrate, lower cost savings (bandwidth capacity limit) More VMs to migrate, lower cost savings (bandwidth capacity limit) Higher load, lower cost savings Higher load, lower cost savings Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost Nr of VMs per DC
- 15. Results: 24-hour variation on cost savings 5/26/201715 Cost savings over the day varies with the load and electricity price Cost savings over the day varies with the load and electricity price Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost
- 16. Results: impact of epoch 5/26/201716 Frequently executing the algorithm has more cost savings in lower loads than higher loads Frequently executing the algorithm has more cost savings in lower loads than higher loads Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost
- 17. Summary and future work • Spatio-temporal variation of electricity prices can help to minimize DC electricity cost significantly • DWVPM optimizes DC electricity cost in dynamic scenarios • Savings in the orfer of 20-30% • Future work: • Use of new virtualization platforms such as „docker containers‟ • A-priori identification of the right “dynamicity” 5/26/201717 Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost
- 18. 5/26/201718 Massimo Tornatore: Dynamic Workload Migration over Optical Backbone Network to Minimize Data Center Electricity Cost [email protected]