Php day 2011 - Zing me configuration system arch
Download as PPT, PDF0 likes813 views
The document summarizes the configuration system architecture at Zing Me. 1. The system was designed to manage configurations across their 700+ servers running over 100 services like ZiDB, Memcached, MySQL and Cassandra. 2. It uses a central ServicesMap module written in C++ to store and synchronize configurations across modules and applications written in different languages like C++, Java and PHP. 3. The ServicesMap provides high performance of over 180K reads per second and agents monitor configurations to detect changes and update applications in real-time using shared memory segments.
![Q & A Contact: Nguyễn Quang Nam [email_address] http://me.zing.vn/nam.nq](https://image.slidesharecdn.com/phpday2011-zingmeconfigurationsystemarch-111219020730-phpapp02/85/Php-day-2011-Zing-me-configuration-system-arch-16-320.jpg)
Php day 2011 - Zing me configuration system arch
- 1. Zing Me Configuration System Architecture Nguyen Quang Nam Zing Me Team
- 2. Content Why Introduction Designs 1 3 2 Q&A 4
- 3. Introduction
- 4. Some info: - Servers: ~700 - ZiDB: ~115 instances - Memcached: ~80 instances - MySQL: ~20 instances - Cassandra: ~8 instances - Others: Gearman, Scribe, HBase, ZiHttpd, ZiProxy, ..: many many How to manage?
- 5. Why
- 6. - Too many services to keep in your head - Auto synchronize configuration changes - C/C++/Java/PHP (or any) apps can share same configurations
- 7. Designs
- 10. - Written in C++ - NonblockingServer with Thrift interface - Cache: hash table data structure with zallocator is designed to reduce memory fragmentation - Persistent DB: ZiDB core - Very high performance: 180K reads per second ServicesMap
- 11. - Written in C++ - Agent is scheduled to read only changed config from ServicesMap - SHM ConfSet is on Shared Memory - SHM ConfSet contains double buffer to store both old & new conf Agent & SHM ConfSet
- 12. ConfSet Extension - Written in C & C++ - Provide APIs for PHP app to access SHM ConfSet
- 13. APC? - Access APC from PHP: 120K reads per second - Access SHM ConfSet using ConfSet Extension from PHP: 250K reads per second - So hard to build my own module to access APC - APC can be accessed from any PHP application
- 14. PHP to ServicesMap? - Direct access through a TCP connection: <10K reads per second - ServicesMap is dead, nothing can works - Network is slow, anything can works?
- 15. Agents Monitoring - ServicesMap manages all agents - Each agent in ServicesMap has 2 state Active or Dead - Each agent in ServicesMap has a last sync time field, and an expiration time duration - ServicesMap exposes APIs for Admin module getting all agents and states
- 16. Q & A Contact: Nguyễn Quang Nam [email_address] http://me.zing.vn/nam.nq