Ceph and Storage Management with openATTIC - FOSDEM 2017-02-05
2 likes•619 views
Openattic aims to provide an open-source alternative to proprietary storage management systems, supporting both SAN and NAS functionalities without limitations. The project, under GPLv2, features a modern web interface, RESTful API, and a focus on Ceph management, with community contributions encouraged through public issue tracking and a roadmap. Key developments include enhanced monitoring capabilities, volume management, and a commitment to user-friendly design in storage administration tools.
Ceph and Storage Management with openATTIC - FOSDEM 2017-02-05
- 1. Ceph and Storage Management with openATTIC FOSDEM 2017, Brussels, BE Lenz Grimmer <[email protected]> Engineering Team Lead SUSE LINUX GmbH
- 2. 2 openATTIC – Our Vision Develop an alternative to proprietary storage management systems “Traditional” unified storage (NAS/SAN) Support Ceph for scale-out scenarios Open Source, backed with professional support and services
- 3. 3 OpenATTIC – Notable Changes Removed Enterprise/Community Edition split • Now fully under the GPLv2 • Removed requirement for CLA • DCA (Signed-off-by) is all that’s needed to contribute Public Issue tracker and roadmap (JIRA) Public pull requests / code reviews on BitBucket Monthly releases / nightly snapshot builds Entire code base (backend/UI/Tests/Docs) in one branch Part of SUSE since November 2016
- 4. 4 openATTIC – Key Aspects Focus on data center storage management • Support both SAN and NAS functionality without limitations • Ceph support Fully Open Source (GPLv2) • No arbitrary functional restrictions • Low entrance barrier for adoption Based on standard Linux / OSS tools and frameworks Multiple Linux distributions (Debian/Ubuntu/Red Hat/SUSE) • Well-established, mature technology stack • Broad vendor support (e.g. device drivers) • Broad user base
- 5. 5 openATTIC – Open Source Storage Management • Modern WebUI • RESTful API (Software-Defined Storage) • Unified Storage – NAS (NFS, CIFS, HTTP) – SAN (iSCSI, Fibre Channel) • LVM, XFS, ZFS, Btrfs, ext3/4 • Volume mirroring (DRBD®) • Multi-node support • Monitoring (Nagios/Icinga) built-in • Ceph management & monitoring • Development sponsored by SUSE
- 6. 6 openATTIC – Components Backend • Python (Django) • Django REST Framework • Linux tools for storage management (LVM, LIO, filesystem utilities, DRBD, etc.) • Nagios/Icinga + PNP4Nagios (Monitoring and Graphing) • Salt / DeepSea (Ceph deployment & management) • Stick around for Jan Fajerski’s talk about DeepSea at 15:00 Web Frontend • AngularJS (JS framework) • Bootstrap (HTML, CSS and JS framework) • Uses REST API exclusively Automated Test Suites • Python/Django Unit Tests • REST API Test framework (Gatling) • WebUI E2E Tests (Protractor/Jasmine)
- 7. 7 openATTIC – High Level Architecture
- 8. 8 openATTIC – Storage Monitoring Infrastructure
- 9. 9 openATTIC – Ceph Monitoring Infrastructure
- 10. 10 openATTIC – Storage Management Roadmap Add DRBD volume mirroring to the WebUI (WIP) Extend Disk and Storage Pool Management functionality • Creating/Managing LVM Volume Groups • Creating/Modifying Btrfs/ZFS Pools (incl. RAID setups) • Automatic discovery of disks/pools (via udev) • Disk health monitoring (SMART) Extend SAN functionality (more iSCSI/FC features) Public Roadmap on the openATTIC Jira/Wiki to solicit community feedback
- 11. 11 openATTIC – Ceph Management Goals Create a management & monitoring GUI tool A tool that admins actually want to use That scales without becoming overwhelming Still should allow changes to be made elsewhere, without becoming inconsistent
- 12. 12 openATTIC – Current Ceph Development Status Ceph Cluster Status Dashboard (Performance Graphs, Health Status) Pool management (view/create/delete) Pool monitoring Manage EC profiles RBD management (view/create/delete/map) RBD monitoring OSD management (view) CRUSH map editor Support for managing multiple Ceph clusters
- 13. 13 openATTIC – Ceph Development Roadmap Dashboard improvements (more metrics / graphs) Task Queue WebUI (WIP) Deployment, remote configuration / role assignment of Ceph nodes (via Salt Open & SUSE’S “DeepSea framework) iSCSI target management OSD Monitoring/Management RGW Management (e.g. users, buckets, keys) via RGW Admin Ops API Extend Pool Management CephFS Management / Monitoring Remote node monitoring (via Salt & collectd)
- 14. 14 Screenshots
- 15. 15 openATTIC – Storage Dashboard
- 16. 16 openATTIC – Volume Management
- 17. 17 openATTIC – API Recorder
- 18. 18 openATTIC – Ceph Cluster Dashboard
- 19. 19 openATTIC – Ceph Pool List
- 20. 20 openATTIC – Ceph Pool Creation
- 21. 21 openATTIC – Ceph RBD List
- 22. 22 openATTIC – Ceph OSD List
- 23. 23 openATTIC – Ceph RBD List
- 24. 24 openATTIC – Ceph RBD Creation
- 25. 25 openATTIC – CRUSH Map Editor
- 26. 26 openATTIC – Resources ● www.openattic.org ● demo.openattic.org ● blog.openattic.org ● docs.openattic.org ● bitbucket.org/openattic ● tracker.openattic.org ● Twitter: @openattic ● G+: openATTIC
- 27. 27 Questions?