Ceph and Storage Management with openATTIC, openSUSE Conference 2016-06-23
0 likes•1,365 views
Ceph and Storage Management with openATTIC focuses on developing an open source alternative to proprietary storage management systems. OpenATTIC supports both SAN and NAS functionality for unified storage without limitations. It provides Ceph support for scale-out scenarios and is fully open source under GPLv2. OpenATTIC provides a modern web UI, RESTful API, storage management of technologies like LVM, XFS, and DRBD, and integrated monitoring. It is working to expand its Ceph management capabilities through tools like a Ceph cluster status dashboard and performance graphs.
Ceph and Storage Management with openATTIC, openSUSE Conference 2016-06-23
- 1. Ceph and Storage Management with openATTIC openSUSE Conference, Nuremberg, Germany 2016-06-23 Lenz Grimmer <[email protected]>
- 2. 2 openATTIC – Our Vision ─ Develop an open source alternative to proprietary storage management systems ─ „Traditional” unified storage (NAS/SAN) ─ Support Ceph for scale-out scenarios ─ Backed with commercial support and services
- 3. 3 openATTIC – What Sets us Apart? ─ Focus on data center storage management ─ Support both SAN and NAS functionality without limitations ─ Fully Open Source (GPLv2) ─ No arbitrary functional restrictions ─ Low entrance barrier for adoption ─ Based on Linux / OSS tools ─ Multiple Linux distributions (Debian/Ubuntu/Red Hat/SUSE) ─ Well-established technology stack (e.g. drivers, hardware support) ─ Broad user base
- 4. 4 ─ Modern Web UI ─ RESTful API (Software- Defined Storage) ─ Unified Storage ─ NAS (NFS, CIFS, HTTP) ─ SAN (iSCSI, Fibre Channel) ─ LVM, XFS, ZFS, Btrfs, ext3/4 ─ Volume mirroring (DRBD®) ─ Multi-node support ─ Monitoring (Nagios/Icinga) built-in ─ Ceph management and monitoring (WIP) ─ Development sponsored by it-novum openATTIC – Open Source Storage Management
- 5. 5 ─ Backend ─ Python (Django) ─ Django REST Framework (RESTful API) ─ Linux tools for storage management, e.g. LVM, LIO, filesystem utilities, DRBD, etc. ─ Nagios/Icinga & PNP4Nagios (Monitoring and Graphing) ─ Web Frontend ─ AngularJS (JS framework) ─ Bootstrap (HTML, CSS, and JS framework) ─ Uses REST API exclusively openATTIC – Components
- 6. 6 openATTIC – High Level Architecture
- 7. 7 openATTIC – Installation on SUSE Linux ─ OBS Project filesystems:openATTIC ─ Packages available for openSUSE Leap 42.1 & SLES12 ─ Thanks to Eric Jackson (swiftgeist) for the support! ─ Feedback is welcome!
- 8. 8 openATTIC – Storage Development Roadmap ─ Add Disk and Storage Pool Management to the API & WebUI ─ Creating/Modifying LVM Volume Groups / MD RAID setups ─ Creating/Modifying Btrfs/ZFS Pools (incl. RAID setups) ─ Automatic discovery of disks/pools (via udev) ─ Monitoring Disk health (SMART) ─ Manage HW RAID controllers ─ Add volume mirroring support to the WebUI ─ Extend SAN functionality (more iSCSI/FC features) ─ Public Roadmap on the openATTIC Jira/Wiki to solicit community feedback
- 9. 9 openATTIC – Ceph Management Challenges ─ Managing and monitoring Ceph is complex ─ Many tools exist (e.g. Calamari, Intel VSM, ceph-dash) ─ Limited functionality, unclear roadmaps ─ Finding the best approach for managing Ceph
- 10. 10 openATTIC – Ceph Management Goals ─ Create a management & monitoring GUI tool ─ A tool that administrators actually want to use ─ That scales without becoming overwhelming ─ Still should allow changes to be made elsewhere, without becoming inconsistent
- 11. 11 openATTIC – Ceph Management Implementation ─ Which Ceph Management API? ─ How to manage a distributed system? ─ How to monitor the cluster‘s health/performance? ─ How to perform remote management tasks? ─ How to monitor cluster nodes in a scalable way?
- 12. 12 Django REST Framework Django Models Client (GUI) REST API DB (PostgreSQL) nodb Python librados / librbddjango.db.models openATTIC – “NoDB” Django models
- 13. 13 openATTIC – Current Ceph Development Status ─ “NoDB” backend architecture / framework in place ─ Create and map RBDs as block devices (volumes) ─ Pool Management Web UI (table view) ─ OSD Management Web UI (table view) ─ RBD Management Web UI (table view) ─ Monitor a cluster health and performance ─ CRUSH Map Editor ─ Support for managing multiple Ceph clusters
- 14. 14 openATTIC – Ceph REST API Overview https://wiki.openattic.org/display/OP/openATTIC+Ceph+REST+API+overview
- 15. 15 openATTIC – Ceph Development Roadmap ─ Ceph Cluster Status Dashboard incl. Performance Graphs ─ Extend Pool Management ─ OSD Monitoring/Management ─ RBD Management/Monitoring ─ CephFS Management ─ RGW Management (users, buckets keys) ─ Deployment, remote configuration of Ceph nodes (via Salt) ─ Public Roadmap on the openATTIC Wiki to solicit community feedback
- 16. 16 openATTIC – Storage Management Dashboard
- 17. 17 openATTIC – Ceph Pool List
- 18. 18 openATTIC – Ceph OSD List
- 19. 19 openATTIC – Ceph CRUSH map editing
- 20. 20 openATTIC – Volume Management
- 21. 21 openATTIC – API Recorder
- 22. 22 ─ www.openattic.org ─ demo.openattic.org ─ blog.openattic.org ─ docs.openattic.org ─ bitbucket.org/openattic ─ tracker.openattic.org ─ @openATTIC ─ openATTIC openATTIC – Resources
- 24. 24 Thank you!