Introducing MagnetoDB, a key-value storage sevice for OpenStack
0 likes•5,387 views
MagnetoDB is an open source implementation of the Amazon DynamoDB API for OpenStack. It provides a key-value database service for storing unlimited data with scalability and predictable performance. MagnetoDB's API is compatible with existing DynamoDB clients, allowing applications using DynamoDB storage to run on OpenStack. The pilot implementation provides basic CRUD operations for items and tables and is available on GitHub under an Apache 2 license.
Introducing MagnetoDB, a key-value storage sevice for OpenStack
- 2. What is MagnetoDB? MagnetoDB - OpenSource Amazon DynamoDB API implementation for OpenStack, the key-value database service for storing any amount of data with seamless scalability and predictable performance.
- 3. MagnetoDB key features ● Easy-to-integrate REST-like API (AWS SDK, boto clients) ● Schemaless, non-relational table-based model ● Put/get/query/scan item operations ● Eventual and strong consistency reads ● Local Secondary indexes ● Batch read/write operations ● Designed to handle any amount of data and any level of request traffic ● Seamless throughput and storage scaling ● Fault tolerance
- 4. MagnetoDB use cases ● High request traffic level applications ● Time series data ● Queries are distributed across the data ● Any other applications ● Migration of workloads between AWS and OpenStack
- 5. Architecture highlights ● Layered architecture ● Horizontally scalable ● Pluggable database backend ● Uses native OpenStack infrastructure ○ OpenStack HEAT for provisioning ○ OpenStack Neutron LoadBalancer ○ Integration with OpenStack Keystone planned
- 7. Integration with OpenStack services
- 8. Current status ○ Pilot implemented ○ Open source, Apache 2 license ○ Launchpad homepage: https://launchpad.net/magnetodb ○ Code published on github: https://github. com/Mirantis/magnetodb ○ Deployable to Vanilla OpenStack ○ Compatible with existing DynamoDB clients
- 9. MagnetoDB Pilot Features ● Table CRUD API ○ ListTables ○ DescribeTable ○ CreateTable ○ DeleteTable ● Item CRUD API ○ PutItem ○ UpdateItem ○ DeleteItem ○ GetItem ● Data querying API ○ Query ○ Scan ● Error Handling API
- 10. MagentoDB use-case: dynamodb-geo “Geo Library for Amazon DynamoDB allows to easily create and query geospatial data”
- 12. Next steps ● General ○ Move the development to OpenStack Infra ○ Integration with OpenStack Keystone ● DynamoDB API ○ Atomic counters ○ Asynchronous table creation ○ Atomic conditional write operations ○ Batch operations ● Other features ○ Management API ○ Quota management
- 13. Summary ● The pilot implementation is available on GitHub in public repository ● MagnetoDB is compatible with AWS SDK and boto library ● It is now possible to run applications which use DynamoDB as a storage on top of OpenStack using MagnetoDB
- 14. Links and Resources ○ Wiki: https://wiki.openstack.org/wiki/MagnetoDB ○ Launchpad: https://launchpad.net/magnetodb/ ○ Source code: https://github.com/Mirantis/magnetodb ○ IRC: #magnetodb @ FreeNode ○ AWS DynamoDB http://aws.amazon.com/dynamodb/ ○ dynamodb-geo https://github.com/awslabs/dynamodb-geo