Data Modeling and Relational to NoSQL
0 likes749 views
The document outlines the features and advantages of Couchbase, a modern NoSQL database, including its sub-millisecond performance, scalability, flexible JSON schema, and comparison with traditional relational databases. It discusses practical use cases like real-time insights, content management, and log analysis, while providing guidance on shifting applications and optimizing data models. Additionally, it highlights tools for migrating data and offers next steps for users interested in exploring Couchbase further.
![21
{
"PersonID": 123,
"FirstName": "Ken",
"MiddleName": "J",
"LastName": "Sánchez",
"ModifiedDate": "2009-01-07T00:00:00",
"EmailAddresses": [
{
"PersonID": 123,
"EmailAddress": "ken0@adventureworks.com",
"ModifiedDate": "2009-01-18T04:23:07"
}
]
}
{
"PersonID": 123,
"FirstName": "Ken",
"MiddleName": "J",
"LastName": "Sánchez",
"ModifiedDate": "2009-01-07T00:00:00"
}
{
"PersonID": 123,
"EmailAddress": "ken0@adventureworks.com",
"ModifiedDate": "2009-01-18T04:23:07"
}
Many-to-One consolidation
Person has 1 or more EmailAddress](https://image.slidesharecdn.com/couchbasejan22slides-220110221908/85/Data-Modeling-and-Relational-to-NoSQL-21-320.jpg)
Data Modeling and Relational to NoSQL
- 1. Presented by Matthew D. Groves Data Modeling and Relational to NoSQL
- 2. 2 Couchbase: The Modern NoSQL Database Sub-millisecond performance Simplicity & Scalability UC: Caching, Cart, IOT, User Profiles & Sessions Compare with: Redis, Elasticache, Aerospike Flexible JSON schema easily maps to RDBMS N1QL is SQL for JSON UC: Content Management, Catalog, Metadata, Customer 360 Compare with: DynamoDB, MongoDB, CosmosDB No ETL, SQL++, MPP Workload Isolation UC: Real-time Insights, Fraud detection, AI, Recommendation engines Compare with: MemSQL, CockroachDB, Hana Full-text Search Inverted Index UC: Log analysis, Collaboration, Website Search Compare with: Elasticsearch, Solr, Lucene Cloud to Edge Sync Peer to Peer Sync UC: Field Apps, Airplanes, Ships, Retail Stores, Restaurants, IOT Apps Compare with: Realm, SQLite, Berkeley DB Key-Value Store Document Database Analytics HTAP/HOAP Search Engine Edge Database
- 3. 3 Are These Your Goals? • Identify a use case that can benefit from a modern database • Get some/all of data on to a modern database • Switch your application / Build a new application • Optimize your data model / access
- 4. 01/ 02/ 03/ Mapping from relational Shift Application Code Optimize Agenda
- 5. 5 1 Mapping from relational
- 6. 6 Why now? • Couchbase 7.0 / Couchbase Capella • Scopes / collections • ACID Transactions • N1QL (SQL++)
- 7. 7 So, is Couchbase a relational database now? • Distributed • Highly available • Flexible • Memory-first
- 8. 8 SQL-to-Couchbase Dictionary Legacy (relational) Modern (Couchbase) Notes Server Cluster ➕ Scalability / High Availability Database Bucket ➕ Replication / Caching Schema Scope "dbo" and "_default" Table Collection ➕ Flexibility Row Document ➕ JSON tSQL (SQL) N1QL (SQL++) Full SQL implementation with: SELECT, JOIN, COMMIT, ROLLBACK, GROUP BY, INSERT, etc… Primary Key Document Key Index Index
- 10. 10 Other Options/Tools • GlueSync - https://gluesync.com/ • Built by partner MOLO17 • Real-time sync between Couchbase and SQL Server / Oracle • Couchgres - https://github.com/metonymic-smokey/couchgres • Open source community project • Migrate from Postgres to Couchbase • Python script - https://bit.ly/mysqlPython • Bare-bones, script-based approach • Import CSV via UI
- 11. 11 Demo: Mapping
- 12. 12 2 Shift Application Code
- 13. 13 What do I need to shift? • SDK – connecting to the database • SQL – querying the database • ACID Transactions – updating data reliably
- 14. 14 SELECT RTRIM(p.FirstName) + ' ' + LTRIM(p.LastName) AS Name, d.City FROM AdventureWorks2016.Person.Person AS p INNER JOIN AdventureWorks2016.HumanResources.Employee e ON p.BusinessEntityID = e.BusinessEntityID INNER JOIN (SELECT bea.BusinessEntityID, a.City FROM AdventureWorks2016.Person.Address AS a INNER JOIN AdventureWorks2016.Person.BusinessEntityAddress AS bea ON a.AddressID = bea.AddressID) AS d ON p.BusinessEntityID = d.BusinessEntityID ORDER BY p.LastName, p.FirstName; SQL: Reuse Official Microsoft example of tSQL
- 15. 15 SELECT RTRIM(p.FirstName) || ' ' || LTRIM(p.LastName) AS Name, d.City FROM AdventureWorks2016.Person.Person AS p INNER JOIN AdventureWorks2016.HumanResources.Employee e ON p.BusinessEntityID = e.BusinessEntityID INNER JOIN (SELECT bea.BusinessEntityID, a.City FROM AdventureWorks2016.Person.Address AS a INNER JOIN AdventureWorks2016.Person.BusinessEntityAddress AS bea ON a.AddressID = bea.AddressID) AS d ON p.BusinessEntityID = d.BusinessEntityID ORDER BY p.LastName, p.FirstName; SQL: Reuse N1QL (SQL++) version of the same query (after converting data into Couchbase)
- 16. 16 public async Task<IActionResult> UpdatePurchaseOrderAsync(PersonUpdateApi personUpdateApi) { var transaction = await _context.Database.BeginTransactionAsync(); try { // update one or more rows of data, save changes await _context.SaveChangesAsync(); // commit transaction await transaction.CommitAsync(); return Ok($"Person {personUpdateApi.PersonId} name and email updated."); } catch (Exception ex) { // rollback transaction await transaction.RollbackAsync(); return BadRequest("Something went wrong, transaction rolled back"); } } ACID Transactions: relational C# example – SQL Server
- 17. 17 public async Task<IActionResult> UpdatePurchaseOrderAsync(PersonUpdateApi personUpdateApi) { // create transaction var transaction = Transactions.Create(cluster, TransactionConfigBuilder.Create().DurabilityLevel(DurabilityLevel.None).Build()); try { await transaction.RunAsync(async (context) => { // update one or more documents, save changes // commit (implied) }); return Ok($"Person {personUpdateApi.PersonId} name and email updated."); } catch (Exception ex) { // rollback (implied) return BadRequest("Something went wrong, transaction rolled back."); } } ACID Transactions: Couchbase C# Example – Couchbase Server
- 19. 19 3 Optimize
- 20. 20 Consolidate • Relational-style data is spread out • Requires JOINs and/or ACID transactions (overhead) • De-normalize
- 21. 21 { "PersonID": 123, "FirstName": "Ken", "MiddleName": "J", "LastName": "Sánchez", "ModifiedDate": "2009-01-07T00:00:00", "EmailAddresses": [ { "PersonID": 123, "EmailAddress": "[email protected]", "ModifiedDate": "2009-01-18T04:23:07" } ] } { "PersonID": 123, "FirstName": "Ken", "MiddleName": "J", "LastName": "Sánchez", "ModifiedDate": "2009-01-07T00:00:00" } { "PersonID": 123, "EmailAddress": "[email protected]", "ModifiedDate": "2009-01-18T04:23:07" } Many-to-One consolidation Person has 1 or more EmailAddress
- 22. 23 var person = await coll.GetAsync("123"); SELECT p.* FROM AdventureWorks2016.Person.Person p WHERE p.PersonID = 123 Use the key-value API when possible The key-value API is always faster
- 24. 25 Next Steps • Couchbase Playground: 30 min session • https://couchbase.live/ • Examples and learning path • Connect to the Capella trial • Couchbase Capella Trial: 30 days • https://cloud.couchbase.com/sign-up • Self service tutorial • Sample data / import data • Post trial options • Sign up with pay-as-you-go model • Starter Kits: Discounted credits & professional services
- 26. THANK YOU