How to Avoid Common Data Visualization Pitfalls and Being Led Astray By Your Data
1 like516 views
The document provides MongoDB tips for analyzing student data, focusing on using aggregation functions to calculate average grades by section. It advises checking the data for accuracy, investigating potential errors like misspellings, and leveraging integrations for data retrieval. Practical examples of MongoDB queries are included to demonstrate these techniques.
![MongoDBTip 1: Leverage Existing Functions
© 2017 8 Path Solutions LLC. All Rights Reserved.
db.Student.aggregate ([ { "$group": { "_id": { "Section" : "$Section" },
"AverageGrades": { "$avg":"$Grades" } } } ])
{ "_id" : { "Section" : 4 }, "AverageGrades" : 26.666666666666668 }
{ "_id" : { "Section" : 3 }, "AverageGrades" : 72.5 }
{ "_id" : { "Section" : 2 }, "AverageGrades" : 70 }
{ "_id" : { "Section" : 1 }, "AverageGrades" : 74 }
{ "_id" : { "Section" : null }, "AverageGrades" : null }](https://image.slidesharecdn.com/crystaladay11140-1220jennifershinhowtoavoidcommondatavisualization-170621221611/85/How-to-Avoid-Common-Data-Visualization-Pitfalls-and-Being-Led-Astray-By-Your-Data-49-320.jpg)
![MongoDBTip 2: Check the Data
© 2017 8 Path Solutions LLC. All Rights Reserved.
• db.Student.find()
{ "_id" : ObjectId("59352ef5e8bdf3bfa5a6a465"), "StudentName" : "Ann", "Section" : 1, "Grades" : 70, "Subject" : [ "Science", "English", "Math" ] }
{ "_id" : ObjectId("59352ef5e8bdf3bfa5a6a466"), "StudentName" : "Arthur", "Section" : 1, "Grades" : 90, "Subject" : [ "English" ] }
{ "_id" : ObjectId("59352ef5e8bdf3bfa5a6a467"), "StudentName" : "Ann", "Section" : 1, "Grades" : 70, "Subject" : [ "Math" ] }
{ "_id" : ObjectId("59352f32e8bdf3bfa5a6a468"), "StudentName" : "Ann", "Section" : 1, "Grades" : 70, "Subject" : [ "Science" ] }
{ "_id" : ObjectId("59352f32e8bdf3bfa5a6a469"), "Subject" : [ "English" ] }
{ "_id" : ObjectId("59352f32e8bdf3bfa5a6a46a"), "StudentName" : "Ann", "Section" : 2, "Grades" : 70, "Subject" : [ "Math" ] }
{ "_id" : ObjectId("59352f33e8bdf3bfa5a6a46b"), "StudentName" : "An", "Section": 1, "Grades" : 70, "Subject" : [ "Math" ] }
{ "_id" : ObjectId("59352f39e8bdf3bfa5a6a46c"), "Subject" : [ "English" ] }
{ "_id" : ObjectId("59352f39e8bdf3bfa5a6a46d"), "StudentName" : "Lea", "Section" : 3, "Grades" : 50, "Subject" : [ "English" ] }
{ "_id" : ObjectId("59352f39e8bdf3bfa5a6a46e"), "StudentName" : "Tom", "Section" : 4, "Grades" : 40, "Subject" : [ "Math" ] }
{ "_id" : ObjectId("59352f39e8bdf3bfa5a6a46f"), "StudentName" : "To", "Section": 4, "Grades" : 20, "Subject" : [ "English", "Math" ] }
{ "_id" : ObjectId("59352f3be8bdf3bfa5a6a470"), "StudentName" : "Tod", "Section" : 4, "Grades" : 20, "Subject" : [ "English", "Math" ] }
{ "_id" : ObjectId("593536d6e8bdf3bfa5a6a471"), "Subject" : [ "English" ] }
{ "_id" : ObjectId("59353795e8bdf3bfa5a6a472"), "StudentName" : "Lee", "Section": 3, "Grades" : 80, "Subject" : [ "Math", "English" ] }
{ "_id" : ObjectId("59353923e8bdf3bfa5a6a473"), "StudentName" : "Alex", "Section" : 3, "Grades" : 80, "Subject" : [ "Mth" ] }
{ "_id" : ObjectId("593539dee8bdf3bfa5a6a474"), "StudentName" : "Alex", "Section" : 3, "Grades" : 80, "Subject" : [ "english" ] }](https://image.slidesharecdn.com/crystaladay11140-1220jennifershinhowtoavoidcommondatavisualization-170621221611/85/How-to-Avoid-Common-Data-Visualization-Pitfalls-and-Being-Led-Astray-By-Your-Data-50-320.jpg)
![MongoDBTip 4: Use Integrations
© 2017 8 Path Solutions LLC. All Rights Reserved.
dbGetQuery(mongo, "Student", "{}", 0, 999999)
Grades X_id StudentName Section Subject 1
70 59352ef5e8bdf3bfa5a6a465 Ann 1 [ "Science" , "English" , "Math"]
90 59352ef5e8bdf3bfa5a6a466 Arthur 1 [ "English"]
70 59352ef5e8bdf3bfa5a6a467 Ann 1 [ "Math"]
70 59352f32e8bdf3bfa5a6a468 Ann 1 [ "Science"]
NA 59352f32e8bdf3bfa5a6a469 NA [ "English"]
70 59352f32e8bdf3bfa5a6a46a Ann 2 [ "Math"]
70 59352f33e8bdf3bfa5a6a46b An 1 [ "Math"]
NA 59352f39e8bdf3bfa5a6a46c NA [ "English"]
50 59352f39e8bdf3bfa5a6a46d Lea 3 [ "English"]
40 59352f39e8bdf3bfa5a6a46e Tom 4 [ "Math"]
20 59352f39e8bdf3bfa5a6a46f To 4 [ "English" , "Math"]
20 59352f3be8bdf3bfa5a6a470 Tod 4 [ "English" , "Math"]
NA 593536d6e8bdf3bfa5a6a471 NA [ "English"]
80 59353795e8bdf3bfa5a6a472 Lee 3 [ "Math" , "English"]
80 59353923e8bdf3bfa5a6a473 Alex 3 [ "Mth"]
80 593539dee8bdf3bfa5a6a474 Alex 3 [ "english"]](https://image.slidesharecdn.com/crystaladay11140-1220jennifershinhowtoavoidcommondatavisualization-170621221611/85/How-to-Avoid-Common-Data-Visualization-Pitfalls-and-Being-Led-Astray-By-Your-Data-53-320.jpg)
![© 2017 8 Path Solutions LLC. All Rights Reserved.
dbGetDistinct(mongo,"Student","Subject")
[1] "English" "Math" "Science" "Mth" "english"
MongoDBTip 4: Use Integrations](https://image.slidesharecdn.com/crystaladay11140-1220jennifershinhowtoavoidcommondatavisualization-170621221611/85/How-to-Avoid-Common-Data-Visualization-Pitfalls-and-Being-Led-Astray-By-Your-Data-54-320.jpg)
How to Avoid Common Data Visualization Pitfalls and Being Led Astray By Your Data
- 49. MongoDBTip 1: Leverage Existing Functions © 2017 8 Path Solutions LLC. All Rights Reserved. db.Student.aggregate ([ { "$group": { "_id": { "Section" : "$Section" }, "AverageGrades": { "$avg":"$Grades" } } } ]) { "_id" : { "Section" : 4 }, "AverageGrades" : 26.666666666666668 } { "_id" : { "Section" : 3 }, "AverageGrades" : 72.5 } { "_id" : { "Section" : 2 }, "AverageGrades" : 70 } { "_id" : { "Section" : 1 }, "AverageGrades" : 74 } { "_id" : { "Section" : null }, "AverageGrades" : null }
- 50. MongoDBTip 2: Check the Data © 2017 8 Path Solutions LLC. All Rights Reserved. • db.Student.find() { "_id" : ObjectId("59352ef5e8bdf3bfa5a6a465"), "StudentName" : "Ann", "Section" : 1, "Grades" : 70, "Subject" : [ "Science", "English", "Math" ] } { "_id" : ObjectId("59352ef5e8bdf3bfa5a6a466"), "StudentName" : "Arthur", "Section" : 1, "Grades" : 90, "Subject" : [ "English" ] } { "_id" : ObjectId("59352ef5e8bdf3bfa5a6a467"), "StudentName" : "Ann", "Section" : 1, "Grades" : 70, "Subject" : [ "Math" ] } { "_id" : ObjectId("59352f32e8bdf3bfa5a6a468"), "StudentName" : "Ann", "Section" : 1, "Grades" : 70, "Subject" : [ "Science" ] } { "_id" : ObjectId("59352f32e8bdf3bfa5a6a469"), "Subject" : [ "English" ] } { "_id" : ObjectId("59352f32e8bdf3bfa5a6a46a"), "StudentName" : "Ann", "Section" : 2, "Grades" : 70, "Subject" : [ "Math" ] } { "_id" : ObjectId("59352f33e8bdf3bfa5a6a46b"), "StudentName" : "An", "Section": 1, "Grades" : 70, "Subject" : [ "Math" ] } { "_id" : ObjectId("59352f39e8bdf3bfa5a6a46c"), "Subject" : [ "English" ] } { "_id" : ObjectId("59352f39e8bdf3bfa5a6a46d"), "StudentName" : "Lea", "Section" : 3, "Grades" : 50, "Subject" : [ "English" ] } { "_id" : ObjectId("59352f39e8bdf3bfa5a6a46e"), "StudentName" : "Tom", "Section" : 4, "Grades" : 40, "Subject" : [ "Math" ] } { "_id" : ObjectId("59352f39e8bdf3bfa5a6a46f"), "StudentName" : "To", "Section": 4, "Grades" : 20, "Subject" : [ "English", "Math" ] } { "_id" : ObjectId("59352f3be8bdf3bfa5a6a470"), "StudentName" : "Tod", "Section" : 4, "Grades" : 20, "Subject" : [ "English", "Math" ] } { "_id" : ObjectId("593536d6e8bdf3bfa5a6a471"), "Subject" : [ "English" ] } { "_id" : ObjectId("59353795e8bdf3bfa5a6a472"), "StudentName" : "Lee", "Section": 3, "Grades" : 80, "Subject" : [ "Math", "English" ] } { "_id" : ObjectId("59353923e8bdf3bfa5a6a473"), "StudentName" : "Alex", "Section" : 3, "Grades" : 80, "Subject" : [ "Mth" ] } { "_id" : ObjectId("593539dee8bdf3bfa5a6a474"), "StudentName" : "Alex", "Section" : 3, "Grades" : 80, "Subject" : [ "english" ] }
- 51. MongoDBTip 3: Investigate Potential Errors © 2017 8 Path Solutions LLC. All Rights Reserved. • db.Student.distinct("Subject“) • Find ‘distinct’ terms to look for potential errors • Look for misspelled terms • Check for mismatch between upper case and lower case
- 52. MongoDBTip 4: Use Integrations © 2017 8 Path Solutions LLC. All Rights Reserved. library('RMongo') mongo <- mongoDbConnect("test", "localhost", 27017) dataProd <- dbGetQuery(mongo, "Student", "{}", 0, 999999) subjects <- dbGetDistinct(mongo,"Student","Subject")
- 53. MongoDBTip 4: Use Integrations © 2017 8 Path Solutions LLC. All Rights Reserved. dbGetQuery(mongo, "Student", "{}", 0, 999999) Grades X_id StudentName Section Subject 1 70 59352ef5e8bdf3bfa5a6a465 Ann 1 [ "Science" , "English" , "Math"] 90 59352ef5e8bdf3bfa5a6a466 Arthur 1 [ "English"] 70 59352ef5e8bdf3bfa5a6a467 Ann 1 [ "Math"] 70 59352f32e8bdf3bfa5a6a468 Ann 1 [ "Science"] NA 59352f32e8bdf3bfa5a6a469 NA [ "English"] 70 59352f32e8bdf3bfa5a6a46a Ann 2 [ "Math"] 70 59352f33e8bdf3bfa5a6a46b An 1 [ "Math"] NA 59352f39e8bdf3bfa5a6a46c NA [ "English"] 50 59352f39e8bdf3bfa5a6a46d Lea 3 [ "English"] 40 59352f39e8bdf3bfa5a6a46e Tom 4 [ "Math"] 20 59352f39e8bdf3bfa5a6a46f To 4 [ "English" , "Math"] 20 59352f3be8bdf3bfa5a6a470 Tod 4 [ "English" , "Math"] NA 593536d6e8bdf3bfa5a6a471 NA [ "English"] 80 59353795e8bdf3bfa5a6a472 Lee 3 [ "Math" , "English"] 80 59353923e8bdf3bfa5a6a473 Alex 3 [ "Mth"] 80 593539dee8bdf3bfa5a6a474 Alex 3 [ "english"]
- 54. © 2017 8 Path Solutions LLC. All Rights Reserved. dbGetDistinct(mongo,"Student","Subject") [1] "English" "Math" "Science" "Mth" "english" MongoDBTip 4: Use Integrations
- 55. MongoDBTip 4: Use Integrations © 2017 8 Path Solutions LLC. All Rights Reserved.
- 56. © 2017 8 Path Solutions LLC. All Rights Reserved. MongoDBTip 4: Use Integrations