New way to learn Machine Learning with AWS DeepLens & Daniel ZivKovic
2 likes240 views
The document presents an overview of AWS DeepLens, a deep learning-enabled developer kit designed for machine learning applications. It covers topics such as getting started with sample projects, machine learning definitions, model training, and the capabilities of AWS SageMaker for building and deploying models. The document emphasizes the importance of community and mentorship for continuous learning in the field of AI and machine learning.
New way to learn Machine Learning with AWS DeepLens & Daniel ZivKovic
- 1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Daniel ZivKovic, Cloud Solutions Architect TriNimbus, an Onica company AWS DeepLens: A New Way to Learn Machine Learning Toronto AWS User Group, September 27, 2018
- 2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS DEEPLENS IS NOT A VIDEO CAMERA… …IT’S THE WORLDS FIRST DEEP LEARNING ENABLED DEVELOPER KIT
- 3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. GET STARTED WITH SAMPLE PROJECTS ARTISTIC STYLE TRANSFER OBJECT DETECTION FACE DETECTIONHOT DOG / NOT HOT DOG CAT VS. DOG ACTIVITY DETECTION O r b u ild cu stom d eep learn in g mod els in th e c lou d u sin g Am azo n SageMaker HEAD POSE DETECTION
- 4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 3. DEEPLENS OVERVIEW 2. MACHINE LEARNING OVERVIEW 1. WHY LISTEN TO AMAZON? TODAY WE WILL COVER 4. BUILD & TRAIN MODELS IN SAGEMAKER 5. KEEP LEARNING
- 5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 1. WHY LISTEN TO AMAZON?
- 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Two Decades of Machine Learning at Amazon.com
- 7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. UI – PERSONALIZED RECOMMENDATIONS Amazon.com Recommendations – Item-to-Item Collaborative Filtering algorithm, did to Barnes & Noble what Google PageRank algorithm did to Yahoo’s search dominance – which was based on professional web surfers curating the web. – Jeremy Howard
- 8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ALEXA – AI ENABLED #VoiceFirst UI With voice, for the first time in human evolution ever – we can operate “tools” out of our hand's reach! – Paul Cutsinger Alexa was my “wake- up call” for AI, as before it no speech recognition program could handle my thick accent, hoarseness, and pace of speech. – Daniel ZivKovic
- 9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 50K ROBOTS ACROSS DELIVERY CENTRES
- 10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DRONES – ALGOS LIKE IN SELF-DRIVING CARS
- 11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AMAZON GO – NO CHECKOUT, NO CASHIERS
- 12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML @ AWS MISSION Put Machine Learning in the hands of every developer and data scientist This mission statement feels as big as Bill Gates' - "A computer on every desk and in every home", or Steve Jobs' - "1000 Songs In Your Pocket" mission statements before.
- 13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS ML STACK
- 14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SAGEMAKER – FULLY-MANAGED PLATFORM The quickest and easiest way to get ML models from idea to production End-to-End Machine Learning Platform Zero Setup Flexible Model Training Pay By The Second
- 15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML USE CASES BY VERTICALS
- 16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 2. MACHINE LEARNING OVERVIEW
- 17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DEFINITIONS
- 18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. MORE DEFINITIONS • Unsupervised – clustering finds hidden patterns in your data; draws inferences (conclusions) from datasets without labeled data • Supervised – regression predicts future value of continuous variable like temperature or stock price • Supervised – classification predict the likelihood of belonging to a specific group (e.g. cat or a dog) • Supervised – most commonly includes algorithm, plus labeled data • Data Science…
- 19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Model training Inference OVERVIEW OF DEEP LEARNING Data
- 20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DATA Annotate Labeling Pre-process Sizing, formatting… Data split Training set vs Validation set
- 21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. MODEL DEVELOPMENT & TRAINING • Define model architecture • Input the annotated and cleaned data into the model • Multiple iterations (epochs) to train the model • Validate with held back dataset Large, annotated dataset Training set Validation set Training Validate
- 22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. INFERENCE It’s where the magic happens! 1. Preprocess new data/image just like training set. 2. Feed image back to the trained model to get a predicted output.
- 23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. THE OLD WAY VS. THE NEW WAY If you want a computer to do something, the old way to do it is to write a program. The new way is you tell the computer to pretend to be in neural network with a learning algorithm in it - that's programming, but then after that, if you want to solve a particular problem you just show it examples. – Geoffrey Hinton
- 24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 3. DEEPLENS OVERVIEW
- 25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DEEPLENS SPECIFICATIONS • Intel Atom Processor • Gen9 graphics • Ubuntu OS- 16.04 LTS • 100 GFLOPS performance • Dual band Wi-Fi • 8 GB RAM • 16 GB Storage (eMMC) • 32 GB SD card • 4 MP camera with MJPEG • H.264 encoding at 1080p resolution • 2 USB ports • Micro HDMI • Audio out • AWS Greengrass preconfigured • clDNN Optimized for MXNet
- 26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. UNDER THE COVERS- AWS DEEPLENS • Cloud to device • On the device
- 27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS DEEPLENS ARCHITECTURE Video out Data out I N F E R E N C E D E P L O Y P R O J E C T S Manage device Security Console Project Management AWS Cloud Intel: Model Optimizer cIDNN and Driver
- 28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 4. BUILD & TRAIN MODELS IN SAGEMAKER
- 29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. GET STARTED WITH SAMPLE PROJECTS ARTISTIC STYLE TRANSFER OBJECT DETECTION FACE DETECTIONHOT DOG / NOT HOT DOG CAT VS. DOG ACTIVITY DETECTION O r b u ild cu stom d eep learn in g mod els in th e c lou d u sin g Am azo n SageMaker HEAD POSE DETECTION
- 30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. End-to-End Machine Learning Platform Zero Setup Flexible Model Training Pay By The Second AMAZON SAGEMAKER The quickest and easiest way to get ML models from idea to production $
- 31. First Place Second Place Third Place ReadToMe Created by Alex Schultz ReadToMe is a deep learning enabled application that is able to read books to kids. In this case, reading Green Eggs and Ham, by Dr. Seuss. Dee Created by Matthew Clark Dee is a fun AWS DeepLens interactive device for children. The device asks children to answer questions by showing a picture of the answer. SafeHaven Created by Nathan Stone and Peter McLean SafeHaven uses Alexa and AWS DeepLens to bring peace of mind for vulnerable people and their families. VIEW ALL 23 PROJECTS: aws.amazon.com/deeplens/community-projects AWS DEEPLENS HACKATHON WINNERS: © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SEE WHAT OTHERS HAVE BUILT
- 32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Watch the demo: https://youtu.be/2oMGkWc46Lw
- 33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Rekognition Image Inference Lambda Amazon S3 Bucket Amazon DynamoDB SageMaker & DeepLens Console Amazon S3 Bucket Recognize Emotions Lambda Training/validation data Cropped Face Images Cropped Face Images Detected Emotions DeepLens Cloud Amazon CloudWatch Detected Emotions
- 34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Now, let’s see it in action….
- 35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
- 36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 5. KEEP LEARNING
- 37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CHOOSE YOUR MENTORS WISELY • Unlike 25+ years ago when there was a lack of information, Internet overwhelms us with information. New problem is finding good mentors (not just those who sound good) – because nowadays everyone writes, records videos, and brags. • Join local communities! (“Collaborative Filtering” the old fashioned way ;) • Follow the links in my curated list of awesome people and resources where to go for knowledge next… And let’s make the world a better place through AI & ML!
- 38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DEEPLENS & SAGEMAKER • Julien Simon, AI & Machine Learning @ AWS https://medium.com/@julsimon • Deep Learning at the edge with AWS DeepLens - Julien Simon (AWS) https://www.youtube.com/watch?v=Vw-bX1RRZGQ • An overview of Amazon SageMaker https://www.youtube.com/watch?v=ym7NEYEx9x4 • Dev Guide https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-dg.pdf • Lynn Langit: “Amazon Web Services Machine Learning Essential Training” 3hr course on Lynda.com or https://www.linkedin.com/learning/amazon-web-services-machine-learning-essential-training • Randall Hunt, Sr Technical Evangelist @ AWS https://aws.amazon.com/blogs/aws/author/randhunt/ ALEXA & VOICE-FIRST AI • Paul Cutsinger, Head of Alexa Voice Design Education @ AWS https://twitter.com/PaulCutsinger • Alexa Blogs https://developer.amazon.com/blogs/alexa/ • ML uses case “Chatbots & Voice User Interfaces (the Amazon way)” – links to slides & samples in https://www.meetup.com/Serverless-Toronto/events/rwrcspyxjblc/
- 39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML & DEEP LEARNING • Robert Newman @ Beyondsoft “How to Leverage Machine Learning” https://www.brighttalk.com/webcast/16661/321515/how-to-leverage-machine-learning • Geoffrey Hinton “The Foundations of Deep Learning” https://www.youtube.com/watch?v=zl99IZvW7rE • Deep Learning Crash Course https://gluon.mxnet.io/chapter01_crashcourse/introduction.html • 3Blue1Brown playlist “Neural Networks” https://www.youtube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi • Jeremy Howard https://en.wikipedia.org/wiki/Jeremy_Howard_(entrepreneur) • Preview our Deep Learning Certificate with a lecture by Jeremy Howard https://www.usfca.edu/data- institute/certificates/deep-learning-part-one • The wonderful and terrifying implications of computers that can learn https://www.youtube.com/watch?v=t4kyRyKyOpo • Practical Deep Learning for Coders http://course.fast.ai/start.html (2018 edition of 7-week course) • UN Sustainable Development Goals https://www.globalgoals.org/ (17 goals for a better world by 2030) • AI grounded in human values, empowering people to live better lives https://www.PartnershipOnAI.org • Make the world a better place through AI https://ai4good.org/
- 40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. THANKS & WRAP-UP Order on Amazon.com Search: AWS DeepLens CURRENTLY ONLY AVAILABLE FOR SHIPPING IN THE USA! Request a workshop Work with your AWS account management team to request a hands-on SageMaker & DeepLens workshop
- 41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Let’s chat…