AI Dev Summit 2024 - Empower Your AI Journey_ Hands-on Machine Learning with fastai for Graphics and NLP
0 likes18 views
AI Dev Summit 2024 - Empower Your AI Journey_ Hands-on Machine Learning with fastai for Graphics and NLP Session Info: https://developerweekmanagement2024.sched.com/event/1cuKJ/open-talk-ai-empower-your-ai-journey-hands-on-machine-learning-with-fastai-for-graphics-and-nlp Are you excited about diving into artificial intelligence and machine learning but don't have a background in data sciences or ML? Join us in this interactive session as we unlock the potential of fastai, a powerful open-source deep-learning library that empowers both beginners and experts in the AI domain. In this session, we won't dwell on high-level generalities; instead, we'll show you how to roll up your sleeves and create machine learning models. We'll guide you through building starter AI/ML models tailored for graphics processing and natural language processing (NLP). You'll gain practical skills and insights, and by the end, you'll be equipped with a recipe for implementing AI models in your applications. Whether you're new to AI or a seasoned data scientist, this session promises to be your gateway to harnessing the power of AI/ML with fastai. Join us on this journey to unleash the potential of your data and turn your ideas into intelligent applications.
![All Of The Things
17
CLICK HERE] for All Material Contained in this Session CLICK HERE
All the Things in This Presentation
● Example: Which Breed of Dog?
● Example: Question vs Non-Question
● Example: LLM Answering Questions in Meetings
● STT & TTS Deepgram Speech-to-Text and Text-to-Speech
● Additional Readings:
○ Python for Data Analysis: Data Wrangling with pandas, NumPy, and
Jupyter by Wes McKinney
○ Deep Learning for Coders with fastai and pytorch by Howard Gugger
San Francisco, CA
May 29-30, 2024](https://image.slidesharecdn.com/aidevsummit-empoweryouraijourneyhands-onmachinelearningwithfastaiforgraphicsandnlp-250324132732-b138b07b/85/AI-Dev-Summit-2024-Empower-Your-AI-Journey_-Hands-on-Machine-Learning-with-fastai-for-Graphics-and-NLP-17-320.jpg)
![All Of The Things(part 2)
18
CLICK HERE] for All Material Contained in this Session CLICK HERE
How To Get Started
● Tutorials
○ FREE Online Courses - https://course.fast.ai/
○ Examples via Jupyter Notebook - https://github.com/fastai/fastbook
● Image Processing
○ Kaggle Jupyter Book by Jeremy Howard
○ FastAI Data Tutorial - Image Classification by Julius Simonelli
● Natural Language Processing
○ NLP from Scratch with PyTorch, fastai, and HuggingFace by Amar Saini
○ A Hackers' Guide to Language Models
San Francisco, CA
May 29-30, 2024](https://image.slidesharecdn.com/aidevsummit-empoweryouraijourneyhands-onmachinelearningwithfastaiforgraphicsandnlp-250324132732-b138b07b/85/AI-Dev-Summit-2024-Empower-Your-AI-Journey_-Hands-on-Machine-Learning-with-fastai-for-Graphics-and-NLP-18-320.jpg)
AI Dev Summit 2024 - Empower Your AI Journey_ Hands-on Machine Learning with fastai for Graphics and NLP
- 1. Empower Your AI Journey Hands-on Machine Learning with fastai for Graphics and NLP David vonThenen Software Engineer/Developer Advocate @dvonthenen San Francisco, CA May 29-30, 2024
- 2. David vonThenen ● Are you Human or AI? ● I want 5 Kubernetes ● Virtual Machines are Real ● Replacing Myself with Bots… ● Cloudy, cloudy, cloudy… ● There is storage for that! @dvonthenen San Francisco, CA May 29-30, 2024
- 3. 3 Agenda ● What is fastai? ● Image Classification ● Natural Language Processing ○ Dataset Considerations ● Resources ● Q&A San Francisco, CA May 29-30, 2024
- 4. San Francisco, CA May 29-30, 2024 What is fastai? Accelerate Model Creation
- 5. fastai: Deep Learning Library for All 5 fastai - https://github.com/fastai/fastai ● Deep Learning Abstraction on top of PyTorch ● Top-Down Approach to Learning AI/ML ● Fast and Easy Neural Network Training ○ ML Model is Your Output ● Usability Without Sacrificing Performance ● Provides High-level Components ● Enables Transfer Learning with Minimal Code ● Audience: Everyone! ○ Beginners in Machine Learning ○ Rapid Prototyping for Experts San Francisco, CA May 29-30, 2024
- 6. Great! What Do I Need to Know? 6 Core Components: ● Data Loaders - Flexible Data Loading and Transformations ● Learner - Training Models Wide Variety of Domains (these are Data Loaders! ● Images ● Text ● Tabular ● Collaborative) Filtering ● Data Block Generic/Custom) ● And more! San Francisco, CA May 29-30, 2024 Opinionated Data, Pipeline, Memory Management
- 7. San Francisco, CA May 29-30, 2024 Image Classifier Discussion and Demo
- 8. Problem to Blueprint 8 Image Classifier for Dogs Boxer, German Shepherd, Golden Retriever) ● Need to Create a Dataset ○ 30 Unique Images of Each Type of Dog ○ Make Images Uniform ○ Incorrectly Download Dogs? ● Build and Train the Model ○ Create Dataset Based on Categories ○ Augment Pre-Trained Model with Layers ○ Train the New Model Apply Weights) ● Test the Model with Images ○ Success? Probability? San Francisco, CA May 29-30, 2024
- 9. San Francisco, CA May 29-30, 2024 Demo Who Doesn't Love Dogs?!?
- 10. San Francisco, CA May 29-30, 2024 Natural Language Processing Discussion and Demo https://youtu.be/DC9Q6hlQiTs
- 11. Question vs Non-Question Sentences 11 How to Approach This Problem: ● Need to Create a Dataset ○ Big Problem: Where to Get Data? ○ Qs: Stanford Question Answering Dataset ■ Remove the Answers ○ Non-Qs: Use Answers OR Rand Wiki Pages ● Build and Train the Model ○ Using Tabular/DataFrame ■ 2 Cols: Sentence, Is Question ● Test the Model ○ Create a Q and Non-Q and Test! San Francisco, CA May 29-30, 2024
- 12. San Francisco, CA May 29-30, 2024 Demo Identifying Questions in Text https://youtu.be/jjzgaRIrYSg
- 13. Right Data for the Right Problem 13 Why Did We Fail At First? ● Dataset Needs to be Representative ○ Obtain the Right Kind of Data ○ Verify the Data is Correct ○ Modify the Data to Fit?!? ● Verify the Model ○ Test and Retest ○ More Data or More "Alignment" ○ Repeat! San Francisco, CA May 29-30, 2024
- 14. Getting Answers to Questions 14 Use Case: In Meetings, Phone Calls, etc, Use an LLM to Answer Questions ● Useful Because: ○ Provide "Level Set" on Participant Knowledge ○ Get Answers Now vs "Taking Offline" ○ Provide Other Lesser Known Facts ● LLM Could Be: ○ Geared Toward a Domain (ex. Medical) ○ Trained on Company Docs ○ Generalized Demo: Deepgram STT + OpenAI + Deepgram TTS San Francisco, CA May 29-30, 2024
- 15. San Francisco, CA May 29-30, 2024 Demo Answering Questions with LLMs in Real-Time Using Deepgram and OpenAI https://youtu.be/NCDLFGmK9Sw
- 16. San Francisco, CA May 29-30, 2024 Resources Materials, Links, Docs, Extras, etc
- 17. All Of The Things 17 CLICK HERE] for All Material Contained in this Session CLICK HERE All the Things in This Presentation ● Example: Which Breed of Dog? ● Example: Question vs Non-Question ● Example: LLM Answering Questions in Meetings ● STT & TTS Deepgram Speech-to-Text and Text-to-Speech ● Additional Readings: ○ Python for Data Analysis: Data Wrangling with pandas, NumPy, and Jupyter by Wes McKinney ○ Deep Learning for Coders with fastai and pytorch by Howard Gugger San Francisco, CA May 29-30, 2024
- 18. All Of The Things(part 2) 18 CLICK HERE] for All Material Contained in this Session CLICK HERE How To Get Started ● Tutorials ○ FREE Online Courses - https://course.fast.ai/ ○ Examples via Jupyter Notebook - https://github.com/fastai/fastbook ● Image Processing ○ Kaggle Jupyter Book by Jeremy Howard ○ FastAI Data Tutorial - Image Classification by Julius Simonelli ● Natural Language Processing ○ NLP from Scratch with PyTorch, fastai, and HuggingFace by Amar Saini ○ A Hackers' Guide to Language Models San Francisco, CA May 29-30, 2024
- 19. Thank you David vonThenen Software Engineer/Developer Advocate @dvonthenen San Francisco, CA May 29-30, 2024