RTC Conference 2023 - Enhancing Real-Time WebRTC Conversation Understanding Using ChatGPT
0 likes21 views
RTC Conference 2023 - Enhancing Real-Time WebRTC Conversation Understanding Using ChatGPT Session Info: https://www.rtc-conference.com/2023/presentation/?hid=326 Immerse yourself in the future of real-time video communications with a captivating live demonstration. Experience firsthand the seamless integration of ChatGPT with WebRTC, revolutionizing conversation understanding and response generation. Join us to witness the power of AI-driven intelligence in action, as we showcase a live demo that highlights the enhanced capabilities of WebRTC applications. Explore the technical implementation, discover industry use cases, and unlock new possibilities for immersive real-time video experiences.
RTC Conference 2023 - Enhancing Real-Time WebRTC Conversation Understanding Using ChatGPT
- 1. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 David vonThenen Software Engineer/Developer Advocate @dvonthenen Enhancing Real-Time WebRTC Conversation Understanding Using ChatGPT
- 2. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 2 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 David vonThenen ● Are you Human or an AI? ● I want 5 Kubernetes ● Virtual Machines are Real ● Replacing Myself with Bots… ● Cloudy, cloudy, cloudy… ● There is storage for that! @dvonthenen
- 3. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 3 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Agenda ● Conversation Understanding ● Why ChatGPT and LLMs? ● WebRTC + ChatGPT Goodness! ● Demo ● Q&A
- 4. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 4 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Conversation Understanding
- 5. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 5 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Uhhh, Say Again? ● Virtual Meeting Statistics ○ Zoom hosts 300M Meetings a DAY! ○ Virtual Meeting Increase 48% to 77% (2020->2022) ○ Predicted 2021->2028 Increase 23.7% ○ Average Person: 4 Hours per Week ● Opportunity to "Record" These Meetings ○ Automatic Speech Recognition (ASR) ● We Need Accurate Transcriptions! ○ Word Error Rate (WER) and Confidence 25 Incredible Meeting Statistics: Virtual, Zoom & Productivity https://quixy.com/blog/meeting-statistics-virtual-zoom Quixy Editorial Team
- 6. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 6 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Conversation Understanding ● Conversational AI is Combination of… ○ Automatic Speech Recognition (ASR) ○ Extracting Context From Dialog ○ Art of "Simulating" Conversation ● Things Going Wrong… ○ Autocorrect on Your Phone ○ Poor Transcription (Chachi PT) ● Extracting Conversation Insights: ○ "Where is David going on vacation in 2 days?"
- 7. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 7 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Do You Follow Me? ● More Knowledge, Meta(data), Higher-level Constructs… ○ Dog vs Chocolate Labrador named Charlie ● Previously: Parsing and Trigger Actions ● Opportunity: Digest and Participate ○ Books, Webinars: One Way Conversations ○ Telephony, Meetings, Chat: Two/Multi Way ● Participation is the Key! ○ Asynchronously: Post Analysis ○ Real-time: Influence the Conversation
- 8. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 8 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Why ChatGPT And LLMs?
- 9. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 9 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Smart Engagement & Influence ● Historically, Chatbots Reacted to Keywords ○ Simplistic at Best ○ Triggers Actions based on Code ● ChatGPT Democratized Chatbots, LLMs, etc ○ Human-like Responses in Sentences ○ Interaction in Conversation Format ● Why Have They Been Successful? ○ Meaningful Participation ○ Conversation Understanding? How ChatGPT Will Massively Disrupt Many Industries And Democratize AI https://beyondphilosophy.com/how-chatgpt-will-massively-disrupt-many-industries-and-democratize-ai-2/ Colin Shaw - LinkedIn
- 10. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 10 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Meaningful Participation ● How Do We Achieve Conversation AI? ○ Machine Learning (ML) ○ Next Token Prediction Engines ● Bring Value to the Conversation ○ Relevant Insights (Just Predictions) ○ Collaborate Seamlessly ● Predictions So Good = Meaningful? ○ Hallucinations Link1 Link2 ○ Illinois Tech 🎉 - ChatGPT Benchmarks GPT-4 Passes the Bar Exam https://www.iit.edu/news/gpt-4-passes-bar-exam Daniel Martin Katz - IIT Website Lost In Translation. Funny True Miscommunication https://www.linkedin.com/pulse/lost-translation-funny-true-miscommunication-tony-j-hughes/ Tony J. Hughes - LinkedIn
- 11. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 11 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 WebRTC + ChatGPT Goodness!
- 12. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 12 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Enhancing WebRTC ● Perfect Storm of Goodness ○ Communication Platforms: WebRTC ○ Conversational AI: ChatGPT ● Open Source WebRTC Application ○ ChatGPT to Keep Context of Conv. ○ Ask ChatGPT for Relevant Insights ○ Response with a Voice! ● Let's see it instead…
- 13. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 13 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Demo Huge Shoutout to: Théo Monnom - Bio Twitter Russ d'Sa - Bio Twitter KITT https://livekit.io/kitt https://blog.livekit.io/meet-kitt/
- 14. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 14 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Demo via YouTube https://youtu.be/KzxlKSz0jb4
- 15. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 15 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Resources, Links, etc ● KITT - Kaleidoscopic, Interconnected Talking Transformer ○ Théo Monnom - Bio Twitter ○ Russ d'Sa - Bio Twitter ○ Code Original: https://github.com/livekit-examples/kitt ○ Modified Code: https://github.com/dvonthenen/kitt ● Chat-GPEasy - https://github.com/dvonthenen/chat-gpeasy ○ Opinionated OpenAI Client ● Google Speech-to-Text API ● Google Text-to-Speech API
- 16. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 16 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 Questions?
- 17. 感谢您下载包图网平台上提供的PPT作品，为了您和包图网以及原创作者的利益，请勿复制、传播、销售，否则将承担法律责任！包图网将对作品进行维权，按照传播下载次数进行十倍的索取赔偿！ ibaotu.com 17 IIT RTC Conference Illinois Tech @ Chicago Oct 3 & 4, 2023 David vonThenen https://davidvonthenen.com @dvonthenen Thank You!