2023-My AI Experience - Colm Dunphy.pdf
0 likes•81 views
This document provides a summary of the author's experience with artificial intelligence over time, beginning in college in 1990 studying expert systems, machine learning, and natural language processing. It then outlines developments in AI assistants like Siri, Alexa, and Grammarly. The author worked on early projects involving music recommendation systems, mobile payments, and automated radio scheduling. More recently, the author has observed the growth of AI tools for code generation, image generation, and summarization. In teaching programming, the author had to address issues around students using AI to generate assignments. Overall, the rapid advancement of AI capabilities is an ongoing challenge requiring updated policies around ethics, privacy, and appropriate use in education.
2023-My AI Experience - Colm Dunphy.pdf
- 1. My AI Experience Colm Dunphy - June 2023
- 2. TIMELINE - 1 • 1990 AI Subject in College • Expert systems • Machine Learning • Neural Networks • Natural Language Processing • Languages • Lisp, Prolog • 1998 Furby • “Furbish” • Learned English commands • Talk to another (infra red) • 2010 Siri app • 2011 Integrated into iOS • DARPA • 2013 Amazon Alexa • 2019 3rd generation Alexa Dots • 2001 Polish “Ivona”
- 3. TIMELINE - 2 • MS Word • Spelling & grammar • 1989 Word 2.0 spell check • 1993 Word 6 for windows • 1995 Word 95 • 1997 Autocorrect • 2007 Contextual spelling & grammar
- 4. TIMELINE - 3 • Grammarly • 2009 First release • 2017 iOS & Android • 2018 Google Docs compatible
- 5. TIMELINE - 4 • MS Powerpoint • Design Ideas • 2016 Office 365 Windows • Powerpoint Design Ideas • 2017 Office 365 Mac • Background Removal 2013
- 6. Adobe Photoshop Fill • Context Aware • New AI Generative Fill
- 9. CANVA – Text to Image
- 11. WRTC/DIGITAL(DEC) Internship • Karl Sandison & Larry Stapleton • ECO – Engineering Change Order • Learn the “lexographical structure of ECOs” so that they could be automatically read/parsed and interpreted, by a computer program. • Technologies • LISP, ADA, C, VAX PARSE, RDBMS • MIT Information Lens • https://dspace.mit.edu/bitstream/handle/1721.1/2277/SWP-3082- 21174847-CISR-192.pdf?sequence=1 • VILE-MMS - 4th Year Project 1991 • - Vax Information Lens Editor & Mail Management System • Mail Filtering Rules • - Novell Groupwise Mail - 1995 before we had these features in Waterford.
- 12. DJ & Radio – R&D Background (TSSG) • ABC PLAYOUT (1997) • Schedule music ads, automate a radio station • (RCS, Myriad, RadioMation, Genesys, mAirList) • Hash6 / Catch (2002) • Identify a song on the radio, add to your locker, buy and download • (Spotify,Shazam) • UMetaDJ (2003) • Open format for sharing data between professional DJ softwares • (RecordBuddy, RecordCloud, MIXO, iTunes) • MORP (2003) • MObile Retail Payments • (Revolut) • MUZU (2002) • online music video site • largest legal catalogue of online music videos. • FeedHenry (2002) • Global RSS feed curation • Later pivoted to SAAS Red Hat Mobile Services
- 13. DJ & Radio - Background • MetaData / Cue Points – MANUAL EXERCISE • Vinyl (80s) • Chewing gum Labels Painters Tape • Video tape (90s) • magnetic index markers • Minidisc (90s) • insert markers • CD (90s) • stored on separate SD memory cards • Laptop (00s) / Digital Files • Separate Database • within metadata of the file
- 14. DJ & Radio • CLUB DJ SOFTWARE • Traktor, Serato, RecordBox, VirtualDJ, MIXX, dJay Algorithm • 2020 Pioneer RecordBox 6 • subscription model • auto identifies song structure during analysis • (intro, verse, break, chorus, drop, etc.) • Supervised Gianluca Zuccarelli • Sun Life Computing Projects Innovation Award 2020-21 • "Neural Network based Song Structure Analysis". • i.e. creating and training your own model
- 16. DJ – ACCAPELLAS / STEMS - services 2015 Native Instruments TRAKTOR STEMs Open Format •File containing 4 parts •.stem.mp4 2020 LALAL.AI 2023 AuDImix
- 17. 2020 djay Pro AI 2021 VirtualDJ 2022 Serato FADR.com 2023 VirtualDJ (STEMS 2) Rekordbox DJ DJ – ACCAPELLAS / STEMS - RealTime
- 18. Music • Writing a song – ChatGBT • MelodyStudio • Better context / syllables • Chord Progression / melody • Apple Logic / GarageBand • Virtual Musicians • Virtual drummer • Move away from texboxes to sliders and emotions
- 19. Audio • Focusrite FAST AI plugins • Sound cards • SHURE MOTIV AI • Shure mv7 mic
- 20. Adobe VoCo • Adobe Max 2016 • Photoshop for Voice • Transcribe a video • By editing the text transcript, you edit the video • 2023 Adobe Premiere Pro now has this functionality • Surprise: • By adding new words, your could make the person say those words • This is now available in resemble.ai • Concerns over ethics, copyright, data privacy – voiceprint biometrics, human image syntheses
- 21. Resemble.ai - Al Voice Synthesis
- 22. Resemble.ai - Al Voice Synthesis
- 23. Text to Speech / Voice Cloning • Speechify $249 pa (best??) • Snoop Dog - please open a web page • Resemble.ai
- 24. Waterford Tech Meetup 2018 • Deep learning techniques • to better understand the brainwaves (EEG) of newborn babies • detecting seizures in infants. PhD candidate Alison O’Shea • TensorFlow • Creating your own machine learning models
- 25. Computer Code Generation - 1 • Computers talk in Binary Machine Language (01010101) • Chips Assembly Language (Minimal instruction set) • High Level Languages • Basic, Cobol, Pascal ,C • Python, Java, JavaScript, Node.js C++ • Interpetted v compiled • Libraries of code • can be reused • Vast Number • Versions! • NPM
- 26. Computer Code Generation - 2 • Code Completion • IntelliJ • Visual Code • CoPilot • CoPilot VoiceAssist • GitHub • Bought by Microsoft in 2018 for $7.5 billion • 100 million developers • 92% of programmers using AI • CEO Thomas Dohmke interview • Copilot will write 80% of code “sooner than later” • Keeps developers in the editor. • Net Promoter score +81% • 46% of code is now written by CoPilot • 55% fastser
- 27. Last Year
- 28. Nov 2022 • Mobile App Dev assignment • Slack Post appeared re writing a spec for • AI Generation came to the fore • Replied ok to use AI tools once acknowledged. However own words need to be own words. • FINAL Project: • Highlighted AI Detection (open source projects on GitHub) • STUDENTS BEWARE • Acknowledge • Cite • Policies • Code of Conduct (dis) honest • Plagiarism
- 29. Dec 2022 • Started reading around generative AI Tools • Subscribing to Facebook groups • Email Subscription • TLDR AI • Getting Informed for next semester • Key Considerations 1. If ChatGBT can generate the solution to your assignment… • Are you asking students to do the right assignment? • Are you teaching the right thing? 2. Embrace AI versus trying to prevent it’s use • (akin to pretending there is no internet and students don’t have mobile phones/data)
- 30. Jan 2003 • New Cohort of students starting Programming • Q: Can ChatGPT generate the programming language being taught (Processing)? • A: Web says NO. However by trying it out myself I discovered partial YES • Q: What do I need to change in Assigment 1 • A: No more than normal (change the theme and some constraints) • Why? • We don’t mark the code, we mark the reflection • The reflection is tied to the marking rubric, which in turn is tied to the code • WE ARE MAKING THE LEARNING NOT THE ARTIFACT
- 31. Feb 2023 • Following more education based AI Groups • Differences of opinion about citing • Personal communication. • Appendix for • Prompt • Response • Methods / Methodology • Evaluation of AI responses used
- 32. Mar 2023 • CoP with Hazell and Peter
- 33. April 2023 • Colleagues in other schools complaining about generated assignments • Detecting an AI generated Final Project Report • TurnItIn • Similarity • AI Detection • 98% Confidence Interval • 99% Confidence Interval for third level • Highlighting of generated text
- 34. Generated Projects - How we handled it • Ran all student reports manually through TurnItIn • Students above a combined threshold were contacted. • Result Message posted (next slide) • Follow up interviews • Traditional plagiarised project – Redo • Generated Report – Redo • Some generation • Update citations • Acknowledgements • Chapter on AI use Hi StudentX, Based on University policy, we must follow up with another call, in relation to your project. There are issues with generated content. Can we have a call tomorrow morning to discuss further? If you send me a DM in the morning, I will call you back ASAP after 9.30. Thanks, Colm
- 35. Hi @channel, Thank you for your presentations last week. We have completed the initial processing of the marks. We indicated that feedback would be given today. There have been unexpected delays in releasing that feedback as intended. However, we are releasing indicative grades imminently (rather than percentages). You will receive a follow up DM shortly.During the course of our examination of the projects, a number of issues arose in relation to referencing, citations, plagiarism, generated content, and a combination of both. In a number of cases, generated content was found in the reports, in the code, or in both. As a result, we have re-examined everyone’s work, using all the tools at our disposal and a number of students have already been contacted for follow-ups to address the issues found.If you have received a Slack DM, requesting a further call, we will need to discuss your project further before releasing your grade. If not, we don’t foresee any further additional examination or work, on your project. … We would like to point out that we were very happy with the standard of the projects this year overall, and indeed the variety. One major issue, for most students, was with using Harvard referencing and citations in final reports. Despite asking everyone on our calls last semester if they understood this, it was generally poorly done. For future reference see https://wit-ie.libguides.com/c.php?g=629615&p=4394252Text generated by AI tools (e.g. ChatGPT, Bing Chat, etc.) should be used as follows: •In-text citation: (OpenAI, 2023) •In references: OpenAI. (2023) ChatGPT-4, Response to prompt: “Outline an essay on XYZ”, Accessed: April 26, 2023. •Appendix: the full response included in the appendix. (The text generated should NOT be in your main core text.) We look forward to seeing you all at the next workshop on May 25th / 26th. Don’t forget we will be presenting the Red Hat Online Computing Award for Best Project and the DataWorks Online Computing Communitarian Award at the event. If not we’ll hopefully see you at graduation (whenever that is).Well done. For most it’s over. It’s been a pleasure. From all the team we wish you the very best in your future software careers. Don’t be strangers – you have an open invite to all our workshops, and we look forward to you coming back sharing your experiences with future cohorts.Regards, Colm
- 36. Observation – All Windows Computers in SETU
- 37. May 2023 • Generating images Computing Expo ‘23 • Project Catalogue • Large Screen • Panel Screens • Used • Dalle-E • MidJourney • inside DISCORD • Require ATHENTICATOR for 2fa
- 43. June • Revisiting NoleJ.io • Supply a static content • Document / video / audio • Creates dynamic activities • h5p interactive video with stops actions, • transcript • glossary • quizzes • Games • Fill in blanks • Drag words • Upload H5P/SCORM package to Moodle. • Editable • Runway for Video
- 44. Conclusions • We’ve been using AI generation for years (without knowing) • Exponential growth clearly visible in the last 8 months in particular • generated, text, video, audio, metadata • Data privacy, ethics, regulation, legislation • (last week in Europe) • Better Advice needed for students (in advance of CA/Exams) • Moving target - Policies will need updating every semester in the short term • No longer talking about AI NOT being allowed