CREATIVEAI-ART,MUSIC,JOKE
USINGMODERNMLTECHNIQUES
MLOPS MEETUP - OCT 19 2022
SUYASH JOSHI (SUYASH@SUYASHJOSHI.COM)
@SUYASHCJOSHI
@MLOPSCOMMUNITY
#CREATIVEAI
- Creative Coder & Artist (Magician) currently
pursuing masters degree at Goldsmiths,
University of London and available for
consulting around AR/Mobile/Creative AI
- 10+ years of work experience in (Silicon Valley)
SF Bay Area as a software engineer
- BS in Computer Science from The Univ. of
Michigan
@suyashcjoshi
suyash@suyashjoshi.com
WHOAMI
Ref: https://www.reddit.com/r/dalle2/comments/wir4ao/comparison_of_dalle_midjourney_stable_diffusion/
IMAGE GENERATION MODELS
PROMPT
STATE OF AI ART IN 2022
Popular Generative Networks - 2022
PREVIOUS WORK …
AARON
Oldest AI Art system built using GOFAI in 1960’s
by Harold Cohen
Steven Thaler and/or Creativity Machine
Generative Art created by Zach Liberman
Ref: https://zachlieberman.medium.com/daily-sketches-2016-28586d8f008e
AI ART CONTROVERSIES
Edmond de Belamy
Christie’s sold its
fi
rst piece of auctioned AI art
for $432,500 in 2018. Original open source
authors got nothing :(
Steven Thaler and/or Creativity Machine
- In 2022, USA Copyright Office refused to
register the piece on the basis that it lacked “the
human authorship necessary to support a
copyright claim”.
- Getty Image banned AI generated Imagery
from their website to protect against Copyright
claims
In 2022, AI Art won the Colorado State Fair Art
Competition!
CONTROVERSIAL AI ART
- Prompt "A SEXY ROBOT WOMAN" USING
STABILITY AI'S DREAMSTUDIO
THE RESULT OF A PROMPT FOR "A SEXY ROBOT WOMAN" USING STABILITY AI'S DREAMSTUDIO
- Deep Fake Generated ‘Porn’ of real people -
non consensual etc
NFT Art inundated with AI generated Art work
FAKEORREAL?
VIDEO GENERATION MODELS
Ref: https://arxiv.org/pdf/2209.14792.pdf
Ref: https://makeavideo.studio
DEMOS
StyleGan3 - Collab
Stability AI - Tool
Stable Diffusion - GitHub
AIGENERATEDMUSIC
1stAIGeneratedSong“Daddy’sCar”bySonyCSLMusicTeamin2016
ALGORITHMICCOMPOSITION
https://coconet.glitch.me/
Google Magenta - Coconut
STYLETRANSFERBUTFORMUSIC
Ref: https://sites.research.google/tonetransfer
Ref: https://magenta.tensor
f
low.org/ddsp
1. MUSIC INFORMATION RETRIEVAL
OTHERCREATIVEAIPOSSIBILITIES
2. TEXT + MUSIC : DEAR DIARY , HTTPS://SLIDESLIVE.COM/38941538/MUSICAL-DIARY-AI-APPLICATION-FOR-
MUSIC-MAKING-AND-JOURNALING
3. JOKE GENERATION (PUNS, MEMES)
4. NARRATIVE / NON FICTION STORY GENERATION
5. POETRY
ETHICAL & SOCIETAL CHALLENGES
1. Ownership : Who is the real author ?
2. Credit/Permission : Whose data were the ML Model(s) train on?
3. Accessibility : Is the technology limited to large enterprises or only certain users ?
4. JobDisplacement : Concept Artist, Illustrators, Animators, Musicians, Writers
@SUYASHCJOSHI - SUYASH@SUYASHJOSHI.COM
MIT’S COURSE ON DEEP CREATIVITY: HTTPS://ALI-DESIGN.GITHUB.IO/DEEPCREATIVITY/
RESOURCES
HOW TO WRITE A GOOD PROMPT : HTTPS://DECENTRALIZEDCREATOR.COM/WRITE-GOOD-PROMPTS-FOR-AI-ART-GENERATORS/
MUSIC AI GENERATION APPS: HTTPS://WWW.AUDIOCIPHER.COM/POST/AI-MUSIC-APP
ML ARTS CURATION (COURSE, ART WORK ETC) : HTTPS://ML4A.NET
TEXT TO SPEECH: HTTPS://GITHUB.COM/ML4A/ML4A/BLOB/MASTER/EXAMPLES/MODELS/TACOTRON2.IPYNB
HTTPS://AI.GOOGLEBLOG.COM/2017/12/TACOTRON-2-GENERATING-HUMAN-LIKE-SPEECH.HTML
CREATIVE AI DATABASE: https://creative-ai.org
RUNWAY ML OPEN SOURCE PROJECTS : HTTPS://RUNWAYML.COM/
QUESTIONS?
SUYASH JOSHI (SUYASH@SUYASHJOSHI.COM)
@SUYASHCJOSHI
@MLOPSCOMMUNITY
#CREATIVEAI

Creative AI Talk at MLOps Meetup