SlideShare a Scribd company logo
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
David vonThenen
@davidvonthenen
Crack the AI Black Box
PracticalTechniques for Explainable AI
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
● Are you Human or an AI?
● I want 5 Kubernetes
● Virtual Machines are Real
● Cloudy, cloudy, cloudy…
● There is storage for that!
David
vonThenen
@davidvonthenen
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
3
Agenda
● What is Explainable AI?
● Understanding Data Inconsistencies
● Dataset Observability and Diagnostics
○ Demo: NLP
○ Demo: Vision
● Adversarial Attacks for Good… & Bad
● Let's Continue the Discussion!
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
What is Explainable AI?
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
5
Flawed Data
● AI/ML Only As Good As the Data
○ What If the Data is Flawed?
● Real-World Examples:
○ Recruiter AI + Male Skewed
○ Offensive AI Chatbot
○ Court Case Hallucinations
○ Home Purchasing Spree
○ Scan Sitting Up or Down
○ Many, Many, Many More
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
6
Explainable AI
Why Do We Care?
● Trust and Transparency
● Debugging + Improvement
● Compliance and Ethics
Key Goals:
● Interpretability
● Accountability
● Fairness + Bias Detection
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
Understanding
Data Inconsistencies
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
8
Data Inconsistencies Matter
● Impacts AI "Decision Making"
○ Annotation Errors
○ Data Bias
○ Distribution Drift
○ Adversarial Input
● Accidental,
Unintended
Consequences
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
9
Annotation Errors
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
10
Data Bias
Image Attribution
Princeton University Researcher - Tool helps clear biases from computer vision
Molly Sharlach on October 1, 2020
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
11
Data Imbalance
Image Attribution
Introduction to Balanced and Imbalanced Datasets in Machine Learning
Nikolaj Buhl on November 11, 2022
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
12
Distribution Shifts
Image Attribution
Dive Into Deep Learning
Nikolaj Buhl on November 11, 2022
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
13
Adversarial Samples
Image Attribution:
PyTorch Documentation - Adversarial Example Generation
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
Dataset Observability
And Diagnostics
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
15
What Tools Can I Use?
● Captum - https://github.com/pytorch/captum
● SHAP - https://github.com/shap/shap
● LIME
● ELI5
● AIX360
● Many More
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
16
Let's Take a Look at Captum
● Open Source PyTorch Library
○ Gradients, Saliency Maps, SHAP
○ Layer/Neuron Contributions
○ NLP, Vision
● Detects:
○ Biases
○ Inconsistency
○ Hidden Patterns
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
17
Captum: Case Study
● Study: Urinary Incontinence
● Captum Revealed Findings:
○ Validated Contributions
○ Discovered 3 Features
● Future Application:
○ Update Surgical Protocols
○ Improved Techniques
○ Post-Op Therapy
Case Study Paper
An artificial intelligence method for predicting postoperative urinary incontinence based on multiple anatomic
parameters of MRI
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
Demo: Captum + NLP Classifier
https://youtu.be/geZNwLzoaT4
https://youtu.be/m0VxUAGhKcY
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
Demo: Captum + Vision Classifier
https://youtu.be/5J2sGIU0RV4
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
Adversarial Attacks: For Good… and Bad
Building Better Models via Intentional Disruption
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
21
Turning Insights Into Action
● Why Explainable AI?
○ Question Rigid Assumptions
○ Finding Data Flaws
○ Expose Ethical Scenarios
○ Adversarial Testing
● Result
○ Why Exclude Data
○ Fix Problematic Data
○ Underrepresentation
○ Fairness
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
22
What Else…
● Intentional Adversarial Attacks
○ Besides Finding Holes…
○ Disrupting Classification
■ Vision
■ NLP
● Why?
○ Unauthorized Surveillance
○ Protect Privacy
○ Obfuscation
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
23
Adversarial Strategies
Ideas/Concepts in NLP to Disrupt
Be Creative!!
● Encoding/Formatting
● Homophones and Phonetics
● Code Switching
● Low-Resource Languages
○ Navajo - "Code Talkers"
● Adversarial Spelling
● Polysemy/Multiple Meanings
● Speaking in Metaphors
Video Credit: Darmok, under 8 minutes (Star Trek Abridged)
Source: Star Trek: The Next Generator, Episode 102 - Darmok
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
Creative Communication
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
Demo: Spoofing Recognition
https://youtu.be/b_T448UXaHw
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
Just In Case…
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
Resources
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
Resources
[CLICK HERE] for All Materials and Demos in this Session
DigitalOcean Bare Metal H200 Availability
https://www.digitalocean.com/blog/now-available-bare-metal-nvidia-hgx-h200-gpus
Continue the Conversation - DigitalOcean Discord
https://discord.com/invite/digitalocean
● Captum:
○ GitHub - https://github.com/pytorch/captum
○ Tutorials - https://captum.ai/tutorials/
● PyTorch:
○ GitHub - https://github.com/pytorch/pytorch
○ Tutorials - https://pytorch.org/tutorials/index.html
感谢您下载包图网平台上提供的PPT作品,为了您和包图网以及原创作者的利益,请勿复制、传播、销售,否则将承担法律责任!包图网将对作品进行维权,按照传播下载次数进行十倍的索取赔偿!
ibaotu.com
29
Thank You!
Senior AI/ML Engineer
@davidvonthenen
David vonThenen

More Related Content

PDF
Devoxx France 2025: Explaining the Unexplainable Python Tools for AI Transpar...
David vonThenen
 
PDF
DevBcn 2025: Confuse, Obfuscate, Disrupt: Using Adversarial Techniques for Be...
David vonThenen
 
PDF
WeAreDevelopers World Congress 2025: Confuse, Obfuscate, Disrupt: Using Adver...
David vonThenen
 
PDF
RenderATL 2025: The Future of UI/UX AI Generated Interfaces Tailored Just in ...
David vonThenen
 
PPTX
artificial intelligence and the commercial world
VipulVishvajeet
 
PDF
Devoxx UK 2025: The Rise of Agentic AI Harnessing Open Source for Dynamic Dec...
David vonThenen
 
PDF
ODSC East: Adaptive RAG Systems with Knowledge Graphs Building Reinforcement ...
David vonThenen
 
PDF
2025 All Things Open AI - Leveraging Knowledge Graphs for RAG - A Smarter App...
David vonThenen
 
Devoxx France 2025: Explaining the Unexplainable Python Tools for AI Transpar...
David vonThenen
 
DevBcn 2025: Confuse, Obfuscate, Disrupt: Using Adversarial Techniques for Be...
David vonThenen
 
WeAreDevelopers World Congress 2025: Confuse, Obfuscate, Disrupt: Using Adver...
David vonThenen
 
RenderATL 2025: The Future of UI/UX AI Generated Interfaces Tailored Just in ...
David vonThenen
 
artificial intelligence and the commercial world
VipulVishvajeet
 
Devoxx UK 2025: The Rise of Agentic AI Harnessing Open Source for Dynamic Dec...
David vonThenen
 
ODSC East: Adaptive RAG Systems with Knowledge Graphs Building Reinforcement ...
David vonThenen
 
2025 All Things Open AI - Leveraging Knowledge Graphs for RAG - A Smarter App...
David vonThenen
 

More from David vonThenen (20)

PDF
2025 SCaLE 22x - Training Multi-Modal ML Classification Models for Real Time ...
David vonThenen
 
PDF
2025 SCaLE 22x - Demystifying Building Natural Language Processing ML Models ...
David vonThenen
 
PDF
2025 DeveloperWeek - The Sound of Innovation: Why Voice Cloning Will Redefine...
David vonThenen
 
PDF
2025 Developer Week - Navigating the Edge-Cloud Bridge_ Building Resource Opt...
David vonThenen
 
PDF
2024 RTC Conference - Training Machine Learning Classification Models for Cre...
David vonThenen
 
PDF
2024 RTC CONF - Building Multiple Natural Language Processing Models to Work ...
David vonThenen
 
PDF
AI Dev Summit 2024 - Empower Your AI Journey_ Hands-on Machine Learning with ...
David vonThenen
 
PDF
SCaLE 21x - Voice-Activated AI Collaborators: A Hands-On Guide Using LLMs in ...
David vonThenen
 
PDF
RTC Conference 2023 - Edge Devices as Interactive Personal Assistants_ Unleas...
David vonThenen
 
PDF
RTC Conference 2023 - Enhancing Real-Time WebRTC Conversation Understanding U...
David vonThenen
 
PDF
Cloud Native Rejekts Europe 2022 - Learnings From Creating CI/CD Pipelines
David vonThenen
 
PDF
KubeCon EU 2020 - Provider vSphere All Things vSphere Working Group
David vonThenen
 
PDF
KubeCon Europe 2019 - VMware SIG - Intro to the CSI driver
David vonThenen
 
PDF
OSS Japan - Application Monitoring And Tracing In Kubernetes
David vonThenen
 
PDF
SCaLE 16x - Application Monitoring And Tracing In Kubernetes
David vonThenen
 
PPTX
How Container Schedulers and Software-based Storage will Change the Cloud
David vonThenen
 
PPTX
Robust Applications in Mesos using External Storage
David vonThenen
 
PPTX
Managing ScaleIO as Software on Mesos
David vonThenen
 
PPTX
SCaLE 15x - How Container Schedulers and Software-Defined Storage will Change...
David vonThenen
 
PPTX
ContainerCon EU 2016 - Software-Defined Storage and Container Schedulers
David vonThenen
 
2025 SCaLE 22x - Training Multi-Modal ML Classification Models for Real Time ...
David vonThenen
 
2025 SCaLE 22x - Demystifying Building Natural Language Processing ML Models ...
David vonThenen
 
2025 DeveloperWeek - The Sound of Innovation: Why Voice Cloning Will Redefine...
David vonThenen
 
2025 Developer Week - Navigating the Edge-Cloud Bridge_ Building Resource Opt...
David vonThenen
 
2024 RTC Conference - Training Machine Learning Classification Models for Cre...
David vonThenen
 
2024 RTC CONF - Building Multiple Natural Language Processing Models to Work ...
David vonThenen
 
AI Dev Summit 2024 - Empower Your AI Journey_ Hands-on Machine Learning with ...
David vonThenen
 
SCaLE 21x - Voice-Activated AI Collaborators: A Hands-On Guide Using LLMs in ...
David vonThenen
 
RTC Conference 2023 - Edge Devices as Interactive Personal Assistants_ Unleas...
David vonThenen
 
RTC Conference 2023 - Enhancing Real-Time WebRTC Conversation Understanding U...
David vonThenen
 
Cloud Native Rejekts Europe 2022 - Learnings From Creating CI/CD Pipelines
David vonThenen
 
KubeCon EU 2020 - Provider vSphere All Things vSphere Working Group
David vonThenen
 
KubeCon Europe 2019 - VMware SIG - Intro to the CSI driver
David vonThenen
 
OSS Japan - Application Monitoring And Tracing In Kubernetes
David vonThenen
 
SCaLE 16x - Application Monitoring And Tracing In Kubernetes
David vonThenen
 
How Container Schedulers and Software-based Storage will Change the Cloud
David vonThenen
 
Robust Applications in Mesos using External Storage
David vonThenen
 
Managing ScaleIO as Software on Mesos
David vonThenen
 
SCaLE 15x - How Container Schedulers and Software-Defined Storage will Change...
David vonThenen
 
ContainerCon EU 2016 - Software-Defined Storage and Container Schedulers
David vonThenen
 
Ad

2025 NVIDIA GTC: Crack the AI Black Box: Practical Techniques for Explainable AI