SlideShare a Scribd company logo
Squinting Vision Pipelines:
Detecting and Correcting Errors
in Vision Models at Runtime
Ken Wenger
Chief Technology Officer
Squint AI Inc
www.squintinc.com
Squint AI Inc
© 2025 Squint AI Inc. 2
Humans squint when we are not
sure.
AI CAN SQUINT TOO.
Squint AI Inc
© 2025 Squint AI Inc. 3
What problems are we solving?
Fundamental question
© 2025 Squint AI Inc. 4
Can we trust the predictions of AI models ?
Model expression
© 2025 Squint AI Inc. 5
DEFINITELY A
MOTORCYCLE!
Challenges we must address
© 2025 Squint AI Inc. 6
DEFINITELY A
MOTORCYCLE!
• Models often make
mistakes.
• It is difficult to assess an
accurate expectation of
performance in a production
setting.
• It is difficult to assess what
the models are learning.
Models often make mistakes
© 2025 Squint AI Inc. 7
[0.01, 0.95, … , n ]
Input
Challenge addressing performance expectation
© 2025 Squint AI Inc. 8
What can cause models to get it wrong?
Model
Dataset
Addressing dataset problems
© 2025 Squint AI Inc. 9
ENTROPY
The variance that each unit of information can
experience (before information is completely
lost).
COMPLEXITY
A measure of how many categories and data
samples are required to accurately describe the
operational domain.
AMBIGUITY
How much overlap exists between the
datapoints in the different categories.
Why is it difficult to get the
dataset right?
Dataset
Consequence of a poor dataset on performance expectation
© 2025 Squint AI Inc. 10
Bounding trust
© 2025 Squint AI Inc. 11
Can we detect this
for each prediction?
Explainable AI / Slice discovery
© 2025 Squint AI Inc. 12
Explainable AI (XAI) is not
only useful during model
development.
Explainable AI can be
used to build runtime
watchdogs to actively
guarantee the integrity of
the AI application.
A novel application of XAI in squinting models:
A position paper - ScienceDirect
Visualization and Model Explanations in
Convolutional Neural Networks | by Kumar
Devesh | Medium
Bounding confidence
© 2025 Squint AI Inc. 13
Adding contextual information
© 2025 Squint AI Inc. 14
Different regions within a cluster
contain different semantic
information
Analyzing the semantic information within
each cluster can provide contextual
information. E.g., this isn’t just “grade 1
cancer” this is “grade 1 cancer” with the
following cell morphology…
Robust, context-aware pipelines can be built
this way.
Bounding a robust pipeline
© 2025 Squint AI Inc. 15
Input Model
Watchdog
(Squint)
Trust
Prediction?
Squinting
Model
Signal application
retry?
Prediction + Contextual
Information
Refined
Prediction
Prediction
Prediction +
Contextual
Information
Yes
Yes
No
State
No
Summary
© 2025 Squint AI Inc. 16
• Models often make mistakes.
• Geofence the ambiguous region
• It is difficult to assess an accurate
expectation of performance in a
production setting.
• Bound performance to
trusted regions
• It is difficult to assess what the models
are learning.
• Use XAI, input saliency, semantic
clustering analysis, etc.
Results ─ Squint pipeline with human in the loop
© 2025 Squint AI Inc. 17
Breast Cancer Experiment:
• Dataset: 126,056 images (62,901 pos, 63,155 neg)
• ResNet-based classifier with state of the art 89.37%
accuracy
Baseline model Squint watchdog +
Human in the loop
Squint watchdog +
Squinting model
(Vision Transformer)
10.63% error rate 2.02% error rate 1.79% error rate
89.38% accuracy 97.98% accuracy 98.21% accuracy
Squint AI Inc
© 2025 Squint AI Inc. 18
How do we build this framework today?
Booth: 619 (Come see us!)
© 2025 Squint AI Inc. 19
© 2025 Squint AI Inc. 20
Squint AI’s explainable AI paper:
A novel application of XAI in squinting models
Thank you!
www.squintinc.com
© 2025 Squint AI Inc. 21

More Related Content

Similar to “Squinting Vision Pipelines: Detecting and Correcting Errors in Vision Models at Runtime,” a Presentation from Squint AI (20)

PDF
Migrating_to_Cloud-Native_App_Architectures_Pivotal (2)
Dean Bruckman
 
PDF
Migrating_to_Cloud-Native_App_Architectures_Pivotal (2)
Tim Kirby
 
PDF
Migrating_to_Cloud-Native_App_Architectures_Pivotal
Estevan McCalley
 
PDF
Will You Join Me
Zigmund Rubel, AIA
 
PDF
The Microservices Manifesto: How to Get More Out of the Development Lifecycle
DevOps.com
 
PDF
Guide To Continuous Deployment Containerization With Docker Complete Deck
SlideTeam
 
PPTX
Getting Your Supply Chain Back on Track with AI
Sri Ambati
 
PPTX
Driving Continuous Delivery Transformation in a Data-Driven Way
Vladyslav Ukis
 
PDF
AIOps Is How We Will Survive DevOps
DEVOPS LIVE Meetup
 
PPTX
Model-Based Testing for Cypress
Curiosity Software Ireland
 
PDF
AI For PMs - Leading a Machine Learning (ML) Team
Scott W. Ambler
 
PDF
YuryMakedonov_STP_2006_TestingCycles_05slides
Yury M
 
PPTX
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
ThousandEyes
 
PDF
Final observability starts_with_data
Dave McAllister
 
PDF
Machine Learning for the Automotive World
Jeff Rehm
 
PDF
Agile Resiliency: How CMMI can make Agile thrive and survive
Jeff Dalton
 
PDF
Realise True Business Value .pdf
ThousandEyes
 
PDF
Beyond the hype: The reality of AI security.pdf
Jose Manuel Ortega Candel
 
PPTX
Explainable AI in Industry (FAT* 2020 Tutorial)
Krishnaram Kenthapadi
 
PPTX
AMER Introduction to ThousandEyes Webinar
ThousandEyes
 
Migrating_to_Cloud-Native_App_Architectures_Pivotal (2)
Dean Bruckman
 
Migrating_to_Cloud-Native_App_Architectures_Pivotal (2)
Tim Kirby
 
Migrating_to_Cloud-Native_App_Architectures_Pivotal
Estevan McCalley
 
Will You Join Me
Zigmund Rubel, AIA
 
The Microservices Manifesto: How to Get More Out of the Development Lifecycle
DevOps.com
 
Guide To Continuous Deployment Containerization With Docker Complete Deck
SlideTeam
 
Getting Your Supply Chain Back on Track with AI
Sri Ambati
 
Driving Continuous Delivery Transformation in a Data-Driven Way
Vladyslav Ukis
 
AIOps Is How We Will Survive DevOps
DEVOPS LIVE Meetup
 
Model-Based Testing for Cypress
Curiosity Software Ireland
 
AI For PMs - Leading a Machine Learning (ML) Team
Scott W. Ambler
 
YuryMakedonov_STP_2006_TestingCycles_05slides
Yury M
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
ThousandEyes
 
Final observability starts_with_data
Dave McAllister
 
Machine Learning for the Automotive World
Jeff Rehm
 
Agile Resiliency: How CMMI can make Agile thrive and survive
Jeff Dalton
 
Realise True Business Value .pdf
ThousandEyes
 
Beyond the hype: The reality of AI security.pdf
Jose Manuel Ortega Candel
 
Explainable AI in Industry (FAT* 2020 Tutorial)
Krishnaram Kenthapadi
 
AMER Introduction to ThousandEyes Webinar
ThousandEyes
 

More from Edge AI and Vision Alliance (20)

PDF
“NPU IP Hardware Shaped Through Software and Use-case Analysis,” a Presentati...
Edge AI and Vision Alliance
 
PDF
“Voice Interfaces on a Budget: Building Real-time Speech Recognition on Low-c...
Edge AI and Vision Alliance
 
PDF
“Computer Vision at Sea: Automated Fish Tracking for Sustainable Fishing,” a ...
Edge AI and Vision Alliance
 
PDF
“ONNX and Python to C++: State-of-the-art Graph Compilation,” a Presentation ...
Edge AI and Vision Alliance
 
PDF
“Beyond the Demo: Turning Computer Vision Prototypes into Scalable, Cost-effe...
Edge AI and Vision Alliance
 
PDF
“Running Accelerated CNNs on Low-power Microcontrollers Using Arm Ethos-U55, ...
Edge AI and Vision Alliance
 
PDF
“Scaling i.MX Applications Processors’ Native Edge AI with Discrete AI Accele...
Edge AI and Vision Alliance
 
PDF
“A Re-imagination of Embedded Vision System Design,” a Presentation from Imag...
Edge AI and Vision Alliance
 
PDF
“MPU+: A Transformative Solution for Next-Gen AI at the Edge,” a Presentation...
Edge AI and Vision Alliance
 
PDF
“Evolving Inference Processor Software Stacks to Support LLMs,” a Presentatio...
Edge AI and Vision Alliance
 
PDF
“Efficiently Registering Depth and RGB Images,” a Presentation from eInfochips
Edge AI and Vision Alliance
 
PDF
“How to Right-size and Future-proof a Container-first Edge AI Infrastructure,...
Edge AI and Vision Alliance
 
PDF
“Image Tokenization for Distributed Neural Cascades,” a Presentation from Goo...
Edge AI and Vision Alliance
 
PDF
“Key Requirements to Successfully Implement Generative AI in Edge Devices—Opt...
Edge AI and Vision Alliance
 
PDF
“Bridging the Gap: Streamlining the Process of Deploying AI onto Processors,”...
Edge AI and Vision Alliance
 
PDF
“From Enterprise to Makers: Driving Vision AI Innovation at the Extreme Edge,...
Edge AI and Vision Alliance
 
PDF
“Addressing Evolving AI Model Challenges Through Memory and Storage,” a Prese...
Edge AI and Vision Alliance
 
PDF
“Why It’s Critical to Have an Integrated Development Methodology for Edge AI,...
Edge AI and Vision Alliance
 
PDF
“Solving Tomorrow’s AI Problems Today with Cadence’s Newest Processor,” a Pre...
Edge AI and Vision Alliance
 
PDF
“State-space Models vs. Transformers for Ultra-low-power Edge AI,” a Presenta...
Edge AI and Vision Alliance
 
“NPU IP Hardware Shaped Through Software and Use-case Analysis,” a Presentati...
Edge AI and Vision Alliance
 
“Voice Interfaces on a Budget: Building Real-time Speech Recognition on Low-c...
Edge AI and Vision Alliance
 
“Computer Vision at Sea: Automated Fish Tracking for Sustainable Fishing,” a ...
Edge AI and Vision Alliance
 
“ONNX and Python to C++: State-of-the-art Graph Compilation,” a Presentation ...
Edge AI and Vision Alliance
 
“Beyond the Demo: Turning Computer Vision Prototypes into Scalable, Cost-effe...
Edge AI and Vision Alliance
 
“Running Accelerated CNNs on Low-power Microcontrollers Using Arm Ethos-U55, ...
Edge AI and Vision Alliance
 
“Scaling i.MX Applications Processors’ Native Edge AI with Discrete AI Accele...
Edge AI and Vision Alliance
 
“A Re-imagination of Embedded Vision System Design,” a Presentation from Imag...
Edge AI and Vision Alliance
 
“MPU+: A Transformative Solution for Next-Gen AI at the Edge,” a Presentation...
Edge AI and Vision Alliance
 
“Evolving Inference Processor Software Stacks to Support LLMs,” a Presentatio...
Edge AI and Vision Alliance
 
“Efficiently Registering Depth and RGB Images,” a Presentation from eInfochips
Edge AI and Vision Alliance
 
“How to Right-size and Future-proof a Container-first Edge AI Infrastructure,...
Edge AI and Vision Alliance
 
“Image Tokenization for Distributed Neural Cascades,” a Presentation from Goo...
Edge AI and Vision Alliance
 
“Key Requirements to Successfully Implement Generative AI in Edge Devices—Opt...
Edge AI and Vision Alliance
 
“Bridging the Gap: Streamlining the Process of Deploying AI onto Processors,”...
Edge AI and Vision Alliance
 
“From Enterprise to Makers: Driving Vision AI Innovation at the Extreme Edge,...
Edge AI and Vision Alliance
 
“Addressing Evolving AI Model Challenges Through Memory and Storage,” a Prese...
Edge AI and Vision Alliance
 
“Why It’s Critical to Have an Integrated Development Methodology for Edge AI,...
Edge AI and Vision Alliance
 
“Solving Tomorrow’s AI Problems Today with Cadence’s Newest Processor,” a Pre...
Edge AI and Vision Alliance
 
“State-space Models vs. Transformers for Ultra-low-power Edge AI,” a Presenta...
Edge AI and Vision Alliance
 
Ad

Recently uploaded (20)

PPTX
The Project Compass - GDG on Campus MSIT
dscmsitkol
 
PDF
Bitkom eIDAS Summit | European Business Wallet: Use Cases, Macroeconomics, an...
Carsten Stoecker
 
PDF
Next Generation AI: Anticipatory Intelligence, Forecasting Inflection Points ...
dleka294658677
 
PDF
Transforming Utility Networks: Large-scale Data Migrations with FME
Safe Software
 
PPTX
CapCut Pro PC Crack Latest Version Free Free
josanj305
 
PDF
Survival Models: Proper Scoring Rule and Stochastic Optimization with Competi...
Paris Women in Machine Learning and Data Science
 
PPTX
MuleSoft MCP Support (Model Context Protocol) and Use Case Demo
shyamraj55
 
PPTX
Manual Testing for Accessibility Enhancement
Julia Undeutsch
 
PDF
Evolution: How True AI is Redefining Safety in Industry 4.0
vikaassingh4433
 
PPTX
Securing Model Context Protocol with Keycloak: AuthN/AuthZ for MCP Servers
Hitachi, Ltd. OSS Solution Center.
 
PDF
Modern Decentralized Application Architectures.pdf
Kalema Edgar
 
PPTX
Agentforce World Tour Toronto '25 - MCP with MuleSoft
Alexandra N. Martinez
 
PDF
What’s my job again? Slides from Mark Simos talk at 2025 Tampa BSides
Mark Simos
 
PPTX
New ThousandEyes Product Innovations: Cisco Live June 2025
ThousandEyes
 
PDF
Software Development Company Keene Systems, Inc (1).pdf
Custom Software Development Company | Keene Systems, Inc.
 
PPTX
Mastering ODC + Okta Configuration - Chennai OSUG
HathiMaryA
 
PDF
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
PPTX
Talbott's brief History of Computers for CollabDays Hamburg 2025
Talbott Crowell
 
DOCX
Cryptography Quiz: test your knowledge of this important security concept.
Rajni Bhardwaj Grover
 
PPTX
Role_of_Artificial_Intelligence_in_Livestock_Extension_Services.pptx
DrRajdeepMadavi
 
The Project Compass - GDG on Campus MSIT
dscmsitkol
 
Bitkom eIDAS Summit | European Business Wallet: Use Cases, Macroeconomics, an...
Carsten Stoecker
 
Next Generation AI: Anticipatory Intelligence, Forecasting Inflection Points ...
dleka294658677
 
Transforming Utility Networks: Large-scale Data Migrations with FME
Safe Software
 
CapCut Pro PC Crack Latest Version Free Free
josanj305
 
Survival Models: Proper Scoring Rule and Stochastic Optimization with Competi...
Paris Women in Machine Learning and Data Science
 
MuleSoft MCP Support (Model Context Protocol) and Use Case Demo
shyamraj55
 
Manual Testing for Accessibility Enhancement
Julia Undeutsch
 
Evolution: How True AI is Redefining Safety in Industry 4.0
vikaassingh4433
 
Securing Model Context Protocol with Keycloak: AuthN/AuthZ for MCP Servers
Hitachi, Ltd. OSS Solution Center.
 
Modern Decentralized Application Architectures.pdf
Kalema Edgar
 
Agentforce World Tour Toronto '25 - MCP with MuleSoft
Alexandra N. Martinez
 
What’s my job again? Slides from Mark Simos talk at 2025 Tampa BSides
Mark Simos
 
New ThousandEyes Product Innovations: Cisco Live June 2025
ThousandEyes
 
Software Development Company Keene Systems, Inc (1).pdf
Custom Software Development Company | Keene Systems, Inc.
 
Mastering ODC + Okta Configuration - Chennai OSUG
HathiMaryA
 
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
Talbott's brief History of Computers for CollabDays Hamburg 2025
Talbott Crowell
 
Cryptography Quiz: test your knowledge of this important security concept.
Rajni Bhardwaj Grover
 
Role_of_Artificial_Intelligence_in_Livestock_Extension_Services.pptx
DrRajdeepMadavi
 
Ad

“Squinting Vision Pipelines: Detecting and Correcting Errors in Vision Models at Runtime,” a Presentation from Squint AI

  • 1. Squinting Vision Pipelines: Detecting and Correcting Errors in Vision Models at Runtime Ken Wenger Chief Technology Officer Squint AI Inc www.squintinc.com
  • 2. Squint AI Inc © 2025 Squint AI Inc. 2 Humans squint when we are not sure. AI CAN SQUINT TOO.
  • 3. Squint AI Inc © 2025 Squint AI Inc. 3 What problems are we solving?
  • 4. Fundamental question © 2025 Squint AI Inc. 4 Can we trust the predictions of AI models ?
  • 5. Model expression © 2025 Squint AI Inc. 5 DEFINITELY A MOTORCYCLE!
  • 6. Challenges we must address © 2025 Squint AI Inc. 6 DEFINITELY A MOTORCYCLE! • Models often make mistakes. • It is difficult to assess an accurate expectation of performance in a production setting. • It is difficult to assess what the models are learning.
  • 7. Models often make mistakes © 2025 Squint AI Inc. 7 [0.01, 0.95, … , n ] Input
  • 8. Challenge addressing performance expectation © 2025 Squint AI Inc. 8 What can cause models to get it wrong? Model Dataset
  • 9. Addressing dataset problems © 2025 Squint AI Inc. 9 ENTROPY The variance that each unit of information can experience (before information is completely lost). COMPLEXITY A measure of how many categories and data samples are required to accurately describe the operational domain. AMBIGUITY How much overlap exists between the datapoints in the different categories. Why is it difficult to get the dataset right? Dataset
  • 10. Consequence of a poor dataset on performance expectation © 2025 Squint AI Inc. 10
  • 11. Bounding trust © 2025 Squint AI Inc. 11 Can we detect this for each prediction?
  • 12. Explainable AI / Slice discovery © 2025 Squint AI Inc. 12 Explainable AI (XAI) is not only useful during model development. Explainable AI can be used to build runtime watchdogs to actively guarantee the integrity of the AI application. A novel application of XAI in squinting models: A position paper - ScienceDirect Visualization and Model Explanations in Convolutional Neural Networks | by Kumar Devesh | Medium
  • 13. Bounding confidence © 2025 Squint AI Inc. 13
  • 14. Adding contextual information © 2025 Squint AI Inc. 14 Different regions within a cluster contain different semantic information Analyzing the semantic information within each cluster can provide contextual information. E.g., this isn’t just “grade 1 cancer” this is “grade 1 cancer” with the following cell morphology… Robust, context-aware pipelines can be built this way.
  • 15. Bounding a robust pipeline © 2025 Squint AI Inc. 15 Input Model Watchdog (Squint) Trust Prediction? Squinting Model Signal application retry? Prediction + Contextual Information Refined Prediction Prediction Prediction + Contextual Information Yes Yes No State No
  • 16. Summary © 2025 Squint AI Inc. 16 • Models often make mistakes. • Geofence the ambiguous region • It is difficult to assess an accurate expectation of performance in a production setting. • Bound performance to trusted regions • It is difficult to assess what the models are learning. • Use XAI, input saliency, semantic clustering analysis, etc.
  • 17. Results ─ Squint pipeline with human in the loop © 2025 Squint AI Inc. 17 Breast Cancer Experiment: • Dataset: 126,056 images (62,901 pos, 63,155 neg) • ResNet-based classifier with state of the art 89.37% accuracy Baseline model Squint watchdog + Human in the loop Squint watchdog + Squinting model (Vision Transformer) 10.63% error rate 2.02% error rate 1.79% error rate 89.38% accuracy 97.98% accuracy 98.21% accuracy
  • 18. Squint AI Inc © 2025 Squint AI Inc. 18 How do we build this framework today?
  • 19. Booth: 619 (Come see us!) © 2025 Squint AI Inc. 19
  • 20. © 2025 Squint AI Inc. 20 Squint AI’s explainable AI paper: A novel application of XAI in squinting models