SlideShare a Scribd company logo
5
Most read
6
Most read
12
Most read
GDSC, University of Bologna, November 15 2021
A short intro to Physics-
informed Machine Learning
Andrea Panizza
Introduction
The case for Physics-Informed
Machine Learning
Physics, PDEs and IBVP
Flow around a landing gear
(NASA Ames)
Simulations of micro-fluidics at
cell resolution (ETH Zurich)
Flow field in a simulated wind-farm
(JHU)
pics
from
https://events.seas.upenn.edu/event/meam-
seminar-bridging-physical-models-and-observational-
data-with-physics-informed-deep-learning/
Numerical solution of an IBVP
1. Define geometry 2. Build mesh 3. Run simulation 4. Examine results
A lot of work for each simulation!
Limitations of traditional approaches
● PDE, IC & BC must all be known
● Parametric PDE ➡︎ N forward problems ➡︎ expensive
● Solve inverse problems ➡︎ expensive
● Discover missing physics ➡︎ expensive
● Data assimilation ➡︎ expensive
● Assumptions introduce uncertainty!
Can we do better by using data? Yes, but...
Machine Learning
Great at data assimilation…. ...and high-dimensional optimization...
...but! Data-hungry
And each simulation is expensive
Limitations of Machine Learning
● Data generation is expensive
● Solutions don’t necessarily respect symmetries/conservation laws
● Physicists look for “universal” laws, but Deep Learning struggles
with Out-Of-Distribution generalization
Enter Physics-Informed Machine Learning
How to embed physics in ML
Three main approaches
https://www.nature.com/articles/s42254-021-00314-5
Observational bias
https://arxiv.org/abs/2010.0889
5
Inductive bias
https://arxiv.org/abs/2104.13478 https://arxiv.org/abs/2010.03409
Learning bias (PINNs)
https://arxiv.org/abs/2105.0950
6
https://arxiv.org/abs/2012.07938
Complex geometries
Flow around a heat sink
Flow inside an aneurysm
Different physical laws
Acoustics...
Maxwell equations...
Issues with PINNs (1/2)
Convergence pathologies...
exact solution PINN solution
exact solution PINN solution
exact solution PINN solution
https://arxiv.org/abs/2012.10047
https://arxiv.org/abs/2109.01050
Issues with PINNs (2/2)
...which can be fixed! Beware of vanilla PINNS
exact solution PINN solution exact solution PINN solution
exact solution PINN solution
https://arxiv.org/abs/2012.10047
https://arxiv.org/abs/2109.01050
Conclusions
Key takeaways
● Embed Physics into ML
● Many different approaches
● Some great results…
● ...but many open problems!
What we didn’t cover
● Differentiable physics
● Learning Symbolic Physics with Graph Networks
● Hybrid approaches
Thanks for listening!
https://www.linkedin.com/in/andrea-panizza-
7114025/
https://github.com/AndreaPi
https://twitter.com/unsorsodicorda
Andrea Panizza
Senior AI Specialist
*special thanks to Simone Scardapane for the slides layout

More Related Content

What's hot (20)

PDF
Physics-Informed Machine Learning Methods for Data Analytics and Model Diagno...
Velimir (monty) Vesselinov
 
PPTX
Introduction to Graph neural networks @ Vienna Deep Learning meetup
Liad Magen
 
PPTX
Notes on attention mechanism
Khang Pham
 
PDF
Deep learning and Healthcare
Thomas da Silva Paula
 
PDF
ViT (Vision Transformer) Review [CDM]
Dongmin Choi
 
PDF
Overcoming catastrophic forgetting in neural network
Katy Lee
 
PDF
Transformer in Computer Vision
Dongmin Choi
 
PPTX
Transformers AI PPT.pptx
RahulKumar854607
 
PPTX
Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...
Preferred Networks
 
PDF
Independent Component Analysis
Tatsuya Yokota
 
PPTX
Graph Neural Network - Introduction
Jungwon Kim
 
PDF
Deep learning with Keras
QuantUniversity
 
PDF
Deep learning for medical imaging
geetachauhan
 
PPTX
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Simplilearn
 
PDF
Graph neural networks overview
Rodion Kiryukhin
 
PPTX
Deep learning with tensorflow
Charmi Chokshi
 
PPTX
Deep learning
Ratnakar Pandey
 
PPTX
What is Deep Learning?
NVIDIA
 
PPTX
Introduction to Transformer Model
Nuwan Sriyantha Bandara
 
PDF
Deep learning - A Visual Introduction
Lukas Masuch
 
Physics-Informed Machine Learning Methods for Data Analytics and Model Diagno...
Velimir (monty) Vesselinov
 
Introduction to Graph neural networks @ Vienna Deep Learning meetup
Liad Magen
 
Notes on attention mechanism
Khang Pham
 
Deep learning and Healthcare
Thomas da Silva Paula
 
ViT (Vision Transformer) Review [CDM]
Dongmin Choi
 
Overcoming catastrophic forgetting in neural network
Katy Lee
 
Transformer in Computer Vision
Dongmin Choi
 
Transformers AI PPT.pptx
RahulKumar854607
 
Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...
Preferred Networks
 
Independent Component Analysis
Tatsuya Yokota
 
Graph Neural Network - Introduction
Jungwon Kim
 
Deep learning with Keras
QuantUniversity
 
Deep learning for medical imaging
geetachauhan
 
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Simplilearn
 
Graph neural networks overview
Rodion Kiryukhin
 
Deep learning with tensorflow
Charmi Chokshi
 
Deep learning
Ratnakar Pandey
 
What is Deep Learning?
NVIDIA
 
Introduction to Transformer Model
Nuwan Sriyantha Bandara
 
Deep learning - A Visual Introduction
Lukas Masuch
 

Similar to Physics-Informed Machine Learning (20)

PDF
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
Chris Rackauckas
 
PDF
SSK_Artificial Neural Networks Basic to Models.pdf
SasiKala592103
 
PDF
Esa act talk
Advanced-Concepts-Team
 
PPTX
Intro to Soft Computing with a focus on AI
AuthorChikwenje
 
PPTX
The Advancement and Challenges in Computational Physics - Phdassistance
PhD Assistance
 
PDF
Reservoir computing fast deep learning for sequences
Claudio Gallicchio
 
PDF
IEEE CIS Webinar Sustainable futures.pdf
Claudio Gallicchio
 
PPT
Support Vector Machines Support Vector Machines
nikitabhagat28
 
PPTX
Bayesian Autoencoders (BAE) & Honest Thoughts on research
Bang Xiang Yong
 
PDF
Deep Learning Hardware: Past, Present, & Future
Rouyun Pan
 
PDF
Evo star2012 Robot Base Disturbance Optimization with Compact Differential Ev...
Fabio Caraffini
 
PDF
alexVAE_New.pdf
sourabhgothe1
 
PDF
Automatic Differentiation and SciML in Reality: What can go wrong, and what t...
Chris Rackauckas
 
PDF
0-introduction.pdf
ArafathJazeeb1
 
PDF
Xin Yao: "What can evolutionary computation do for you?"
ieee_cis_cyprus
 
DOCX
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Independent component ensemble of ...
IEEEBEBTECHSTUDENTPROJECTS
 
PDF
Deep Learning through Examples
Sri Ambati
 
PDF
Information processing with artificial spiking neural networks
Advanced-Concepts-Team
 
PDF
Reproducible research in molecular biophysics and structural biology
khinsen
 
PDF
Slides barcelona risk data
Arthur Charpentier
 
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
Chris Rackauckas
 
SSK_Artificial Neural Networks Basic to Models.pdf
SasiKala592103
 
Intro to Soft Computing with a focus on AI
AuthorChikwenje
 
The Advancement and Challenges in Computational Physics - Phdassistance
PhD Assistance
 
Reservoir computing fast deep learning for sequences
Claudio Gallicchio
 
IEEE CIS Webinar Sustainable futures.pdf
Claudio Gallicchio
 
Support Vector Machines Support Vector Machines
nikitabhagat28
 
Bayesian Autoencoders (BAE) & Honest Thoughts on research
Bang Xiang Yong
 
Deep Learning Hardware: Past, Present, & Future
Rouyun Pan
 
Evo star2012 Robot Base Disturbance Optimization with Compact Differential Ev...
Fabio Caraffini
 
alexVAE_New.pdf
sourabhgothe1
 
Automatic Differentiation and SciML in Reality: What can go wrong, and what t...
Chris Rackauckas
 
0-introduction.pdf
ArafathJazeeb1
 
Xin Yao: "What can evolutionary computation do for you?"
ieee_cis_cyprus
 
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Independent component ensemble of ...
IEEEBEBTECHSTUDENTPROJECTS
 
Deep Learning through Examples
Sri Ambati
 
Information processing with artificial spiking neural networks
Advanced-Concepts-Team
 
Reproducible research in molecular biophysics and structural biology
khinsen
 
Slides barcelona risk data
Arthur Charpentier
 
Ad

Recently uploaded (20)

PDF
CIFDAQ Token Spotlight for 9th July 2025
CIFDAQ
 
PDF
Fl Studio 24.2.2 Build 4597 Crack for Windows Free Download 2025
faizk77g
 
PDF
Human-centred design in online workplace learning and relationship to engagem...
Tracy Tang
 
PDF
July Patch Tuesday
Ivanti
 
PDF
LLMs.txt: Easily Control How AI Crawls Your Site
Keploy
 
PDF
Jak MŚP w Europie Środkowo-Wschodniej odnajdują się w świecie AI
dominikamizerska1
 
PDF
Why Orbit Edge Tech is a Top Next JS Development Company in 2025
mahendraalaska08
 
PDF
SFWelly Summer 25 Release Highlights July 2025
Anna Loughnan Colquhoun
 
PDF
Using FME to Develop Self-Service CAD Applications for a Major UK Police Force
Safe Software
 
PDF
Empower Inclusion Through Accessible Java Applications
Ana-Maria Mihalceanu
 
PPTX
UiPath Academic Alliance Educator Panels: Session 2 - Business Analyst Content
DianaGray10
 
PDF
Presentation - Vibe Coding The Future of Tech
yanuarsinggih1
 
PDF
TrustArc Webinar - Data Privacy Trends 2025: Mid-Year Insights & Program Stra...
TrustArc
 
PDF
Smart Air Quality Monitoring with Serrax AQM190 LITE
SERRAX TECHNOLOGIES LLP
 
PDF
HubSpot Main Hub: A Unified Growth Platform
Jaswinder Singh
 
PDF
Building Real-Time Digital Twins with IBM Maximo & ArcGIS Indoors
Safe Software
 
PDF
Windsurf Meetup Ottawa 2025-07-12 - Planning Mode at Reliza.pdf
Pavel Shukhman
 
PPTX
✨Unleashing Collaboration: Salesforce Channels & Community Power in Patna!✨
SanjeetMishra29
 
PDF
Blockchain Transactions Explained For Everyone
CIFDAQ
 
PDF
Smart Trailers 2025 Update with History and Overview
Paul Menig
 
CIFDAQ Token Spotlight for 9th July 2025
CIFDAQ
 
Fl Studio 24.2.2 Build 4597 Crack for Windows Free Download 2025
faizk77g
 
Human-centred design in online workplace learning and relationship to engagem...
Tracy Tang
 
July Patch Tuesday
Ivanti
 
LLMs.txt: Easily Control How AI Crawls Your Site
Keploy
 
Jak MŚP w Europie Środkowo-Wschodniej odnajdują się w świecie AI
dominikamizerska1
 
Why Orbit Edge Tech is a Top Next JS Development Company in 2025
mahendraalaska08
 
SFWelly Summer 25 Release Highlights July 2025
Anna Loughnan Colquhoun
 
Using FME to Develop Self-Service CAD Applications for a Major UK Police Force
Safe Software
 
Empower Inclusion Through Accessible Java Applications
Ana-Maria Mihalceanu
 
UiPath Academic Alliance Educator Panels: Session 2 - Business Analyst Content
DianaGray10
 
Presentation - Vibe Coding The Future of Tech
yanuarsinggih1
 
TrustArc Webinar - Data Privacy Trends 2025: Mid-Year Insights & Program Stra...
TrustArc
 
Smart Air Quality Monitoring with Serrax AQM190 LITE
SERRAX TECHNOLOGIES LLP
 
HubSpot Main Hub: A Unified Growth Platform
Jaswinder Singh
 
Building Real-Time Digital Twins with IBM Maximo & ArcGIS Indoors
Safe Software
 
Windsurf Meetup Ottawa 2025-07-12 - Planning Mode at Reliza.pdf
Pavel Shukhman
 
✨Unleashing Collaboration: Salesforce Channels & Community Power in Patna!✨
SanjeetMishra29
 
Blockchain Transactions Explained For Everyone
CIFDAQ
 
Smart Trailers 2025 Update with History and Overview
Paul Menig
 
Ad

Physics-Informed Machine Learning