[Tutorial] building machine learning models for predictive maintenance applications - Yan Zhang
Sample Scenario
Predictive maintenance in IoT applications vs. traditional predictive maintenance concepts
Predictive problem: “When an in-service machine will fail?”
Machine learning approach
Problem formulation
Use case
Input data – publicly available aircraft engine run-to-failure data
Data labeling and feature engineering
Tools to build end-to-end solution from data to web service
Azure ML
Predictive Maintenance Template in Azure ML
Demo: desktop app to predict machine’s remaining useful life
2
3
DATA
Business
apps
Custom
apps
Sensors
and
devices
ACTION
People
Automated
Systems
Data Science Process
DATA
4
DATA
Desktop app
5
6
Predictive Maintenance in IoT Traditional Predicative Maintenance
Goal
Improve production and/or maintenance
efficiency
Ensure the reliability of machine
operation
Data
Data stream (time varying features), Multiple
data sources
Very limited time varying features
Scope Component level, System level Parts level
Approach Data driven Model driven
Tasks
Failure prediction, fault/failure detection &
diagnosis, maintenance actions
recommendation, etc. Essentially any task
that improves production/maintenance
efficiency
Failure prediction (prognosis),
fault/failure detection & diagnosis
(diagnosis)
7
1 1 5 4 3
7 5 3 5 3
5 5 9 0 6
3 5 2 0 0
8
9
http://ti.arc.nasa.gov/tech/dash/pcoe/prognostic-
data-repository/
10
Sample training data
~20k rows,
100 unique engine id
Sample testing data
~13k rows,
100 unique engine id
Sample ground truth data
100 rows
11
12
Sample training data
~20k rows,
100 unique engine id
Sample testing data
~13k rows,
100 unique engine id
Sample ground truth data
100 rows
13
RUL label1 label2
?
14
id cycle … RUL label1 label2
1 1 191 0 0
1 2 190 0 0
1 3 189 0 0
1 4 188 0 0
… … … …
1 160 32 0 0
1 161 31 0 0
1 162 30 1 1
1 163 29 1 1
1 164 28 1 1
1 165 27 1 1
1 166 26 1 1
1 167 25 1 1
1 168 24 1 1
1 169 23 1 1
1 170 22 1 1
1 171 21 1 1
1 172 20 1 1
1 173 19 1 1
1 174 18 1 1
1 175 17 1 1
1 176 16 1 1
1 177 15 1 2
1 178 14 1 2
1 179 13 1 2
1 180 12 1 2
1 181 11 1 2
1 182 10 1 2
1 183 9 1 2
1 184 8 1 2
1 185 7 1 2
1 186 6 1 2
1 187 5 1 2
1 188 4 1 2
1 189 3 1 2
1 190 2 1 2
1 191 1 1 2
1 192 0 1 2
Predefined window size
for classification models
w1 = 30
w0 = 15
w1
w0
15
16
a1 a2 … a21 sd1 sd2 … sd21 RUL label1 label2
Other potential features: change from initial value, velocity of change, frequency count over a
predefined threshold
http://gallery.azureml.net (search “predictive maintenance”)
http://azure.com/ml
free tier & standard tier
18
 Accessible through a web browser,
no software to install
 Best ML algorithms
 Extensible, support for R & Python
 Collaborative work with anyone,
anywhere via Azure workspace
 Visual composition with end2end
support for data science workflow
19
Step #2B
Train and evaluate binary
classification models
Step #1 Data preparation and
feature engineering
Step #2A
Train and evaluate regression
models
Step #3A
Deploy web service with a
regression model
Step #3B
Deploy web service with a
binary classification model
Step #3C
Deploy web service with a
multi-class classification
model
Step #2C
Train and evaluate multi-class
classification models
Step 1 Step 2 Step 3
20
21
22
Step #2B
Train and evaluate
binary classification
models
Step #1 Data
preparation and
feature engineering
Step #2A
Train and evaluate
regression models
Step #3A
Deploy web service
with a regression
model
Step #3B
Deploy web service
with a binary
classification model
Step #3C
Deploy web service
with a multi-class
classification model
Step #2C
Train and evaluate
multi-class
classification
models
23
Decision Forest Regression
Boosted Decision Tree Regression
Poisson Regression
Neural Network Regression
24
Saved Transform
Web service input/output
25
[Tutorial] building machine learning models for predictive maintenance applications - Yan Zhang
Desktop app
Azure ML Model
(Deployed Web
Service)
ML predictions
consumed
through the
RRS web service
interfaceData input
27
DATA INTELLIGENCE ACTION
28
using three machine learning models: regression, binary classification,
multi-class classification
Introduced how to build end-to-end
data pipeline with Azure ML
29
 Microsoft Azure Machine Learning
http://azure.com/ml
 http://gallery.azureml.net (search “predictive
maintenance”)
 Register for the Cortana Analytics Workshop
hosted in Redmond on September 10-11, 2015.
https://analyticsworkshop.azurewebsites.net

More Related Content

PDF
Performance Metrics for Machine Learning Algorithms
PPTX
Anomaly Detection - Real World Scenarios, Approaches and Live Implementation
PPTX
Data streaming algorithms
PDF
18 Data Streams
PDF
R, Scikit-Learn and Apache Spark ML - What difference does it make?
PPTX
Feature Engineering
PDF
Machine learning for predictive maintenance external
PPTX
Major issues in data mining
Performance Metrics for Machine Learning Algorithms
Anomaly Detection - Real World Scenarios, Approaches and Live Implementation
Data streaming algorithms
18 Data Streams
R, Scikit-Learn and Apache Spark ML - What difference does it make?
Feature Engineering
Machine learning for predictive maintenance external
Major issues in data mining

What's hot (20)

PDF
Gradient descent method
PPTX
Computer Vision image classification
PPTX
Deep ar presentation
PDF
An introduction to Machine Learning
PDF
Asynchronous Methods for Deep Reinforcement Learning
PPTX
Machine Learning in Cyber Security
PPT
3. mining frequent patterns
PPT
Anomaly Detection in DataMining
PPT
5.1 mining data streams
PPTX
Machine Learning - Splitting Datasets
PDF
Tensorflow presentation
PDF
Foundations of Machine Learning
PPTX
Recurrent Neural Networks (RNNs)
PPSX
Classification Using Decision tree
PPT
Data preprocessing
PPTX
Machine learning workshop using Orange datamining framework
PPT
Chapter 08 Data Mining Techniques
PDF
Model selection and cross validation techniques
PDF
Machine-Learning-A-Z-Course-Downloadable-Slides-V1.5.pdf
PPTX
Association Rule Mining in Data Mining.pptx
Gradient descent method
Computer Vision image classification
Deep ar presentation
An introduction to Machine Learning
Asynchronous Methods for Deep Reinforcement Learning
Machine Learning in Cyber Security
3. mining frequent patterns
Anomaly Detection in DataMining
5.1 mining data streams
Machine Learning - Splitting Datasets
Tensorflow presentation
Foundations of Machine Learning
Recurrent Neural Networks (RNNs)
Classification Using Decision tree
Data preprocessing
Machine learning workshop using Orange datamining framework
Chapter 08 Data Mining Techniques
Model selection and cross validation techniques
Machine-Learning-A-Z-Course-Downloadable-Slides-V1.5.pdf
Association Rule Mining in Data Mining.pptx
Ad

Similar to [Tutorial] building machine learning models for predictive maintenance applications - Yan Zhang (20)

PPTX
Machine Learning Impact on IoT - Part 2
PDF
Cortana Analytics Workshop: Predictive Maintenance in the IoT Era
PDF
Mtc strategy-briefing-houston-pd m-05212018-3
PPTX
Machine Learning & Predictive Maintenance
PPTX
IoT Evolution Expo- Machine Learning and the Cloud
PPTX
Predictive Maintenance - Portland Machine Learning Meetup
PPTX
Predictive Maintenance using Deep Learning.pptx
PDF
Predictive Maintenance - Predict the Unpredictable
PPTX
Azure Machine Learning Challenge_Speakers Presentation.pptx
PDF
Machine Learning Use Cases with Azure
PDF
The Machine Learning Workflow with Azure
PDF
Azure Machine Learning tutorial
PDF
Intro to machine learning for web folks @ BlendWebMix
PDF
Prepare your data for machine learning
PDF
Using Data Science to Build an End-to-End Recommendation System
PDF
Simulation for predictive maintenance using weighted training algorithms in ...
PDF
Azure Machine Learning and ML on Premises
PPTX
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
PDF
predictive maintenance advanced solution
PDF
Machine learning for IoT - unpacking the blackbox
Machine Learning Impact on IoT - Part 2
Cortana Analytics Workshop: Predictive Maintenance in the IoT Era
Mtc strategy-briefing-houston-pd m-05212018-3
Machine Learning & Predictive Maintenance
IoT Evolution Expo- Machine Learning and the Cloud
Predictive Maintenance - Portland Machine Learning Meetup
Predictive Maintenance using Deep Learning.pptx
Predictive Maintenance - Predict the Unpredictable
Azure Machine Learning Challenge_Speakers Presentation.pptx
Machine Learning Use Cases with Azure
The Machine Learning Workflow with Azure
Azure Machine Learning tutorial
Intro to machine learning for web folks @ BlendWebMix
Prepare your data for machine learning
Using Data Science to Build an End-to-End Recommendation System
Simulation for predictive maintenance using weighted training algorithms in ...
Azure Machine Learning and ML on Premises
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
predictive maintenance advanced solution
Machine learning for IoT - unpacking the blackbox
Ad

More from PAPIs.io (20)

PDF
Shortening the time from analysis to deployment with ml as-a-service — Luiz A...
PDF
Feature engineering — HJ Van Veen (Nubank) @@PAPIs Connect — São Paulo 2017
PDF
Extracting information from images using deep learning and transfer learning ...
PDF
Discovering the hidden treasure of data using graph analytic — Ana Paula Appe...
PDF
Deep learning for sentiment analysis — André Barbosa (elo7) @PAPIs Connect — ...
PDF
Building machine learning service in your business — Eric Chen (Uber) @PAPIs ...
PDF
Building machine learning applications locally with Spark — Joel Pinho Lucas ...
PDF
Battery log data mining — Ramon Oliveira (Datart) @PAPIs Connect — São Paulo ...
PDF
A tensorflow recommending system for news — Fabrício Vargas Matos (Hearst tv)...
PDF
Scaling machine learning as a service at Uber — Li Erran Li at #papis2016
PDF
Real-world applications of AI - Daniel Hulme @ PAPIs Connect
PDF
Past, Present and Future of AI: a Fascinating Journey - Ramon Lopez de Mantar...
PDF
Revolutionizing Offline Retail Pricing & Promotions with ML - Daniel Guhl @ P...
PDF
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
PDF
Predictive APIs: What about Banking? - Natalino Busa @ PAPIs Connect
PDF
Microdecision making in financial services - Greg Lamp @ PAPIs Connect
PDF
Engineering the Future of Our Choice with General AI - JoEllen Lukavec Koeste...
PDF
Distributed deep learning with spark on AWS - Vincent Van Steenbergen @ PAPIs...
PDF
How to predict the future of shopping - Ulrich Kerzel @ PAPIs Connect
PDF
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...
Shortening the time from analysis to deployment with ml as-a-service — Luiz A...
Feature engineering — HJ Van Veen (Nubank) @@PAPIs Connect — São Paulo 2017
Extracting information from images using deep learning and transfer learning ...
Discovering the hidden treasure of data using graph analytic — Ana Paula Appe...
Deep learning for sentiment analysis — André Barbosa (elo7) @PAPIs Connect — ...
Building machine learning service in your business — Eric Chen (Uber) @PAPIs ...
Building machine learning applications locally with Spark — Joel Pinho Lucas ...
Battery log data mining — Ramon Oliveira (Datart) @PAPIs Connect — São Paulo ...
A tensorflow recommending system for news — Fabrício Vargas Matos (Hearst tv)...
Scaling machine learning as a service at Uber — Li Erran Li at #papis2016
Real-world applications of AI - Daniel Hulme @ PAPIs Connect
Past, Present and Future of AI: a Fascinating Journey - Ramon Lopez de Mantar...
Revolutionizing Offline Retail Pricing & Promotions with ML - Daniel Guhl @ P...
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
Predictive APIs: What about Banking? - Natalino Busa @ PAPIs Connect
Microdecision making in financial services - Greg Lamp @ PAPIs Connect
Engineering the Future of Our Choice with General AI - JoEllen Lukavec Koeste...
Distributed deep learning with spark on AWS - Vincent Van Steenbergen @ PAPIs...
How to predict the future of shopping - Ulrich Kerzel @ PAPIs Connect
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...

Recently uploaded (20)

PPTX
cardiac failure and associated notes.pptx
PPTX
text mining_Natural Language Processing.pptx
PPTX
Fkrjrkrkekekekeekkekswkjdjdjddwkejje.pptx
PDF
American Journal of Multidisciplinary Research and Review
PDF
Q1-wK1-Human-and-Cultural-Variation-sy-2024-2025-Copy-1.pdf
PDF
Lesson 1 - intro Cybersecurity and Cybercrime.pptx.pdf
PDF
MULTI-ACCESS EDGE COMPUTING ARCHITECTURE AND SMART AGRICULTURE APPLICATION IN...
PPTX
1.Introduction to orthodonti hhhgghhcs.pptx
PDF
PPT nikita containers of the company use
PPTX
Microsoft Fabric Modernization Pathways in Action: Strategic Insights for Dat...
PDF
The-Physical-Self.pdf college students1-4
PPT
2011 HCRP presentation-final.pptjrirrififfi
PPTX
Sistem Informasi Manejemn-Sistem Manajemen Database
PPTX
4. Sustainability.pptxxxxxxxxxxxxxxxxxxx
PPTX
Transport System for Biology students in the 11th grade
PPT
DWDM unit 1 for btech 3rd year students.ppt
PDF
Stochastic Programming problem presentationLuedtke.pdf
PDF
NU-MEP-Standards معايير تصميم جامعية .pdf
PPTX
Power BI - Microsoft Power BI is an interactive data visualization software p...
PPTX
Overview_of_Computing_Presentation.pptxxx
cardiac failure and associated notes.pptx
text mining_Natural Language Processing.pptx
Fkrjrkrkekekekeekkekswkjdjdjddwkejje.pptx
American Journal of Multidisciplinary Research and Review
Q1-wK1-Human-and-Cultural-Variation-sy-2024-2025-Copy-1.pdf
Lesson 1 - intro Cybersecurity and Cybercrime.pptx.pdf
MULTI-ACCESS EDGE COMPUTING ARCHITECTURE AND SMART AGRICULTURE APPLICATION IN...
1.Introduction to orthodonti hhhgghhcs.pptx
PPT nikita containers of the company use
Microsoft Fabric Modernization Pathways in Action: Strategic Insights for Dat...
The-Physical-Self.pdf college students1-4
2011 HCRP presentation-final.pptjrirrififfi
Sistem Informasi Manejemn-Sistem Manajemen Database
4. Sustainability.pptxxxxxxxxxxxxxxxxxxx
Transport System for Biology students in the 11th grade
DWDM unit 1 for btech 3rd year students.ppt
Stochastic Programming problem presentationLuedtke.pdf
NU-MEP-Standards معايير تصميم جامعية .pdf
Power BI - Microsoft Power BI is an interactive data visualization software p...
Overview_of_Computing_Presentation.pptxxx

[Tutorial] building machine learning models for predictive maintenance applications - Yan Zhang

  • 2. Sample Scenario Predictive maintenance in IoT applications vs. traditional predictive maintenance concepts Predictive problem: “When an in-service machine will fail?” Machine learning approach Problem formulation Use case Input data – publicly available aircraft engine run-to-failure data Data labeling and feature engineering Tools to build end-to-end solution from data to web service Azure ML Predictive Maintenance Template in Azure ML Demo: desktop app to predict machine’s remaining useful life 2
  • 3. 3
  • 6. 6 Predictive Maintenance in IoT Traditional Predicative Maintenance Goal Improve production and/or maintenance efficiency Ensure the reliability of machine operation Data Data stream (time varying features), Multiple data sources Very limited time varying features Scope Component level, System level Parts level Approach Data driven Model driven Tasks Failure prediction, fault/failure detection & diagnosis, maintenance actions recommendation, etc. Essentially any task that improves production/maintenance efficiency Failure prediction (prognosis), fault/failure detection & diagnosis (diagnosis)
  • 7. 7 1 1 5 4 3 7 5 3 5 3 5 5 9 0 6 3 5 2 0 0
  • 8. 8
  • 9. 9
  • 11. Sample training data ~20k rows, 100 unique engine id Sample testing data ~13k rows, 100 unique engine id Sample ground truth data 100 rows 11
  • 12. 12
  • 13. Sample training data ~20k rows, 100 unique engine id Sample testing data ~13k rows, 100 unique engine id Sample ground truth data 100 rows 13 RUL label1 label2 ?
  • 14. 14 id cycle … RUL label1 label2 1 1 191 0 0 1 2 190 0 0 1 3 189 0 0 1 4 188 0 0 … … … … 1 160 32 0 0 1 161 31 0 0 1 162 30 1 1 1 163 29 1 1 1 164 28 1 1 1 165 27 1 1 1 166 26 1 1 1 167 25 1 1 1 168 24 1 1 1 169 23 1 1 1 170 22 1 1 1 171 21 1 1 1 172 20 1 1 1 173 19 1 1 1 174 18 1 1 1 175 17 1 1 1 176 16 1 1 1 177 15 1 2 1 178 14 1 2 1 179 13 1 2 1 180 12 1 2 1 181 11 1 2 1 182 10 1 2 1 183 9 1 2 1 184 8 1 2 1 185 7 1 2 1 186 6 1 2 1 187 5 1 2 1 188 4 1 2 1 189 3 1 2 1 190 2 1 2 1 191 1 1 2 1 192 0 1 2 Predefined window size for classification models w1 = 30 w0 = 15 w1 w0
  • 15. 15
  • 16. 16 a1 a2 … a21 sd1 sd2 … sd21 RUL label1 label2 Other potential features: change from initial value, velocity of change, frequency count over a predefined threshold
  • 18. http://azure.com/ml free tier & standard tier 18  Accessible through a web browser, no software to install  Best ML algorithms  Extensible, support for R & Python  Collaborative work with anyone, anywhere via Azure workspace  Visual composition with end2end support for data science workflow
  • 19. 19 Step #2B Train and evaluate binary classification models Step #1 Data preparation and feature engineering Step #2A Train and evaluate regression models Step #3A Deploy web service with a regression model Step #3B Deploy web service with a binary classification model Step #3C Deploy web service with a multi-class classification model Step #2C Train and evaluate multi-class classification models Step 1 Step 2 Step 3
  • 20. 20
  • 21. 21
  • 22. 22 Step #2B Train and evaluate binary classification models Step #1 Data preparation and feature engineering Step #2A Train and evaluate regression models Step #3A Deploy web service with a regression model Step #3B Deploy web service with a binary classification model Step #3C Deploy web service with a multi-class classification model Step #2C Train and evaluate multi-class classification models
  • 23. 23 Decision Forest Regression Boosted Decision Tree Regression Poisson Regression Neural Network Regression
  • 25. 25
  • 27. Desktop app Azure ML Model (Deployed Web Service) ML predictions consumed through the RRS web service interfaceData input 27
  • 29. using three machine learning models: regression, binary classification, multi-class classification Introduced how to build end-to-end data pipeline with Azure ML 29
  • 30.  Microsoft Azure Machine Learning http://azure.com/ml  http://gallery.azureml.net (search “predictive maintenance”)  Register for the Cortana Analytics Workshop hosted in Redmond on September 10-11, 2015. https://analyticsworkshop.azurewebsites.net