SlideShare a Scribd company logo
• Contact us for 1 free consultation: giuseppe@valueamplify.com
• Twitter: @giuseppeHighTec
• Linkedin: www.linkedin.com/in/giuseppemascarella
What Is Machine Learning for IoT?
Machine Learning Impact on IoT - Part 2
Machine Learning Impact on IoT - Part 2
Machine Learning Impact on IoT - Part 2
IoT Predictive Maintenance Concepts
Predictive Maintenance in IoT
Traditional Predicative
Maintenance
Goal
Improve production and/or
maintenance efficiency
Ensure the reliability of
machine operation
Data
Data stream (time varying features),
Multiple data sources
Very limited time varying
features
Scope Component level, System level Parts level
Approach Data driven Model driven
Tasks
Failure prediction, fault/failure
detection & diagnosis, maintenance
actions recommendation, etc.
Essentially any task that improves
production/maintenance efficiency
Failure prediction
(prognosis), fault/failure
detection & diagnosis
(diagnosis)
Example Predictive Maintenance Use Cases
IoT Predictive Maintenance – Qantas Airways
~24,000 sensors
Qantas A380 Fleet
Technical Delays
12
$65M+
per A380
50%
Technical Delays
400-700 Fault/warning
messages/day
have potential for predictive
modelling
Develop ML model
(MATLAB)
alongside local
university
Optimise code
Reduce runtime
Develop
user web
front endBuild
evaluation
module
Refine model
parameters
Configure model
in AML PM
template
Evaluate & refine
model data &
parameters
Visualize results
in Power BI
Months
/year
Orchestrate data
pipeline in Azure
Data Factory
Source: www.microsoft.com
Stay ahead of the curve with Cortana Intelligence Suite
Business
apps
Custom
apps
Sensors
and
devices
People
Automated
systems
Data Intelligence
Cortana Intelligence
Action
Apps
The IoT Ecosystem Around ML
Intelligence
Dashboards &
Visualizations
Information
Management
Big Data Stores Machine Learning
and Analytics
CortanaEvent Hubs
HDInsight
(Hadoop and
Spark)
Stream
Analytics
Data Intelligence Action
People
Automated
Systems
Apps
Web
Mobile
Bots
Bot
Framework
SQL Data
WarehouseData Catalog
Data Lake
Analytics
Data Factory
Machine
Learning
Data Lake Store
Cognitive
Services
Power BI
Data
Sources
Apps
Sensors
and
devices
Data
Machine Learning Impact on IoT - Part 2
Machine Learning Impact on IoT - Part 2
Source: www.microsoft.com
Define scope/Preparation/Source/Labeling/Feature Engineering
Scope
Question
is sharp.
Data
measures
what they
care
about.
Data is
connected.
Data is
accurate.
A lot of
data.
The better the raw materials, the better the product.
E.g. Predict
whether
component X will
fail in the next Y
days; clear path
of action with
answer
E.g. Identifiers at
the level they are
predicting
E.g. Will be difficult
to predict failure
accurately with few
examples
E.g. Failures are
really failures,
human labels on
root causes; domain
knowledge
translated into
process
E.g. Machine
information linkable
to usage
information
Machine Learning Impact on IoT - Part 2
Machine Learning Impact on IoT - Part 2
Machine Learning Impact on IoT - Part 2
Machine Learning Impact on IoT - Part 2
Machine Learning Impact on IoT - Part 2
Data Sources
The failure history of a machine
or component within the
machine.
The repair history of a machine,
e.g. previous maintenance
records, components replaced,
maintenance activities
performed. Maintenance types.
The operation conditions of a
machine, e.g. data collected from
sensors.
FAILURE HISTORY REPAIR HISTORY MACHINECONDITIONS
The features of machine or
components, e.g. production
date, technical specifications.
Environmental features that may
influence a machine’s
performance, e.g. location,
temperature, other interactions.
The attributes of the operator
who uses the machine, e.g. driver.
MACHINE FEATURES OPERATING CONDITIONS OPERATORATTRIBUTES
Sample training data
~20k rows,
100 unique engine id
Sample testing data
~13k rows,
100 unique engine id
Sample ground truth data
100 rows
Please refer to following link of doc for Data description section
https://gallery.cortanaintelligence.com/Experiment/df7c518dcba
7407fb855377339d6589f
Classes
•Regression models: How many more cycles an in-
service engine will last before it fails?
•Binary classification: Is this engine going to fail within
w1 cycles?
•Multi-class classification: Is this engine going to fail
within the window [1, w0] cycles or to fail within the
window [w0+1, w1] cycles, or it will not fail within w1
cycles?
Feature Engineering
The process of creating features that provide better or
additional predictive power to the learning algorithm.
a1 a2 … a21 sd1 sd2 … sd21 RUL label1 label2
40+ engineered features
Data Labeling
How far ahead of
time the alert of
failure should trigger
before the actual
failure event.
Feature Engineering
1. Selected raw features
2. Aggregate features
Machine Learning Impact on IoT - Part 2
Machine Learning Impact on IoT - Part 2
Machine Learning Impact on IoT - Part 2
Machine Learning Impact on IoT - Part 2
Modelling Techniques
Predict failures within a future period of time
BINARY CLASSIFICATION
Predict failures with their causes within a future
time period.
Predict remaining useful life within ranges of
future periods
MULTICLASSCLASSIFICATION
Predict remaining useful life, the amount of time
before the next failure
REGRESSION
Identify change in normal trends to find
anomalies
ANOMALYDETECTION
Data Labeling
id cycle … RUL label1 label2
1 1 191 0 0
1 2 190 0 0
1 3 189 0 0
1 4 188 0 0
… … … …
1 160 32 0 0
1 161 31 0 0
1 162 30 1 1
1 163 29 1 1
1 164 28 1 1
1 165 27 1 1
1 166 26 1 1
1 167 25 1 1
1 168 24 1 1
1 169 23 1 1
1 170 22 1 1
1 171 21 1 1
1 172 20 1 1
1 173 19 1 1
1 174 18 1 1
1 175 17 1 1
1 176 16 1 1
1 177 15 1 2
1 178 14 1 2
1 179 13 1 2
1 180 12 1 2
1 181 11 1 2
1 182 10 1 2
1 183 9 1 2
1 184 8 1 2
1 185 7 1 2
1 186 6 1 2
1 187 5 1 2
1 188 4 1 2
1 189 3 1 2
1 190 2 1 2
1 191 1 1 2
1 192 0 1 2
Predefined window size
for classification models
w1 = 30
w0 = 15
w1
w0
Regression
Binary classification
Multi-class classification
Evaluation
• Time dependent split
• Train in the past, validate in the future
• Class imbalance
• A few failure events
• sampling, cost-sensitive learning
• Metrics
• Recall, Precision, F1
• Random Guess, Weighted Guess
“Most IoT data are not used currently…
the data that are used today are mostly for
anomaly detection and control, not
optimization and prediction, which
provide the greatest value.”1
Machine Learning Impact on IoT - Part 2
Acknowledgements
• We utilized the following publically available data to help us generate realistic data for
the demo shown. We received assistance in creating this solution as a result of this
repository and the donators of the data:
“A. Saxena and K. Goebel (2008). "PHM08 Challenge Data Set", NASA Ames Prognostics
Data Repository (http://ti.arc.nasa.gov/project/prognostic-data-repository), NASA Ames
Research Center, Moffett Field, CA.”
• McKinskey Global Institute, The Internet of Things: Mapping the Value beyond the hype
• Microsoft Cortana Gallery Experiments
Learn and try yourself!
• Learn from Cortana Analytics Gallery
• Solution package material – deploy by hand to learn here
• Try Cortana Analytics Solution Template – Predictive
Maintenance for Aerospace in private preview
• Try Azure IOT pre-configured solution for Predictive
Maintenance
• Read the Predictive Maintenance Playbook for more details
on how to approach these problems
• Run the Modelling Guide R Notebook for a DS walk-
through
• Contact us for 1 free consultation: giuseppe@valueamplify.com
• Twitter: @giuseppeHighTec
• Linkedin: www.linkedin.com/in/giuseppemascarella

More Related Content

What's hot (20)

PPTX
Leveraging Open Source Automated Data Science Tools
Domino Data Lab
 
PDF
BA Summit 2014 Predictive maintenance: Met big data het lek dichten
Daniel Westzaan
 
PDF
Storage Challenges for Production Machine Learning
Nisha Talagala
 
PDF
Knowledge Discovery
André Karpištšenko
 
PDF
Strata parallel m-ml-ops_sept_2017
Nisha Talagala
 
PPTX
Asset performance management using Druid by Eric Lim, Bistel
Metatron
 
PPTX
Rest microservice ml_deployment_ntalagala_ai_conf_2019
Nisha Talagala
 
PDF
Scaling AutoML-Driven Anomaly Detection With Luminaire
Databricks
 
PPTX
Real time machine learning
Vinoth Kannan
 
PDF
Machine Learning for Self-Driving Cars
Jan Wiegelmann
 
PDF
Streaming analytics
Gerard McNamee
 
PDF
Scaling AI in production using PyTorch
geetachauhan
 
PPTX
Distributed deep learning_over_spark_20_nov_2014_ver_2.8
Vijay Srinivas Agneeswaran, Ph.D
 
PPTX
From Machine Learning to Learning Machines: Creating an End-to-End Cognitive ...
Spark Summit
 
PPTX
Production ready big ml workflows from zero to hero daniel marcous @ waze
Ido Shilon
 
PDF
White paper - Robust firmware development for wind applications through HiL/S...
Ingeteam Wind Energy
 
PDF
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
Spark Summit
 
PPTX
Ai use cases
Sparsh Agarwal
 
PPTX
REAL-TIME SIMULATION TECHNOLOGIES FOR POWER SYSTEMS DESIGN, TESTING, AND ANAL...
Jithin T
 
PDF
Distributed Models Over Distributed Data with MLflow, Pyspark, and Pandas
Databricks
 
Leveraging Open Source Automated Data Science Tools
Domino Data Lab
 
BA Summit 2014 Predictive maintenance: Met big data het lek dichten
Daniel Westzaan
 
Storage Challenges for Production Machine Learning
Nisha Talagala
 
Knowledge Discovery
André Karpištšenko
 
Strata parallel m-ml-ops_sept_2017
Nisha Talagala
 
Asset performance management using Druid by Eric Lim, Bistel
Metatron
 
Rest microservice ml_deployment_ntalagala_ai_conf_2019
Nisha Talagala
 
Scaling AutoML-Driven Anomaly Detection With Luminaire
Databricks
 
Real time machine learning
Vinoth Kannan
 
Machine Learning for Self-Driving Cars
Jan Wiegelmann
 
Streaming analytics
Gerard McNamee
 
Scaling AI in production using PyTorch
geetachauhan
 
Distributed deep learning_over_spark_20_nov_2014_ver_2.8
Vijay Srinivas Agneeswaran, Ph.D
 
From Machine Learning to Learning Machines: Creating an End-to-End Cognitive ...
Spark Summit
 
Production ready big ml workflows from zero to hero daniel marcous @ waze
Ido Shilon
 
White paper - Robust firmware development for wind applications through HiL/S...
Ingeteam Wind Energy
 
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
Spark Summit
 
Ai use cases
Sparsh Agarwal
 
REAL-TIME SIMULATION TECHNOLOGIES FOR POWER SYSTEMS DESIGN, TESTING, AND ANAL...
Jithin T
 
Distributed Models Over Distributed Data with MLflow, Pyspark, and Pandas
Databricks
 

Viewers also liked (20)

PDF
ROI of Machine Learning In IoT
Value Amplify Consulting
 
PDF
DeepLearning and Advanced Machine Learning on IoT
Romeo Kienzler
 
PDF
IoT and machine learning - Computational Intelligence conference
Ajit Jaokar
 
PPTX
IoT Evolution EXPO: Machine Learning Introductory Certification. PART 1
Value Amplify Consulting
 
PDF
Applied Machine Learning for the IoT - Data Science Pop-up Seattle
Domino Data Lab
 
PDF
Data Science Popup Austin: Applied Machine Learning for IOT
Domino Data Lab
 
PPTX
Io t and machine learning smart cities
Ajit Jaokar
 
PDF
IT Strategy, Cloud Benefit Realization
Value Amplify Consulting
 
PDF
Jinxing_LIN_S224266_Poster
jinxing lin
 
PPTX
Machine Learning and the Cloud
Andrew Bogard
 
PDF
Love & Innovative technology presented by a technology pioneer and an AI expe...
Romeo Kienzler
 
PDF
Machine Learning and the Smart City
Erika Fille Legara
 
PDF
Machine Learning and Internet of Things
Sofian Hadiwijaya
 
PDF
Cloud and Machine Learning in real world business
Dae Kim
 
PDF
Machine Learning in the Cloud: Building a Better Forecast with H20 & Salesforce
Salesforce Developers
 
PDF
Cloud Machine Learning with Google Cloud Platform
Michal Brys
 
PPTX
Introduccion a Azure Machine Learning
Eduardo Castro
 
PDF
How to deploy machine learning models in the Cloud
Alex Casalboni
 
PDF
Building Serverless Machine Learning models in the Cloud
Alex Casalboni
 
PPTX
Cloud Computing by AGDMOUN Khalid
خالد اكدمون
 
ROI of Machine Learning In IoT
Value Amplify Consulting
 
DeepLearning and Advanced Machine Learning on IoT
Romeo Kienzler
 
IoT and machine learning - Computational Intelligence conference
Ajit Jaokar
 
IoT Evolution EXPO: Machine Learning Introductory Certification. PART 1
Value Amplify Consulting
 
Applied Machine Learning for the IoT - Data Science Pop-up Seattle
Domino Data Lab
 
Data Science Popup Austin: Applied Machine Learning for IOT
Domino Data Lab
 
Io t and machine learning smart cities
Ajit Jaokar
 
IT Strategy, Cloud Benefit Realization
Value Amplify Consulting
 
Jinxing_LIN_S224266_Poster
jinxing lin
 
Machine Learning and the Cloud
Andrew Bogard
 
Love & Innovative technology presented by a technology pioneer and an AI expe...
Romeo Kienzler
 
Machine Learning and the Smart City
Erika Fille Legara
 
Machine Learning and Internet of Things
Sofian Hadiwijaya
 
Cloud and Machine Learning in real world business
Dae Kim
 
Machine Learning in the Cloud: Building a Better Forecast with H20 & Salesforce
Salesforce Developers
 
Cloud Machine Learning with Google Cloud Platform
Michal Brys
 
Introduccion a Azure Machine Learning
Eduardo Castro
 
How to deploy machine learning models in the Cloud
Alex Casalboni
 
Building Serverless Machine Learning models in the Cloud
Alex Casalboni
 
Cloud Computing by AGDMOUN Khalid
خالد اكدمون
 
Ad

Similar to Machine Learning Impact on IoT - Part 2 (20)

PDF
Cortana Analytics Workshop: Predictive Maintenance in the IoT Era
MSAdvAnalytics
 
PDF
Mathworks CAE simulation suite – case in point from automotive and aerospace.
WMG centre High Value Manufacturing Catapult
 
PDF
1030 iordanescu
Rising Media, Inc.
 
PDF
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
mattdenesuk
 
PPTX
Machine Learning + Analytics in Splunk
Splunk
 
PDF
Reliability Case Results
Vladislav Filinkov
 
PDF
Autonomous Control AI Training from Data
Ivo Andreev
 
PDF
Optimizing connected system performance md&m-anaheim-sandhi bhide 02-07-2017
sandhibhide
 
PDF
Predictive Maintenance - Predict the Unpredictable
Ivo Andreev
 
PPTX
Machine Learning & Predictive Maintenance
Arnab Biswas
 
PDF
Mtc strategy-briefing-houston-pd m-05212018-3
Dania Kodeih
 
PPTX
Supply chain design and operation
AngelainBay
 
PPTX
Finalbhgggggggggggggggggggggggggggggggggggg_PPT.pptx
penyameen1
 
PDF
[Tutorial] building machine learning models for predictive maintenance applic...
PAPIs.io
 
PDF
Next generation alerting and fault detection, SRECon Europe 2016
Dieter Plaetinck
 
PDF
AEMP Connect 2021 Can AI Solve Construction Telematics Overload Problem? Ode...
Oded Ran
 
PDF
Machine Learning & IT Service Intelligence for the Enterprise: The Future is ...
Precisely
 
PDF
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
Perfecto by Perforce
 
PDF
Visionaize - Upstream-Midstream-Downstream Use Cases.pdf
SumantaBasu12
 
PPTX
RS in the context of Big Data-v4
Khadija Atiya
 
Cortana Analytics Workshop: Predictive Maintenance in the IoT Era
MSAdvAnalytics
 
Mathworks CAE simulation suite – case in point from automotive and aerospace.
WMG centre High Value Manufacturing Catapult
 
1030 iordanescu
Rising Media, Inc.
 
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
mattdenesuk
 
Machine Learning + Analytics in Splunk
Splunk
 
Reliability Case Results
Vladislav Filinkov
 
Autonomous Control AI Training from Data
Ivo Andreev
 
Optimizing connected system performance md&m-anaheim-sandhi bhide 02-07-2017
sandhibhide
 
Predictive Maintenance - Predict the Unpredictable
Ivo Andreev
 
Machine Learning & Predictive Maintenance
Arnab Biswas
 
Mtc strategy-briefing-houston-pd m-05212018-3
Dania Kodeih
 
Supply chain design and operation
AngelainBay
 
Finalbhgggggggggggggggggggggggggggggggggggg_PPT.pptx
penyameen1
 
[Tutorial] building machine learning models for predictive maintenance applic...
PAPIs.io
 
Next generation alerting and fault detection, SRECon Europe 2016
Dieter Plaetinck
 
AEMP Connect 2021 Can AI Solve Construction Telematics Overload Problem? Ode...
Oded Ran
 
Machine Learning & IT Service Intelligence for the Enterprise: The Future is ...
Precisely
 
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
Perfecto by Perforce
 
Visionaize - Upstream-Midstream-Downstream Use Cases.pdf
SumantaBasu12
 
RS in the context of Big Data-v4
Khadija Atiya
 
Ad

More from Value Amplify Consulting (20)

PPTX
AI Is An ROI Booster For Restaurants
Value Amplify Consulting
 
PPTX
AI Class Topic 6: Easy Way to Learn Deep Learning AI Technologies
Value Amplify Consulting
 
PPTX
AI Class Topic 5: Social Network Graph
Value Amplify Consulting
 
PPTX
AI Class Topic 4: Text Analytics, Sentiment Analysis and Apache Spark
Value Amplify Consulting
 
PPTX
AI Class Topic 3: Building Machine Learning Predictive Systems (Predictive Ma...
Value Amplify Consulting
 
PPTX
AI Class Topic 2: Step-by-step Process for AI development
Value Amplify Consulting
 
PPTX
What Is Artificial Intelligence? Part 1/10
Value Amplify Consulting
 
PPTX
Fractional Chief AI Officer Services For Hire
Value Amplify Consulting
 
PPTX
Chief AI Officer and AI Digital Transformation
Value Amplify Consulting
 
PDF
AI Planning Workshop overview
Value Amplify Consulting
 
PPTX
EKATRA IoT Digital Twin Presentation at FOG World Congress
Value Amplify Consulting
 
PPTX
EKATRA IoT Digital Twin Presentation at FOG World Congress
Value Amplify Consulting
 
PPTX
AI WITH AN ROI
Value Amplify Consulting
 
PPTX
Bitcoin, Altcoins and Trading Robots jan2018
Value Amplify Consulting
 
PPTX
Bitcoin and Blockchain overview
Value Amplify Consulting
 
PPTX
Bitcoin: Busienss and Technology Robot Overview
Value Amplify Consulting
 
PDF
ICOs Good The Bad and the Ugly
Value Amplify Consulting
 
PPTX
Tutorial on BlockChain and ICO in Commodity Trading
Value Amplify Consulting
 
PPTX
Introduction to Blockchain and BitCoin New Business Opportunties
Value Amplify Consulting
 
PPTX
Rapid Economic Justifcation for Machine Learning in IoT
Value Amplify Consulting
 
AI Is An ROI Booster For Restaurants
Value Amplify Consulting
 
AI Class Topic 6: Easy Way to Learn Deep Learning AI Technologies
Value Amplify Consulting
 
AI Class Topic 5: Social Network Graph
Value Amplify Consulting
 
AI Class Topic 4: Text Analytics, Sentiment Analysis and Apache Spark
Value Amplify Consulting
 
AI Class Topic 3: Building Machine Learning Predictive Systems (Predictive Ma...
Value Amplify Consulting
 
AI Class Topic 2: Step-by-step Process for AI development
Value Amplify Consulting
 
What Is Artificial Intelligence? Part 1/10
Value Amplify Consulting
 
Fractional Chief AI Officer Services For Hire
Value Amplify Consulting
 
Chief AI Officer and AI Digital Transformation
Value Amplify Consulting
 
AI Planning Workshop overview
Value Amplify Consulting
 
EKATRA IoT Digital Twin Presentation at FOG World Congress
Value Amplify Consulting
 
EKATRA IoT Digital Twin Presentation at FOG World Congress
Value Amplify Consulting
 
AI WITH AN ROI
Value Amplify Consulting
 
Bitcoin, Altcoins and Trading Robots jan2018
Value Amplify Consulting
 
Bitcoin and Blockchain overview
Value Amplify Consulting
 
Bitcoin: Busienss and Technology Robot Overview
Value Amplify Consulting
 
ICOs Good The Bad and the Ugly
Value Amplify Consulting
 
Tutorial on BlockChain and ICO in Commodity Trading
Value Amplify Consulting
 
Introduction to Blockchain and BitCoin New Business Opportunties
Value Amplify Consulting
 
Rapid Economic Justifcation for Machine Learning in IoT
Value Amplify Consulting
 

Recently uploaded (20)

PPTX
apidays Helsinki & North 2025 - Vero APIs - Experiences of API development in...
apidays
 
PPTX
apidays Helsinki & North 2025 - Running a Successful API Program: Best Practi...
apidays
 
PPTX
Listify-Intelligent-Voice-to-Catalog-Agent.pptx
nareshkottees
 
PPTX
apidays Singapore 2025 - From Data to Insights: Building AI-Powered Data APIs...
apidays
 
PPTX
apidays Helsinki & North 2025 - APIs at Scale: Designing for Alignment, Trust...
apidays
 
PDF
OPPOTUS - Malaysias on Malaysia 1Q2025.pdf
Oppotus
 
PPTX
apidays Helsinki & North 2025 - Agentic AI: A Friend or Foe?, Merja Kajava (A...
apidays
 
PDF
Product Management in HealthTech (Case Studies from SnappDoctor)
Hamed Shams
 
PDF
Simplifying Document Processing with Docling for AI Applications.pdf
Tamanna
 
PDF
apidays Helsinki & North 2025 - API-Powered Journeys: Mobility in an API-Driv...
apidays
 
PDF
Merits and Demerits of DBMS over File System & 3-Tier Architecture in DBMS
MD RIZWAN MOLLA
 
PDF
Development and validation of the Japanese version of the Organizational Matt...
Yoga Tokuyoshi
 
PDF
AUDITABILITY & COMPLIANCE OF AI SYSTEMS IN HEALTHCARE
GAHI Youssef
 
PPTX
SlideEgg_501298-Agentic AI.pptx agentic ai
530BYManoj
 
PPTX
apidays Helsinki & North 2025 - API access control strategies beyond JWT bear...
apidays
 
PDF
R Cookbook - Processing and Manipulating Geological spatial data with R.pdf
OtnielSimopiaref2
 
PDF
Building Production-Ready AI Agents with LangGraph.pdf
Tamanna
 
PPTX
Module-5-Measures-of-Central-Tendency-Grouped-Data-1.pptx
lacsonjhoma0407
 
PDF
JavaScript - Good or Bad? Tips for Google Tag Manager
📊 Markus Baersch
 
PDF
The European Business Wallet: Why It Matters and How It Powers the EUDI Ecosy...
Lal Chandran
 
apidays Helsinki & North 2025 - Vero APIs - Experiences of API development in...
apidays
 
apidays Helsinki & North 2025 - Running a Successful API Program: Best Practi...
apidays
 
Listify-Intelligent-Voice-to-Catalog-Agent.pptx
nareshkottees
 
apidays Singapore 2025 - From Data to Insights: Building AI-Powered Data APIs...
apidays
 
apidays Helsinki & North 2025 - APIs at Scale: Designing for Alignment, Trust...
apidays
 
OPPOTUS - Malaysias on Malaysia 1Q2025.pdf
Oppotus
 
apidays Helsinki & North 2025 - Agentic AI: A Friend or Foe?, Merja Kajava (A...
apidays
 
Product Management in HealthTech (Case Studies from SnappDoctor)
Hamed Shams
 
Simplifying Document Processing with Docling for AI Applications.pdf
Tamanna
 
apidays Helsinki & North 2025 - API-Powered Journeys: Mobility in an API-Driv...
apidays
 
Merits and Demerits of DBMS over File System & 3-Tier Architecture in DBMS
MD RIZWAN MOLLA
 
Development and validation of the Japanese version of the Organizational Matt...
Yoga Tokuyoshi
 
AUDITABILITY & COMPLIANCE OF AI SYSTEMS IN HEALTHCARE
GAHI Youssef
 
SlideEgg_501298-Agentic AI.pptx agentic ai
530BYManoj
 
apidays Helsinki & North 2025 - API access control strategies beyond JWT bear...
apidays
 
R Cookbook - Processing and Manipulating Geological spatial data with R.pdf
OtnielSimopiaref2
 
Building Production-Ready AI Agents with LangGraph.pdf
Tamanna
 
Module-5-Measures-of-Central-Tendency-Grouped-Data-1.pptx
lacsonjhoma0407
 
JavaScript - Good or Bad? Tips for Google Tag Manager
📊 Markus Baersch
 
The European Business Wallet: Why It Matters and How It Powers the EUDI Ecosy...
Lal Chandran
 

Machine Learning Impact on IoT - Part 2

  • 1. • Contact us for 1 free consultation: [email protected] • Twitter: @giuseppeHighTec • Linkedin: www.linkedin.com/in/giuseppemascarella
  • 2. What Is Machine Learning for IoT?
  • 6. IoT Predictive Maintenance Concepts Predictive Maintenance in IoT Traditional Predicative Maintenance Goal Improve production and/or maintenance efficiency Ensure the reliability of machine operation Data Data stream (time varying features), Multiple data sources Very limited time varying features Scope Component level, System level Parts level Approach Data driven Model driven Tasks Failure prediction, fault/failure detection & diagnosis, maintenance actions recommendation, etc. Essentially any task that improves production/maintenance efficiency Failure prediction (prognosis), fault/failure detection & diagnosis (diagnosis)
  • 8. IoT Predictive Maintenance – Qantas Airways ~24,000 sensors Qantas A380 Fleet Technical Delays 12 $65M+ per A380 50% Technical Delays 400-700 Fault/warning messages/day have potential for predictive modelling Develop ML model (MATLAB) alongside local university Optimise code Reduce runtime Develop user web front endBuild evaluation module Refine model parameters Configure model in AML PM template Evaluate & refine model data & parameters Visualize results in Power BI Months /year Orchestrate data pipeline in Azure Data Factory Source: www.microsoft.com
  • 9. Stay ahead of the curve with Cortana Intelligence Suite Business apps Custom apps Sensors and devices People Automated systems Data Intelligence Cortana Intelligence Action Apps
  • 10. The IoT Ecosystem Around ML Intelligence Dashboards & Visualizations Information Management Big Data Stores Machine Learning and Analytics CortanaEvent Hubs HDInsight (Hadoop and Spark) Stream Analytics Data Intelligence Action People Automated Systems Apps Web Mobile Bots Bot Framework SQL Data WarehouseData Catalog Data Lake Analytics Data Factory Machine Learning Data Lake Store Cognitive Services Power BI Data Sources Apps Sensors and devices Data
  • 15. Scope Question is sharp. Data measures what they care about. Data is connected. Data is accurate. A lot of data. The better the raw materials, the better the product. E.g. Predict whether component X will fail in the next Y days; clear path of action with answer E.g. Identifiers at the level they are predicting E.g. Will be difficult to predict failure accurately with few examples E.g. Failures are really failures, human labels on root causes; domain knowledge translated into process E.g. Machine information linkable to usage information
  • 21. Data Sources The failure history of a machine or component within the machine. The repair history of a machine, e.g. previous maintenance records, components replaced, maintenance activities performed. Maintenance types. The operation conditions of a machine, e.g. data collected from sensors. FAILURE HISTORY REPAIR HISTORY MACHINECONDITIONS The features of machine or components, e.g. production date, technical specifications. Environmental features that may influence a machine’s performance, e.g. location, temperature, other interactions. The attributes of the operator who uses the machine, e.g. driver. MACHINE FEATURES OPERATING CONDITIONS OPERATORATTRIBUTES
  • 22. Sample training data ~20k rows, 100 unique engine id Sample testing data ~13k rows, 100 unique engine id Sample ground truth data 100 rows Please refer to following link of doc for Data description section https://gallery.cortanaintelligence.com/Experiment/df7c518dcba 7407fb855377339d6589f
  • 23. Classes •Regression models: How many more cycles an in- service engine will last before it fails? •Binary classification: Is this engine going to fail within w1 cycles? •Multi-class classification: Is this engine going to fail within the window [1, w0] cycles or to fail within the window [w0+1, w1] cycles, or it will not fail within w1 cycles?
  • 24. Feature Engineering The process of creating features that provide better or additional predictive power to the learning algorithm. a1 a2 … a21 sd1 sd2 … sd21 RUL label1 label2 40+ engineered features
  • 25. Data Labeling How far ahead of time the alert of failure should trigger before the actual failure event.
  • 26. Feature Engineering 1. Selected raw features 2. Aggregate features
  • 31. Modelling Techniques Predict failures within a future period of time BINARY CLASSIFICATION Predict failures with their causes within a future time period. Predict remaining useful life within ranges of future periods MULTICLASSCLASSIFICATION Predict remaining useful life, the amount of time before the next failure REGRESSION Identify change in normal trends to find anomalies ANOMALYDETECTION
  • 32. Data Labeling id cycle … RUL label1 label2 1 1 191 0 0 1 2 190 0 0 1 3 189 0 0 1 4 188 0 0 … … … … 1 160 32 0 0 1 161 31 0 0 1 162 30 1 1 1 163 29 1 1 1 164 28 1 1 1 165 27 1 1 1 166 26 1 1 1 167 25 1 1 1 168 24 1 1 1 169 23 1 1 1 170 22 1 1 1 171 21 1 1 1 172 20 1 1 1 173 19 1 1 1 174 18 1 1 1 175 17 1 1 1 176 16 1 1 1 177 15 1 2 1 178 14 1 2 1 179 13 1 2 1 180 12 1 2 1 181 11 1 2 1 182 10 1 2 1 183 9 1 2 1 184 8 1 2 1 185 7 1 2 1 186 6 1 2 1 187 5 1 2 1 188 4 1 2 1 189 3 1 2 1 190 2 1 2 1 191 1 1 2 1 192 0 1 2 Predefined window size for classification models w1 = 30 w0 = 15 w1 w0 Regression Binary classification Multi-class classification
  • 33. Evaluation • Time dependent split • Train in the past, validate in the future • Class imbalance • A few failure events • sampling, cost-sensitive learning • Metrics • Recall, Precision, F1 • Random Guess, Weighted Guess
  • 34. “Most IoT data are not used currently… the data that are used today are mostly for anomaly detection and control, not optimization and prediction, which provide the greatest value.”1
  • 36. Acknowledgements • We utilized the following publically available data to help us generate realistic data for the demo shown. We received assistance in creating this solution as a result of this repository and the donators of the data: “A. Saxena and K. Goebel (2008). "PHM08 Challenge Data Set", NASA Ames Prognostics Data Repository (http://ti.arc.nasa.gov/project/prognostic-data-repository), NASA Ames Research Center, Moffett Field, CA.” • McKinskey Global Institute, The Internet of Things: Mapping the Value beyond the hype • Microsoft Cortana Gallery Experiments
  • 37. Learn and try yourself! • Learn from Cortana Analytics Gallery • Solution package material – deploy by hand to learn here • Try Cortana Analytics Solution Template – Predictive Maintenance for Aerospace in private preview • Try Azure IOT pre-configured solution for Predictive Maintenance • Read the Predictive Maintenance Playbook for more details on how to approach these problems • Run the Modelling Guide R Notebook for a DS walk- through
  • 38. • Contact us for 1 free consultation: [email protected] • Twitter: @giuseppeHighTec • Linkedin: www.linkedin.com/in/giuseppemascarella

Editor's Notes

  • #3: Designing with artificial intelligence The secret to getting people to engage with products and services is to make interaction as simple as possible. Remove friction and people will embrace your product. But simplicity isn’t the same as minimalism. The secret to getting people to engage with products and services is to make interaction as simple as possible. Remove friction and people will embrace your product. But simplicity isn’t the same as minimalism. For IoT devices, the interface may be as minimal as a few LEDs and a touchpad—and that kind of minimalism can feel obscure and confusing to users. What’s more, IoT devices often need to operate in concert to create delightful services, such as coordinating the levels of light and sound in a room. This simply increases complexity. Unless we come up with new ideas, the world is about to feel terribly broken. That’s why interfaces and services increasingly rely on artificial intelligence technologies. Algorithms make sense of contextual data, anticipate user needs, and accept more natural forms of input, like voice commands. Keeping the interface simple means the device has to become more intelligent. AI isn’t magic—it’s engineering. To develop compelling products, designers and product managers need to understand the constraints and possibilities of AI. They also need to develop new ways of working together so that the resulting products and services feel more… human. This session looks at how algorithms work, examines what they can and can’t do, and explores case studies and examples of how product teams have combined a deep understanding of people with clever design and smart algorithms to produce truly wonderful products. Decisions of what data to keep, ignore, and what to forward to a centralized authority will be required. Many of the kinetic devices will be used and application whose action can neither tolerate long latency nor risk the possibility that the connection with the centralized authority (“the cloud”) is not available. Their decisions must be made instantly with local information and knowledge. Most IoT endpoints will be limited in capabilities due to size, cost, and the power requirements and will need companion computing that is either embedded in the larger system or in a companion gateway. These gateways will primarily bridge between the local device communication domains and higher level network domains and will in most cases make behavioral decisions. As the industry matures, these gateways will also be responsible for allowing data to be exchanged between intended devices, and ensuring the information is protected. Network traffic patterns will be significantly impacted as more device-to-endpoint traffic will occur and more machine-to-machine communication will materialize, shifting from today’s patterns. However, these solutions will not be static, and their evolving behavior will need to vary depending on local characteristics, giving rise to more software-defined functions at both the edge and within the datacenter. Further, their numbers will be vast and their operation cannot require human intervention.
  • #23: The input data consists of "train_FD001.txt", "test_FD001.txt", and "RUL_FD001.txt" in the original data source [1]. The training data ("train_FD001.txt") consists of multiple multivariate time series with "cycle" as the time unit, together with 21 sensor readings for each cycle. Each time series can be assumed as being generated from a different engine of the same type. Each engine is assumed to start with different degrees of initial wear and manufacturing variation, and this information is unknown to the user. In this simulated data, the engine is assumed to be operating normally at the start of each time series. It starts to degrade at some point during the series of the operating cycles. The degradation progresses and grows in magnitude. When a predefined threshold is reached, then the engine is considered unsafe for further operation. In other words, the last cycle in each time series can be considered as the failure point of the corresponding engine. Taking the sample training data shown in the following table as an example, the engine with id=1 fails at cycle 192, and engine with id=2 fails at cycle 287. The testing data ("test_FD001.txt") has the same data schema as the training data. The only difference is that the data does not indicate when the failure occurs (in other words, the last time period does NOT represent the failure point). Taking the sample testing data shown in the following table as an example, the engine with id=1 runs from cycle 1 through cycle 31. It is not shown how many more cycles this engine can last before it fails. The ground truth data ("RUL_FD001.txt") provides the number of remaining working cycles for the engines in the testing data. Taking the sample ground truth data shown in the following table as an example, the engine with id=1 in the testing data can run another 112 cycles before it fails.
  • #27: Selected raw features The raw features are those that are included in the original input data. In order to decide which raw features should be included in the training data, both the detailed data field description and domain knowledge is helpful. In this template, all the sensor measurements (s1-s21) are included in the training data. Other raw features get used are: cycle, setting1-setting3. Aggregate features These features summarize the historical activity of each asset. In the template, two types of aggregate features are created for each of the 21 sensors. The description of these features are shown below. a1-a21: the moving average of sensor values in the most w recent cycles sd1-sd21: the standard deviation of sensor values in the most w recent cycles