IoT - from prototype to enterprise platform (DigitalXchange 2022)
Download as PPTX, PDF0 likes45 views
The document discusses the transition of IoT from prototype to an enterprise platform, focusing on its application in the energy sector over three years with multiple business cases. It emphasizes the importance of real-time data measurement and the integration of operational technology with enterprise IT systems to enhance energy management processes. Additionally, it outlines the architecture principles and the scalability of the IoT platform implemented on Microsoft Azure.
![Classificatie: vertrouwelijk
What is IoT?
• Internet of Things
• Eyes, Ears, Smell and Feel
for [enterprise] IT systems](https://image.slidesharecdn.com/digitalxchange-iot-fromprototypetoenterpriseplatform-lucasjellema-september2022-220918081231-468f2af6/85/IoT-from-prototype-to-enterprise-platform-DigitalXchange-2022-11-320.jpg)
![Classificatie: vertrouwelijk
What is IoT?
• Internet of Things
• Eyes, Ears, Smell and Feel
for [enterprise] IT systems
• A remote control – for manipulating
the real world from within the enterprise IT](https://image.slidesharecdn.com/digitalxchange-iot-fromprototypetoenterpriseplatform-lucasjellema-september2022-220918081231-468f2af6/85/IoT-from-prototype-to-enterprise-platform-DigitalXchange-2022-14-320.jpg)
![Classificatie: vertrouwelijk
Conclusion
• IoT is [a special case of] data integration
• Communicate, collect, process, persist, publish
• Fast, High Volume, Real Time
• Many parties to interact with
• IoT brings physical world of real things close to enterprise IT
• Automation is a lot of work – and is worth it
• Speed, repeatability, ability for agility, fewer errors,
reduced effort, less reliance on key resources
• Anything local (edge side), physical or manual
is expensive and hard to change and to scale up
• Azure is a pretty nice environment to work and run in
• especially the ability to rapidly ramp up, explore, scale and let go off
– and not have to manage infrastructure details
• Once you have an IoT Platform – the number of use cases may grow rapidly
Cloud IoT Platform for Energy Transition - DigitalXchange 2020](https://image.slidesharecdn.com/digitalxchange-iot-fromprototypetoenterpriseplatform-lucasjellema-september2022-220918081231-468f2af6/85/IoT-from-prototype-to-enterprise-platform-DigitalXchange-2022-46-320.jpg)
IoT - from prototype to enterprise platform (DigitalXchange 2022)
- 2. Classificatie: vertrouwelijk IoT - from prototype to enterprise platform - three years and seven business cases at a Dutch Energy Provider Digital Xchange 2022 Lucas Jellema – CTO for AMIS | Conclusion
- 3. Classificatie: vertrouwelijk Microservices in real life – with Node & Dapr.io Founded in 1991 by students from University of Twente – Aircraft Maintenance Information System (AMIS) 80 colleagues, located in Nieuwegein, NL the core of what we do: working with Data. partnering with peers and companies in several countries – including Opitz Consulting Lucas Jellema (2002) Cloud Solution Architect & CTO [email protected] | technology.amis.nl | @lucasjellema | lucas-jellema
- 4. Classificatie: vertrouwelijk • grid lock on Dutch electricity infrastructure
- 5. Classificatie: vertrouwelijk • grid controller requires “instant curtailment of electricity production” Titel van de presentatie 5
- 6. Classificatie: vertrouwelijk Power Production Reduced Titel van de presentatie 6
- 7. Classificatie: vertrouwelijk Curtailment – how it should work Titel van de presentatie 7 Grid Controller Agency Energy Producer Virtual Power Plants controller OT/IT Bridge An effect within 30 seconds Reduce power by X % Report actual power production (every 8 seconds) Total power production setpoint Total power production setpoint
- 8. Classificatie: vertrouwelijk Real time measuring of current production is crucial Titel van de presentatie 8 Grid Controller Agency Energy Producer Virtual Power Plants controller OT/IT Bridge An effect within 30 seconds Reduce power by X % Report actual power production (every 8 seconds)
- 9. Classificatie: vertrouwelijk Real time measuring of current production is crucial: Clouds on the horizon Titel van de presentatie 9 Grid Controller Agency Energy Producer Virtual Power Plants controller OT/IT Bridge An effect within 30 seconds Reduce power by X % Report actual power production (every 8 seconds)
- 10. Classificatie: vertrouwelijk Bridging the Physical World with the Enterprise IT World Enterprise IT Systems IoT Platform OT (operational technology) & Real, Physical World Third Parties
- 11. Classificatie: vertrouwelijk What is IoT? • Internet of Things • Eyes, Ears, Smell and Feel for [enterprise] IT systems
- 12. Classificatie: vertrouwelijk Eyes through IoT-systems
- 14. Classificatie: vertrouwelijk What is IoT? • Internet of Things • Eyes, Ears, Smell and Feel for [enterprise] IT systems • A remote control – for manipulating the real world from within the enterprise IT
- 15. Classificatie: vertrouwelijk Measure Communicate Receive & Process Interpret Report & Act How? device management monitoring security cost control How often, how fast, how much, how accurate and reliable, how secure
- 16. Classificatie: vertrouwelijk Measure Communicate Receive & Process Interpret Report & Act How? device management monitoring security cost control Decide on Action Send signal (to“thing”) Execute action Receive/ Interpret
- 17. Classificatie: vertrouwelijk Heat as a Product Cloud IoT Platform for Energy Transition - DigitalXchange 2020
- 18. Classificatie: vertrouwelijk Heat as a Product Cloud IoT Platform for Energy Transition - DigitalXchange 2020
- 19. Classificatie: vertrouwelijk Heat as a Product Cloud IoT Platform for Energy Transition - DigitalXchange 2020 Supply (100°-120°) Return Heat Production Auxilliary Heat Production Local Distributor Supply Return Consumer Homes ∆T Supply (70°-90°) Return (40°-60°) Return (58°- 68°)
- 20. Classificatie: vertrouwelijk A need to know basis Cloud IoT Platform for Energy Transition - DigitalXchange 2020 HEAT When & How much Energy transfered? Also: Volume, Supply & Return Temperature Health details meters, communication, grid • Invoicing • Capacity Planning • Customer App/Portal/API • Heat Grid Analysis • Data Science • Customer Service/Helpdesk • Device Monitoring & Operations
- 21. Classificatie: vertrouwelijk The moving pieces Cloud IoT Platform for Energy Transition - DigitalXchange 2020 HEAT Smart Meter Smart Meter Communication Module API Event Streaming Platform Telemetry Ingest, Authenticate & Check Validate, Enrich Process, Convert, Publish Devices Monitoring Actuator
- 22. Classificatie: vertrouwelijk Orders of magnitude Cloud IoT Platform for Energy Transition - DigitalXchange 2020 HEAT Smart Meter Smart Meter Communication Module API Event Streaming Platform Telemetry Ingest, Authenticate & Check Validate, Enrich Process, Convert, Publish Devices Monitoring Actuator 150K devices 3.5M msg/day 70M measurements/day 70M records/day 12M events/day
- 23. Classificatie: vertrouwelijk Smart Meters Cloud IoT Platform for Energy Transition - DigitalXchange 2020 Smart Meter Smart Meter Communication Module Ingest, Authenticate & Check Devices Actuator Readings are digitally available through industry standard protocols – and wired or wireless. Examples are Wired respectively Wireless M-Bus (for Heat Meters), and OpenTherm (thermostates) Heat Meters measure actual Supply and Return Temperature (K), total Volume (m3) and Energy transferred (GJ), actual flow (m3). Heat Meters report health indicators. Meters retain history. Meters can publish error codes to indicate distress Meters connect to pipes and use sensors to measure physical properties
- 24. Classificatie: vertrouwelijk Communication Module and Communication Network Cloud IoT Platform for Energy Transition - DigitalXchange 2020 HEAT Smart Meter Smart Meter Communication Module Ingest, Authenticate & Check Devices Actuator Communication Module is edge device with firmware for on- device processing, SIM card that sends scheduled data reports over “Mobile” Communication channels (GPRS/3G/4G/LTE- M/LoRA) using protocols such as HTTP(S), MQTT and in data formats such as JSON, CSV, (XML,), custom, binary. CM can also receive instructions from device management systems. Communication Module reads values from the meter registers – through industry standard protocols like M-Bus and OpenTherm. Communication Module can read actual and historic values (from Meter memory). CM connects to meters through wires or wireless Communication Module can send instructions to local actuators, for example to set a valve to a specific position
- 25. Classificatie: vertrouwelijk Ingest Cloud IoT Platform for Energy Transition - DigitalXchange 2020 Communication Module Telemetry Ingest, Authenticate & Check Validate, Enrich Process, Convert, Publish Devices Monitoring ator Only messages from known, provisioned, authenticated devices should be received and processed. The message should satisfy basic requirements (e.g. digital signature, valid JSON). Messages can arrive in high volumes. Initial processing is light weight, messages are quickly saved to queue for further, off-loaded processing
- 26. Classificatie: vertrouwelijk Process, Persist and Publish Cloud IoT Platform for Energy Transition - DigitalXchange 2020 API Telemetry Ingest, Authenticate & Check Devices Monitoring Event Streaming Platform Validate, Enrich Process, Convert, Publish All business relevant telemetry messages are published to an Event Platform in canonical enterprise format. This platform is the corporate data exchange, high volume, fully decoupled. Billing/invoicing, capacity planning, data science, customer app are all subscribed to the platform. Telemetry data is stored in a Time Series database, allowing for very rapid (append only) recording of timestamped data, quick time- based aggregations and analysis and period- based data consolidation and data pruning, Telemetry data can be retrieved through REST APIs – per device, per day (primarily for monthly bill) Telemetry messages from various types of meters and communication modules are deduplicated, converted into standard units and canonical value labels. Administrative connection details are added to the published messages
- 27. Classificatie: vertrouwelijk Monitor & Operate Cloud IoT Platform for Energy Transition - DigitalXchange 2020 Communication Module API Telemetry Ingest, Authenticate & Check Validate, Enrich Process, Convert, Publish Devices Monitoring Provision Provisioning is a time-consuming, hard-to- scale, manual process: hooking up a new Communication Module to the enterprise backend, connecting it to smart meters, configuring the measuring & reporting regime The health of smart meters, communication modules and communication networks need to be monitored in real-time – and in case of deviations of expected & desired behavior, alerts should trigger correcting actions. Note: this monitoring is not about the business meaning of telemetry.
- 28. Classificatie: vertrouwelijk So far the What. Next is: How? Cloud IoT Platform for Energy Transition - DigitalXchange 2020 HEAT Smart Meter Smart Meter Communication Module API Event Streaming Platform Telemetry Ingest, Authenticate & Check Validate, Enrich Process, Convert, Publish Devices Monitoring Actuator
- 29. Classificatie: vertrouwelijk Architecture Principles & Choices • On Azure • Native PaaS much preferred over IaaS • On top of 3rd party managed Cloud Infra Landing Zone (Network, VMs, Storage, Accounts) • Key theme: decoupled • Logically (design time) – insulated against changes • Physically (run time) – insulated regarding availability, throughput and physical resource usage compartimentalized • Run time Azure decoupling mechanisms of choice: • Event Grid (operations), Queue (events), Database (data), Serverless, Service Plan (physical resource usage) • Automation • Auto-provisioning of CM, Infrastructure as Code, Continuous Delivery, Regression & Smoke Tests, Dynamic Scalability (rule based scale up and scale out), Alerts & Notifications Cloud IoT Platform for Energy Transition - DigitalXchange 2020 Microsoft Azure
- 30. Classificatie: vertrouwelijk Ingest Cloud IoT Platform for Energy Transition - DigitalXchange 2020 Communication Module Provision Devices & Communicate http/csv (VPN) mqtt/json (3G, open internet) Microsoft Azure Device & Grid metadata IoT Hub Device Provisioning Service
- 31. Classificatie: vertrouwelijk Ingest Cloud IoT Platform for Energy Transition - DigitalXchange 2020 Communication Module Ingest, Authenticate & Check http/csv (VPN) mqtt/json (open internet) Microsoft Azure Device & Grid metadata IoT Hub Device Provisioning Service Function Telemetry Data Explorer
- 32. Classificatie: vertrouwelijk Cloud IoT Platform for Energy Transition - DigitalXchange 2020 Device & Grid metadata IoT Hub Database for PostgreSQL Microsoft Azure API Event Streaming Platform APGIGEE Telemetry Device Provisioning Service Event Grid Function Data Explorer Snowflake Publish & Expose
- 33. Classificatie: vertrouwelijk Cloud IoT Platform for Energy Transition - DigitalXchange 2020 Device & Grid metadata IoT Hub Database for PostgreSQL Microsoft Azure API Event Streaming Platform APGIGEE Telemetry Event Hub Device Provisioning Service Event Grid Function Data Explorer Snowflake Stream Analytics Analyze, Monitor, Anomaly Detection, Alert
- 34. Classificatie: vertrouwelijk IoT Use Cases – keep popping up • For Eneco the ability to connect Enterprise IT to the Operational domain (production & distribution) as well as to Customer sites is very valuable Titel van de presentatie 37
- 35. Classificatie: vertrouwelijk Learn about failing connections in the home Titel van de presentatie 38 Microsoft Azure
- 36. Classificatie: vertrouwelijk Learn about failing connections in the home Titel van de presentatie 39 Microsoft Azure
- 38. Classificatie: vertrouwelijk Accumulator Thermal District heating Homes Offices Distribution Grid Consumers Generation Customer Service Field agent Maintenance 1x per year
- 39. Classificatie: vertrouwelijk Accumulator Thermal District heating Homes Offices Distribution Grid Consumers Generation Customer Service Field agent Maintenance
- 40. Classificatie: vertrouwelijk Accumulator Thermal District heating Homes Offices Distribution Grid Consumers Generation Customer Service Field agent Maintenance every 15 mins. Charging stations Central heating Home appliances Solar panels Smart thermostat
- 41. Classificatie: vertrouwelijk Accumulator Thermal District heating Homes Offices Distribution Grid Consumers Generation Customer Service Field agent Maintenance every 15 mins. Charging stations Central heating Home appliances Solar panels Smart thermostat
- 42. Classificatie: vertrouwelijk Accumulator Thermal District heating Homes Distribution Grid Consumers Generation Customer Service Field agent Maintenance Offices
- 43. Classificatie: vertrouwelijk Accumulator Thermal District heating Homes Distribution Grid Consumers Generation Customer Service Field agent Maintenance Offices Data Scientist Building characteristics Consumption predictions Predictive maintenance
- 44. Classificatie: vertrouwelijk Accumulator Thermal District heating Homes Distribution Grid Consumers & prosumers Generation Network operation center Distribution Field agent Maintenance Distribution Customer Service Data Scientist Network balancing Dispersed energy production Production steering Wind Solar Network operation center Generation Field agent Maintenance Housing Field agent Maintenance Generation End-to-End network monitoring Preventive maintenance Legionella prevention Load shifting Infinite possibilities Building characteristics Consumption predictions Predictive maintenance District heating Electric vehicles Homes Offices Charging stations Central heating Home appliances Solar panels Smart thermostat Virtual Power Plant IoT
- 45. Classificatie: vertrouwelijk Broader IoT Platform objectives/ Next Steps • Single point of entry for all operational data • Solar Farms • Windmills • Central Heating (gas powered) • EV charging • Local production / trade/ consumption • Active, Real-Time Operations (two-way data stream) • Act • Pro-act Cloud IoT Platform for Energy Transition - DigitalXchange 2020
- 46. Classificatie: vertrouwelijk Conclusion • IoT is [a special case of] data integration • Communicate, collect, process, persist, publish • Fast, High Volume, Real Time • Many parties to interact with • IoT brings physical world of real things close to enterprise IT • Automation is a lot of work – and is worth it • Speed, repeatability, ability for agility, fewer errors, reduced effort, less reliance on key resources • Anything local (edge side), physical or manual is expensive and hard to change and to scale up • Azure is a pretty nice environment to work and run in • especially the ability to rapidly ramp up, explore, scale and let go off – and not have to manage infrastructure details • Once you have an IoT Platform – the number of use cases may grow rapidly Cloud IoT Platform for Energy Transition - DigitalXchange 2020
- 47. Classificatie: vertrouwelijk The End Cloud IoT Platform for Energy Transition - DigitalXchange 2020 [email protected] | technology.amis.nl | @lucasjellema | lucas-jellema
Editor's Notes
- #5: Gridlock on the Power Grid
- #12: geluid trilling beeld pH CO2 concentratie vochtigheid temperatuur locatie snelheid versnelling rpm debiet gewicht kleur maar niet: geur, smaak, sfeer,
- #15: geluid trilling beeld pH CO2 concentratie vochtigheid temperatuur locatie snelheid versnelling rpm debiet gewicht kleur maar niet: geur, smaak, sfeer,
- #16: actie: curtailment start bemaling bedien klep
- #17: actie: curtailment start bemaling bedien klep