Matteo Murgida - Monet: a NodeJS enterprise system for IoT and Energy Management
3 likes783 views
Monet is a cloud-based enterprise system developed for IoT and energy management, designed to monitor and optimize energy flows in various infrastructures like smart grids and cities. Built on Node.js, it employs a micro-services architecture that facilitates real-time data handling and efficient resource management through services exposed via a REST API. The architecture incorporates several components, including a dispatcher and gateways for acquiring data from field devices, along with tools for deployment and runtime management.
Matteo Murgida - Monet: a NodeJS enterprise system for IoT and Energy Management
- 1. MILAN 21.11.2015 Monet: a NodeJS enterprise system for IoT and Energy Management MATTEO MURGIDA - SIEMENS SPA
- 2. MILAN 21.11.2015 - MATTEO MURGIDA Table of contents • What is Monet? • Technology: why node? • High Level Architecture • Micro-services Architecture • Cloud Architecture • Façade • Dispatcher • MQTT & Gateway • Leveraging The Cloud • Deployment and Runtime Tools • Future Improvements
- 3. MILAN 21.11.2015 - MATTEO MURGIDA What is Monet? (1/2) Monet, Smart Grid Energy Management Cockpit Monet is a Cloud platform providing set of services for Energy Monitoring and Energy Management following the Software as a Service model. It is a solution for monitoring, controlling, and optimizing energy flows inside a specific site or location being a Smart Grid, a Micro Grid, a Smart City or part of it.
- 4. MILAN 21.11.2015 - MATTEO MURGIDA What is Monet? (2/2) Smart Metering Systems Monet – Energy Management System Building Automation Systems Energy Monitoring / Energy Reporting Energy Efficiency / Demand Response Distribution Network SCADA Systems Site/Plant SCADA Systems Other Smart City Systems (electric vehicle infrastructure, public lighting, …) Home / IOT Devices Energy Profiling / Generation Forecast
- 5. MILAN 21.11.2015 - MATTEO MURGIDA Demo Time Demo Time
- 6. MILAN 21.11.2015 - MATTEO MURGIDA Why NodeJS? “Node.js is a platform built on Chrome's JavaScript runtime for easily building fast, scalable network applications. Node.js uses an event-driven, non- blocking I/O model that makes it lightweight and efficient, perfect for data- intensive real-time applications that run across distributed devices.”
- 7. MILAN 21.11.2015 - MATTEO MURGIDA Table of contents • What is Monet? • Technology: why node? • High Level Architecture • Micro-services Architecture • Cloud Architecture • Façade • Dispatcher • MQTT & Gateway • Leveraging The Cloud • Deployment and Runtime Tools • Future Improvements
- 8. Monet middleware BUS PremiseCloud M2M WebApp Field Monet Operation CenterNODE.JS EXPRESS MONGO DB REST Interface (Http/Https) HTML5 / CSS / Javascript Sencha ExtJS MQTT Monet OC Mobile HTML5 / CSS / Javascript Sencha Touch / Apache Cordova CORE Package Energy Reporting Package Gen. Forecast Package Gateway 60870-5-104 Gateway 62056-21 Gateway 61850 Gateway Modbus Gateway Archilede Gateway EMM Gateway STM Gateway Desigo Green Button Active Demand Package Gateway Smart Info MILAN 21.11.2015 - MATTEO MURGIDA High Level Architecture
- 9. • Monet follows the Micro-Service Architecture pattern • It has a service for each functionality package that expose a REST API • It has jobs to perform background tasks and complex calculations • Services communicate via the Dispatcher module and the Service Bus. MILAN 21.11.2015 - MATTEO MURGIDA Micro Services Architecture (1/2)
- 10. MILAN 21.11.2015 - MATTEO MURGIDA Micro Services Architecture (2/2) Monet Business Logic Tier BUS M2M MQTT MQTT Feeds Broker MONGO DB Monet Presentation Tier Energy Reporting Services Things Service Trends Service Gen. Forecast Services Energy Service Energy Job REST REST CORE Services Facade REST Trends Job Graphics Service Assets ServiceNotifier Events Service Dashboards Sites Service Authentication Users Stakeholders Triggers Job Forecast Service Dashboard(s) Things Management Assets Management Energy Management Reporting Active DemandTicketingAdministration Customers Ticketing Active Demand Services REST Active Demand Service Active Demand Job Energy Rules Service
- 11. MILAN 21.11.2015 - MATTEO MURGIDA Cloud Architecture (1/2)
- 12. MILAN 21.11.2015 - MATTEO MURGIDA Cloud Architecture (2/2)
- 13. MILAN 21.11.2015 - MATTEO MURGIDA Table of contents • What is Monet? • Technology: why node? • High Level Architecture • Micro-services Architecture • Cloud Architecture • Façade • Dispatcher • MQTT & Gateway • Leveraging The Cloud • Deployment and Runtime Tools • Future Improvements
- 14. MILAN 21.11.2015 - MATTEO MURGIDA Facade
- 15. MILAN 21.11.2015 - MATTEO MURGIDA Dispatcher
- 16. The EMS System via its M2M component is able to acquire data directly from field devices. Sometimes this is not possible or it is not convenient for several reasons: § devices own protocol is not “Internet of Things ready” § communication infrastructure § security In these scenarios the EMS Gateway is able to collect data from devices and to send them to the EMS-M2M in an optimized and secure way. MILAN 21.11.2015 - MATTEO MURGIDA Gateway (1/3)
- 17. MILAN 21.11.2015 - MATTEO MURGIDA Gateway (2/3) Mosca is used as MQTT broker. It is a powerful nodejs module that can be used standalone or can be run inside a custom nodejs module.
- 18. MILAN 21.11.2015 - MATTEO MURGIDA Gateway (3/3) § Gateway Configuration and Subscriptions flow: § The gateway has the basic info to connect to the MQTT Broker § It subscribes to the topic gw/gatewayMqttClientId/dr/+/conf § It subscribes to the topic dr/driverId/de/+/conf mqttbroker
- 19. MILAN 21.11.2015 - MATTEO MURGIDA Table of contents • What is Monet? • Technology: why node? • High Level Architecture • Micro-services Architecture • Cloud Architecture • Façade • Dispatcher • MQTT & Gateway • Leveraging The Cloud • Deployment and Runtime Tools • Future Improvements
- 20. MILAN 21.11.2015 - MATTEO MURGIDA Leveraging the Cloud
- 21. MILAN 21.11.2015 - MATTEO MURGIDA Communication Strategies Service A.1 Service A.2 Service B.1 Service B.2 Req 1 Req 1 Req … Res 1 Res 1Res 1
- 22. § Monet is composed by several nodejs modules that are deployed as subfolders in the main “backend” module. § Each module has its own conf file, that can be overridden by a common global conf file § A “core” module colled Overlord reads the main configuration files and acts as process / logging manager § Moving towards a more flexible and structured approach via npm private repository MILAN 21.11.2015 - MATTEO MURGIDA Deployment
- 23. § Forever is a process monitor: it starts and watchdogs the desired nodejs processes § Bunyan is a json logging tool implementing a lot of different transports MILAN 21.11.2015 - MATTEO MURGIDA Runtime Tools
- 24. MILAN 21.11.2015 - MATTEO MURGIDA The importance of using npm shrinkwrap § npm shrinkwrap command locks down the versions of a package's dependencies so that you can control exactly which versions of each dependency will be used when your package is installed. § Wildcards are commonly used when specifying dependencies in package.json. These are very handy but can be very harmful when you have to deploy your stuff in production environments § This is the only way you have to be sure to deploy the same thing every time you do an npm install § You can always check for outdated dependencies using npm outdated
- 25. § First of all: we must go towards having a repo per submodule, and a npm package for each submodule using a private NPM repository. A good choice should be sinopia. § Use git § Dockerize all this stuff § Use a cluster / processes manager like pm2 to manage all the different subprocesse, resources and logging MILAN 21.11.2015 - MATTEO MURGIDA Future Improvements
- 26. MILAN 21.11.2015 - MATTEO MURGIDA nodeschool http://nodeschool.io/ https://github.com/nodeschool/italy/issues http://nodeschool.io/italy
- 27. MILAN 21.11.2015 Matteo Murgida SIEMENS SPA @teomurgi Thank You
- 28. MILAN 21.11.2015 - MATTEO MURGIDA Leave your feedback on Joind.in! https://m.joind.in/event/codemotion-milan-2015