The MRAA and UPM Eclipse IoT Projects | Eclipse IoT Day Santa Clara 2019
1 like•425 views
The document discusses the MRAA and UPM projects, highlighting their roles in providing standardized APIs for IoT sensor management and easy integration with various hardware platforms. It details contributions from various organizations and outlines future development plans for enhancing IoT frameworks, including support for new device types and compliance with industrial standards. Additionally, it emphasizes the importance of continuous integration and testing to ensure software effectiveness in IoT applications.
![Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
8
Outreach & Adoption
Example MRAA Contributions
(code, bugfixes & samples)
• Arduino
• Siemens
• Linaro (ARM)
• Apple
• SAP, Amazon, Microsoft
Example Developer Kits with
MRAA/UPM Support
• IoT Developer Kits (with Cloud
Service partners)
• RFP Kits
• IoT reference OSs – WR Linux
and ClearLinux
Sample external usage:
• Cylon.js
• Johnny-Five
• Linaro/96 Boards Community
• Mediatek Linkit Smart
• Android Things
• STMicro
• Phytec
• ICS
• Ublox
• Technexion
• Qualcomm
• GE
• Honeywell
• Siemens
• Omron
MRAA/UPM >2K avg. clones per month
MRAA/UPM ~20K avg. monthly visitors
IoT Dev Kit >25K avg. monthly visitors
Siemens
“[…] ‘mraa’ core works flawlessly on the current generation
IoT2020”
Android Things
“I really like how so much ‘just works’ with mraa and upm”
Linaro
“Well, the first thing I like about this library (mraa) is its ability
to support many peripherals […]”](https://image.slidesharecdn.com/mraa-upmeclipseiotday19-v1-190516175227/85/The-MRAA-and-UPM-Eclipse-IoT-Projects-Eclipse-IoT-Day-Santa-Clara-2019-8-320.jpg)
The MRAA and UPM Eclipse IoT Projects | Eclipse IoT Day Santa Clara 2019
- 1. Tudor Panu IoT Software Architect May 2019
- 2. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 2 Agenda • Introduction • The MRAA and UPM Projects • Deep Dive: Value Proposition, Infrastructure, Outreach Examples and more • The Big Picture: Integrating the Tools Within the IoT Ecosystem • Industrial Standards and Interoperability • Future Plans
- 3. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 3 Why Sensor Framework? Without Sensor Framework Setup pinmuxes (~200 lines of code) Interact with sensor With Sensor Framework (~5 lines of code) Set Tristate to 0 Set GPIO14 to input Set GPIO165 to input Set GPIO236 to output & disable Set GPIO237 to output & disable Set GPIO212 to input Set GPIO213 to input Change pinmode for pin 28 Change pinmode for pin 27 Set Tristate to 1 Example: reading data from a typical I2C sensor Call read function Call sensor constructor Define smbus data structs Fill in values ioctl write configure sensor Allocate read buffer ioctl read • MRAA handles pinmuxing and memory allocations • UPM provides default configuration and enables sensor • Easy code portability to any MRAA supported platform
- 4. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice • Standard IO Interface for all IoT Developer Kits • Supports Intel & non-Intel (community) platforms • Abstraction APIs: • Open source on GitHub: http://mraa.io 4 Eclipse MRAA - Hardware Abstraction • GPIO • Analog (AIO) • PWM • SPI • I2C • UART • 1-Wire • Firmata • IIO • LED APIs Typical stack on UNIX systems: Intel® IoT Entry, Workstations and Servers Aaeon* UP & UP2 UP Core Plus and AI Plus Kits
- 5. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice Linux Kernel MRAA C/C++ APIs 5 ActuatorsSensors UPM C++ Standardized APIs iLight iPressure iHumidity iGas iGPS iAngle GPIO I2C SPI UART PWM Eclipse UPM - Standardized Sensor APIs Connectivity Industrial ADC iio Libmodbus Bacnet Other… … tinyb
- 6. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 6 400+ specialized sensor drivers and growing, thousands of basic prototyping and industrial sensors supported (e.g. LEDs, Switches) • Prototype* • Industrial* • Connectivity* Value Proposition
- 7. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 7 Distribution Channels • Integrated with native package managers Ecosystem & Distribution Multiple OS support* Multiple language support* IDE Integrations
- 8. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 8 Outreach & Adoption Example MRAA Contributions (code, bugfixes & samples) • Arduino • Siemens • Linaro (ARM) • Apple • SAP, Amazon, Microsoft Example Developer Kits with MRAA/UPM Support • IoT Developer Kits (with Cloud Service partners) • RFP Kits • IoT reference OSs – WR Linux and ClearLinux Sample external usage: • Cylon.js • Johnny-Five • Linaro/96 Boards Community • Mediatek Linkit Smart • Android Things • STMicro • Phytec • ICS • Ublox • Technexion • Qualcomm • GE • Honeywell • Siemens • Omron MRAA/UPM >2K avg. clones per month MRAA/UPM ~20K avg. monthly visitors IoT Dev Kit >25K avg. monthly visitors Siemens “[…] ‘mraa’ core works flawlessly on the current generation IoT2020” Android Things “I really like how so much ‘just works’ with mraa and upm” Linaro “Well, the first thing I like about this library (mraa) is its ability to support many peripherals […]”
- 9. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 9 Authorship Pick the FPGA class matching requirements Eclipse MRAA and UPM copyright ownership 74% 8% 6% 2% 2% 2%1%1%1%1%1%1% Total Intel Corporation Alex Tereschenko Linaro Ltd Emutex Ltd Phytec Messtechnik GmbH Serge Vakulenko Linaro Limited The Regents of the University of California Jules Dourlens (jdourlens@gmailcom) TechNexion Ltd Colin O'Flynn Dallas Semiconductor Corporation 89% 2% 1%1%1%1%1%1%0%0%0%0%0%0%0%0%0%0%0%0%0%0%0% Total Intel Corporation Nordic Semiconductor ASA Phytec Messtechnik GmbH Rohm Semiconductor Daniel Mosquera Alex Tereschenko seeed technology inc Adafruit Industries Sergey Kiselev Bosch Sensortec GmbH SparkFun Electronics Jun Kato Steve Karg The Android Open Source Project Yannick Adam IFE-ENS-Lyon Mike McCauley Juan Jose Chong Kionix Inc Microsoft Corporation SEMTECH SA MRAA Project UPM Project
- 10. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 10 CI and Testing Infrastructure Pick the FPGA class matching requirements Both projects are setup for continuous integration as well as static code analysis and vulnerability scans. Builders available on DockerHub and as DockerFiles.
- 11. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 11 IDE Integration IDE integration allows you to easily discover sensors and import code snippets to quickly develop & prototype…
- 12. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 12 Sensor Catalog Template upm.mraa.io Discover and search the sensor library, with code snippets and sensor datasheets…
- 13. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 13 Standards drive real world products and solutions. Currently UPM supports OPC-UA using the open62541 library*. Examples provided for both Server & Client side implementations. Other standards considered*: Key takeaway: • Industry standards define data formats and protocols for compliant devices • UPM provides implementation to data values thus complements standards Standards Compliance
- 14. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice • Support for entry level generic serial/UART cameras • UPM VCAP module provides easy integration with libjpeg for capturing snapshots from Linux video devices • Keeps development centered around a single set of APIs when dealing with both sensors and cameras • Stills can be sent for processing to the CV pipeline (training or inference) • Vision Kits come preloaded with UPM • UPM provides complementary libraries: • Motor control (servo, stepper) • Distance measurement (lidar, sonar) • Motion detection (IR) • Light sensors 14 Eclipse UPM and OpenVINO™ Toolkit
- 15. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 15 Interacting with FPGA and Vision Accelerators • MRAA supports entry level FPGA development (Terasic DE-10 Nano) • Easy to learn and build experience with FPGA devices • Scale: Atom, Core or Xeon + FPGAs and/or VPUs platforms: • Altera FPGAs available as subplatforms from the MRAA library • Mix and match any MRAA x86 supported platform with Altera FPGA PCIe cards • Utilize FPGAs for traditional I/O expansion or sensor fusion • UP AI Core and Edge • Intel® Movidius™ Pick the FPGA class matching requirements
- 16. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 16 Proposed Future Development Under Eclipse Pick the FPGA class matching requirements Developer Tools Launched Q1’19 Q2’19 Q3’19 Q4’19 Q1’20 IP transfer to Eclipse Foundation IEI AIoT Developer Kits Support MRAA • Open Source on Github • I/O Library • Supports x86, ARM, MIPS, FPGA boards and dev kits (v2.0) Simple I/O Protocol Abstraction: • GPIO, AIO, PWM, SPI, I2C, UART, 1-Wire, Firmata • Portable between supported platforms • OSes: Linux, Android Things, Zephyr RTOS • Language support: C, C++, Java, JavaScript, Python APIs UPM • Open Source on Github • Standardized sensor library with high level APIs that make it easy to connect and use sensors and actuators in IOT solutions • Enables fast and easy transition from prototyping to commercial deployment Mock platform improvements for sensor virtualization Dev kit support for new IoT Platforms † (v1.7) UPM Libraries with 400+ specialized sensor drivers • HW agnostic across MRAA supported boards • Abstracts some industrial standards and protocols • OS support: Linux, Android Things, Zephyr RTOS • Language support: C, C++, Java, JavaScript, Python APIs Enhance I/O support on FPGA devices New I/O protocol support: I2S Dev kit support for new Client Platforms † 2.0 Release IP transfer to Eclipse Foundation Sensor Support via TinyB PLC support (libplctag, Siemens* IOT2020) Integration with EdgeX Foundry ProfiBus/ProfiNet EtherCAT UPM generic interface for actuators Enhance OPC-UA integration Dev kit support for new IoT Platforms † UPM generic interface for radios/modems † Provided by Intel based on HW availability
- 17. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 17 Pick the FPGA class matching requirements This virtual conference offers comprehensive resources and training to help developers sharpen their professional skills and deliver future-ready solutions. The last edition of the Intel Global IoT DevFest, held in June 2018, delivered 75 technical sessions and attracted 28,000+ developers across 90+ countries, garnering 182,000+ unique impressions. CHOOSE FROM 4 CONFERENCE TRACKS Accelerating Business Transformation with Computer Vision Enabling Workload Consolidation for High-Performance Industrial System Transforming Retail for Immersive and Personalized Experiences Emerging Tools and Technologies for Innovative Solutions IMPORTANT DATES & DEADLINES Last date to submit abstracts: May 17, 2019 Notification of session acceptance for speakers before: May 24, 2019 Conference dates: June 18-19, 2019 devfest.intel.com
- 18. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice Legal Disclaimer & Optimization Notice Optimization Notice Intel’s compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice. Notice revision #20110804 18 Benchmark results were obtained prior to implementation of recent software patches and firmware updates intended to address exploits referred to as "Spectre" and "Meltdown". Implementation of these updates may make these results inapplicable to your device or system. Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more complete information visit www.intel.com/benchmarks. INFORMATION IN THIS DOCUMENT IS PROVIDED “AS IS”. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO THIS INFORMATION INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. Copyright © 2018, Intel Corporation. All rights reserved. Intel, Xeon, Xeon Phi, Core, VTune, and the Intel logo are trademarks of Intel Corporation in the U.S. and other countries.
- 20. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 20 This component provides standardized, open sourced abstraction libraries and tools It consists of Sensor Libraries And Cloud Connectors Build Your Solution with the IoT Connection Tools The IoT connection tools are a collection of libraries essential to any IoT solution developer. Take advantage of tight integration with the IDE interface and project templates in Intel® System Studio. TinyBMRAA UPM Things Network Infrastructure DataCenter/Cloud EdgeCompute
- 21. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice We offer 2 projects aiming to create clean, modern and easy to use Bluetooth LE APIs. • TinyB - exposes the BLE GATT API for C++, Java and other languages, using BlueZ over D-Bus. • LittleB - exposes the BLE GATT API in pure C using BlueZ over SD-Bus. • Firmata – Subplatform I/O for MCUs. 21 More on IoT Connection Tools Serial BLE WiFi* MCU Espressif Arduino
- 22. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice Visualize Learn Build Optimize Deploy Scale 22 Bridging the gap to production • A comprehensive toolkit to develop and deploy CV solutions on Intel® platforms • Harness the performance of CV accelerators, quickly deploy CV algorithms with deep learning support, and add custom kernels Arduino Create • Cloud based development solution which streamlines prototyping of commercial based IoT solutions • Setup made easy with integrated Intel® based boards • Multiple Intel® optimized libraries available out of the box including the IoT connection tools • Great for getting started and creating proofs of concept but can easily go beyond • Simplifies application deployment and device management • Lacks advanced debugging and optimization features • High performance kit providing a clear path to production • Simple set up, pre-installed Ubuntu OS, expanded, and a means to incorporate complex, advanced libraries Intel® System Studio • Easy-to-use, comprehensive cross-platform tool suite • Includes debuggers, analyzers and optimization tools for IA • Speed system and IoT device application development, boost performance and power efficiency, and strengthen system reliability • Tight integration with the IoT connection tools and dedicated UI elements • Supports C/C++ and Java development for IoT solutions • Steeper learning curve Prototyping Minimize risk by resolving unknowns Commercial Deployment Maximize success by optimizing solution Project
- 23. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 23 Eclipse UPM and OpenVINO™ Toolkit Static Image OpenCV Process Input Frame FaceDetector FaceRecognizer Overlay Status Messages → Syslog Raw Video to FFMPEG Local Face DB UPM Selects Input UPM LED Control MQTT to Web Service • Basic example of using UPM sensor libraries to control the video pipeline in a Computer Vision application • Motion sensor turns off camera when nobody is in front of it
- 24. Copyright © 2018, Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. Optimization Notice 24 A Vision for the Future – AI and Sensor Fusion Pick the FPGA class matching requirements