SensorStudio introduction (IDC 2016)
1 like235 views
SensorStudio is a sensor platform that simplifies software and algorithm development for sensors. The agenda for the IDC SensorStudio track includes an introduction to SensorStudio and how it can help tackle challenges in the expanding IoT market. It will cover new SensorStudio features and development kits, provide a deep dive into the development environment, and showcase real use cases. Hands-on time with the SensorStudio development kits will be provided.
SensorStudio introduction (IDC 2016)
- 3. IDC - SensorStudio track - Agenda 1. Introduction – Herve Blanc – The Iot market expansion is calling for more flexibility. In this session, you can learn how SensorStudio will help you tackle the challenges ahead. Market trend, SensorStudio solution, and roadmap will be introduced. 2. New Features/Benefits – Sheena Shi, Maaz Qazi, Christopher Rumpf – We are listening to you and a lot of effort has been put into addressing your feedback. Come learn about SensorStudio new release features and new development kits. 3. Deep Dive – Herve Blanc – SensorStudio development environment will be detailed. You will learn how to add your sensor driver and create your algorithms, while benefiting from a complete sensor development framework. 4. Real Use cases – Andreas Brauchli, Herve Blanc – We will review how Sensirion partner integrated its new SHT3x humidity sensor in SensorStudio. – We will discuss how we have used SensorStudio to put together prototypes, pulled new algorithms and demos together in no time. 5. Hands on – Christopher Rumpf – In this session, you will be able to access the SensorStudio development kits, evaluate the software and ask questions to our developers. 3 InvenSense Inc. Company Confidential
- 4. Foreword • “And we’ve analyzed over 700 swimmers, different body types, different abilities. We hooked them up to state-of-the- art metabolic equipment. We’ve even drawn blood samples to look at lactic acid levels and we used all this body of information to create an algorithm that will give you the most accurate calorie burn information while you’re swimming. ” InvenSense Developers Conference 20164 Source http://www.apple.com/newsroom/2016/09/apple-introduces-apple-watch-series-2.html Source http://www.singjupost.com/apple-iphone-7-keynote-september-2016-launch-event-full-transcript/4/
- 5. Motto • SensorStudio, The sensor platform for the “Internet of Sensors”, Simplifies software & algorithm development and Accelerate your time to market 5 InvenSense Inc. Company Confidential
- 6. Why: Problem being solved SensorStudio is reducing Software Development cost/effort as: • Developers can get started with sensing project quickly without prior sensing knowledge • Developers can focus on combining sensors & algos • Developers don’t need to learn FreeRTOS configuration • Sensor framework handle data synchronization • Higher level of abstraction through visual programming • Gain data insight through real time scientific visualizations • Record & replay for a complete algo dev/validation cycle and paving the way to machine learning (e.g. TensorFlow) • Creates compelling PoCs & demos in no time (get funding!) • Customer final product works with SensorStudio too (all necessary source code is provided to support customization) 6
- 7. Overview 7 A E D C B A B C D E “Flows” In graphics format Drag and drop elements, traces, inputs and outputs “Pool” Collection of all building Blocks available for the flow design “Console” window for Debug messages “Flow” in list format (does not show connections and dependencies) “Properties” Parameters of each element in Flow InvenSense Inc. Company Confidential
- 8. Development Environment 8 • SensorStudio Software tool on PC • CortexM4 sensor framework loads as a primitive in SensorStudio. • Access to framework features and functions • Custom algo development capabilities in C. • Debug code with Eclipse • STm32 Nucleo - CortexM4 microcontroller • “bridge mode” (used as interface card between SensorStudio and sensor framework) • Load Final project from SensorStudio into Nucleo FLASH memory • Run algo in Nucleo and SensorStudio simultaneously -> iterative development • Debug code in Eclipse C/C++ (could be STm32 Cube) • InvenSense Shield with ICM-20690, Mag, Pressure, Proximity USB SPI SensorStudioSWNucleoHWICM-20690HW InvenSense Inc. Company Confidential
- 9. 9 GenericSensorHub on Nucleo Robust sensor framework Rapid implementation Optimized for low-power Extensible for any sensor Host AP / MCU agnostic SOC is managed through a race-free protocol InvenSense Inc. Company Confidential InvenSense Motion Algorithm Library Framework Engine Dynamic Protocol Developer Code (sensor drivers, algorithms) InvenSenseSensor Framework Sensor Drivers RTOS/ Scheduler + Power Mgmt Cortex M4 MCU I2C / SPI A G M P … Customer Application Task ICM-20690
- 10. Software Features • Sensor features supported on Cortex M4 MCU • All features accessible via API from host application processor • Feature running on Cortex M4 and power/code optimized – Motion • Calibrated Acc • Calibrated Gyro • Calibrated Mag • Linear Acceleration • Gravity – Orientation • Game Rotation Vector (AG-Orientation) • Rotation Vector (AGM-Orientation) • Orientation (AGM-orientation reported as yaw/pitch/roll angle) • Geomag Rotation Vector (AM-Orientation) – Gestures • SMD (Significant Motion Detector) • Pickup • Tilt – Activity Classification • Step Detector • Step Counter • Basic Activity Classifier (Still, Walk, Run, Biking) – Pressure – BMP280 – Proximity – VCNL4040 10 InvenSense Inc. Company Confidential
- 11. Visualize all signals Real-Time • Different visualizations types • InvenSense sensors & sensor fusion, your own! InvenSense Developers Conference 201611
- 12. Easily add sensors & algorithms • Don’t worry about RTOS • Data synchronization is taken care off • Focus on your new sensors or algorithms! InvenSense Developers Conference 201612
- 13. Configure, Build & Debug eMD • Gcc/linaro toolchain is preintegrated • Configure/build/flash are just button clicks • Eclipse IDE projects generated InvenSense Developers Conference 201613
- 14. Live demos • Rearrange desktop to showcase your ideas • Get your next round of funding InvenSense Developers Conference 201614
- 15. Migrating to a Full Prototype 15 A - Tested and validated project is integrated onto Nucleo via SensorStudio B - Create new Application code to include rest of the platform needs i.e . connectivity shield StudioSW SW Development Environment for GenericSensorHub ArduinoSW APP/HW product development Environment Simple and fast migration from Algo/SW development --> proto/product development InvenSense Inc. Company Confidential USB SPI NucleoHWICM-20690 USB SPI NucleoHWICM-20690
- 16. • SensorStudio can work with your final product too • “Dynamic Protocol” – code connect SensorStudio & GenericSensorHub – source code is available for you to modify if needed Working with your final Product USB SPI StudioSWArduinoHW CortexM4 Aux. Sensor #1 SPI I2C Aux. Sensor #N USB Final Product Architecture 16 InvenSense Inc. Company Confidential GSH
- 17. What’s new in 2.2? SW • Record and replay all sensor and algorithm signals – Repeatability is key to a converging iterative d • Add INVN sensor fusion & framework on Cortex M4 • C editor : – Syntax highlighting – search & replace, • User experience improvements – New Welcome Screen – Simplified operations (e.g. Device auto connect) – Tutorial • Packaging include eMD, docs • Still support FireFlytm Dev Kit (ICM-30670) InvenSense Developers Conference 201617
- 18. What’s new in 2.2? SW highlights InvenSense Developers Conference 201618 Welcome Screen Tutorial C Editor Record & Replay
- 19. What’s new in 2.2? ICM-20690 DK • Add support for ICM-20690 Development Kit – Nucleo-F411RE: Cortex M4 MCU • more processing power, FPU, more Flash, more RAM ! • On board ST-Link debug (~$300 cost saving for you!) – ICM-20690 6-axis (gyroscope & accelerometer) • small 2.5x3x0.91 mm (14-pin LGA) package InvenSense Developers Conference 201619
- 20. IoT Tech Hackathon InvenSense Developers Conference 201620
- 21. What’s new in 2.2? ICM-30670 DK • Still support FireFlytm ICM-30670 Development Kit – Still support Arduino Zero – ICM-30670 Added capabilities over ICM-30630: • 1kHz ODR • Using RAM loading to free up Flash InvenSense Developers Conference 201621
- 22. Where to get SensorStudio? • Download SensorStudio from Developers Corner – https://www.invensense.com/sensorstudio/ • Buy SensorStudio Development Kits today – from our Platinum Sponsor: CDI • Order SensorStudio Development Kits online – https://www.invensense.com/products/genericsensorhub- development-kit/ – https://www.invensense.com/products/motion-tracking/6-axis/firefly- development-kit/ InvenSense Developers Conference 201622
- 23. Conclusion • We listen & bring you most valuable sensing features • Simple and easy to use sensor development tool – Graphical interface – Custom sensor & algorithm support – Full debug and visualization • Support complete sensor hub on Cortex M4 – Power and code size optimized – Integrated Sensor Framework (GenericSensorHub) – Rich feature set with API command access • Support open hardware platform integration – Arduino/Nucleo developers community – Fastest path to prototype and full functionality product 23 InvenSense Inc. Company Confidential
- 24. Thank You
- 25. ICM-30670 Developt Environment 25 • SensorStudio Software tool on PC • Firefly sensor framework loads as a primitive in SensorStudio. • Access to framework features and functions • Custom algo development capabilities in C. • Debug code with Eclipse • Arduino Zero - Atmel SamD21 microcontroller • Arduino with sketch “bridge mode” (used as interface card between SensorStudio and Firefly) • InvenSense Shield with Firefly ICM-30630, Mag, Pressure, Proximity • Load Final project from SensorStudio into Firefly memory • Run algo in Firefly and SensorStudio simultaneously -> iterative development • Debug code in Eclipse C/C++ USB SPI SensorStudioSWArduinoHWICM-30630HW InvenSense Inc. Company Confidential
- 26. Migrating to a Full Prototype 26 A - Tested and validated project is integrated onto Firefly via SensorStudio B - Transfer “Arduino+Firefly shield” HW from SensorStudio to Arduino IDE environment C - Create new sketch to include rest of the platform needs i.e . connectivity shield USB SPI StudioSWArduinoHWICM-30630HW SW Development Environment for Firefly SOC USB SPI ArduinoSWArduinoHWICM-30630HW HW product development Environment Simple and fast migration from Algo/SW development --> proto/product development InvenSense Inc. Company Confidential
- 27. FireFly™ ICM-30670 Architecture • Hierarchical Tri-Core Processing – ARM M0: Open platform – DMP4: Algorithm Accelerator incl FFT Android L features offload • Integrated Accel & Gyro • I2C Port for additional sensors – Ie mag, pressure, proximity • Firefly SOC is a slave sensor hub device, running GenericSensorHub – needs to boot form external host MCU • Efficient Combo: DMP4+CortexM0 – Higher performance-power ratio than Cortex M4 including FPU • Available/Free resources* – Memory: ~32KB SRAM (incl FIFO) + ~32KB Flash – Compute: 64MHz ARM Cortex M0 + DMP4 Algorithm Acceleration InvenSense Inc. Company Confidential8
- 28. 28 GenericSensorHub in FireFlytm I2C / SPI A G M P … InvenSense Motion Algorithm Library Framework Engine Command Protocol Developer Code InvenSenseSensor Framework Sensor Drivers RTOS/ Schedul er + Power Mgmt FIFO Data FIFO Control APPS HAL DRIVER AP/MCU FireFlytmICM-30670AP/MCU Robust sensor framework Rapid implementation Optimized for low-power Extensible for any sensor Host AP / MCU agnostic Firefly SOC is managed through a FIFO protocol (no registers) Input (command) FIFO for communication No race conditions, Scalable Interface. InvenSense Inc. Company Confidential Bridge
- 29. Working with your final Product USB SPI StudioSWArduinoHW MCU Aux. Sensor #1 SPI I2C Aux. Sensor #N USB Bridge Final Product Architecture • SensorStudio can work with your final product too • “Bridge” code connect SensorStudio & FireFlytm ICM-30670 • “Bridge” source code is available for you to integrate – Download ICM30670-eMD_ArduinoZero – ICM30670-eMD_ArduinoZerosrcBridge 29 InvenSense Inc. Company Confidential