ApacheCon 2021: Cracking the nut with Apache Pulsar (FLiP)
1 like383 views
The document discusses the integration of edge AI solutions using Apache tools to process data from various devices in real time. It outlines a system architecture that utilizes Apache NiFi, Minifi, Pulsar, Flink, and MXNet for analytics and machine learning applications at the edge and in cloud environments. The document also highlights multiple upcoming talks related to Apache technologies and their applications in edge AI scenarios.
![Demo Walkthrough
{"entriesAddedCounter":1,"numberOfEntries":1,
"totalSize":651,"currentLedgerEntries":1,"curre
ntLedgerSize":651,"lastLedgerCreatedTimestam
p":"2021-09-13T16:13:06.6-04:00","waitingCurs
orsCount":0,"pendingAddEntriesCount":0,"lastC
onfirmedEntry":"7076:0","state":"LedgerOpene
d","ledgers":[{"ledgerId":7076,"entries":0,"size"
:0,"offloaded":false,"underReplicated":false}],"c
ursors":{},"schemaLedgers":[],"compactedLedge
r":{"ledgerId":-1,"entries":-1,"size":-1,"offloaded
":false,"underReplicated":false}}](https://image.slidesharecdn.com/apachecon2021-crackingthenutwithapachepulsarflip-210922181938/85/ApacheCon-2021-Cracking-the-nut-with-Apache-Pulsar-FLiP-24-320.jpg)
![NVIDIA JETSON WITH ENVIRONMENTAL SENSOR
key:[null], properties:[], content:{"ir": "258.0", "id":
"20210914142805_cfc3c4ef-6639-46cb-bb16-1fa7ee6424d9", "end": "1631629865.51", "uuid":
"nano_uuid_xmm_20210914142805", "lux": "0", "gputemp": "16.5", "cputemp": "16.5", "te": "179.529592991",
"systemtime": "09/14/2021 10:31:05", "hum": "63.9", "memory": 21.8, "gas": "29843.0", "pressure": "1015.63",
"host": "nano2gb-desktop", "diskusage": "32617.2 MB", "ipaddress": "192.168.1.217", "macaddress":
"1c:bf:ce:1a:7f:a0", "temp": "16.39", "uv": "0.02", "gputempf": "62.0", "host_name": "nano2gb-desktop",
"runtime": "180.0", "cpu": 0.0, "cputempf": "62.0"}](https://image.slidesharecdn.com/apachecon2021-crackingthenutwithapachepulsarflip-210922181938/85/ApacheCon-2021-Cracking-the-nut-with-Apache-Pulsar-FLiP-26-320.jpg)
ApacheCon 2021: Cracking the nut with Apache Pulsar (FLiP)
- 1. CRACKING THE NUT Timothy Spann & David Kjerrumgaard Developer Advocates / StreamNative Wednesday 22-Sept-2021
- 2. Cracking the Nut, Solving Edge AI
- 3. Agenda Wednesday 17:10 UTC Cracking the Nut, Solving Edge AI with Apache Tools and Frameworks Today, data is being generated from devices and containers living at the edge of networks, clouds and data centers. We need to run business logic, analytics and deep learning at the edge before we start our real-time streaming flows. Fortunately using the all Apache FLiP Stack we can do this with ease! Streaming AI Powered Analytics From the Edge to the Data Center is now a simple use case. With MiNiFi we can ingest the data, do data checks, cleansing, run machine learning and deep learning models and route our data in real-time to Apache NiFi and Apache Pulsar for further transformations and processing. Apache Flink will provide our advanced streaming capabilities fed real-time via Apache Kafka topics. Apache MXNet models will run both at the edge and in our data centers via Apache NiFi and MiNiFi. Our final data will be stored in various Apache datastores. Event-Driven Microservices in Apache Pulsar Functions. Tools: Apache Flink, Apache Pulsar, Apache NiFi, MiNiFi, Apache MXNet
- 4. My Other Talks & Apache Pulsar Talks ● Tuesday 17:10 UTC - Apache NIFi Deep Dive 300 by Tim Spann ● Tuesday 18:00 UTC - Apache Deep Learning 302 by Tim Spann ● Wednesday 15:00 UTC - Smart Transit: Real-Time Transit Information with FLiP by David Kjerrumgaard & Tim Spann ● Wednesday 15:50 UTC - Replicated Subscriptions: taking Apache Pulsar Geo-Replication to next level by Matteo Merli ● Wednesday 17:10 UTC - Cracking the Nut, Solving Edge AI... by David Kjerrumgaard & Tim Spann ● Wednesday 17:10 UTC - Exclusive Producer: Using Apache Pulsar to build distributed applications by Matteo Merli ● Thursday 14:10 UTC - Apache NiFi 101: Introduction and Best Practices - Tim Spann
- 5. Stay Connected With Us! https://github.com/david-streamlio David Kjerrumgaard Developer Advocate https://twitter.com/DavidKjerrumga1 https://github.com/tspannhw Tim Spann Developer Advocate https://twitter.com/paasDev https://www.linkedin.com/in/davidkj/ https://www.linkedin.com/in/timothyspann
- 7. Speaker Bio DZone Zone Leader and Big Data MVB; @PaasDev https://github.com/tspannhw https://www.datainmotion.dev/ https://github.com/tspannhw/SpeakerProfile https://dev.to/tspannhw https://sessionize.com/tspann/ https://www.slideshare.net/bunkertor Developer Advocate
- 8. streamnative.io StreamNative Solution Application Messaging Data Pipelines Real-time Contextual Analytics Tiered Storage APP Layer Computing Layer Storage Layer StreamNative Platform IaaS Layer Micro Service Notification Dashboard Risk Control Auditing Payment ETL
- 9. FLiP Stack ● Apache Flink ● Apache Pulsar ● StreamNative's Flink Connector for Pulsar ● Apache NiFi and more Apache projects are the way for all streaming use cases.
- 10. FLiP Stack for Cloud Data Engineers - Edge AI Multiple users, frameworks, languages, clouds, data sources & clusters CLOUD DATA ENGINEER • Experience in ETL/ELT • Coding skills in Python or Java • Knowledge of database query languages such as SQL • Experience with Streaming • Knowledge of Cloud Tools • Expert in ETL (Eating, Ties and Laziness) • Edge Camera Interaction • Typical User • No Coding Skills • Can use NiFi • Questions your cloud spend CAT AI / Deep Learning / ML / DS • Can run in Apache NiFi • Can run in Pulsar Functions • Can run in Apache Flink https://functionmesh.io/
- 11. Open Source Cloud Native Frameworks MQTT on Pulsar (MoP) Kafka on Pulsar (KoP)
- 12. Apache MXNet Native Processor through DJL.AI for Apache NiFi This processor uses the DJL.AI Java Interface https://github.com/tspannhw/nifi-djl-processor https://dev.to/tspannhw/easy-deep-learning-in-apache-nifi-with-djl-2d79
- 13. 13 What is Apache NiFi and MiNiFi used for?
- 14. A Unified Messaging Platform Message Queuing Data Streaming
- 18. Edge AI to Cloud Streaming Pipeline Device Data Sensors Energy Logs Weather Sensors Aggregates Energy SQL Analytics MiNiFi Agent Deep Learning Classification Edge Private Cloud Multi-Public Cloud
- 19. {"uuid": "rpi4_uuid_jfx_20200826203733", "amplitude100": 1.2, "amplitude500": 0.6, "amplitude1000": 0.3, "lownoise": 0.6, "midnoise": 0.2, "highnoise": 0.2, "amps": 0.3, "ipaddress": "192.168.1.76", "host": "rp4", "host_name": "rp4", "macaddress": "6e:37:12:08:63:e1", "systemtime": "08/26/2020 16:37:34", "endtime": "1598474254.75", "runtime": "28179.03", "starttime": "08/26/2020 08:47:54", "cpu": 48.3, "cpu_temp": "72.0", "diskusage": "40219.3 MB", "memory": 24.3, "id": "20200826203733_28ce9520-6832-4f80-b17d-f36c21fd8fc9", "temperature": "47.2", "adjtemp": "35.8", "adjtempf": "76.4", "temperaturef": "97.0", "pressure": 1010.0, "humidity": 8.3, "lux": 67.4, "proximity": 0, "oxidising": 77.9, "reducing": 184.6, "nh3": 144.7, "gasKO": "Oxidising: 77913.04 OhmsnReducing: 184625.00 OhmsnNH3: 144651.47 Ohms"} SHOW ME THE DATA
- 20. BME280 - temperature, pressure, humidity sensor LTR-559 - light and proximity sensor MICS6814 - analog gas sensor ADS1015 ADC MEMS - microphone 0.96-inch, 160 x 80 color LCD WHERE DID THAT DATA COME FROM?
- 21. MANY DEVICES
- 22. NVIDIA JETSON WITH ENVIRONMENTAL SENSOR
- 23. Using NVIDIA Jetson Devices With Pulsar https://dev.to/tspannhw/unboxing-the-most-amazing-edge-ai-device -part-1-of-3-nvidia-jetson-xavier-nx-595k https://github.com/tspannhw/minifi-xaviernx/ https://github.com/tspannhw/minifi-jetson-nano https://github.com/tspannhw/Flip-iot https://www.datainmotion.dev/2020/10/flank-streaming-edgeai-on-n ew-nvidia.html
- 25. NVIDIA JETSON WITH ENVIRONMENTAL SENSOR
- 26. NVIDIA JETSON WITH ENVIRONMENTAL SENSOR key:[null], properties:[], content:{"ir": "258.0", "id": "20210914142805_cfc3c4ef-6639-46cb-bb16-1fa7ee6424d9", "end": "1631629865.51", "uuid": "nano_uuid_xmm_20210914142805", "lux": "0", "gputemp": "16.5", "cputemp": "16.5", "te": "179.529592991", "systemtime": "09/14/2021 10:31:05", "hum": "63.9", "memory": 21.8, "gas": "29843.0", "pressure": "1015.63", "host": "nano2gb-desktop", "diskusage": "32617.2 MB", "ipaddress": "192.168.1.217", "macaddress": "1c:bf:ce:1a:7f:a0", "temp": "16.39", "uv": "0.02", "gputempf": "62.0", "host_name": "nano2gb-desktop", "runtime": "180.0", "cpu": 0.0, "cputempf": "62.0"}
- 27. Demo
- 28. DEMO SOURCE CODE ● https://github.com/tspannhw/minifi-xaviernx ● https://github.com/tspannhw/minifi-jetson-nano ● https://github.com/tspannhw/minifi-enviroplus ● https://github.com/tspannhw/EverythingApacheNiFi ● https://github.com/tspannhw/CloudDemo2021 ● https://www.datainmotion.dev/2019/07/powering-edge-ai-with-powerful-jetson.html ● https://www.datainmotion.dev/2021/07/upcoming-apache-pulsar-and-apache-flink.html
- 29. ● https://github.com/streamnative/pulsar-flink ● https://www.linkedin.com/pulse/2021-schedule-tim-spann/ ● https://github.com/tspannhw/SpeakerProfile/blob/main/2021/talks/20210729_HailHydrate!FromStreamto Lake_TimSpann.pdf ● https://streamnative.io/en/blog/release/2021-04-20-flink-sql-on-streamnative-cloud ● https://docs.streamnative.io/cloud/stable/compute/flink-sql ● https://dzone.com/articles/real-time-transit-feed-data-processing Deeper Content @PaasDev https://www.pulsardeveloper.com/ timothyspann
- 30. streamnative.io Pulsar Summit Europe October 6, 2021 Pulsar Summit Asia November 20-21, 2021 Contact us at [email protected] to become a sponsor or partner
- 31. streamnative.io
- 32. 32