twMVC#42 Azure IoT Hub for Smart Factory
0 likes•225 views
本文件介绍了 Azure IoT Hub 的功能和架构，强调了在智能制造中的应用及面临的挑战。文档还讨论了数据处理、格式问题和设备管理的最佳实践。此外，提出了优化和安全性建议，以及IoT设备与云服务之间的通信策略。
twMVC#42 Azure IoT Hub for Smart Factory
- 1. https://mvc.tw 歡迎參加我們的每週四固定聚會 1 Azure IoT Hub for Smart Factory 講者：Carl Yang
- 2. https://mvc.tw Challenges ▪ 多樣化的資料來源 ▪ 不一致的資料格式 ▪ 網路通訊的難易度 ▪ 龐大的資料量 2
- 4. https://mvc.tw Scale ▪ Free: ▪ Only 1 per subscription ▪ Basic: ▪ Device-to-cloud ▪ Standard: ▪ Cloud-to-device ▪ IoT Edge ▪ Device Management (Ref: https://docs.microsoft.com/en-us/azure/iot-hub/iot-hub-scaling)
- 5. https://mvc.tw IoT Hub vs Event Hub (Ref: https://docs.microsoft.com/en-us/azure/iot-hub/iot-hub-compare-event-hubs)
- 6. https://mvc.tw Telemetry ▪ Cache: 1~7 days ▪ Unified format ▪ Unstructured ▪ Data Centralizing ▪ 相同事件、相同時間 6
- 7. https://mvc.tw Consumer Group ▪ Pulling data ▪ Max. 20 consumer groups per IoT Hub ▪ 5 concurrent readers per group
- 8. https://mvc.tw File Upload ▪ Only Support Storage Container ▪ Save data to blob files ▪ Block Blob Only • 10 concurrent keys in queue • 同時10台裝置上傳，超過就會失敗
- 9. https://mvc.tw Query Explorer ▪ Only in Standard Tier ▪ Device Twins/Jobs information ▪ Help to manage devices
- 10. https://mvc.tw SDKs for Client ▪ C: https://github.com/Azure/azure-iot-sdk-c ▪ Python: https://github.com/Azure/azure-iot-sdk-python ▪ Node.js: https://github.com/Azure/azure-iot-sdk-node ▪ Java: https://github.com/Azure/azure-iot-sdk-java ▪ .NET C#: https://github.com/Azure/azure-iot-sdk-csharp
- 12. https://mvc.tw ▪ Data Flow ▪ Monitor ▪ Authentication 12
- 22. https://mvc.tw Sources ▪ Various: ▪ Bar Code Scanner: ▪ Device Support ▪ Weak Integration ▪ OCR: ▪ Visual Identification Machine ▪ Machine Logs: ▪ Native Machine Software Support ▪ Stable
- 24. https://mvc.tw Various Data Structures ▪ Various Data Schema: ▪ Keep useful data ▪ Re-organize structure ▪ Merge/Divide Values ▪ Use CSV for exchanging
- 25. https://mvc.tw Format ▪Not consistent: ▪ 欄位分隔符號不一致: 先replace、再Divide ▪Abnormal Values: ▪ 多個數值: 只留真正的資料 ▪Value Type: ▪ Read with STRING type first
- 26. https://mvc.tw Format ▪Multiple columns: ▪Use the column name closed to value ▪Hierarchy: ▪Set with real data hierarchy
- 27. https://mvc.tw Format ▪Extra Information: ▪Remove it ▪Use it on-premises
- 28. https://mvc.tw Format ▪Column in value: ▪Manually Input ▪Confirm with user ▪Parse Value
- 29. https://mvc.tw Frequency ▪Scenario: 1. File Rename: ▪Ex. Test.csv -> Test.tmp 2. Append data per 1s 3. File Rename: ▪Ex. Test.tmp –> Test.csv
- 30. https://mvc.tw File Lock/Missing • Create/Update: • Sol: • Copying file first • Delete/Rename • Sol: Filtering by full name (ex. *.csv) then copying • Sol: Filter by modify time •Hint: 不要跟機台比速度!
- 31. https://mvc.tw 優化 If it can be … else … Optimization: • Create/Update: • Create file instead of update, even if only one record • Delete/ Rename : • Not allowed
- 32. https://mvc.tw Read Local File • Network latency • Data Size • Divide & Conquer • 單一檔太大，分開寫檔/讀檔。 • Read/Write Frequency • 讀寫檔案速度一定是本地 端最快、最穩。 • 提升Host的I/O效能。
- 34. https://mvc.tw Principals for IoT Hub ▪ 256 KB per message ▪ Make data size closed to 256 KB in each request ▪ 4 KB per unit ▪ Reduce data size as possible, ex. u0022 256 KB 256 KB 128 KB IoT Hub 1 2 3
- 35. https://mvc.tw Memory Queue 256 KB 256 KB 128 KB IoT Hub Latency Time Series
- 37. https://mvc.tw IoT Edge ▪ 最接近資料來源的機器 ▪ 分散式計算 ▪ 獨立運算能力 ▪ 網路通訊能力
- 38. https://mvc.tw IoT Devices or Edge? ▪ 政策 ▪ 遠端裝置管理 ▪ 雙向通訊 ▪ Device Client作業環境 ▪ Device Client的網路環境
- 39. https://mvc.tw 政策 ▪ 資料安全性 ▪ 作業系統 ▪ Win 10 1809+ & IoT Edge Runtime & Docker ▪ 設備 ▪ 效能: 運算能力、I/O、Storage ▪ 通訊
- 40. https://mvc.tw 遠端裝置管理 ▪ 軟體更新、大量部署 ▪ IoT Edge ▪ Application Insights Module ▪ 外部通訊 ▪路由 ▪ 模組間的通訊方式 ▪ Telemetry ▪ 資料存取
- 41. https://mvc.tw 雙向通訊 ▪Device to cloud ▪Telemetry遙測資料 ▪Cloud to device ▪Notification ▪Modules Update
- 42. https://mvc.tw Device Client作業環境 ▪Windows/Linux ▪Embedded System ▪Mobile Device(Android/iOS)
- 43. https://mvc.tw Device Client的網路環境 ▪通訊協定 ▪https、AMQP、MQTT…etc ▪Firewall/Proxy ▪ 網路通訊 ▪ 頻寬(ex. 只允許100/10 MB夠不夠用?)
- 44. https://mvc.tw Win Services or Container? ▪ Docker ▪ Memory Process，注意使用量。 ▪ Windows環境下，盡可能不使用大量的I/O處理。 ▪ Windows Services ▪ 管理不易 ▪ Debug資訊不充足 ▪ 系統整合性佳
- 46. https://mvc.tw Basic or Standard tier? (Ref:https://azure.microsoft.com/zh-tw/pricing/details/iot-hub/)
- 47. https://mvc.tw Azure IoT Hub Quota ▪ Charge Unit: 4KB ▪ Batch Daily Volume: ▪ Type1: 0.18 KB x 60s x 60m x 24H x 12 Lines = 186,624 KB ▪ Type2: 0.98 KB x 60/10s x 60m x 24H x 12 Lines = 101,606 KB ▪ Total: 288,230 / 4 KB = 72,057 Units ▪ Real-time Daily Count: ▪ Type1: 60s x 60m x 24H x 12 Lines = 1,036,800 records ▪ Type2: 60/10s x 60m x 24H x 12 Lines = 1,036,80 records ▪ Total: 1,036,800 + 1,036,80 = 1,140,480 Units
- 50. https://mvc.tw ▪ Contact: ▪ [email protected] ▪ PPT: ▪ https://github.com/carlyang920/twMVC2021-42.git