Is big data dead?
1 like460 views
Hadoop enabled big data but the technology stack has become more complicated over time. Big data continues to drive artificial intelligence development. While big data is not dead, the paradigm is shifting again as technologies like IoT and edge computing generate enormous new data sources. This will require new approaches and platforms to integrate device data, perform analytics at the edge, and deploy trained machine learning models across different environments while ensuring data privacy and security.
Is big data dead?
- 1. Big Data is Dead? … it is Hadoop, isn’t ?! Alexander Alten-Lorenz, founder & managing director
- 2. About Me creative lateral thinker and futurist Nerd. Make things digital. Entrepreneur. founder @infinimesh, digitalgrid, @scalytics CTO scalytics, Inc., Executive President infinimesh, Inc., Managing Director digitalgrid UG Github: https://github.com/2pk03 LN: https://www.linkedin.com/in/alexanderalten/ Alexander Alten - Lorenz
- 3. Hadoop once made Big Data possible
- 4. How the Stack looks like today … complicated
- 5. Big Data - The driver for AI Big Data Is Dead Long Live Big Data
- 6. Is Big Data not enough?
- 7. IoT and connected devices will generate... *IDC, "Unlocking the Power of IoT Through Actionable Insights from Data Analytics, May 2018" 90ZB of IoT data* by 2025
- 8. Challenges and Opportunities Internet of Things - the dog food of AI Data Driven Society AI will drive our mankind
- 9. ● Regulated industries can’t participate (GDPR) ● Data Privacy / GDPR unclear ● Costly integrations, no simple to use platform present ● Europe depend on US / China dominance The problem to solve
- 10. Deploy trained & pre-compiled Models (facenet, gazenet models) Device data Aggregated data Build or bring your own model Trained ML model Data Build and train ML model in your Cloud Infinimesh IoT at edge, premise or cloud Operational data Open Source: infinimesh IoT as Data Integration Platform API driven Cloud-Native Solution
- 11. Big Data and Big Tech are the foundation for AI https://novarica.com/big-data-iot-and-ai-maturity-levels/
- 12. AI at Scale Need Big Tech - but not Hadoop https://towardsdatascience.com/life-after-hadoop-getting-data-science-to-work-for-your-business-c9ab6605733f
- 13. Conclusion Big Data ushers Cloud Technology Hadoop is top player at PT scale DWH Big Data is not dead, but the paradigm shifts again
- 14. Thank you! digitalgrid https://digitalgr.id we think beyond the box https://www.facebook.com/digitalgridEU/ https://www.linkedin.com/company/digitalgrid-eu