Data Process Systems, connecting everything
Download as PPTX, PDF0 likes766 views
This document summarizes Patrick de Vries' presentation on connecting everything at the Hadoop Summit 2016. The presentation discusses KPN's use of Hadoop to manage increasing data and network capacity needs. It outlines KPN's data flow process from source systems to Hadoop for processing and generating reports. The presentation also covers lessons learned in implementing Hadoop including having strong executive support, addressing cultural challenges around data ownership, and leveraging existing investments. Finally, it promotes joining a new TELCO Hadoop community for telecommunications providers to share use cases and lessons.
Data Process Systems, connecting everything
- 1. 1 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING, Hadoop Summit 2016 – “connecting everything” Version 07032016 Patrick de Vries Process systems Data
- 2. 2 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING, Intro kpn movie https://youtu.be/JHDobTF4_Dc
- 3. 3 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING, `x 1) Based on continuing operations. 4) Estimated avoided energy consumption by customers from the use of our ICT solutions compared with KPN own energy consumption. For more information, please see annual report
- 4. 4 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING, Presentor Patrick de Vries (42 years) is an OSS manager (Demand), IT architect with more than 8 years experience in the mobile networks. He has a passion for data management and processing. Maanplein 55| 2500 GC The Hague | The Netherlands Mobile: +31653102171 | E-mail: [email protected] https://nl.linkedin.com/in/patrick-de-vries-570a8469
- 5. 5 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING, Network 2000 2010 2012 2014 2016 2018 2020 GSM GPRSUM TS HSDPA LTE W IFI Publicfree LORA 5G M2M / data only Data The hunger for telecommunication capacity continues to grow. # IT systems TCO We are at the brink of the “Fourth Industrial Revolution”.
- 6. 6 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING,
- 7. 7 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING,
- 8. 8 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING,
- 9. 9 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING,
- 10. 10 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING,
- 11. 11 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING,
- 12. 12 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING, Counter ready at source E(T)L retrieve Counters Counter Ready at HDFSvia KNOX Move Data to Processing Folder Workbook Parsing XMLs Export ready in Target Data Structure KPI calculation Workbook Data flow OOZIE Reports with Raw Counters Aggregates and KPI in Target Data Structure with Hortonworks Data flow with current architecture Roadmap topics data flow • From ETL to ETL • From batch to streaming HAAS solution
- 13. 13 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING, Lessens learned What is your Corporate policy on use of Data? Just because it’s legal doesn’t mean it’s right… Start small but plan for big Strong Exec sponsorship required Multi faceted business case Leverage existing resources and investments where possible Prepare for cultural challenges (data ownership and tools)
- 14. 14 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING, Bedankt voor uw aandachtConnected by KPN. We believe that communication technology enriches life. It is our mission to provide safe, reliable and future-proof networks and services, enabling people, businesses and organizations to be connected anytime, anywhere, adding value to their lives.
- 15. 15 HADOOP SUMMIT 2016 | CONNECTING EVERYTHING, Connected by Hadoop The TELCO Hadoop community will be a non-profit association for service providers and their suppliers in the telecommunications. The members share operational support use cases and lessens learned to help the community to grow in data and processes. Join the TELCO community For more information send an e-mail to [email protected]