Bde sc3 2nd_workshop_2016_10_04_p01_bde_introduction
0 likes574 views
The document discusses empowering communities with big data technologies through lowering barriers to using big data. It describes the Big Data Europe consortium and platform, which consists of three layers - hardware, a resource manager, and big data applications. The platform packages big data components like HDFS, Spark, and Kafka in Docker containers to solve specific problems, and provides installation instructions and technical support contacts.
1 of 9
Download to read offline
More Related Content
Ad
Viewers also liked (20)
Ad
Similar to Bde sc3 2nd_workshop_2016_10_04_p01_bde_introduction (20)
More from BigData_Europe (20)
Bde sc3 2nd_workshop_2016_10_04_p01_bde_introduction
- 1. Empowering Communities with Data Technologies Fraunhofer IAIS - coordinatorSC Workshops BIG DATA EUROPE
- 2. Rationale Show societal value of Big Data Lower barrier for using big data technologies o Required effort and resources o Limited data science skills Help establishing cross- lingual/organizational/domain Data Value Chains 4-oct.-16
- 5. Open-Source Technologies for Big Data Apps 4-oct.-16www.big-data-europe.eu 5
- 6. Big Data – Technologies vs 3Vs www.big-data-europe.eu Volume VelocityVariety Storm
- 7. Big Data Technology - Groups 4-oct.-16www.big-data-europe.eu Big Data Technologies Data Storage Technologies Data Processing Workflow Coordination Querying/ Processing Search Data Export/ Import Data Analysis Text Mining
- 8. Big Data Europe Platform 4-oct.-16www.big-data-europe.eu BDE platform consists of 3 layers: • the hardware layer • a resource manager – Docker Swarm – and • Big Data applications running on top An application can be seen as a pipeline consisting of multiple components, like HDFS, Spark and Kafka, which are wired together in order to solve a specific Big Data problem. The components will be packaged in Docker containers and glued together with Docker Compose.
- 9. Big Data Europe Platform 4-oct.-16www.big-data-europe.eu https://www.big-data-europe.eu/howto-install-the-bde-platform/ https://github.com/big-data-europe Youtube: Getting Started With BDE Platform Install BDE platform Technical support: TENFORCE Aad Versteden [email protected] Erika Pauwels [email protected]