Intro To Hadoop
Download as PPTX, PDF0 likes107 views
Hadoop is an open source software framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It provides storage for large datasets in the Hadoop Distributed File System (HDFS) and allows parallel processing of the data using the MapReduce programming model. Hadoop has evolved from Google's work and is developed by Yahoo and Apache to provide a low-cost solution for very large data volumes and processing needs across both structured and unstructured data sources.
1 of 6
Download to read offline
More Related Content
What's hot (20)
Viewers also liked (7)
Ad
Recently uploaded (20)
PDF
Log-Based Anomaly Detection: Enhancing System Reliability with Machine LearningMohammed BEKKOUCHEAd
Intro To Hadoop
- 2. Hadoop • Open Source Software • Exceeds Enterprise VLDB • Storage Processing Costs per gigabyte • Structured and Unstructured data • Evolved from Google • Developed by Yahoo • Technical Reasons for • Business Use Case
- 3. Hadoop Ecosystem • Hive: Structured Data • Pig: Structured and Semi-structured • Sqoop: Data Transfer Tool • Hbase: Real Time Table Access • Hcatatlog: Metadata view of HDFS data • Flume: Log Stream • Oozie: Workflow
- 4. Hadoop 1.0 Core Architecture Map Reduce (distributed processing) Hadoop Distributed File System (storage)
- 6. Apache Tez HDFS HDFS MapReduce Yarn Hadoop 1.0 Hadoop 2.0 MapReduce