Ntb0e5xqqjihzzxh3bit 140416002604-phpapp02
Download as PPT, PDF0 likes42 views
This document provides an overview of the Hadoop framework. It describes the key components of Hadoop including the NameNode, DataNodes, JobTracker, TaskTracker, and SecondaryNameNode. The NameNode manages the file system metadata and DataNodes store the actual data blocks. The JobTracker is responsible for scheduling jobs across the cluster and TaskTrackers execute tasks on slave nodes. The SecondaryNameNode provides backup support in case of NameNode failure. Hadoop uses a MapReduce programming model where data is processed in parallel across clusters.
Ntb0e5xqqjihzzxh3bit 140416002604-phpapp02
- 1. Hadoop Edit by Cassell Hsu 2013.04.19
- 3. Hadoop • Master • NameNode • JobTracker • SecondaryNameNode
- 4. NameNode • Where is NameNode? • Master • HDFS(Hadoop Distributed File System) • What is NameNode? • 資料之位置資訊 • 資料之屬性 ？？
- 5. NameNode • 位置資訊 ? • 所有資料皆存放在 – DataNode
- 6. DataNode • What is DataNode • 存放資料 • Where is DataNode • HDFS • Slaves (and Master)
- 9. Hadoop • Master • NameNode • JobTracker • SecondaryNameNode
- 10. JobTracker • What is JobTracker? • 排程工作 • Where is JobTracker? • Master 誰來工作？
- 11. JobTracker & TaskTracker JobTracker TaskTracker Where Master Slaves What 排程工作 執行工作
- 13. Hadoop • Master • NameNode • JobTracker • SecondaryNameNode
- 14. SecondaryNameNode • What is SecondaryNameNode? • NameNode 發生錯誤時補救 • Where is SecondaryNameNode? • Master
- 17. MapReduce • 案切割檔 • Hadoop 上區塊切割 • 程式指定