SlideShare a Scribd company logo

Data governance in Hadoop (My Personal Notes)

•
Komes Chandavimol, profile picture
Komes Chandavimol

The document discusses data governance in Hadoop, emphasizing components such as Apache Falcon and Apache Atlas that facilitate data lifecycle management, compliance, and metadata services. Apache Falcon provides data pipeline management, while Apache Atlas offers core metadata services and governance capabilities. The overarching goal is to streamline data management and meet regulatory requirements within Hadoop environments.

Data & Analytics
1 of 66
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)
Data governance in Hadoop (My Personal Notes)

More Related Content

PPTX
Open Metadata and Governance with Apache Atlas
DataWorks Summit
 
PDF
An architecture for federated data discovery and lineage over on-prem datasou...
DataWorks Summit
 
PPTX
GDPR-focused partner community showcase for Apache Ranger and Apache Atlas
DataWorks Summit
 
PPTX
Enterprise Data Classification and Provenance
DataWorks Summit/Hadoop Summit
 
PPTX
Apache Atlas: Tracking dataset lineage across Hadoop components
DataWorks Summit/Hadoop Summit
 
PPTX
The Future of Apache Hadoop an Enterprise Architecture View
DataWorks Summit/Hadoop Summit
 
PDF
Apache Atlas. Data Governance for Hadoop. Strata London 2015
Sean Roberts
 
PPTX
Data Driving Yahoo Mail Growth and Evolution with a 50 PB Hadoop Warehouse
DataWorks Summit
 
Open Metadata and Governance with Apache Atlas
DataWorks Summit
 
An architecture for federated data discovery and lineage over on-prem datasou...
DataWorks Summit
 
GDPR-focused partner community showcase for Apache Ranger and Apache Atlas
DataWorks Summit
 
Enterprise Data Classification and Provenance
DataWorks Summit/Hadoop Summit
 
Apache Atlas: Tracking dataset lineage across Hadoop components
DataWorks Summit/Hadoop Summit
 
The Future of Apache Hadoop an Enterprise Architecture View
DataWorks Summit/Hadoop Summit
 
Apache Atlas. Data Governance for Hadoop. Strata London 2015
Sean Roberts
 
Data Driving Yahoo Mail Growth and Evolution with a 50 PB Hadoop Warehouse
DataWorks Summit
 

What's hot (20)

PPTX
Navigating the World of User Data Management and Data Discovery
DataWorks Summit/Hadoop Summit
 
PDF
Extend Governance in Hadoop with Atlas Ecosystem: Waterline, Attivo & Trifacta
DataWorks Summit/Hadoop Summit
 
PDF
Data Governance - Atlas 7.12.2015
Hortonworks
 
PDF
Filling the Data Lake
DataWorks Summit/Hadoop Summit
 
PPTX
HDP Next: Governance
DataWorks Summit
 
PPTX
Tag based policies using Apache Atlas and Ranger
Vimal Sharma
 
PPTX
Security, ETL, BI & Analytics, and Software Integration
DataWorks Summit
 
PPTX
Apache atlas sydney 2017-v4
Nigel Jones
 
PDF
Introducing a horizontally scalable, inference-based business Rules Engine fo...
Cask Data
 
PPTX
Optimizing industrial operations using the big data ecosystem
DataWorks Summit
 
PPTX
Enterprise large scale graph analytics and computing base on distribute graph...
DataWorks Summit
 
PPTX
Top Three Big Data Governance Issues and How Apache ATLAS resolves it for the...
DataWorks Summit/Hadoop Summit
 
PPTX
Loan Decisioning Transformation
DataWorks Summit/Hadoop Summit
 
PDF
About CDAP
Cask Data
 
PDF
Data Integration for Big Data (OOW 2016, Co-Presented With Oracle)
Rittman Analytics
 
PPTX
Driving Enterprise Data Governance for Big Data Systems through Apache Falcon
DataWorks Summit
 
PDF
Visualizing Big Data in Realtime
DataWorks Summit
 
PPTX
Aster getting started
Ahsan Nabi Khan
 
PDF
Apache Eagle: Secure Hadoop in Real Time
DataWorks Summit/Hadoop Summit
 
PPTX
Data Governance in Apache Falcon - Hadoop Summit Brussels 2015
Seetharam Venkatesh
 
Navigating the World of User Data Management and Data Discovery
DataWorks Summit/Hadoop Summit
 
Extend Governance in Hadoop with Atlas Ecosystem: Waterline, Attivo & Trifacta
DataWorks Summit/Hadoop Summit
 
Data Governance - Atlas 7.12.2015
Hortonworks
 
Filling the Data Lake
DataWorks Summit/Hadoop Summit
 
HDP Next: Governance
DataWorks Summit
 
Tag based policies using Apache Atlas and Ranger
Vimal Sharma
 
Security, ETL, BI & Analytics, and Software Integration
DataWorks Summit
 
Apache atlas sydney 2017-v4
Nigel Jones
 
Introducing a horizontally scalable, inference-based business Rules Engine fo...
Cask Data
 
Optimizing industrial operations using the big data ecosystem
DataWorks Summit
 
Enterprise large scale graph analytics and computing base on distribute graph...
DataWorks Summit
 
Top Three Big Data Governance Issues and How Apache ATLAS resolves it for the...
DataWorks Summit/Hadoop Summit
 
Loan Decisioning Transformation
DataWorks Summit/Hadoop Summit
 
About CDAP
Cask Data
 
Data Integration for Big Data (OOW 2016, Co-Presented With Oracle)
Rittman Analytics
 
Driving Enterprise Data Governance for Big Data Systems through Apache Falcon
DataWorks Summit
 
Visualizing Big Data in Realtime
DataWorks Summit
 
Aster getting started
Ahsan Nabi Khan
 
Apache Eagle: Secure Hadoop in Real Time
DataWorks Summit/Hadoop Summit
 
Data Governance in Apache Falcon - Hadoop Summit Brussels 2015
Seetharam Venkatesh
 
Ad

Similar to Data governance in Hadoop (My Personal Notes) (20)

PPTX
Brief Introduction about Hadoop and Core Services.
Muthu Natarajan
 
PDF
Odi 12c-new-features-wp-2226353
Udaykumar Sarana
 
PPTX
In15orlesss hadoop
Worapol Alex Pongpech, PhD
 
PDF
What is hadoop
Asis Mohanty
 
PDF
Aucfanlab Datalake - Big Data Management Platform -
Aucfan
 
PPTX
Unified Batch and Real-Time Stream Processing Using Apache Flink
Slim Baltagi
 
PPTX
Big Data Technology Stack : Nutshell
Khalid Imran
 
PPTX
Lecture-20.pptx
mohaaalsa
 
PPTX
cakephp UDUYKTHA (1)
Varsha Krishna
 
PPTX
Hadoop vs Apache Spark
ALTEN Calsoft Labs
 
PPTX
Arun Rathinasabapathy, Senior Software Engineer, LexisNexis at MLconf ATL 2016
MLconf
 
PPTX
Hadoop white papers
Muthu Natarajan
 
PDF
Discover HDP 2.1: Apache Hadoop 2.4.0, YARN & HDFS
Hortonworks
 
PPT
Haoscar
Chuka Okoye
 
DOCX
Spark,Hadoop,Presto Comparition
Sandish Kumar H N
 
PDF
Talend openstudio bigdata_gettingstarted_6.3.0_en
Manoj Sharma
 
PDF
Webinar: Ways to Succeed with Hadoop in 2015
Edureka!
 
PDF
Big data + cloud computing glossary for community
Kumar Chinnakali
 
PPTX
Hadoop.pptx
AlbertoBarronMiranda1
 
PPTX
Big data or big deal
eduarderwee
 
Brief Introduction about Hadoop and Core Services.
Muthu Natarajan
 
Odi 12c-new-features-wp-2226353
Udaykumar Sarana
 
In15orlesss hadoop
Worapol Alex Pongpech, PhD
 
What is hadoop
Asis Mohanty
 
Aucfanlab Datalake - Big Data Management Platform -
Aucfan
 
Unified Batch and Real-Time Stream Processing Using Apache Flink
Slim Baltagi
 
Big Data Technology Stack : Nutshell
Khalid Imran
 
Lecture-20.pptx
mohaaalsa
 
cakephp UDUYKTHA (1)
Varsha Krishna
 
Hadoop vs Apache Spark
ALTEN Calsoft Labs
 
Arun Rathinasabapathy, Senior Software Engineer, LexisNexis at MLconf ATL 2016
MLconf
 
Hadoop white papers
Muthu Natarajan
 
Discover HDP 2.1: Apache Hadoop 2.4.0, YARN & HDFS
Hortonworks
 
Haoscar
Chuka Okoye
 
Spark,Hadoop,Presto Comparition
Sandish Kumar H N
 
Talend openstudio bigdata_gettingstarted_6.3.0_en
Manoj Sharma
 
Webinar: Ways to Succeed with Hadoop in 2015
Edureka!
 
Big data + cloud computing glossary for community
Kumar Chinnakali
 
Hadoop.pptx
AlbertoBarronMiranda1
 
Big data or big deal
eduarderwee
 
Ad

More from Komes Chandavimol (7)

PDF
Is Data Scientist still the Sexiest job of the 21st century?
Komes Chandavimol
 
PDF
How to Introduce Data Science to Marketing
Komes Chandavimol
 
PDF
Data Science for Marketing
Komes Chandavimol
 
PDF
How to find Business Oppputunity With AI?
Komes Chandavimol
 
PPTX
Data Science for Social Good @Thailand Tableau User Group 2020
Komes Chandavimol
 
PPTX
Data Driven Economy @CMU
Komes Chandavimol
 
PDF
Electronic Medical Records From Paperless to Big Data Initiatives
Komes Chandavimol
 
Is Data Scientist still the Sexiest job of the 21st century?
Komes Chandavimol
 
How to Introduce Data Science to Marketing
Komes Chandavimol
 
Data Science for Marketing
Komes Chandavimol
 
How to find Business Oppputunity With AI?
Komes Chandavimol
 
Data Science for Social Good @Thailand Tableau User Group 2020
Komes Chandavimol
 
Data Driven Economy @CMU
Komes Chandavimol
 
Electronic Medical Records From Paperless to Big Data Initiatives
Komes Chandavimol
 

Recently uploaded (20)

PPTX
lecture 13 mind test academy it skills.pptx
ggesjmrasoolpark
 
PPTX
Fuzzy_Membership_Functions_Presentation.pptx
pythoncrazy2024
 
PDF
Fundamentals and Techniques of Biophysics and Molecular Biology (Pranav Kumar...
RohitKumar868624
 
PDF
Technical Writing Module-I Complete Notes.pdf
VedprakashArya13
 
PDF
WISE main accomplishments for ISQOLS award July 2025.pdf
StatsCommunications
 
PPTX
Probability systematic sampling methods.pptx
PrakashRajput19
 
PDF
Classifcation using Machine Learning and deep learning
bhaveshagrawal35
 
PDF
The_Future_of_Data_Analytics_by_CA_Suvidha_Chaplot_UPDATED.pdf
CA Suvidha Chaplot
 
PPTX
Fluvial_Civilizations_Presentation (1).pptx
alisslovemendoza7
 
PDF
TIC ACTIVIDAD 1geeeeeeeeeeeeeeeeeeeeeeeeeeeeeer3.pdf
Thais Ruiz
 
PDF
SUMMER INTERNSHIP REPORT[1] (AutoRecovered) (6) (1).pdf
pandeydiksha814
 
PPTX
The whitetiger novel review for collegeassignment.pptx
DhruvPatel754154
 
PDF
717629748-Databricks-Certified-Data-Engineer-Professional-Dumps-by-Ball-21-03...
pedelli41
 
PPTX
INFO8116 - Week 10 - Slides.pptx data analutics
guddipatel10
 
PDF
Practical Measurement Systems Analysis (Gage R&R) for design
Rob Schubert
 
PPTX
World-population.pptx fire bunberbpeople
umutunsalnsl4402
 
PPTX
Multiscale Segmentation of Survey Respondents: Seeing the Trees and the Fores...
Sione Palu
 
PDF
An Uncut Conversation With Grok | PDF Document
Mike Hydes
 
PPTX
Web dev -ppt that helps us understand web technology
shubhragoyal12
 
PPTX
Future_of_AI_Presentation for everyone.pptx
boranamanju07
 
lecture 13 mind test academy it skills.pptx
ggesjmrasoolpark
 
Fuzzy_Membership_Functions_Presentation.pptx
pythoncrazy2024
 
Fundamentals and Techniques of Biophysics and Molecular Biology (Pranav Kumar...
RohitKumar868624
 
Technical Writing Module-I Complete Notes.pdf
VedprakashArya13
 
WISE main accomplishments for ISQOLS award July 2025.pdf
StatsCommunications
 
Probability systematic sampling methods.pptx
PrakashRajput19
 
Classifcation using Machine Learning and deep learning
bhaveshagrawal35
 
The_Future_of_Data_Analytics_by_CA_Suvidha_Chaplot_UPDATED.pdf
CA Suvidha Chaplot
 
Fluvial_Civilizations_Presentation (1).pptx
alisslovemendoza7
 
TIC ACTIVIDAD 1geeeeeeeeeeeeeeeeeeeeeeeeeeeeeer3.pdf
Thais Ruiz
 
SUMMER INTERNSHIP REPORT[1] (AutoRecovered) (6) (1).pdf
pandeydiksha814
 
The whitetiger novel review for collegeassignment.pptx
DhruvPatel754154
 
717629748-Databricks-Certified-Data-Engineer-Professional-Dumps-by-Ball-21-03...
pedelli41
 
INFO8116 - Week 10 - Slides.pptx data analutics
guddipatel10
 
Practical Measurement Systems Analysis (Gage R&R) for design
Rob Schubert
 
World-population.pptx fire bunberbpeople
umutunsalnsl4402
 
Multiscale Segmentation of Survey Respondents: Seeing the Trees and the Fores...
Sione Palu
 
An Uncut Conversation With Grok | PDF Document
Mike Hydes
 
Web dev -ppt that helps us understand web technology
shubhragoyal12
 
Future_of_AI_Presentation for everyone.pptx
boranamanju07
Â