SlideShare a Scribd company logo
4
Most read
9
Most read
11
Most read
Advance Data Quality Management
Basice Overview
Khaled Mosharraf. Msc
mosharrafkhaled@gmx.de
A.K.M Bhalul Haque. M.Sc
b.haque@gmx.de
FH Kiel, Germany
2016
Agenda
• Motivation / Introduction
• Data Quality Definitions
• Foundation of Data Quality
• Data Quality Assessments
• Measuring Data Quality
• DQ-Organisation
• Data Policies
• Data Governance
• DQ Policies
• Data Profiling
Kiel University of Applied Sciences
Introduction
Today is world of heterogeneity.
We have different technologies.
We operate on different platforms.
We have large amount of data being generated
everyday in all sorts of organizations and
Enterprises.
And we do have problems with data.
Kiel University of Applied Sciences
What is data quality?
• Data quality is a perception or an assessment
of data’s fitness to serve its purpose in a given
context.
• It is described by several dimensions like
• Correctness / Accuracy : Accuracy of data is the
degree to which the captured data correctly
describes the real world entity.
• Consistency: This is about the single version of
truth. Consistency means data throughout the
enterprise should be sync with each other.
Kiel University of Applied Sciences
• Completeness: It is the extent to which the
expected attributes of data are provided.
• Timeliness: Right data to the right person at the
right time is important for business.
•
• Metadata: Data about data.
Kiel University of Applied Sciences
Data Quality Definitions
i. Intuitive definition
ii. System definition
iii. Information consumers’ definition
iv. Objective and Subjective IQ dimensions
v. Context independent and dependent IQ
dimensions
Kiel University of Applied Sciences
Data Quality Definitions
‘‘Data quality is measuring data to determine if its fit for
the purpose or not. „
• Main problem of data quality
Data duplication
Data inconsistent
Data incomlite
Data Ambiguous
Kiel University of Applied Sciences
Data Quality
Kiel University of Applied Sciences
Real World
In the real world, activities are
implemented in the field. These
activities are designed to
produce results that are
quantifiable.
Data Management System
An information system represents
these activities by collecting the
results that were produced and
mapping them to a recording system.
Data Quality: How well the DMS represents the real world
Real
World
Data
Management
System
Why data quality matters?
• Good data is your most valuable asset, and bad
data can seriously harm business and
credibility…
What have you missed?
When things go wrong.
Making confident decisions.
Kiel University of Applied Sciences
Why data quality is important now a
days ?
• Improve customer satisfaction.
• Reduce of time from empoly on manual process.
• Improve Profit.
• Improve product
• Improve Reportaion
Kiel University of Applied Sciences
Why we interested in data quality.
• Day by day data quentity is increasing. So we need any
data for use we cannot figureout it easely. So data
quality is most important for future anylisis.
• Waste of time and money
• Labor cost increase if data quality not standerd.
Kiel University of Applied Sciences
Next slide we will continue
Kiel University of Applied Sciences
Thank You
If you have any question please
write email.

More Related Content

What's hot (20)

PDF
Master Data Management - Aligning Data, Process, and Governance
DATAVERSITY
 
PDF
Implementing Effective Data Governance
Christopher Bradley
 
PPT
Gartner: Seven Building Blocks of Master Data Management
Gartner
 
PDF
Introduction to Data Governance
John Bao Vuu
 
PPTX
Data Quality & Data Governance
Tuba Yaman Him
 
PDF
DAS Slides: Data Quality Best Practices
DATAVERSITY
 
PDF
Data Quality Best Practices
DATAVERSITY
 
PPTX
How to Build & Sustain a Data Governance Operating Model
DATUM LLC
 
PDF
Data Governance
Boris Otto
 
PDF
Data Quality Best Practices
DATAVERSITY
 
PDF
Data Quality
jerdeb
 
PDF
Top 10 Artifacts Needed For Data Governance
First San Francisco Partners
 
PPTX
Data analytics
Bhanu Pratap
 
PDF
Master Data Management's Place in the Data Governance Landscape
CCG
 
PDF
Building a Data Strategy – Practical Steps for Aligning with Business Goals
DATAVERSITY
 
PPTX
Data quality and data profiling
Shailja Khurana
 
PPTX
Capability Model_Data Governance
Steve Novak
 
PPT
Data Management
BashirMutebi1
 
PDF
Data Catalog for Better Data Discovery and Governance
Denodo
 
PPTX
Introduction to Data Management Maturity Models
Kingland
 
Master Data Management - Aligning Data, Process, and Governance
DATAVERSITY
 
Implementing Effective Data Governance
Christopher Bradley
 
Gartner: Seven Building Blocks of Master Data Management
Gartner
 
Introduction to Data Governance
John Bao Vuu
 
Data Quality & Data Governance
Tuba Yaman Him
 
DAS Slides: Data Quality Best Practices
DATAVERSITY
 
Data Quality Best Practices
DATAVERSITY
 
How to Build & Sustain a Data Governance Operating Model
DATUM LLC
 
Data Governance
Boris Otto
 
Data Quality Best Practices
DATAVERSITY
 
Data Quality
jerdeb
 
Top 10 Artifacts Needed For Data Governance
First San Francisco Partners
 
Data analytics
Bhanu Pratap
 
Master Data Management's Place in the Data Governance Landscape
CCG
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
DATAVERSITY
 
Data quality and data profiling
Shailja Khurana
 
Capability Model_Data Governance
Steve Novak
 
Data Management
BashirMutebi1
 
Data Catalog for Better Data Discovery and Governance
Denodo
 
Introduction to Data Management Maturity Models
Kingland
 

Viewers also liked (19)

PDF
ETIS09 - Data Quality: Common Problems & Checks - Presentation
David Walker
 
PDF
Data Quality Management - Data Issue Management & Resolutionn / Practical App...
Burak S. Arikan
 
ODP
Data quality overview
Alex Meadows
 
PPT
Data Quality Definitions
Michael Küsters
 
PPT
Data quality architecture
anicewick
 
PDF
Infographic - Procurement Trends 2016
Jonathan Betts
 
PDF
Inside the circle of trust: Data management for modern enterprises
Experian Data Quality
 
PDF
RDAP 15 Navigating the Rocky Road to Research Data Acceptance
ASIS&T
 
PPTX
Spend Analysis: What Your Data Is Telling You and Why It’s Worth Listening
SAP Ariba
 
PPTX
Adapting Data Quality Assurance Approaches and Tools to Meet Local Needs
removed_62798267384a091db5c693ad7f1cc5ac
 
PDF
Data Governance and the Internet of Things
DATAVERSITY
 
PDF
Data-Ed Webinar: Data Quality Engineering
DATAVERSITY
 
PPTX
Data Validation Victories: Tips for Better Data Quality
Safe Software
 
PPTX
Data Quality: A Raising Data Warehousing Concern
Amin Chowdhury
 
PPT
Data Quality Rules introduction
datatovalue
 
PPTX
Data Governance in the Big Data Era
Pieter De Leenheer
 
PPTX
Data Governance Best Practices
Boris Otto
 
PPT
Building a Data Quality Program from Scratch
dmurph4
 
PPT
Le Data Quality
wdmmdp
 
ETIS09 - Data Quality: Common Problems & Checks - Presentation
David Walker
 
Data Quality Management - Data Issue Management & Resolutionn / Practical App...
Burak S. Arikan
 
Data quality overview
Alex Meadows
 
Data Quality Definitions
Michael Küsters
 
Data quality architecture
anicewick
 
Infographic - Procurement Trends 2016
Jonathan Betts
 
Inside the circle of trust: Data management for modern enterprises
Experian Data Quality
 
RDAP 15 Navigating the Rocky Road to Research Data Acceptance
ASIS&T
 
Spend Analysis: What Your Data Is Telling You and Why It’s Worth Listening
SAP Ariba
 
Adapting Data Quality Assurance Approaches and Tools to Meet Local Needs
removed_62798267384a091db5c693ad7f1cc5ac
 
Data Governance and the Internet of Things
DATAVERSITY
 
Data-Ed Webinar: Data Quality Engineering
DATAVERSITY
 
Data Validation Victories: Tips for Better Data Quality
Safe Software
 
Data Quality: A Raising Data Warehousing Concern
Amin Chowdhury
 
Data Quality Rules introduction
datatovalue
 
Data Governance in the Big Data Era
Pieter De Leenheer
 
Data Governance Best Practices
Boris Otto
 
Building a Data Quality Program from Scratch
dmurph4
 
Le Data Quality
wdmmdp
 
Ad

Similar to Data quality management Basic (20)

PDF
Foundation of data quality
Khaled Mosharraf
 
PPTX
BDA 2012 Big data why the big fuss?
Christopher Bradley
 
PPTX
The New Age Data Quality
Ranjeet202050
 
PDF
Dw19 t1+ +dq+fundamentals-cvs+template
MILLER A. ZAMBRANO T.
 
PDF
Business Intelligence (BI) and Data Management Basics
amorshed
 
PDF
Data-Ed Webinar: Data Quality Success Stories
DATAVERSITY
 
PDF
EPF-datagov-part1-1.pdf
cedrinemadera
 
PPTX
Data Quality
Vijaya K
 
PPTX
Is Your Agency Data Challenged?
DLT Solutions
 
PDF
Why data governance is the new buzz?
Aachen Data & AI Meetup
 
PPTX
From Near to Maturity - Presentation to European Data Forum
Castlebridge Associates
 
PPTX
A Business-first Approach to Building Data Governance Program
Precisely
 
PPTX
Ashley Ohmann--Data Governance Final 011315
Ashley Ohmann
 
PDF
Governance as a "painkiller": A Business First Approach to Data Governance
Precisely
 
PDF
Building Rules for Data Governance
Precisely
 
PDF
Data-Ed: Unlock Business Value through Data Quality Engineering
Data Blueprint
 
PDF
Data-Ed: Unlock Business Value through Data Quality Engineering
DATAVERSITY
 
PDF
How to Build Data Governance Programs That Last - A Business-First Approach.pdf
Precisely
 
PDF
Data quality - The True Big Data Challenge
Stefan Kühn
 
PPT
David Reeve - UKAD 2016 forum
The-National-Archives
 
Foundation of data quality
Khaled Mosharraf
 
BDA 2012 Big data why the big fuss?
Christopher Bradley
 
The New Age Data Quality
Ranjeet202050
 
Dw19 t1+ +dq+fundamentals-cvs+template
MILLER A. ZAMBRANO T.
 
Business Intelligence (BI) and Data Management Basics
amorshed
 
Data-Ed Webinar: Data Quality Success Stories
DATAVERSITY
 
EPF-datagov-part1-1.pdf
cedrinemadera
 
Data Quality
Vijaya K
 
Is Your Agency Data Challenged?
DLT Solutions
 
Why data governance is the new buzz?
Aachen Data & AI Meetup
 
From Near to Maturity - Presentation to European Data Forum
Castlebridge Associates
 
A Business-first Approach to Building Data Governance Program
Precisely
 
Ashley Ohmann--Data Governance Final 011315
Ashley Ohmann
 
Governance as a "painkiller": A Business First Approach to Data Governance
Precisely
 
Building Rules for Data Governance
Precisely
 
Data-Ed: Unlock Business Value through Data Quality Engineering
Data Blueprint
 
Data-Ed: Unlock Business Value through Data Quality Engineering
DATAVERSITY
 
How to Build Data Governance Programs That Last - A Business-First Approach.pdf
Precisely
 
Data quality - The True Big Data Challenge
Stefan Kühn
 
David Reeve - UKAD 2016 forum
The-National-Archives
 
Ad

More from Khaled Mosharraf (6)

PDF
PCI DSS introduction by khaled mosharraf,
Khaled Mosharraf
 
PDF
Pixel Bar Charts A New Technique for Visualizing Large Multi-Attribute Data S...
Khaled Mosharraf
 
PPT
Open ssl heart bleed weakness.
Khaled Mosharraf
 
PDF
Six sigma
Khaled Mosharraf
 
PPTX
Introduction to anonymity network tor
Khaled Mosharraf
 
PPTX
Beginners Node.js
Khaled Mosharraf
 
PCI DSS introduction by khaled mosharraf,
Khaled Mosharraf
 
Pixel Bar Charts A New Technique for Visualizing Large Multi-Attribute Data S...
Khaled Mosharraf
 
Open ssl heart bleed weakness.
Khaled Mosharraf
 
Six sigma
Khaled Mosharraf
 
Introduction to anonymity network tor
Khaled Mosharraf
 
Beginners Node.js
Khaled Mosharraf
 

Recently uploaded (20)

PPTX
apidays Helsinki & North 2025 - Agentic AI: A Friend or Foe?, Merja Kajava (A...
apidays
 
PPT
Growth of Public Expendituuure_55423.ppt
NavyaDeora
 
PPTX
apidays Helsinki & North 2025 - API access control strategies beyond JWT bear...
apidays
 
PPTX
apidays Singapore 2025 - Designing for Change, Julie Schiller (Google)
apidays
 
PDF
apidays Helsinki & North 2025 - APIs in the healthcare sector: hospitals inte...
apidays
 
PDF
Using AI/ML for Space Biology Research
VICTOR MAESTRE RAMIREZ
 
PPTX
Numbers of a nation: how we estimate population statistics | Accessible slides
Office for National Statistics
 
PPTX
SlideEgg_501298-Agentic AI.pptx agentic ai
530BYManoj
 
PPTX
ER_Model_with_Diagrams_Presentation.pptx
dharaadhvaryu1992
 
PDF
Simplifying Document Processing with Docling for AI Applications.pdf
Tamanna
 
PPT
tuberculosiship-2106031cyyfuftufufufivifviviv
AkshaiRam
 
PDF
apidays Singapore 2025 - From API Intelligence to API Governance by Harsha Ch...
apidays
 
PDF
Driving Employee Engagement in a Hybrid World.pdf
Mia scott
 
PDF
apidays Singapore 2025 - Streaming Lakehouse with Kafka, Flink and Iceberg by...
apidays
 
PPTX
apidays Singapore 2025 - Generative AI Landscape Building a Modern Data Strat...
apidays
 
PDF
NIS2 Compliance for MSPs: Roadmap, Benefits & Cybersecurity Trends (2025 Guide)
GRC Kompas
 
PDF
JavaScript - Good or Bad? Tips for Google Tag Manager
📊 Markus Baersch
 
PPTX
apidays Helsinki & North 2025 - From Chaos to Clarity: Designing (AI-Ready) A...
apidays
 
PPTX
apidays Singapore 2025 - From Data to Insights: Building AI-Powered Data APIs...
apidays
 
PPTX
b6057ea5-8e8c-4415-90c0-ed8e9666ffcd.pptx
Anees487379
 
apidays Helsinki & North 2025 - Agentic AI: A Friend or Foe?, Merja Kajava (A...
apidays
 
Growth of Public Expendituuure_55423.ppt
NavyaDeora
 
apidays Helsinki & North 2025 - API access control strategies beyond JWT bear...
apidays
 
apidays Singapore 2025 - Designing for Change, Julie Schiller (Google)
apidays
 
apidays Helsinki & North 2025 - APIs in the healthcare sector: hospitals inte...
apidays
 
Using AI/ML for Space Biology Research
VICTOR MAESTRE RAMIREZ
 
Numbers of a nation: how we estimate population statistics | Accessible slides
Office for National Statistics
 
SlideEgg_501298-Agentic AI.pptx agentic ai
530BYManoj
 
ER_Model_with_Diagrams_Presentation.pptx
dharaadhvaryu1992
 
Simplifying Document Processing with Docling for AI Applications.pdf
Tamanna
 
tuberculosiship-2106031cyyfuftufufufivifviviv
AkshaiRam
 
apidays Singapore 2025 - From API Intelligence to API Governance by Harsha Ch...
apidays
 
Driving Employee Engagement in a Hybrid World.pdf
Mia scott
 
apidays Singapore 2025 - Streaming Lakehouse with Kafka, Flink and Iceberg by...
apidays
 
apidays Singapore 2025 - Generative AI Landscape Building a Modern Data Strat...
apidays
 
NIS2 Compliance for MSPs: Roadmap, Benefits & Cybersecurity Trends (2025 Guide)
GRC Kompas
 
JavaScript - Good or Bad? Tips for Google Tag Manager
📊 Markus Baersch
 
apidays Helsinki & North 2025 - From Chaos to Clarity: Designing (AI-Ready) A...
apidays
 
apidays Singapore 2025 - From Data to Insights: Building AI-Powered Data APIs...
apidays
 
b6057ea5-8e8c-4415-90c0-ed8e9666ffcd.pptx
Anees487379
 

Data quality management Basic

  • 1. Advance Data Quality Management Basice Overview Khaled Mosharraf. Msc [email protected] A.K.M Bhalul Haque. M.Sc [email protected] FH Kiel, Germany 2016
  • 2. Agenda • Motivation / Introduction • Data Quality Definitions • Foundation of Data Quality • Data Quality Assessments • Measuring Data Quality • DQ-Organisation • Data Policies • Data Governance • DQ Policies • Data Profiling Kiel University of Applied Sciences
  • 3. Introduction Today is world of heterogeneity. We have different technologies. We operate on different platforms. We have large amount of data being generated everyday in all sorts of organizations and Enterprises. And we do have problems with data. Kiel University of Applied Sciences
  • 4. What is data quality? • Data quality is a perception or an assessment of data’s fitness to serve its purpose in a given context. • It is described by several dimensions like • Correctness / Accuracy : Accuracy of data is the degree to which the captured data correctly describes the real world entity. • Consistency: This is about the single version of truth. Consistency means data throughout the enterprise should be sync with each other. Kiel University of Applied Sciences
  • 5. • Completeness: It is the extent to which the expected attributes of data are provided. • Timeliness: Right data to the right person at the right time is important for business. • • Metadata: Data about data. Kiel University of Applied Sciences
  • 6. Data Quality Definitions i. Intuitive definition ii. System definition iii. Information consumers’ definition iv. Objective and Subjective IQ dimensions v. Context independent and dependent IQ dimensions Kiel University of Applied Sciences
  • 7. Data Quality Definitions ‘‘Data quality is measuring data to determine if its fit for the purpose or not. „ • Main problem of data quality Data duplication Data inconsistent Data incomlite Data Ambiguous Kiel University of Applied Sciences
  • 8. Data Quality Kiel University of Applied Sciences Real World In the real world, activities are implemented in the field. These activities are designed to produce results that are quantifiable. Data Management System An information system represents these activities by collecting the results that were produced and mapping them to a recording system. Data Quality: How well the DMS represents the real world Real World Data Management System
  • 9. Why data quality matters? • Good data is your most valuable asset, and bad data can seriously harm business and credibility… What have you missed? When things go wrong. Making confident decisions. Kiel University of Applied Sciences
  • 10. Why data quality is important now a days ? • Improve customer satisfaction. • Reduce of time from empoly on manual process. • Improve Profit. • Improve product • Improve Reportaion Kiel University of Applied Sciences
  • 11. Why we interested in data quality. • Day by day data quentity is increasing. So we need any data for use we cannot figureout it easely. So data quality is most important for future anylisis. • Waste of time and money • Labor cost increase if data quality not standerd. Kiel University of Applied Sciences
  • 12. Next slide we will continue Kiel University of Applied Sciences
  • 13. Thank You If you have any question please write email.