SlideShare a Scribd company logo
SESIP_0716_AJ
Incorporating ISO Metadata
Using HDF Product
Designer
Aleksandar Jelenak, John Kozimor, Ted Habermann
The HDF Group
This work was supported by NASA/GSFC under
Raytheon Co. contract number NNG15HZ39C
SESIP_0716_AJ
2
The Problem
The need for more contextual data (metadata)
in HDF5 files is growing.
SESIP_0716_AJ
3
The Solution
Use the current conventions to the their
fullest extent.
Store the rest of metadata using the ISO
19115 standards.
SESIP_0716_AJ
4
HDF Product Designer Can Help
• Support for the most widely used Earth
science metadata conventions.
• The latest release (v1.4) allows import of
ISO metadata objects into user designs.
SESIP_0716_AJ
5
1. Use Case
2. Overview
3. Recommendations
4. Conceptual Model
(UML)
5. Implementation (XML)
6. Implementation
(NcML)
HPD Design Name
7. Usage (UMM)
8. Crosswalks
https://wiki.earthdata.nasa.gov/x/qorT
SESIP_0716_AJ
6
Convention Support
SESIP_0716_AJ
7
Convention Support
SESIP_0716_AJ
8
Importing ISO Objects
Separate project with pre-built
ISO metadata components.
SESIP_0716_AJ
9
Importing ISO Objects
All groups in the ISO design
have default role and type
attributes. Do not change
these!
Repeating roles have
"_<uniqueID>" added to their
names
SESIP_0716_AJ
10
Export As…
JSON
Export
Python,
MATLAB
,
IDL
code
HDF5
Templat
e
File
SESIP_0716_AJ
11
Sample of Python Code
# Group: /gmi:acquisitionInformation
grp_1 = f.create_group('gmi:acquisitionInformation')
# Creating attributes for /gmi:acquisitionInformation
grp_1.attrs['role'] = "gmi:acquisitionInformation"
grp_1.attrs['type'] = "gmi:MI_AcquisitionInformation"
# Group: /gmi:acquisitionInformation/gmi:instrument
grp_2 = grp_1.create_group('gmi:instrument')
# Creating attributes for /gmi:acquisitionInformation/gmi:instrument
grp_2.attrs['role'] = "gmi:instrument"
grp_2.attrs['type'] = "gmi:MI_Instrument"
grp_2.attrs['id'] = "instrument_1"
# Group: /gmi:acquisitionInformation/gmi:instrument/gmi:citation
grp_3 = grp_2.create_group('gmi:citation')
# Creating attributes for /gmi:acquisitionInformation/gmi:instrument/gmi:citation
grp_3.attrs['role'] = "gmi:citation"
grp_3.attrs['type'] = "gmd:CI_Citation"
grp_3.attrs['id'] = "fgdccitation_26722.114902.35002"
# Group: /gmi:acquisitionInformation/gmi:instrument/gmi:citation/gmd:date
grp_4 = grp_3.create_group('gmd:date')
# Creating attributes for /gmi:acquisitionInformation/gmi:instrument/gmi:citation/gmd:date
grp_4.attrs['role'] = "gmd:date"
grp_4.attrs['type'] = "gmd:CI_Date"
SESIP_0716_AJ
12
HDF5 Template File
Keyword values in
HDF5
SESIP_0716_AJ
13
This work was supported by
NASA/GSFC under Raytheon Co.
contract number NNG15HZ39C

More Related Content

What's hot (20)

PPTX
SPD and KEA: HDF5 based file formats for Earth Observation
The HDF-EOS Tools and Information Center
 
PPT
MODIS Land and HDF-EOS
The HDF-EOS Tools and Information Center
 
PPTX
Moving form HDF4 to HDF5/netCDF-4
The HDF-EOS Tools and Information Center
 
PPTX
Hierarchical Data Formats (HDF) Update
The HDF-EOS Tools and Information Center
 
PPTX
Improved Methods for Accessing Scientific Data for the Masses
The HDF-EOS Tools and Information Center
 
PPTX
Putting some Spark into HDF5
The HDF-EOS Tools and Information Center
 
PPTX
Matlab, Big Data, and HDF Server
The HDF-EOS Tools and Information Center
 
PDF
HDFCloud Workshop: HDF5 in the Cloud
The HDF-EOS Tools and Information Center
 
PPTX
Indexing HDF5: A Survey
The HDF-EOS Tools and Information Center
 
PPTX
Product Designer Hub - Taking HPD to the Web
The HDF-EOS Tools and Information Center
 
PPTX
HDF Product Designer: Using Templates to Achieve Interoperability
The HDF-EOS Tools and Information Center
 
PPTX
Data Analytics using MATLAB and HDF5
The HDF-EOS Tools and Information Center
 
PPTX
Efficiently serving HDF5 via OPeNDAP
The HDF-EOS Tools and Information Center
 
PPTX
ICESat-2 Metadata and Status
The HDF-EOS Tools and Information Center
 
PPTX
Bridging ICESat and ICESat-2 Standard Data Products
The HDF-EOS Tools and Information Center
 
PPSX
GDAL Enhancement for ESDIS Project
The HDF-EOS Tools and Information Center
 
PPT
HDF5 Performance Enhancements with the Elimination of Unlimited Dimension
The HDF-EOS Tools and Information Center
 
SPD and KEA: HDF5 based file formats for Earth Observation
The HDF-EOS Tools and Information Center
 
Moving form HDF4 to HDF5/netCDF-4
The HDF-EOS Tools and Information Center
 
Hierarchical Data Formats (HDF) Update
The HDF-EOS Tools and Information Center
 
Improved Methods for Accessing Scientific Data for the Masses
The HDF-EOS Tools and Information Center
 
Putting some Spark into HDF5
The HDF-EOS Tools and Information Center
 
Matlab, Big Data, and HDF Server
The HDF-EOS Tools and Information Center
 
HDFCloud Workshop: HDF5 in the Cloud
The HDF-EOS Tools and Information Center
 
Product Designer Hub - Taking HPD to the Web
The HDF-EOS Tools and Information Center
 
HDF Product Designer: Using Templates to Achieve Interoperability
The HDF-EOS Tools and Information Center
 
Data Analytics using MATLAB and HDF5
The HDF-EOS Tools and Information Center
 
Efficiently serving HDF5 via OPeNDAP
The HDF-EOS Tools and Information Center
 
ICESat-2 Metadata and Status
The HDF-EOS Tools and Information Center
 
Bridging ICESat and ICESat-2 Standard Data Products
The HDF-EOS Tools and Information Center
 
GDAL Enhancement for ESDIS Project
The HDF-EOS Tools and Information Center
 
HDF5 Performance Enhancements with the Elimination of Unlimited Dimension
The HDF-EOS Tools and Information Center
 

Viewers also liked (19)

PPTX
Pilot Project for HDF5 Metadata Structures for SWOT
The HDF-EOS Tools and Information Center
 
PPT
Role of Spatial Information in Response to Queensland's Natural Disasters
becnicholas
 
PPTX
Metadata presentation (mip)
Brian O'Leary
 
PDF
Using Imagery in ArcGIS
Esri
 
PDF
Collection development and metadata quality. Presentation at the Europeana Ag...
Europeana
 
PPTX
Metadata for Editorial and Sales Impact
Dominique Raccah
 
KEY
Making metadata effective
Brian O'Leary
 
PPT
Using visualization tools to access HDF data via OPeNDAP
The HDF-EOS Tools and Information Center
 
PPT
Advanced HDF5 Features
The HDF-EOS Tools and Information Center
 
PPTX
Hdf5 current future
mfolk
 
PDF
Unidata's Approach to Community Broadening through Data and Technology Sharing
The HDF-EOS Tools and Information Center
 
PDF
Marketing digital et données personnelles
Prof. Jacques Folon (Ph.D)
 
PDF
Crossref webinar - Maintaining your metadata - latest
Crossref
 
PPT
Planned Maintenance.
Hal Frohreich
 
PPT
Metadata an overview
robin fay
 
PPT
Preventive maintenance final
garfield Tulloch
 
Pilot Project for HDF5 Metadata Structures for SWOT
The HDF-EOS Tools and Information Center
 
Role of Spatial Information in Response to Queensland's Natural Disasters
becnicholas
 
Metadata presentation (mip)
Brian O'Leary
 
Using Imagery in ArcGIS
Esri
 
Collection development and metadata quality. Presentation at the Europeana Ag...
Europeana
 
Metadata for Editorial and Sales Impact
Dominique Raccah
 
Making metadata effective
Brian O'Leary
 
Using visualization tools to access HDF data via OPeNDAP
The HDF-EOS Tools and Information Center
 
Hdf5 current future
mfolk
 
Unidata's Approach to Community Broadening through Data and Technology Sharing
The HDF-EOS Tools and Information Center
 
Marketing digital et données personnelles
Prof. Jacques Folon (Ph.D)
 
Crossref webinar - Maintaining your metadata - latest
Crossref
 
Planned Maintenance.
Hal Frohreich
 
Metadata an overview
robin fay
 
Preventive maintenance final
garfield Tulloch
 
Ad

Similar to Incorporating ISO Metadata Using HDF Product Designer (15)

PPTX
ISO Metadata in HDF Data Files
Ted Habermann
 
PDF
Metadata/Time-Date Tools (Toolkit_MTD)
The HDF-EOS Tools and Information Center
 
PPSX
HDFEOS.org User Analsys, Updates, and Future
The HDF-EOS Tools and Information Center
 
PPTX
ICESat-2 H5-ES Product Development Strategy
The HDF-EOS Tools and Information Center
 
PPTX
ESDIS Metadata Archive
Ted Habermann
 
PPT
Status of HDF-EOS, Related Software, and Tools
The HDF-EOS Tools and Information Center
 
PPT
UML Representation of NPOESS Data Products in HDF5
The HDF-EOS Tools and Information Center
 
PPTX
HDF-EOS Data Product Developer's Guide
The HDF-EOS Tools and Information Center
 
PPT
Metadata Requirements for EOSDIS Data Providers
The HDF-EOS Tools and Information Center
 
PPT
Using HDF5 Archive Information Package to preserve HDF-EOS2 data
The HDF-EOS Tools and Information Center
 
PPSX
Data Are from Mars, Tools Are from Venus
The HDF-EOS Tools and Information Center
 
PPT
HDF-EOS APIs, tools, etc.
The HDF-EOS Tools and Information Center
 
PDF
HDF-EOS Data Extractor & Metadata Updater
The HDF-EOS Tools and Information Center
 
PDF
HDF-EOS Development: Current Status and Tools
The HDF-EOS Tools and Information Center
 
PPSX
NASA HDF/HDF-EOS Data Access Challenges
The HDF-EOS Tools and Information Center
 
ISO Metadata in HDF Data Files
Ted Habermann
 
Metadata/Time-Date Tools (Toolkit_MTD)
The HDF-EOS Tools and Information Center
 
HDFEOS.org User Analsys, Updates, and Future
The HDF-EOS Tools and Information Center
 
ICESat-2 H5-ES Product Development Strategy
The HDF-EOS Tools and Information Center
 
ESDIS Metadata Archive
Ted Habermann
 
Status of HDF-EOS, Related Software, and Tools
The HDF-EOS Tools and Information Center
 
UML Representation of NPOESS Data Products in HDF5
The HDF-EOS Tools and Information Center
 
HDF-EOS Data Product Developer's Guide
The HDF-EOS Tools and Information Center
 
Metadata Requirements for EOSDIS Data Providers
The HDF-EOS Tools and Information Center
 
Using HDF5 Archive Information Package to preserve HDF-EOS2 data
The HDF-EOS Tools and Information Center
 
Data Are from Mars, Tools Are from Venus
The HDF-EOS Tools and Information Center
 
HDF-EOS APIs, tools, etc.
The HDF-EOS Tools and Information Center
 
HDF-EOS Data Extractor & Metadata Updater
The HDF-EOS Tools and Information Center
 
HDF-EOS Development: Current Status and Tools
The HDF-EOS Tools and Information Center
 
NASA HDF/HDF-EOS Data Access Challenges
The HDF-EOS Tools and Information Center
 
Ad

More from The HDF-EOS Tools and Information Center (20)

PDF
Cloud-Optimized HDF5 Files - Current Status
The HDF-EOS Tools and Information Center
 
PDF
Cloud Optimized HDF5 for the ICESat-2 mission
The HDF-EOS Tools and Information Center
 
PPTX
Access HDF Data in the Cloud via OPeNDAP Web Service
The HDF-EOS Tools and Information Center
 
PPTX
Upcoming New HDF5 Features: Multi-threading, sparse data storage, and encrypt...
The HDF-EOS Tools and Information Center
 
PPTX
The State of HDF5 / Dana Robinson / The HDF Group
The HDF-EOS Tools and Information Center
 
PDF
Cloud-Optimized HDF5 Files
The HDF-EOS Tools and Information Center
 
PDF
Accessing HDF5 data in the cloud with HSDS
The HDF-EOS Tools and Information Center
 
PPTX
Highly Scalable Data Service (HSDS) Performance Features
The HDF-EOS Tools and Information Center
 
PDF
Creating Cloud-Optimized HDF5 Files
The HDF-EOS Tools and Information Center
 
PPTX
HDF5 OPeNDAP Handler Updates, and Performance Discussion
The HDF-EOS Tools and Information Center
 
PPTX
Hyrax: Serving Data from S3
The HDF-EOS Tools and Information Center
 
PPSX
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
The HDF-EOS Tools and Information Center
 
PDF
HDF - Current status and Future Directions
The HDF-EOS Tools and Information Center
 
PPTX
HDF - Current status and Future Directions
The HDF-EOS Tools and Information Center
 
PDF
H5Coro: The Cloud-Optimized Read-Only Library
The HDF-EOS Tools and Information Center
 
PPTX
MATLAB Modernization on HDF5 1.10
The HDF-EOS Tools and Information Center
 
PPTX
HDF for the Cloud - Serverless HDF
The HDF-EOS Tools and Information Center
 
PPTX
HDF for the Cloud - New HDF Server Features
The HDF-EOS Tools and Information Center
 
Cloud-Optimized HDF5 Files - Current Status
The HDF-EOS Tools and Information Center
 
Cloud Optimized HDF5 for the ICESat-2 mission
The HDF-EOS Tools and Information Center
 
Access HDF Data in the Cloud via OPeNDAP Web Service
The HDF-EOS Tools and Information Center
 
Upcoming New HDF5 Features: Multi-threading, sparse data storage, and encrypt...
The HDF-EOS Tools and Information Center
 
The State of HDF5 / Dana Robinson / The HDF Group
The HDF-EOS Tools and Information Center
 
Cloud-Optimized HDF5 Files
The HDF-EOS Tools and Information Center
 
Accessing HDF5 data in the cloud with HSDS
The HDF-EOS Tools and Information Center
 
Highly Scalable Data Service (HSDS) Performance Features
The HDF-EOS Tools and Information Center
 
Creating Cloud-Optimized HDF5 Files
The HDF-EOS Tools and Information Center
 
HDF5 OPeNDAP Handler Updates, and Performance Discussion
The HDF-EOS Tools and Information Center
 
Hyrax: Serving Data from S3
The HDF-EOS Tools and Information Center
 
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
The HDF-EOS Tools and Information Center
 
HDF - Current status and Future Directions
The HDF-EOS Tools and Information Center
 
HDF - Current status and Future Directions
The HDF-EOS Tools and Information Center
 
H5Coro: The Cloud-Optimized Read-Only Library
The HDF-EOS Tools and Information Center
 
MATLAB Modernization on HDF5 1.10
The HDF-EOS Tools and Information Center
 
HDF for the Cloud - Serverless HDF
The HDF-EOS Tools and Information Center
 
HDF for the Cloud - New HDF Server Features
The HDF-EOS Tools and Information Center
 

Recently uploaded (20)

PDF
Ampere Offers Energy-Efficient Future For AI And Cloud
ShapeBlue
 
PPTX
Extensions Framework (XaaS) - Enabling Orchestrate Anything
ShapeBlue
 
PPTX
Top Managed Service Providers in Los Angeles
Captain IT
 
PPTX
Building a Production-Ready Barts Health Secure Data Environment Tooling, Acc...
Barts Health
 
PDF
Rethinking Security Operations - Modern SOC.pdf
Haris Chughtai
 
PDF
How a Code Plagiarism Checker Protects Originality in Programming
Code Quiry
 
PDF
CloudStack GPU Integration - Rohit Yadav
ShapeBlue
 
PDF
Building Resilience with Digital Twins : Lessons from Korea
SANGHEE SHIN
 
PPTX
Simplifying End-to-End Apache CloudStack Deployment with a Web-Based Automati...
ShapeBlue
 
PDF
Julia Furst Morgado The Lazy Guide to Kubernetes with EKS Auto Mode + Karpenter
AWS Chicago
 
PDF
"Effect, Fiber & Schema: tactical and technical characteristics of Effect.ts"...
Fwdays
 
PPTX
UI5Con 2025 - Beyond UI5 Controls with the Rise of Web Components
Wouter Lemaire
 
PPTX
Lecture 5 - Agentic AI and model context protocol.pptx
Dr. LAM Yat-fai (林日辉)
 
PPTX
Machine Learning Benefits Across Industries
SynapseIndia
 
PDF
UiPath vs Other Automation Tools Meeting Presentation.pdf
Tracy Dixon
 
PDF
2025-07-15 EMEA Volledig Inzicht Dutch Webinar
ThousandEyes
 
PPTX
Darren Mills The Migration Modernization Balancing Act: Navigating Risks and...
AWS Chicago
 
PPTX
The Yotta x CloudStack Advantage: Scalable, India-First Cloud
ShapeBlue
 
PDF
HR agent at Mediq: Lessons learned on Agent Builder & Maestro by Tacstone Tec...
UiPathCommunity
 
PDF
Women in Automation Presents: Reinventing Yourself — Bold Career Pivots That ...
DianaGray10
 
Ampere Offers Energy-Efficient Future For AI And Cloud
ShapeBlue
 
Extensions Framework (XaaS) - Enabling Orchestrate Anything
ShapeBlue
 
Top Managed Service Providers in Los Angeles
Captain IT
 
Building a Production-Ready Barts Health Secure Data Environment Tooling, Acc...
Barts Health
 
Rethinking Security Operations - Modern SOC.pdf
Haris Chughtai
 
How a Code Plagiarism Checker Protects Originality in Programming
Code Quiry
 
CloudStack GPU Integration - Rohit Yadav
ShapeBlue
 
Building Resilience with Digital Twins : Lessons from Korea
SANGHEE SHIN
 
Simplifying End-to-End Apache CloudStack Deployment with a Web-Based Automati...
ShapeBlue
 
Julia Furst Morgado The Lazy Guide to Kubernetes with EKS Auto Mode + Karpenter
AWS Chicago
 
"Effect, Fiber & Schema: tactical and technical characteristics of Effect.ts"...
Fwdays
 
UI5Con 2025 - Beyond UI5 Controls with the Rise of Web Components
Wouter Lemaire
 
Lecture 5 - Agentic AI and model context protocol.pptx
Dr. LAM Yat-fai (林日辉)
 
Machine Learning Benefits Across Industries
SynapseIndia
 
UiPath vs Other Automation Tools Meeting Presentation.pdf
Tracy Dixon
 
2025-07-15 EMEA Volledig Inzicht Dutch Webinar
ThousandEyes
 
Darren Mills The Migration Modernization Balancing Act: Navigating Risks and...
AWS Chicago
 
The Yotta x CloudStack Advantage: Scalable, India-First Cloud
ShapeBlue
 
HR agent at Mediq: Lessons learned on Agent Builder & Maestro by Tacstone Tec...
UiPathCommunity
 
Women in Automation Presents: Reinventing Yourself — Bold Career Pivots That ...
DianaGray10
 

Incorporating ISO Metadata Using HDF Product Designer

  • 1. SESIP_0716_AJ Incorporating ISO Metadata Using HDF Product Designer Aleksandar Jelenak, John Kozimor, Ted Habermann The HDF Group This work was supported by NASA/GSFC under Raytheon Co. contract number NNG15HZ39C
  • 2. SESIP_0716_AJ 2 The Problem The need for more contextual data (metadata) in HDF5 files is growing.
  • 3. SESIP_0716_AJ 3 The Solution Use the current conventions to the their fullest extent. Store the rest of metadata using the ISO 19115 standards.
  • 4. SESIP_0716_AJ 4 HDF Product Designer Can Help • Support for the most widely used Earth science metadata conventions. • The latest release (v1.4) allows import of ISO metadata objects into user designs.
  • 5. SESIP_0716_AJ 5 1. Use Case 2. Overview 3. Recommendations 4. Conceptual Model (UML) 5. Implementation (XML) 6. Implementation (NcML) HPD Design Name 7. Usage (UMM) 8. Crosswalks https://wiki.earthdata.nasa.gov/x/qorT
  • 8. SESIP_0716_AJ 8 Importing ISO Objects Separate project with pre-built ISO metadata components.
  • 9. SESIP_0716_AJ 9 Importing ISO Objects All groups in the ISO design have default role and type attributes. Do not change these! Repeating roles have "_<uniqueID>" added to their names
  • 11. SESIP_0716_AJ 11 Sample of Python Code # Group: /gmi:acquisitionInformation grp_1 = f.create_group('gmi:acquisitionInformation') # Creating attributes for /gmi:acquisitionInformation grp_1.attrs['role'] = "gmi:acquisitionInformation" grp_1.attrs['type'] = "gmi:MI_AcquisitionInformation" # Group: /gmi:acquisitionInformation/gmi:instrument grp_2 = grp_1.create_group('gmi:instrument') # Creating attributes for /gmi:acquisitionInformation/gmi:instrument grp_2.attrs['role'] = "gmi:instrument" grp_2.attrs['type'] = "gmi:MI_Instrument" grp_2.attrs['id'] = "instrument_1" # Group: /gmi:acquisitionInformation/gmi:instrument/gmi:citation grp_3 = grp_2.create_group('gmi:citation') # Creating attributes for /gmi:acquisitionInformation/gmi:instrument/gmi:citation grp_3.attrs['role'] = "gmi:citation" grp_3.attrs['type'] = "gmd:CI_Citation" grp_3.attrs['id'] = "fgdccitation_26722.114902.35002" # Group: /gmi:acquisitionInformation/gmi:instrument/gmi:citation/gmd:date grp_4 = grp_3.create_group('gmd:date') # Creating attributes for /gmi:acquisitionInformation/gmi:instrument/gmi:citation/gmd:date grp_4.attrs['role'] = "gmd:date" grp_4.attrs['type'] = "gmd:CI_Date"
  • 13. SESIP_0716_AJ 13 This work was supported by NASA/GSFC under Raytheon Co. contract number NNG15HZ39C