Product Designer Hub - Taking HPD to the Web
Download as PPTX, PDF•0 likes•481 views
The document discusses the Product Designer Hub, which aims to take the HDF data format to the web by developing a system with the following key components: 1. A data store to manage user accounts, projects, file structures and metadata. 2. A RESTful server to enable exporting HDF files and data to various formats like JSON, CSV, and importing from formats like XML, MATLAB, and Python. 3. A web service that can ingest metadata from various XML dialects, transform it to HDF groups and attributes, and generate HDF files, JSON, and code templates from the metadata. 4. A client-server architecture where client software like web applications can access HDF files and data through the REST
Product Designer Hub - Taking HPD to the Web
- 1. Product Designer Hub – Taking HPD to the Web 1 Ted Habermann Director of Earth Science [email protected]
- 2. HPD System Overview 2 Data Store (users, projects, file structures, metadata) Desktop Client (Easy Install) Restful Server Export Options HDF5 JSON HDF4 MAP NcML (Remote) HDF online (files, data) OPeNDAP DMR CDLHDF5 Excel Text (CSV) DB HDF JSON Import Options IDL MATLAB Python Description File (doc) HDF5 Template HDF JSON
- 3. HPD System Overview 3 Data Store (users, projects, file structures, metadata) Desktop Client (Easy Install) Restful Server Export Options HDF5 JSON HDF4 MAP NcML (Remote) HDF online (files, data) OPeNDAP DMR CDLHDF5 Excel Text (CSV) DB HDF JSON Import Options IDL MATLAB Python Description File (doc) HDF5 Template HDF JSON
- 4. Product Designer Hub - Overview Browser WebService HDF JSON XML ISO / NcML / WaterML / SensorML / EML HDF online (files, data) IDL MATLAB Python Description File (doc) HDF5 Template HDF JSON Validators / Evaluators GeoNetwork Annotators File Browser / Compass
- 5. Community Metadata in HDF 1) Many communities use metadata dialects that include XML representations. 2) There is a straightforward correspondence between XML structures and HDF groups and attributes. 3) We can create a web service that A. ingests metadata in XML B. transforms that XML into HDF Groups and Attributes (either HDF-XML or NcML) C. creates an HDF file that includes the metadata D. use that file to create A. HDF-JSON B. code in IDL, matlab, or python C. A design document in Word
- 6. Community Metadata in HDF 6
- 7. Product Designer Hub – V0 Browser XML ISO / NcML / WaterML / SensorML / TSML HDF online (files, data) Local Disk The web service: 1. receives the uploaded file 2. checks the XML dialect 3. if is is one of the known dialects: 1. translate the XML to NcML 2. ingest the NcML into HDF 3. return HDF file to user HDF5 Template XML EML
- 8. Client/Server Architecture Client Software Stack HDF Service (h5serv or …) HDF5 Lib REST VOL NetCDF4 Lib C/Fortran Application h5pyd REST Backend Python Applications CMD Line Tools Note: Clients don’t need to know what’s going on inside this box! Browser Web Application HDF REST API (http) S3 VFD
- 9. Web UI – Display HDF Content in a browser https://data.hdfgroup.org