Access HDF5 Datasets through OPeNDAP s Data Access Protocol DAP .


101 views
Uploaded on:
Category: Art / Culture
Description
Access HDF5 Datasets by means of OPeNDAP's Information Access Convention (DAP). MuQun Yang The HDF Bunch. OPeNDAP. A product system that permits straightforward access to remote information Customer server model Servers make the neighborhood information available remotely
Transcripts
Slide 1

Get to HDF5 Datasets by means of OPeNDAP\'s Data Access Protocol (DAP) MuQun Yang The HDF Group HDF and HDF-EOS Workshop X, Landover, MD

Slide 2

OPeNDAP A product structure that permits straightforward access to remote information Client-server demonstrate Servers make the neighborhood information available remotely Clients make applications effortlessly access to remote served information Widely utilized by Earth Science Community URL: http://www.opendap.org/HDF and HDF-EOS Workshop X, Landover, MD

Slide 3

The Data Request Data are asked for with a URL. http://www.cdc.noaa.gov/cgi-receptacle/nph-nc/datasets/Reynolds_sst Protocol Machine name OPeNDAP server Directory File name ?sst[10:10][0:90][0:180] Constraint The client can force a limitation on the information that s/he might want to get from an informational index by attaching a requirement expression to the finish of the URL. HDF and HDF-EOS Workshop X, Landover, MD

Slide 4

OPeNDAP Data Types OPeNDAP gives three essential information objects: information descriptor structure ( .dds ) - syntactic metadata - unbending information characteristic structure ( .das ) - semantic metadata - adaptable information ( .dods ) - the genuine information in a paired structure HDF and HDF-EOS Workshop X, Landover, MD

Slide 5

OPeNDAP Servers Flat Binary CODAR General netCDF HDF4 Matlab DSP Tables SQL FITS CDF CEDAR Data ESML netCDF Matlab JGOFS FITS FreeFrom CODAR HDF4 DSP JDBC CDF CEDAR No completely upheld HDF5 server HDF and HDF-EOS Workshop X, Landover, MD

Slide 6

IDL Client Matlab Client netCDF Java netCDF C Ferret GrADS IDV VisAD ncBrowse Matlab IDL Access Excel OPeNDAP Clients No HDF5 customer HDF and HDF-EOS Workshop X, Landover, MD

Slide 7

Why HDF5-OPeNDAP server and customer? Clients! Clients!! Clients!!! HDF and HDF-EOS Workshop X, Landover, MD

Slide 8

A User Case Task: 10 components of 17 MB HDF5 information 200 components of 10 MB NetCDF information 150 components of 5 MB HDF4 information HDF and HDF-EOS Workshop X, Landover, MD

Slide 9

General approach HDF5 information FTP HDF4 information FTP NetCDF information FTP HDF and HDF-EOS Workshop X, Landover, MD

Slide 10

Approach with OPeNDAP HDF5 information FTP HDF4 information server DAP customer NetCDF information DAP server HDF and HDF-EOS Workshop X, Landover, MD

Slide 11

Conclusion HDF5-DAP server is required HDF5-DAP customer is emphatically prescribed HDF and HDF-EOS Workshop X, Landover, MD

Slide 12

Previous work - A Prototype of DAP2-HDF5 server Incomplete mapping from HDF5 to OPeNDAP No far reaching test suite Only tried a couple of cases on two stages Incomplete documentation HDF and HDF-EOS Workshop X, Landover, MD

Slide 13

From HDF4 server at JPL From HDF5 server at NCSA A case from SSMI HDF and HDF-EOS Workshop X, Landover, MD

Slide 14

Current HDF5-OPeNDAP Support HDF5 DAP Prototyped Server No Client HDF and HDF-EOS Workshop X, Landover, MD

Slide 15

HDF5-OPeNDAP Project Two-year extend granted by NASA ROSES NRA Funding a great deal not as much as expected Original proposed work kept with huge commitments from ESDIS Starting date: Nov. 15 th , 2006 HDF and HDF-EOS Workshop X, Landover, MD

Slide 16

Proposed Work – programming advancement Implementation HDF5-DAP2 server HDF5-DAP4 server Deployment Release servers to OPeNDAP people group HDF and HDF-EOS Workshop X, Landover, MD

Slide 17

HDF5-DAP2 server Update and finish the model, including make records, guidelines, documentation, and so on Add a couple chose components to deal with NASA Aura information and NPOESS information Map HDF5 gathering to DAP(?) Map Object/local reference to DAP(?) Implement an extensive test suite Test on stages upheld by OPeNDAP Demonstrate with test NASA information HDF and HDF-EOS Workshop X, Landover, MD

Slide 18

Fully-Supported HDF5 Server HDF5 server DAP HDF5 server Matlab/Ferret Client DAP HDF and HDF-EOS Workshop X, Landover, MD

Slide 19

Proposed Work – programming improvement Implementation DAP4 to HDF5 change utility Deployment Release utility to OPeNDAP people group Design think about Feasibility of DAP-mindful HDF5 library HDF and HDF-EOS Workshop X, Landover, MD

Slide 20

Proposed Work - DAP to HDF5 utility An order line apparatus that proselytes DAP to HDF5 document individual DAP variable subsetting Conversion device HDF5 server DAP HDF and HDF-EOS Workshop X, Landover, MD

Slide 21

Proposed work - documentations DAP4 determination HDF5-DAP4 mapping archive DAP4 to HDF5 particular RFC for DAP-mindful HDF5 library Submit details to ESDSWG HDF and HDF-EOS Workshop X, Landover, MD

Slide 22

Acknowledgment This work was bolstered basing upon the Cooperative Agreement with the National Aeronautics and Space Administration (NASA) under NASA give NNG05GC60A.  Any sentiments, discoveries, and conclusions or suggestions communicated in this material are those of the author(s) and don\'t really mirror the perspectives of NASA.  HDF and HDF-EOS Workshop X, Landover, MD

Recommended
View more...