Back to top

Data Handlers

This page lists all of the data format handlers we provide, in any form, for Hyrax.

There are three broad classifications of handlers listed here:

  1. Handlers for which we provide full support: We ensure these work with the latest data server and we provide binary builds.
  2. Handlers for which we provide source releases: We often test these against our current server, but not always. We don't, as a rule, provide binary builds for these handlers.
  3. Handlers for which we do not release on a schedule: These are stored in our source code management system (which uses 'subversion') which is open for read-access to all and write-access by request.

If you've written, or are in the process of writing a handler, and you would like us to distribute it, let someone at OPeNDAP know.

Hyrax also supports Response Handlers and Server function handlers.

Format Handlers with full support

HDF4
This handler reads data stored in HDF 4 and HDF-EOS files. To run this you will also need the HDF 4 libraries on your system.
HDF5
HDF5 is a widely used data format used both in and outside of the science community. Soon to be released.
NetCDF 3
This handler reads data stored in netCDF 3 files. It looks for COARDS-compliant files and, if found, promotes arrays to DAP Grid variables so that software that's not COARDS-compliant can make use of bound dimensions.
FreeForm
The handler is designed to work with any ASCII or binary data that can be described using FreeForm. The data must be strictly organized in columns, but otherwise there are very few limitations on the data format. FreeForm supports data files with headers.
FITS
Written by Jose Garcia and Patrick West.
GDAL
GDAL is a library which simplifies reading from geo-referenced data sources. The GDAL handler can read from any of file formats GDAL supports. The formats include GeoTIFF, JPEG2000, and many other formats common in the GIS world. Written by Frank Warmerdam. 
NcML
This handler allows the use of a subset of NcML for manipulating existing datasets on the local server. Using this module, an author may add, modify, and/or remove existing metadata (attributes) and variables from an underlying dataset, or entirely specify a virtual dataset. The module also allows for the aggregation of multiple datasets into one larger virtual dataset --- currently, joinNew, union, and some joinExisting aggregations are supported.
DMR++
This handler subsets data stored in HDF5/NetCDF4 directory from S3 or Google Cloud Store, using information in an ancillary file. It will read chunks in these file in parallel.
Gateway
This handler is not technically a 'format' but instead a way to pull data from a remote location to Hyrax so that it can be served.
HTTPD Catalog
Another remote access handler. This uses THREDDS catalogs to build local inventories of data that maybe local or remote. In the latter case, data are transferred to Hyrax and then served.
CMR
This handler allows the use of a subset of NcML for manipulating existing datasets on the local server. Using this module, an author may add, modify, and/or remove existing metadata (attributes) and variables from an underlying dataset, or entirely specify a virtual dataset. The module also allows for the aggregation of multiple datasets into one larger virtual dataset --- currently, joinNew, union, and some joinExisting aggregations are supported.
 

Format Handlers with source-only support

DSP
DSP is a satellite image processing system from the University of Miami.
JGOFS
JGOFS is the data system for the JGOFS (Joint Global Ocean Flux Study) data system developed by Glenn Flierl. This handler can both read data files that the JGOFS data system can read and act as a gateway between a DAP server and a JGOFS server.
SQL
Access SQL databases using ODBC drivers. This code is fairly general and will work with any data source that can be accessed using ODBC. Caveat: ODBC drivers can be complex to install and configure. 

Format Handlers in our source code control system

We don't have a page in the web site for most of these, so the link points to our source code control system. You can browse the source using the link or use a Git client to check the code out using the git link.

Some of these were written by folks outside of OPeNDAP and I've tried to give the authors credit. My apologies if I leave out anyone's name; if you do notice an omission, please let me know at jgallagher@opendap.org. Also, if you would like to add to the description, please send that information along and I'll include it.

CDF
This handler was originally written by Charles Faulkenberg for a demo at the SISIC meeting. Subsequently Patrick West updated the code. (GitHub)
CEDAR
Written by Jose Garcia and Patrick West. (GitHub)
 
Matlab
This handler was written for Matlab 4 files by Reza Nekovei. (GitHub)