Difference between revisions of "Sensor Data Archiving"
From Earth Science Information Partners (ESIP)
(Created page with "* Archival data formats ** Databases ** File systems ** Netcdf, RDF, CUAHSI HIS Observation Data Model, etc. * Versioning ** Create a "citable" database: monthly, annual, or ...") |
|||
Line 1: | Line 1: | ||
+ | back to [[EnviroSensing Cluster]] main page | ||
+ | |||
+ | |||
* Archival data formats | * Archival data formats | ||
** Databases | ** Databases |
Revision as of 13:53, November 14, 2012
back to EnviroSensing Cluster main page
- Archival data formats
- Databases
- File systems
- Netcdf, RDF, CUAHSI HIS Observation Data Model, etc.
- Versioning
- Create a "citable" database: monthly, annual, or periodic snapshots
- Release of provisional vs. final data
- Tracking changes to the data, e.g., audit trail
- Identify data level - maintain/provide products at different data levels
- Level 0 - Raw data, no QC, no data qualifiers applied (data flags)
- Preservation of original data streams
- Datalogger conversion of units and formats may be acceptable
- Level 1 - QC’d, calibrated data, qualifiers added
- Provisional level (near real-time preparation)
- Published level (delayed release)
- Level 2
- Gap-filled, estimated, or aggregated data
- Involves interpretation – multiple algorithms possible
- Level 0 - Raw data, no QC, no data qualifiers applied (data flags)