Sensor Data Archiving
From Earth Science Information Partners (ESIP)
back to EnviroSensing Cluster main page
- Archival data formats
- Databases
- File systems
- Netcdf, RDF, CUAHSI HIS Observation Data Model, etc.
- Versioning
- Create a "citable" database: monthly, annual, or periodic snapshots
- Release of provisional vs. final data
- Tracking changes to the data, e.g., audit trail
- Identify data level - maintain/provide products at different data levels
- Level 0 - Raw data, no QC, no data qualifiers applied (data flags)
- Preservation of original data streams
- Datalogger conversion of units and formats may be acceptable
- Level 1 - QC’d, calibrated data, qualifiers added
- Provisional level (near real-time preparation)
- Published level (delayed release)
- Level 2
- Gap-filled, estimated, or aggregated data
- Involves interpretation – multiple algorithms possible
- Level 0 - Raw data, no QC, no data qualifiers applied (data flags)