Sensor Data Archiving

• Archival data formats
  • Databases
  • File systems
  • Netcdf, RDF, CUAHSI HIS Observation Data Model, etc.
• Versioning
  • Create a "citable" database: monthly, annual, or periodic snapshots
  • Release of provisional vs. final data
  • Tracking changes to the data, e.g., audit trail
• Identify data level - maintain/provide products at different data levels
  • Level 0 - Raw data, no QC, no data qualifiers applied (data flags)
    • Preservation of original data streams
    • Datalogger conversion of units and formats may be acceptable
  • Level 1 - QC’d, calibrated data, qualifiers added
    • Provisional level (near real-time preparation)
    • Published level (delayed release)
  • Level 2
    • Gap-filled, estimated, or aggregated data
    • Involves interpretation – multiple algorithms possible