Streaming and or netCDF File

From Earth Science Information Partners (ESIP)

< Back to AQ CoP.png | Workshops | Air Quality Data Network

This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive discussion for this page.

Background

  • speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false)
    • might not require "real streaming formats" such as ncstream
      • ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download
    • requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API)


Features of data streaming relevant to AQ

AQ CoP Assessment