Streaming and or netCDF File

From Earth Science Information Partners (ESIP)
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

< Back to AQ CoP.png | Workshops | Air Quality Data Network

This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive discussion for this page.

Background

  • speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false)
    • might not require "real streaming formats" such as ncstream
      • ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download
    • requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API)


Features of data streaming relevant to AQ

AQ CoP Assessment