Difference between revisions of "Streaming and or netCDF File"

From Earth Science Information Partners (ESIP)
 
Line 3: Line 3:
 
This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive [[Talk:Streaming_and_or_netCDF_File | discussion]] for this page.
 
This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive [[Talk:Streaming_and_or_netCDF_File | discussion]] for this page.
  
===Background===
+
==Background==
  
== Features of data streaming relevant to AQ==
+
* speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false)
 +
** might not require "real streaming formats" such as ncstream
 +
*** ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download
 +
** requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API)
  
* streaming, ... Todd?
 
  
* Russ Rew of Unidata points out that
+
== Features of data streaming relevant to AQ ==
 +
 
  
 
== AQ CoP Assessment ==
 
== AQ CoP Assessment ==

Latest revision as of 03:11, August 1, 2011

< Back to AQ CoP.png | Workshops | Air Quality Data Network

This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive discussion for this page.

Background

  • speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false)
    • might not require "real streaming formats" such as ncstream
      • ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download
    • requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API)


Features of data streaming relevant to AQ

AQ CoP Assessment