Difference between revisions of "Streaming and or netCDF File"

From Earth Science Information Partners (ESIP)
 
(2 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
<noinclude>{{AQ CoP Solta2011 Backlinks}}
 
<noinclude>{{AQ CoP Solta2011 Backlinks}}
  
This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. Se also the extensive [[Talk:Streaming_and/or_netCDF_File | discussion] for this page.
+
This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive [[Talk:Streaming_and_or_netCDF_File | discussion]] for this page.
  
===Background===
+
==Background==
  
== Features of data streaming relevant to AQ==
+
* speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false)
 +
** might not require "real streaming formats" such as ncstream
 +
*** ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download
 +
** requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API)
  
* streaming, ... Todd?
 
  
* Russ Rew of Unidata points out that
+
== Features of data streaming relevant to AQ ==
 +
 
  
 
== AQ CoP Assessment ==
 
== AQ CoP Assessment ==

Latest revision as of 03:11, August 1, 2011

< Back to AQ CoP.png | Workshops | Air Quality Data Network

This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive discussion for this page.

Background

  • speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false)
    • might not require "real streaming formats" such as ncstream
      • ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download
    • requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API)


Features of data streaming relevant to AQ

AQ CoP Assessment