Difference between revisions of "Streaming and or netCDF File"
From Earth Science Information Partners (ESIP)
(One intermediate revision by the same user not shown) | |||
Line 1: | Line 1: | ||
<noinclude>{{AQ CoP Solta2011 Backlinks}} | <noinclude>{{AQ CoP Solta2011 Backlinks}} | ||
− | This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. | + | This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive [[Talk:Streaming_and_or_netCDF_File | discussion]] for this page. |
− | + | ==Background== | |
− | = | + | * speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false) |
+ | ** might not require "real streaming formats" such as ncstream | ||
+ | *** ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download | ||
+ | ** requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API) | ||
− | |||
− | + | == Features of data streaming relevant to AQ == | |
+ | |||
== AQ CoP Assessment == | == AQ CoP Assessment == |
Latest revision as of 03:11, August 1, 2011
< Back to | Workshops | Air Quality Data Network
This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive discussion for this page.
Background
- speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false)
- might not require "real streaming formats" such as ncstream
- ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download
- requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API)
- might not require "real streaming formats" such as ncstream