Difference between revisions of "Streaming and or netCDF File"
From Earth Science Information Partners (ESIP)
(10 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
<noinclude>{{AQ CoP Solta2011 Backlinks}} | <noinclude>{{AQ CoP Solta2011 Backlinks}} | ||
− | See Talk | + | This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive [[Talk:Streaming_and_or_netCDF_File | discussion]] for this page. |
− | === | + | ==Background== |
− | |||
− | |||
− | |||
− | + | * speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false) | |
− | + | ** might not require "real streaming formats" such as ncstream | |
− | * | + | *** ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download |
− | * | + | ** requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API) |
− | |||
− | |||
− | * | ||
− | |||
+ | == Features of data streaming relevant to AQ == | ||
− | + | ||
− | + | == AQ CoP Assessment == | |
− |
Latest revision as of 03:11, August 1, 2011
< Back to | Workshops | Air Quality Data Network
This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive discussion for this page.
Background
- speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false)
- might not require "real streaming formats" such as ncstream
- ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download
- requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API)
- might not require "real streaming formats" such as ncstream