Difference between revisions of "Streaming and or netCDF File"
From Earth Science Information Partners (ESIP)
(Created page with "<noinclude>{{AQ CoP Solta2011 Backlinks}} See Talk Page dor discussion Page for describing * streaming, * netCDF and * Comparison") |
|||
| (13 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
<noinclude>{{AQ CoP Solta2011 Backlinks}} | <noinclude>{{AQ CoP Solta2011 Backlinks}} | ||
| − | See Talk | + | This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive [[Talk:Streaming_and_or_netCDF_File | discussion]] for this page. |
| − | + | ==Background== | |
| − | * streaming, | + | |
| − | * | + | * speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false) |
| − | + | ** might not require "real streaming formats" such as ncstream | |
| + | *** ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download | ||
| + | ** requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API) | ||
| + | |||
| + | |||
| + | == Features of data streaming relevant to AQ == | ||
| + | |||
| + | |||
| + | == AQ CoP Assessment == | ||
Latest revision as of 03:11, August 1, 2011
< Back to 
| Workshops | Air Quality Data Network
This page is for summarizing the discussion assessment on the topic of streaming vs file transfer. See also the extensive discussion for this page.
Background
- speed up delivery of netcdf files by avoiding a local copy action before the download (if store=false)
- might not require "real streaming formats" such as ncstream
- ncstream is a new format that differs from current netcdf 3/4, hence users would have to locally convert from ncstream to "normal" netcdf if they want a netcdf file in the end. Therefore, ncstream may be useful for specific client applications, but maybe not for general file download
- requires separation of header creation and variable data (this is probably accomplished in C API but we are not sure about Python API)
- might not require "real streaming formats" such as ncstream
