Talk:Streaming and or netCDF File

From Earth Science Information Partners (ESIP)
Revision as of 06:40, July 14, 2011 by Rhusar (talk | contribs) (Streaming netCDF -- ~~~~)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Streaming netCDF -- Rhusar 06:40, 14 July 2011 (MDT)

Is it possible to stream netcdf output files to the client on-the-fly without the need to save them locally on disk first? this would eliminate a disk i/o bottleneck and also ease possible restrictions on the maximum size of requested datasets. (this would at least be useful for the store=false mode of operation). In this context we should also explore if there are any benefits from using openDAP to some extent. Another idea we had was to find some way to reliably estimate (or predict) the total dataset size before delivery (and possibly before assembly of the result on the server). This would be useful on the server side to restrict queries that will be too big as well as on the user side to give an idea about likely download durations.