Difference between revisions of "WCS NetCDF-CF Updates"

From Earth Science Information Partners (ESIP)
Line 31: Line 31:
 
=== Current Installations at Datafed ===
 
=== Current Installations at Datafed ===
  
 +
[http://128.252.202.19:8080/NASA?service=wcs&version=1.1.0&request=GetCapabilities Capabilities of MODIS4_AOT] AOT at 0.55 micron for both ocean (best) and land (corrected) cached at datafed. This is an 0.1 degree resolution cube for 10 years, is served fom one 85 gigabyte netcdf cube. [http://webapps.datafed.net/datafed.aspx?dataset_abbr=MODIS4_AOT Browse]
  
[http://128.252.202.19:8080/CMAQ_Baron?service=WCS&version=1.1.0&request=GetCapabilities CMAQ_Baron data from CATHALAC cached at datafed]
+
[http://128.252.202.19:8080/NRL?service=WCS&version=1.1.0&request=GetCapabilities Capabilities of NAAPS] 4-dimensional AOD model from Naval Research laboratory. [http://webapps.datafed.net/datafed.aspx?dataset_abbr=MODIS4_AOT Browse]
  
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=CMAQ_Baron_G Browse 20 km resolution] and [http://webapps.datafed.net/datafed.aspx?dataset_abbr=CMAQ_Baron5_G 5 Browse km resolution]
 
  
 +
[http://128.252.202.19:8080/NASA?service=wcs&version=1.1.0&request=GetCapabilities Capabilities of Southeast Asia 2006] Southeast Asia Emission Inventory in 2006 for the NASA INTEX-B Mission, cached at datafed. [http://webapps.datafed.net/datafed.aspx?dataset_abbr=SE_ASIA_2006 Browse]
  
[http://128.252.202.19:8080/BlueSky?service=wcs&version=1.1.0&request=GetCapabilities Capabilities of CMAQ_DISP] is an aerosol related dataset derived from the Total Ozone Monitoring Satellite (TOMS) Sensor, cached at datafed
 
  
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=CMAQ_DISP_D Browse]
+
[http://128.252.202.19:8080/CMAQ_Baron?service=WCS&version=1.1.0&request=GetCapabilities CMAQ_Baron data from CATHALAC cached at datafed]
  
 +
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=CMAQ_Baron_G Browse 20 km resolution] and [http://webapps.datafed.net/datafed.aspx?dataset_abbr=CMAQ_Baron5_G 5 Browse km resolution]
  
[http://128.252.202.19:8080/NASA?service=wcs&version=1.1.0&request=GetCapabilities Capabilities of MODIS4_AOT] AOT at 0.55 micron for both ocean (best) and land (corrected) cached at datafed. This is an 0.1 degree resolution cube for 10 years, is served fom one 85 gigabyte netcdf cube.
+
[http://128.252.202.19:8080/BlueSky?service=wcs&version=1.1.0&request=GetCapabilities Capabilities of CMAQ_DISP] is an aerosol related dataset derived from the Total Ozone Monitoring Satellite (TOMS) Sensor, cached at datafed. [http://webapps.datafed.net/datafed.aspx?dataset_abbr=CMAQ_DISP_D Browse]
 
 
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=MODIS4_AOT Browse]
 
 
 
 
 
[http://128.252.202.19:8080/NASA?service=wcs&version=1.1.0&request=GetCapabilities Capabilities of Southeast Asia 2006] Southeast Asia Emission Inventory in 2006 for the NASA INTEX-B Mission, cached at datafed.  
 
 
 
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=SE_ASIA_2006 Browse]
 
  
 
===New Features and Bug Fixes===
 
===New Features and Bug Fixes===

Revision as of 10:17, May 5, 2010

WCS for NetCDF-CF Updates

External Installations: Juelich

Juelich HTAP Models Capabilities Document

This is a large set of models with monthly data. They have been registered for datafed client.

Example: Mole Fraction of SO2 in the Air

View the Full Catalog


External Installations: Northrop Grumman Geoenterpiselab

Capabilities of CALPuff This is a demo for NetCDF daily slices. It's using Smokefire data. Browse

Capabilities of losangeles Smokefire data of Los Angeles at 2009. Browse

Capabilities of New Orleans 2009 Smokefire data of Los Angeles at 2009. Browse

Capabilities of Niagara Fire Browse

Capabilities of New York Fire Browse

Santa Barbara Fire Browse

Oak Ridge National Laboratory SiB3 Carbon Flux Browse

Current Installations at Datafed

Capabilities of MODIS4_AOT AOT at 0.55 micron for both ocean (best) and land (corrected) cached at datafed. This is an 0.1 degree resolution cube for 10 years, is served fom one 85 gigabyte netcdf cube. Browse

Capabilities of NAAPS 4-dimensional AOD model from Naval Research laboratory. Browse


Capabilities of Southeast Asia 2006 Southeast Asia Emission Inventory in 2006 for the NASA INTEX-B Mission, cached at datafed. Browse


CMAQ_Baron data from CATHALAC cached at datafed

Browse 20 km resolution and 5 Browse km resolution

Capabilities of CMAQ_DISP is an aerosol related dataset derived from the Total Ozone Monitoring Satellite (TOMS) Sensor, cached at datafed. Browse

New Features and Bug Fixes

2010-03-10, By Decker:

  • upgraded server code to WCS version 1.1.2 requirements
  • implemented minimum requirements for WCS 1.1.2
  • totally restructured wcs.py in the process to be able to support new versions more easily in the future (hopefully)
  • versions 1.1.0 and 1.1.1 will be treated by the same code as 1.1.2 as no real protocol differences were found in the spec documents
  • introduced wcs_capabilities.conf in provider dir to provide some static but provider specific settings (Contact, Title, etc); also see inline documentation in that file
  • moved providers from static to own providers dir, so that provider data is not freely accessible via static path any more
  • index.html contents will now be delivered via owsutil.StringResponse
  • moved logs out of static
  • changed owsadmin from a tool generating static xml documents to a tool that collects all relevant metadata for realtime generation of XML responses to all requests
  • metadata is saved as a pickled nested dict in "metadata.dat" in the provider dir -> completely removed template concept
  • added get_range method to all relevant iso_time Time classes
  • changed pync3 time filtering code to handle exact points in time and time ranges
  • added very basic support for multiple CRS definitions
  • introduced config.float_precision to globally set number of digits that floats should be rounded to before comparing them
  • added config options for supported formats and CRSs to be announced in responses
  • updated inline documentation
  • moved ows_name, wcs_name, etc. from owsadmin to owsutil
  • updated ExceptionReport generation
  • owsparser will not mask ";" characters any more as they should be escaped (%3B) if they are not meant to be interpreted by the parser


2010-04-02, By Hoijarvi:

  • Added more query unit tests.

2010-04-05, By Hoijarvi:

  • Upgraded to NetCDF 4 library. This version allows cubes bigger than 2 GB to be used as data source.

2010-04-07, By Decker:

  • Internal improvements in ISO 8609 time parsing, correctly rejecting time zone information from full dates without time.
  • Darcs update: upgraded the repository format from the original to darcs-2. New darcs access requires darcs 2

2010-04-09, By Hoijarvi:

  • Homepages of the service and the providers are now redirected properly, so the html documents can use relative addresses for images and other hyperlinks.
  • Added real W3C-Schema based XML validation for Capabilities and Coverage Descriptions, fixed automated creation of them.

2010-04-14, By Hoijarvi:

  • Fixed NCML interpretation to avoid accumulation of rounding errors when creating values for dimension variables.
  • Allowed querying without bbox. The spec requires either time or bbox filter.

2010-04-15, By Hoijarvi:

  • Re-enabled month, day_of_week, and hour_of_day filters to allow queries like: every noon hour of every weekend in every summer month. This is a non-standard extension.
  • switched from standard python urlparse to own version, to allow semicolon to be used as a separator as it is used in specs.

2010-04-27, By Hoijarvi:

  • Optimization to allow big queries: 500 MB cubes used to cause out of memory exception.
  • Optimized datafed client to do big aggregations with multiple small queries. This enables aggregation of multi-gigabyte queries.

2010-04-29, By Hoijarvi:

  • Fix to allow dimensions to have only one coordinate.

2010-05-05, By Decker:

  • remove unused imports from desc_t
  • updated webpy_logger to wsgilog 0.2
  • improved query parser (parse_qsl)
  • improved is_num_type()