Difference between revisions of "WCS NetCDF-CF Updates"

From Earth Science Information Partners (ESIP)
Line 3: Line 3:
  
 
=== Current External Installations ===
 
=== Current External Installations ===
 +
 +
''' Juelich '''
  
 
[http://htap.icg.kfa-juelich.de:58080/HTAP?service=WCS&version=1.1.0&Request=GetCapabilities Juelich HTAP Models Capabilities Document]
 
[http://htap.icg.kfa-juelich.de:58080/HTAP?service=WCS&version=1.1.0&Request=GetCapabilities Juelich HTAP Models Capabilities Document]
Line 11: Line 13:
  
 
[http://webapps.datafed.net/datafed_catalog.aspx?domain=HTAP View the Full Catalog]
 
[http://webapps.datafed.net/datafed_catalog.aspx?domain=HTAP View the Full Catalog]
 +
 +
 +
'''Northrop Grumman Geoenterpiselab '''
 +
 +
[http://ww10.geoenterpriselab.com/northropgrumman?service=wcs&version=1.1.0&request=getcapabilities Capabilities of CALPuff] This is a demo for NetCDF daily slices. It's using Smokefire data.
 +
 +
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=CALPuff Browse]
 +
 +
 +
[http://ww10.geoenterpriselab.com/losangeles?service=wcs&version=1.1.0&request=getcapabilities Capabilities of losangeles] Smokefire data of Los Angeles at 2009.
 +
 +
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=losangeles_09 Browse]
 +
 +
[http://ww10.geoenterpriselab.com/neworleans?service=wcs&version=1.1.0&request=getcapabilities Capabilities of New Orleans 2009] Smokefire data of Los Angeles at 2009.
 +
 +
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=neworl2 Browse]
 +
 +
 +
[http://ww10.geoenterpriselab.com/niagara?service=wcs&version=1.1.0&request=getcapabilities Capabilities of Niagara Fire]
 +
 +
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=Niagara_fire Browse]
 +
 +
 +
[http://ww10.geoenterpriselab.com/nyc?service=wcs&version=1.1.0&request=getcapabilities Capabilities of New York Fire]
 +
 +
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=nyc_fire Browse]
 +
 +
 +
[http://ww10.geoenterpriselab.com/santabarbara?service=wcs&version=1.1.0&request=getcapabilities Santa Barbara Fire]
 +
 +
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=santabarbara Browse]
 +
 +
 +
[http://ww10.geoenterpriselab.com/SiB3_Carbon_Flux?service=wcs&version=1.1.0&request=getcapabilities Oak Ridge National Laboratory SiB3 Carbon Flux]
 +
 +
[http://webapps.datafed.net/datafed.aspx?dataset_abbr=SiB3_Carbon_Flux Browse]
  
 
=== Current Installations at Datafed ===
 
=== Current Installations at Datafed ===

Revision as of 10:01, May 5, 2010

WCS for NetCDF-CF Updates

Current External Installations

Juelich

Juelich HTAP Models Capabilities Document

This is a large set of models with monthly data. They have been registered for datafed client.

Example: Mole Fraction of SO2 in the Air

View the Full Catalog


Northrop Grumman Geoenterpiselab

Capabilities of CALPuff This is a demo for NetCDF daily slices. It's using Smokefire data.

Browse


Capabilities of losangeles Smokefire data of Los Angeles at 2009.

Browse

Capabilities of New Orleans 2009 Smokefire data of Los Angeles at 2009.

Browse


Capabilities of Niagara Fire

Browse


Capabilities of New York Fire

Browse


Santa Barbara Fire

Browse


Oak Ridge National Laboratory SiB3 Carbon Flux

Browse

Current Installations at Datafed

CMAQ_Baron data from CATHALAC cached at datafed

Browse 20 km resolution and 5 Browse km resolution


Capabilities of CMAQ_DISP is an aerosol related dataset derived from the Total Ozone Monitoring Satellite (TOMS) Sensor, cached at datafed

Browse


Capabilities of MODIS4_AOT AOT at 0.55 micron for both ocean (best) and land (corrected) cached at datafed. This is an 0.1 degree resolution cube for 10 years, is served fom one 85 gigabyte netcdf cube.

Browse


Capabilities of Southeast Asia 2006 Southeast Asia Emission Inventory in 2006 for the NASA INTEX-B Mission, cached at datafed.

Browse

New Features and Bug Fixes

2010-03-10, By Decker:

  • upgraded server code to WCS version 1.1.2 requirements
  • implemented minimum requirements for WCS 1.1.2
  • totally restructured wcs.py in the process to be able to support new versions more easily in the future (hopefully)
  • versions 1.1.0 and 1.1.1 will be treated by the same code as 1.1.2 as no real protocol differences were found in the spec documents
  • introduced wcs_capabilities.conf in provider dir to provide some static but provider specific settings (Contact, Title, etc); also see inline documentation in that file
  • moved providers from static to own providers dir, so that provider data is not freely accessible via static path any more
  • index.html contents will now be delivered via owsutil.StringResponse
  • moved logs out of static
  • changed owsadmin from a tool generating static xml documents to a tool that collects all relevant metadata for realtime generation of XML responses to all requests
  • metadata is saved as a pickled nested dict in "metadata.dat" in the provider dir -> completely removed template concept
  • added get_range method to all relevant iso_time Time classes
  • changed pync3 time filtering code to handle exact points in time and time ranges
  • added very basic support for multiple CRS definitions
  • introduced config.float_precision to globally set number of digits that floats should be rounded to before comparing them
  • added config options for supported formats and CRSs to be announced in responses
  • updated inline documentation
  • moved ows_name, wcs_name, etc. from owsadmin to owsutil
  • updated ExceptionReport generation
  • owsparser will not mask ";" characters any more as they should be escaped (%3B) if they are not meant to be interpreted by the parser


2010-04-02, By Hoijarvi:

  • Added more query unit tests.

2010-04-05, By Hoijarvi:

  • Upgraded to NetCDF 4 library. This version allows cubes bigger than 2 GB to be used as data source.

2010-04-07, By Decker:

  • Internal improvements in ISO 8609 time parsing, correctly rejecting time zone information from full dates without time.
  • Darcs update: upgraded the repository format from the original to darcs-2. New darcs access requires darcs 2

2010-04-09, By Hoijarvi:

  • Homepages of the service and the providers are now redirected properly, so the html documents can use relative addresses for images and other hyperlinks.
  • Added real W3C-Schema based XML validation for Capabilities and Coverage Descriptions, fixed automated creation of them.

2010-04-14, By Hoijarvi:

  • Fixed NCML interpretation to avoid accumulation of rounding errors when creating values for dimension variables.
  • Allowed querying without bbox. The spec requires either time or bbox filter.

2010-04-15, By Hoijarvi:

  • Re-enabled month, day_of_week, and hour_of_day filters to allow queries like: every noon hour of every weekend in every summer month. This is a non-standard extension.
  • switched from standard python urlparse to own version, to allow semicolon to be used as a separator as it is used in specs.

2010-04-27, By Hoijarvi:

  • Optimization to allow big queries: 500 MB cubes used to cause out of memory exception.
  • Optimized datafed client to do big aggregations with multiple small queries. This enables aggregation of multi-gigabyte queries.

2010-04-29, By Hoijarvi:

  • Fix to allow dimensions to have only one coordinate.

2010-05-05, By Decker:

  • remove unused imports from desc_t
  • updated webpy_logger to wsgilog 0.2
  • improved query parser (parse_qsl)
  • improved is_num_type()