Difference between revisions of "WCS Outline"

From Earth Science Information Partners (ESIP)
Line 7: Line 7:
 
* [http://datafedwiki.wustl.edu/index.php/2007-10-16_HTAP_Juelich HTAP Juelich]
 
* [http://datafedwiki.wustl.edu/index.php/2007-10-16_HTAP_Juelich HTAP Juelich]
 
==HTAP Data Network Pilot ==
 
==HTAP Data Network Pilot ==
NetCDF (network Common Data Form) can be used to store and communicate multidimensional data, such as arising from Earth Observations and models. The NetCDF data model is particularly well suited for storing related arrays containing atmospheric and oceanic data and models. Climate and Forecast Metadata Conventions (CF) are used in conjunction with NetCDF as a means of specifying the semantic information.  The semantic metadata is conveyed internally within the NetCDF datasets which makes NetCDF is self documenting. This means that it can associate various physical quantities (such as location, pressure and temperature) with spatio-temporal locations (such as points at specific latitudes, longitudes, vertical levels, and times).  
+
The GEOSS air quality community and its projects has promoted the use of CF-netCDF as the binary incoming of data both for storage as well as for transmission of AQ-relevant data between servers and clients. The CF-netCDF data standard and the OGS WCS, WFS and WMS data access protocols constitutes a complete package for establishing a network of interoperable data finders, servers and clients.
 +
 
 +
=== The network Common Data Form (netCDF) binary data encoding standard === 
 +
The NetCDF (network Common Data Form) can be used to store and communicate multidimensional data, such as arising from Earth Observations and models. The NetCDF data model is particularly well suited for storing related arrays containing atmospheric and oceanic data and models. Climate and Forecast Metadata Conventions (CF) are used in conjunction with NetCDF as a means of specifying the semantic information.  The semantic metadata is conveyed internally within the NetCDF datasets which makes NetCDF is self documenting. This means that it can associate various physical quantities (such as location, pressure and temperature) with spatio-temporal locations (such as points at specific latitudes, longitudes, vertical levels, and times).  
  
 
This standard has been formally recognized by US Government NASA and NOAA standards bodies. Recently, UCAR has introduced NetCDF as a candidate OGC standard to encourage broader international use and greater interoperability among clients and servers interchanging data in binary form. This is the initial step in a longer-term plan for establishing CF-netCDF as an OGC standard for binary encoding. This will enable standard delivery of data in binary form via several OGC service interface standards, including the OGC Web Coverage Service (WCS), Web Feature Service (WFS), and Sensor Observation Service (SOS) Interface Standards.
 
This standard has been formally recognized by US Government NASA and NOAA standards bodies. Recently, UCAR has introduced NetCDF as a candidate OGC standard to encourage broader international use and greater interoperability among clients and servers interchanging data in binary form. This is the initial step in a longer-term plan for establishing CF-netCDF as an OGC standard for binary encoding. This will enable standard delivery of data in binary form via several OGC service interface standards, including the OGC Web Coverage Service (WCS), Web Feature Service (WFS), and Sensor Observation Service (SOS) Interface Standards.
  
  
For the past two decades, NetCDF is developed, maintained and actively supported by the University Corporation for Atmospheric Research (UCAR) http://www.unidata.ucar.edu/software/netcdf/.  NetCDF is a set of software libraries and machine-independent data formats that support the creation, access, and sharing of array-oriented scientific data. NetCDF has a strong and active user community and it is support is provided by a log-term program by the U.S. National Science Foundation.  The GEOSS air quality community and its projects has promoted the use of CF-netCDF as the binary incoming of data both for storage as well as for transmission between servers and clients. The CF-netCDF data standard and the OGS WCS data access protocol constitutes a complete package for establishing a network of interoperable data finders, servers and clients.  
+
For the past two decades, NetCDF was [http://www.unidata.ucar.edu/software/netcdf/ maintained and actively supported] by the University Corportion for Atmospheric Research (UCAR) .  NetCDF is a set of software libraries and machine-independent data formats that support the creation, access, and sharing of array-oriented scientific data. NetCDF has a strong and [http://www.unidata.ucar.edu/software/netcdf/docs/faq.html#maillist  user community] Unidata is supported by the U.S. National Science Foundation for the past 25 years.  
 
 
 
 
 
 
  
 
         Explain TF HTAP, participating nodes
 
         Explain TF HTAP, participating nodes

Revision as of 04:55, September 8, 2010

General Description of Atmospheric Model Evaluation Network (AMEN)

Drawing from the GEO Work Plan (Task DA-09-02d)Task

Demonstrate the use of web services to compare global and regional atmospheric models (including atmospheric chemistry/air quality models). Apply to a variety of Earth observations from distributed archives using standardized approaches to evaluate and improve model performance. Draw upon and contribute to the work of the Task Force on Hemispheric Transport of Air Pollution under the Convention on Long-range Transboundary Air Pollution, the IGAC-SPARC Atmospheric Chemistry and Climate Initiative, AeroCOM, and the Air Quality Model Evaluation International Initiative.

HTAP Data Network Pilot

The GEOSS air quality community and its projects has promoted the use of CF-netCDF as the binary incoming of data both for storage as well as for transmission of AQ-relevant data between servers and clients. The CF-netCDF data standard and the OGS WCS, WFS and WMS data access protocols constitutes a complete package for establishing a network of interoperable data finders, servers and clients.

The network Common Data Form (netCDF) binary data encoding standard

The NetCDF (network Common Data Form) can be used to store and communicate multidimensional data, such as arising from Earth Observations and models. The NetCDF data model is particularly well suited for storing related arrays containing atmospheric and oceanic data and models. Climate and Forecast Metadata Conventions (CF) are used in conjunction with NetCDF as a means of specifying the semantic information. The semantic metadata is conveyed internally within the NetCDF datasets which makes NetCDF is self documenting. This means that it can associate various physical quantities (such as location, pressure and temperature) with spatio-temporal locations (such as points at specific latitudes, longitudes, vertical levels, and times).

This standard has been formally recognized by US Government NASA and NOAA standards bodies. Recently, UCAR has introduced NetCDF as a candidate OGC standard to encourage broader international use and greater interoperability among clients and servers interchanging data in binary form. This is the initial step in a longer-term plan for establishing CF-netCDF as an OGC standard for binary encoding. This will enable standard delivery of data in binary form via several OGC service interface standards, including the OGC Web Coverage Service (WCS), Web Feature Service (WFS), and Sensor Observation Service (SOS) Interface Standards.


For the past two decades, NetCDF was maintained and actively supported by the University Corportion for Atmospheric Research (UCAR) .  NetCDF is a set of software libraries and machine-independent data formats that support the creation, access, and sharing of array-oriented scientific data. NetCDF has a strong and user community Unidata is supported by the U.S. National Science Foundation for the past 25 years.

       Explain TF HTAP, participating nodes
        http://wiki.esipfed.org/index.php/HTAP_GEOSS
       uFIND Interface
       ufind/facets - http://datafedwiki.wustl.edu/images/0/04/IGARSS_InternationalAQCommunity.ppt
       http://wiki.esipfed.org/index.php/HTAP_Report,_Sub-Chap._6_-_Data/Info_System

Development of CF Naming Convention and CF Consistency Tools

Development of WCS Servers

WCS Introduction

WCS Server

WCS Server StationPoint Data

WCS Server Cube Data

Mediators

Keating 2009:

Questions from the GEOCAPE Science Traceability Matrix

  • What are the emissions of gases and aerosols important for air quality and what are the processes controlling these emissions?
  • How do atmospheric transport, chemical evolution, and deposition determine tropospheric composition over scales ranging from urban to continental?
  • How do we improve air quality forecast and assessment models?
  • How do changes in air quality drive climate forcing on a continental scale?
  • How does intercontinental transport affect air quality?

Learning more from EOS, Applying lessons to GEOCAPE

  • The Air Quality Community is just starting to embrace the use of observations from EOS instruments (due in large part to the work of the NASA Air Quality Applications program).
  • As the AQ Community begins to build the infrastructure and capacity to use this information, it is based on the current suite of EOS instruments and datasets – what continuity will there be with GEO-CAPE?
  • The AQ Community consists of a wide spectrum of users with different needs and different capabilities to access and use the data.
  • What lessons can be learned from the current applications of EOS data products regarding data availability, data coverage, data formats, data accessibility, and data

quality?

Proposed Workshop Series on Satellite Observations in Air Quality Management

  • Engage a broader air quality management community: States, Academics, Private Sector Stakeholders
  • Opportunity for two-way communication between Air Quality and Satellite Communities
  • Not just about GEO-CAPE, but also about what can be done with the current stream of satellite observations.
  • Beginning of a longer-term process that we hope will continue as the mission develops and comes to fruition

GEOSS: A Technical Initiative

GEOSS is built around a minimal central clearinghouse and other components of a Common Infrastructure. This GCI is not to house data or tools for using data – it is used to enable users to find that data.

GEOSS registries are flexible enough to work with ‘any’ observation, so metadata will be less than needed for many users.

Community catalogs and portals are response this a to need for a richer access point, tuned for a particular user community.

GEOSS is about decision support. The GCI won’t provide that. It is set up as a base for service oriented architecture which will in turn improve decision support.

Architecture Implementation Pilot Output

AIP charge: produce ‘persistent exemplars’ to develop GEOSS

Air Quality The AIP AQ work group is building an AQ community infrastructure to compliment the GCI


Atmospheric Model Evaluation Network

  • Task DA-09-02d under Data Integration & Analysis
    • Use web services to compare global, regional models, including AQ models.
    • Apply various observations from distributed archives to evaluate & improve models.
  • Related international activities:
    • LRTAP Task Force on Hemispheric Transport of Air Pollution (TF HTAP)
    • IGAC-SPARC Atmospheric Chemistry & Climate initiative
    • AeroCom: International aerosol model - data comparison
    • Air Quality Model Evaluation International Initiative (AQMEII)
  • Related AMI activities:
    • Integration and Evaluation of Global Emissions Inventories in the NEISGEI Framework (06-66)
    • Remote Sensing Information Gateway (RSIG)
    • HTAP Data Network Pilot

Future for EPA GEO Air Theme: Developing an Air Quality Cyberinfrastructure “Consortium”

  • Need a team capable of linking and extending the existing elements of the air quality information system to create a stable cyberinfrastructure (hardware, software, standards, organizations, …).
  • Expertise needed in
    • air quality forecasting and public information
    • air quality assessment or “re-analysis”
    • air quality model evaluation and intercomparison
    • emissions inventory development and evaluation
    • fire and smoke management
    • cyberinfrastructure development
  • Some Possible Tasks for the Consortium
  • Air Quality Information System Wiki
    • Identify functions, strengths, weaknesses of, and relationships between existing air quality information systems
    • Develop consensus guidelines
  • Air Quality Data Network Development
    • Establish a community data and service catalogue specific for air quality information, establish exchange standards for creating connections between existing elements of

the air quality information system of systems, and implement such connections.

  • Air Quality Assessment Tools
    • Processing, visualization, and analytical tools for air quality assessment, or “reanalysis,” in which multiple types of observations and/or model estimates (drawn from across the air quality data network described above) are integrated to best describe the state of the atmosphere at a given point and time.
  • Air Quality Model Evaluation Tools
    • Tools that will enable modelers to compare regional and global model outputs in standard formats to a variety of types of observational data (drawn from across the air quality data network) and to perform standard tests and diagnostics.
  • Emissions Information and Tools
    • Building upon NEISGEI, EMF, and related systems.
  • Outreach and Coordination
    • Organize meetings and other outreach efforts to educate and communicate with the broader air quality management and research community

Opportunities for Constructive Engagement

  • EPA Working on Satellite Constructive Engagement Group Observations for Air Quality Management (and the NASA GEOCAPE Science and Air Quality Application Teams)
  • NARSTO Workshop Series on Use of Satellite Observations in Air Quality Management
  • EPA Cyberinfrastructure for Air Quality Management (CyAir)
  • GEO Air Quality Community of Practice and the ESIP Air Quality Cluster