Difference between revisions of "Networking of Air Quality Data"

Latest revision as of 17:13, January 21, 2013

Background

The mission of the Environmental Protection Agency is to protect human health and the environment. Air quality management involves many activities including setting and maintaing air quality standards, monitoring trends, informing the public, etc. Each of these activities have different information needs. In the past both the monitoring and assessment of air quality has been performed in specific programs each directed and somewhat confined to the specific applications that they served.

Recently, the Agency developed and now is in the process of implementing a new National Air Monitoring Strategy(NAMS). NAMS was designed to produce more reusable datasets for multiple programs/applications in EPA. Implicit in the new strategy is that there is a corresponding new Information System strategy that facilitates the access, processing/analysis/integration of broad range of data applicable to multiple uses.

GEOSS and Air Quality Data Systems

At the international level, the 70-nation Group on Earth Observations (or GEO) is coordinating international efforts to build a Global Earth Observation System of Systems (GEOSS). This emerging public infrastructure (system of systems) is interconnecting a diverse and growing array of instruments and systems for monitoring and forecasting changes in the global environment.

The common characteristics of both the planned EPA and GEOSS information systems are:

A single problem requires many data sets.
A single data set will serve many communities

The above two characteristics of the information system puts high demand on the architecture of the information system that facilitates the flow of the data resources from the providers to the users via a suitable data processing chain. An ingeneous solution to the many-to-many connections is illustrated schematically in the above "bow-tie" or fan in-fan out representation. The left hand side, fan in section, represents the collection of the distributed data resources into a common data access system, represented by the barrel. The potential users of the data, shown on the right hand side, satisfy their data by selecting from the common data pool. The fan out represents the fact that each user may need different combination of data and processing services.

It is recognized that creating a common database that collects all the relavent data and metadata into a single physical database is not practical. An alternative is the network approach where data and information services represent nodes in a network that can be dynamically connected to form user-driven data flow systems.

GEOSS, like the Internet, connects data/information providers and users; to deliver reliable, up-to-date and user friendly information – vital for the work of decision makers, planners and emergency managers. The GEOSS Approach is to build on existing systems, register and catalog reusable components provided voluntarily by the member organizations and to facilitate integration of these components through international standard interfaces.

Networking through the dynamic creation of loosely connected components has the potential to produce the well-known "Network Effect", where the value of the network increases in proportion to the number of network nodes squared. This non-linear behavior of producing overall value to the community is illustrated schematically below.

Preface

The GEOSS Core Architecture for exchange and dissemination of observations consists of the GEO Web Portal, Clearinghouse, and Registry components along with a process to register, discover and use services accessible using GEOSS Interoperability Arrangements. During 2007, the GEO Architecture Data Committee (ADC), through its core tasks, has guided development of an Initial Operating Capability (IOC) of the GEOSS Core Architecture. Results of the development were demonstrated to multiple GEO members in September 2007, including use of the services for several Societal Benefit Areas. This report provides an evaluation of the IOC with a particular focus on pilot-level versions of several GEO Web Portals, Clearinghouses and Registries. It is anticipated that this report will be used for future phases of GEOSS development. This report captures a work in progress. The report provides descriptions of the implementations that have been achieved to date as well providing recommendations on how the implementations should continue.

[ Current Architecture] has several shortcomings that need to be addressed in future stages of development.

Metadata for Datasets. The current architecture is geared toward standardized approach to data: access, processing, portayal, delivery. There is no explicit provision for the accompanying metadata. There is no standard approach for encoding, gathering, and delivery of metadata. This means that the user has little information about the data sensors and platforms, lineage, quality, processing, past applications, etc.
Metadata for Services. Services operating on data may be well-defined in terms of the syntax for the interface. In case of SOAP-WSDL protocol, the interface syntax is encoded in the WSDL XML document. This allows automatic type-checking of service components to be connected. However, neither the semantic meaning of the interface parameters, nor the functionality of individual services is definable in the current systems. An exception is a set of OGC web services which specifies both the interaction protocol and the semantics of the interfaces.
Missing the Service Chaining.

2008-02-25: GEOSS Architecture Schematics, rbh

GEOSS IOC Architecture

7.2 GEO Web Portal Definition

A Web portal is a single point of access to information, which is linked from various logically related Internet based applications and is of interest to various types of users. The GEOSS architecture (Section 5.3) defines two types of portals: a GEO Web Portal and GEOSS Community Portals. Portals present information from diverse sources in a unified way; they provide a consistent look and feel with access control and procedures for multiple applications, which otherwise would have been different entities altogether. Since all the applications share information through portals, there is better communication between various types of users. Another advantage of portals is that they can make event-driven campaigns. Generally, a portal provides:

Intelligent integration and access to enterprise content, applications and processes
Improved communication and collaboration among customers, partners, and employees
Unified, real-time access to information held in disparate systems
Personalized user interactions
Rapid, easy modification and maintenance of the website presentation

The following are the properties of portals:

Look and feel
Consistent headers and footers, color schemes, icons and logos which gives the user a feel and sense of consistency, uniformity, and ease of navigation

@@ Line 1: / Line 1: @@
-{{Backlink}}
+{{Backlink}} > [[GEO_GEOSS]]<br>
+{{AQDS_Backlinks}}
+{{Template:GEO Links}}<br>
+{{Template:GEOSS Committees}}
+----
+__TOC__
 == Background ==
 The mission of the Environmental Protection Agency is to protect human health and the environment. Air quality management involves many activities including setting and maintaing air quality standards, monitoring trends, informing the public, etc. Each of these activities have different information needs. In the past both the monitoring and assessment of air quality has been performed in specific programs each directed and somewhat confined to the specific applications that they served.
@@ Line 7: / Line 10: @@
 Recently, the Agency developed and now is in the process of implementing a new National Air Monitoring Strategy(NAMS). NAMS was designed to produce more reusable datasets for multiple programs/applications in EPA. Implicit in the new strategy is that there is a corresponding new Information System strategy that facilitates the access, processing/analysis/integration of broad range of data applicable to multiple uses.
+===GEOSS and Air Quality Data Systems===
 At the international level, the 70-nation Group on Earth Observations (or GEO) is coordinating international efforts to build a Global Earth Observation System of Systems (GEOSS). This emerging public infrastructure (system of systems) is interconnecting a diverse and growing array of instruments and systems for monitoring and forecasting changes in the global environment.
@@ Line 24: / Line 28: @@
 Networking through the dynamic creation of loosely connected components has the potential to produce the well-known [http://en.wikipedia.org/wiki/Network_effect "Network Effect"], where the value of the network increases in proportion to the number of network nodes squared. This non-linear behavior of producing overall value to the community is illustrated schematically below.
-[[Image:NetworkValue_5.png|400px]][[Image:NetworkValue_5x5.png|400px]]
+[[Image:NetworkValue_5.png|400px]][[Image:NetworkValue_5x5.png|400px]]<br>
+===Preface===
+The GEOSS Core Architecture for exchange and dissemination of observations consists of the GEO Web Portal, Clearinghouse, and Registry components along with a process to register, discover and use services accessible using GEOSS Interoperability Arrangements.
+During 2007, the GEO Architecture Data Committee (ADC), through its core tasks, has guided development of an Initial Operating Capability (IOC) of the GEOSS Core Architecture.  Results of the development were demonstrated to multiple GEO members in September 2007, including use of the services for several Societal Benefit Areas.
+This report provides an evaluation of the IOC with a particular focus on pilot-level versions of several GEO Web Portals, Clearinghouses and Registries.  It is anticipated that this report will be used for future phases of GEOSS development.
+This report captures a work in progress.  The report provides descriptions of the implementations that have been achieved to date as well providing recommendations on how the implementations should continue.
+[[Image:GEO Arch EngView 0802.png|600px]]
-== Example Application: AirNOW ==
-AirNOW is a modern information system that federates the moderating data from hundreds of continuous air quality monitors operated autonomously by various agencies, mostly U.S. states. On the output side, the primary purpose of AirNOW is to deliver air quality status and forecast to the public. For more information, the reader is referred to the [http://airnow.gov/ AirNOW] and [http://www.airnowtech.org/ AirNOW Tech] websites. A structured description of the AIRNow data system can be found on the [[AIRNow| AirNOW profile]]. A community workspace, the [[AIRNOW|AIRNOW dataspace]], facilitates the gathering of community contributed comments, resources, and feedback related to AirNOW.
-The AIRNow program can deliver real-time ozone and PM2.5 concentration data to many different applications spanning several societal benefit areas including, health and ecological effect, disasters, and others. Conversely, fully informing the public can benefit from many data sets and analysises beyond those federated by the AirNOW system. For this reason, AirNOW represents an attractive application of the fan in - fan out networked information architecture adapted by GEOSS and by the [[Data_Summit_Workspace|EPA Air Quality Data Summit]]?
+[[Image:GEO_Arch_Funct_Process_0802.png|600px]]
-===Public Information===
-Delineating the numerous pathways in which the AirNOW data are transmitted to the public is beyond the scope of this report.
-[http://scholar.google.com/scholar?q=AIRNow&hl=en&lr= Google Scholar]
+[ Current Architecture] has several shortcomings that need to be addressed in future stages of development.
+* '''Metadata for Datasets.''' The current architecture is geared toward standardized approach to data: access, processing, portayal, delivery. There is no explicit provision for the accompanying metadata. There is no standard approach for encoding, gathering, and delivery of metadata. This means that the user has little information about the data sensors and platforms, lineage, quality, processing, past applications, etc.
-===Health/Exp. Assessment===
+* '''Metadata for Services.''' Services operating on data may be well-defined in terms of the syntax for the interface. In case of SOAP-WSDL protocol, the interface syntax is encoded in the WSDL XML document. This allows automatic type-checking of service components to be connected. However, neither the semantic meaning of the interface parameters, nor the functionality of individual services is definable in the current systems. An exception is a set of OGC web services which specifies both the interaction protocol and the semantics of the interfaces.
-In recent years the health effects of air pollutants in the U.S. are primarily attributed to surface ozone and fine particles. The AirNOW network provides monitoring data for these two pollutants. The companion network is the regulatory network which uses daily average filter samples, collected every third day to characterize the PM2.5 pattern. Health exposures during short-term fine particle peaks, lasting a few hours, and the exposure during the off days cannot be estimated from the regulatory PM2.5 FRM sampling network. In the past, epidemiological and event-based health studies had to rely on PM2.5 surrogates such as visibility data to associate health effect measures with the corresponding PM2.5 exposure.
+* '''
+* Missing the Service Chaining.
-For this reason the continuous measurements of PM2.5 allows better association of health and pollution signals. This in turn should permit the development of more suitable air quality standards for PM2.5. The continuous AirNOW monitoring data for ozone is compatible to the continuous ozone monitors in the regulatory ozone network.
+[[Media:GEOSS_Arch_Schem_080225rbh.ppt|2008-02-25: GEOSS Architecture Schematics]], rbh
+[http://www.ogcnetwork.net/node/299 GEOSS IOC Architecture]
-[http://scholar.google.com/scholar?num=100&hl=en&lr=&q=AIRNow+Health Google Scholar Search - AirNOW and health]
+===7.2	GEO Web Portal Definition===
-===Emissions Estimation and Planning===
+A Web portal is a single point of access to information, which is linked from various logically related Internet based applications and is of interest to various types of users.  The GEOSS architecture (Section 5.3) defines two types of portals: a GEO Web Portal and GEOSS Community Portals.
-An interesting application of the hourly AirNOW data pertains to improved estimation of emissions. Many
+Portals present information from diverse sources in a unified way; they provide a consistent look and feel with access control and procedures for multiple applications, which otherwise would have been different entities altogether. Since all the applications share information through portals, there is better communication between various types of users. Another advantage of portals is that they can make event-driven campaigns. Generally, a portal provides:
-[http://scholar.google.com/scholar?num=100&hl=en&lr=&q=AIRNow+Emission Google Scholar Search - AirNOW and Emission]
+* Intelligent integration and access to enterprise content, applications and processes
+* Improved communication and collaboration among customers, partners, and employees
+* Unified, real-time access to information held in disparate systems
+* Personalized user interactions
+* Rapid, easy modification and maintenance of the website presentation
-===AQ Trends and Accountability===
+The following are the properties of portals:
-[http://scholar.google.com/scholar?num=100&hl=en&lr=&q=AIRNow+Trend Google Scholar Search - AirNOW and Trend]
+* Look and feel
-===Intercontinental Transport Policy===
+* Consistent headers and footers, color schemes, icons and logos which gives the user a feel and sense of consistency, uniformity, and ease of navigation
-[http://scholar.google.com/scholar?num=100&hl=en&lr=&q=AIRNow+Intercontinental+Transport Google Scholar Search - AirNOW and Intercontinental Transport]
-===Science Support===
-Transport, Vertical Exchange Peocesses; Chemistry, Emission (weekly cycle)
-===NAAQS===
-[http://scholar.google.com/scholar?num=100&hl=en&lr=&q=AIRNow+NAAQS Google Scholar - AIRNow and NAAQS]
-* Regulatory (Except Event)
-* Regional Haze Rule (RPO)
-== NASA Applications of Air Quality Data==
+==Related topics: ==
+* [[AirNOW Data System Design Topics]]
+* [[On_Decision-Support_System_Architectures|DSS Architectures]]
+* [[Applications of AirNOW Data]]
+* [[GEOSS and the AirNOW Data System]]
+* [[EPA Air Quality Data Systems and GEOSS Architecture]]
-== NOAA Applications of Air Quality Data==
+[[LinkedTo::Community Air Quality Data System Workspace]][[Workspace::Networking of Air Quality Data]]
-Model Eveluation (Assimilations/Verification)
+[[LinkedTo::Data Summit Workspace]][[Date::2008-04-14]][[Subpage::Networking of Air Quality Data]][[Creator::Husar]]
-== Academic Applications of Air Quality Data==
+[[Category:AQ Data Network]] [[category:AQWG]]