Data System Connectivity Matrix

Back to <Data Summit Workspace
Back to <Community Air Quality Data System Workspace

Data System Connectivity Description Doc

• The connectivity matrix indicates data system connections ranging from downloading data to standards-based interoperability.
• The yellow cells indicate custom interface connectivity, blue indicates standard interfaces.
• This matrix is incomplete and in flux as the connections among systems are identified and logged. Please add connections or make corrections.
• Clicking on any cell leads you to further explanatiaon about the specific connection. (note: should the links to empty cells be eliminated? Add the provided by and consumed by to titles? Change presentation of notes (footnotes)?)

To edit the matrix, click on the link to 'Data System Connectivity Matrix' above the matrix and then login as aqcluster PW: aqcluster
NOTE: To login, select the 'sign up now' button in the top right. Then type in aqcluster, aqcluster. When the ZoHo applciation loads, select the Data Connectivity Matrix from the list in the left frame.
Before editing, make sure that you see a 'Save' button in the toolbar otherwise you won't be able to save your edits.

1. type in the arrow in the appropriate cell
2. color the cell either yellow or green
3. describe the connection in the appropriate section in the lower half of this wiki page

• Please do not copy and paste cells. Each cell contains a hyperlink to its corresponding section of the wiki page and then link will be overwritten if content from one cell is pasted to another cell.

AQS

AIRNow

AirNow does retrieve data from AQS to include in it's historical data section. This process it not yet automated via web services, so the box was not checked.

AirQuest

AirQuest ingests AQS data once per quarter via the AirQuest ETL (extraction tranformation and load) software/process.

CASTNET

The From CASTNET To AQS box is checked, but no one on the AQS team knows of any CASTNET data that makes its way into AQS.

DataFed

DataFed retrieves data from AQS and creates a WCS output.

HEI AQDB

The HEI AQDB manually ingests new AQS data when the data is posted on the AQS TTN website (this is once per quarter or less). Since this process requires human intervention, the box was not checked.

NEISGEI

NEISGEI uses particulate matter and gasous pollutant concentrations from the AQS network in its analysis applications. The AQS data is accessed through the DataFed WCS interface.

RSIG

The RSIG subsetter is connected to the AQS Data Mart to retrieve ozone and PM data on demand for the RSIG front end.

3D-AQS

NEISGEI

• NEISGEI.org reads the RSS feed from Smog Blog

AIRNow

	DataAccess	Interoperability
AIRNow	AIRNow itself provides AQI data to the public. Raw, numerical data is available to stakeholders via AIRNowTech. AIRNow Gateway is a new addition that provides data streams to a variety of customers, utilizing a web service infrastructure.	Data is available in a variety of common formats – KML, ASCII text, and web services.

NEISGEI

NEISGEI uses AIRNOw PM concentration measurements in its analysis applications. The AIRNOw data is accessed through the DataFed WCS interface.

AirQuest

	DataAccess	Interoperability
EPA AIRQuest Data Warehouse	Not Given	Not Given

AQ Modeling

NEISGEI

NEISGEI serves soem of the HTAP 2001 model results and is developing prototype model analysis applciations for HTAP and a single day CMAQ run. NEISGEI provides WCS access to the RETRO and EDGAR global emission estimates. Fire emissions model ouput are in the process of being integrated.

CASTNET

	DataAccess	Interoperability
CASTNET	All data is provided on the CASTNET website after it is QA’ed. Ozone data is provided to the public through the CASTNET website and AirNow	Data is available within the EPA firewall via SQL*Net and ODBC drivers. Data are available via the Web as prepackaged data sets and a data query wizard.

AIRNow

Ozone data is provided to the public through AirNow.

DAACs

	DataAccess	Interoperability
NASA Atmospheric Science Data Center	Several custom order tools and subset tools.	Metadata managed in PostGres POSTGIS open source database

NEISGEI

NEISGEI accesses NASA MODIS fire products through the NASA DAACs for use in analysis applications

DataFed

	DataAccess	Interoperability
DataFed

NEISGEI

• NEISGEI uses DataFed to register and serve emissions data through OGC WMS and WCS
• NEISGEI uses the DataFed service workflow engine to create web applications
• NEISGEI uses the DataFed Browser and applications for visualization and analysis
• DataFed use WMS and WCS services from NEISGEI

ESIP

	DataAccess	Interoperability
ESIP	Promote the integration and flow of Earth science data from collection and analysis to end-use.	ESIP promotes the use of standards for data interoperability. The ESIP semantic web cluster is exploring new technologies for enhancing data access and interoperability.

NEISGEI

NEISGEI provides DataSpace pages for emissions data and has developed metadata translators to create FGDC and SERF metadata records for data catalogs.

Giovanni

	DataAccess	Interoperability
GIOVANNI	Giovanni provides access to the original and their subsets in various formats: HDF, netCDF, ASCII, kml/kmz (for Google Earth)	SOA, WMS, WCS, OPeNDAP, custom arrangements

NEISGEI

NEISGEI accesses OMI data through the DataFed WCS (which accesses the Giovanni WCS) for use in analysis applications

NEISGEI

	DataAccess	Interoperability
NEISGEI	Standards based access to emissions and related data. Uses DataFed for data registration and access.	OGC standards (WMS, WCS, WFS)

DataFed

DataFed use WMS and WCS services from NEISGEI

NOAA

NEISGEI uses the NOAA Hazard Mapping System WFS and WMS in its analysis applications.

VIEWS

	DataAccess	Interoperability
VIEWS	The VIEWS website provides easy online access to the integrated database through a wide variety of tools and applications. Users are encouraged to register with the website, but no account or login is required to use any of the VIEWS resources. The entire contents of the integrated database are freely and openly available for ad hoc querying, display, and download. In addition, users are encouraged to submit custom requests for data and to provide additional relevant datasets for inclusion in the database.	Raw data and metadata can be obtained from VIEWS in a variety of output mediums: Delimited or fixed width ASCII text files, Microsoft Excel workbooks, static HTML tables, and/or interactive HTML "data grids". In addition, the user can select the specific fields that are included in the output results and can specify a variety of output options, such as "wide" or "skinny" format, date format, missing data placholder, quoted text, etc. The VIEWS team is also working to provide the option to output data in XML and as XML SOAP responses.

NARSTO

VIEWS

Community Air Quality Data System Workspace Data Summit Workspace2008-04-14Data System Connectivity MatrixFalke