Data System Connectivity Matrix

From Earth Science Information Partners (ESIP)

Back to <Data Summit Workspace
Back to <Community Air Quality Data System Workspace

Data System Connectivity Description Doc


  • The connectivity matrix indicates data system connections ranging from downloading data to standards-based interoperability.
  • The yellow cells indicate custom interface connectivity, blue indicates standard interfaces.
  • This matrix is incomplete and in flux as the connections among systems are identified and logged. Please add connections or make corrections.
  • Clicking on any cell leads you to further explanatiaon about the specific connection. (note: should the links to empty cells be eliminated? Add the provided by and consumed by to titles? Change presentation of notes (footnotes)?)


To edit the matrix, click on the link to 'Data System Connectivity Matrix' above the matrix and then login as aqcluster PW: aqcluster
NOTE: To login, select the 'sign up now' button in the top right. Then type in aqcluster, aqcluster. When the ZoHo applciation loads, select the Data Connectivity Matrix from the list in the left frame.
Before editing, make sure that you see a 'Save' button in the toolbar otherwise you won't be able to save your edits.

  1. type in the arrow in the appropriate cell
  2. color the cell either yellow or green
  3. describe the connection in the appropriate section in the lower half of this wiki page
  • Please do not copy and paste cells. Each cell contains a hyperlink to its corresponding section of the wiki page and then link will be overwritten if content from one cell is pasted to another cell.

AQS

3D-AQS

AIRNow

AirNow does retrieve data from AQS to include in it's historical data section. This process it not yet automated via web services, so the box was not checked.

AirQuest

AirQuest ingests AQS data once per quarter via the AirQuest ETL (extraction tranformation and load) software/process.

AQ Modeling

CASTNET

The From CASTNET To AQS box is checked, but no one on the AQS team knows of any CASTNET data that makes its way into AQS.

DAACs

DataFed

DataFed retrieves data from AQS and creates a WCS output.

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

The HEI AQDB manually ingests new AQS data when the data is posted on the AQS TTN website (this is once per quarter or less). Since this process requires human intervention, the box was not checked.

IDD/LDM

NEISGEI

NEISGEI uses particulate matter and gasous pollutant concentrations from the AQS network in its analysis applications. The AQS data is accessed through the DataFed WCS interface.

NOAA

RSIG

The RSIG subsetter is connected to the AQS Data Mart to retrieve ozone and PM data on demand for the RSIG front end.

VIEWS

NARSTO

3D-AQS

AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

  • NEISGEI.org reads the RSS feed from Smog Blog

NOAA

RSIG

VIEWS

NARSTO

AIRNow

 DataAccessInteroperability
AIRNowAIRNow itself provides AQI data to the public. Raw, numerical data is available to stakeholders via AIRNowTech. AIRNow Gateway is a new addition that provides data streams to a variety of customers, utilizing a web service infrastructure.Data is available in a variety of common formats – KML, ASCII text, and web services.

AQS

3D-AQS

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI uses AIRNOw PM concentration measurements in its analysis applications. The AIRNOw data is accessed through the DataFed WCS interface.

NOAA

RSIG

VIEWS

NARSTO

AirQuest

 DataAccessInteroperability
EPA AIRQuest Data WarehouseNot GivenNot Given

AQS

3D-AQS

AIRNow

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

AQ Modeling

AQS

3D-AQS

AIRNow

AirQuest

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI serves soem of the HTAP 2001 model results and is developing prototype model analysis applciations for HTAP and a single day CMAQ run. NEISGEI provides WCS access to the RETRO and EDGAR global emission estimates. Fire emissions model ouput are in the process of being integrated.

NOAA

RSIG

VIEWS

NARSTO

CASTNET

 DataAccessInteroperability
CASTNETAll data is provided on the CASTNET website after it is QA’ed. Ozone data is provided to the public through the CASTNET website and AirNowData is available within the EPA firewall via SQL*Net and ODBC drivers. Data are available via the Web as prepackaged data sets and a data query wizard.

AQS

3D-AQS

AIRNow

Ozone data is provided to the public through AirNow.

AirQuest

AQ Modeling

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

DAACs

 DataAccessInteroperability
NASA Atmospheric Science Data CenterSeveral custom order tools and subset tools.Metadata managed in PostGres POSTGIS open source database

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI accesses NASA MODIS fire products through the NASA DAACs for use in analysis applications

NOAA

RSIG

VIEWS

NARSTO

DataFed

 DataAccessInteroperability
DataFed

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

  • NEISGEI uses DataFed to register and serve emissions data through OGC WMS and WCS
  • NEISGEI uses the DataFed service workflow engine to create web applications
  • NEISGEI uses the DataFed Browser and applications for visualization and analysis
  • DataFed use WMS and WCS services from NEISGEI

NOAA

RSIG

VIEWS

NARSTO

EMF

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

ESIP

 DataAccessInteroperability
ESIPPromote the integration and flow of Earth science data from collection and analysis to end-use.ESIP promotes the use of standards for data interoperability. The ESIP semantic web cluster is exploring new technologies for enhancing data access and interoperability.

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI provides DataSpace pages for emissions data and has developed metadata translators to create FGDC and SERF metadata records for data catalogs.

NOAA

RSIG

VIEWS

NARSTO

GeoWeb

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

Giovanni

 DataAccessInteroperability
GIOVANNIGiovanni provides access to the original and their subsets in various formats: HDF, netCDF, ASCII, kml/kmz (for Google Earth)SOA, WMS, WCS, OPeNDAP, custom arrangements

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI accesses OMI data through the DataFed WCS (which accesses the Giovanni WCS) for use in analysis applications

NOAA

RSIG

VIEWS

NARSTO

HEI AQDB

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

IDD/LDM

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

NEISGEI

 DataAccessInteroperability
NEISGEIStandards based access to emissions and related data. Uses DataFed for data registration and access.OGC standards (WMS, WCS, WFS)

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

DataFed use WMS and WCS services from NEISGEI

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NOAA

NEISGEI uses the NOAA Hazard Mapping System WFS and WMS in its analysis applications.

RSIG

VIEWS

NARSTO

NOAA

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

RSIG

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

VIEWS

NARSTO

VIEWS

 DataAccessInteroperability
VIEWSThe VIEWS website provides easy online access to the integrated database through a wide variety of tools and applications. Users are encouraged to register with the website, but no account or login is required to use any of the VIEWS resources. The entire contents of the integrated database are freely and openly available for ad hoc querying, display, and download. In addition, users are encouraged to submit custom requests for data and to provide additional relevant datasets for inclusion in the database.Raw data and metadata can be obtained from VIEWS in a variety of output mediums: Delimited or fixed width ASCII text files, Microsoft Excel workbooks, static HTML tables, and/or interactive HTML "data grids". In addition, the user can select the specific fields that are included in the output results and can specify a variety of output options, such as "wide" or "skinny" format, date format, missing data placholder, quoted text, etc. The VIEWS team is also working to provide the option to output data in XML and as XML SOAP responses.

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

NARSTO

NARSTO

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

Community Air Quality Data System Workspace Data Summit Workspace2008-04-14Data System Connectivity MatrixFalke