Difference between revisions of "Data System Connectivity Matrix"

Latest revision as of 09:53, October 8, 2021

Back to <Data Summit Workspace
Back to <Community Air Quality Data System Workspace

Data System Connectivity Description Doc

The connectivity matrix indicates data system connections ranging from downloading data to standards-based interoperability.
The yellow cells indicate custom interface connectivity, blue indicates standard interfaces.
This matrix is incomplete and in flux as the connections among systems are identified and logged. Please add connections or make corrections.
Clicking on any cell leads you to further explanatiaon about the specific connection. (note: should the links to empty cells be eliminated? Add the provided by and consumed by to titles? Change presentation of notes (footnotes)?)

To edit the matrix, click on the link to 'Data System Connectivity Matrix' above the matrix and then login as aqcluster PW: aqcluster
NOTE: To login, select the 'sign up now' button in the top right. Then type in aqcluster, aqcluster. When the ZoHo applciation loads, select the Data Connectivity Matrix from the list in the left frame.
Before editing, make sure that you see a 'Save' button in the toolbar otherwise you won't be able to save your edits.

type in the arrow in the appropriate cell
color the cell either yellow or green
describe the connection in the appropriate section in the lower half of this wiki page

Please do not copy and paste cells. Each cell contains a hyperlink to its corresponding section of the wiki page and then link will be overwritten if content from one cell is pasted to another cell.

AQS

3D-AQS

AIRNow

AirNow does retrieve data from AQS to include in it's historical data section. This process it not yet automated via web services, so the box was not checked.

AirQuest

AirQuest ingests AQS data once per quarter via the AirQuest ETL (extraction tranformation and load) software/process.

AQ Modeling

CASTNET

The From CASTNET To AQS box is checked, but no one on the AQS team knows of any CASTNET data that makes its way into AQS.

DAACs

DataFed

DataFed retrieves data from AQS and creates a WCS output.

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

The HEI AQDB manually ingests new AQS data when the data is posted on the AQS TTN website (this is once per quarter or less). Since this process requires human intervention, the box was not checked.

IDD/LDM

NEISGEI

NEISGEI uses particulate matter and gasous pollutant concentrations from the AQS network in its analysis applications. The AQS data is accessed through the DataFed WCS interface.

NOAA

RSIG

The RSIG subsetter is connected to the AQS Data Mart to retrieve ozone and PM data on demand for the RSIG front end.

VIEWS

NARSTO

3D-AQS

AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI.org reads the RSS feed from Smog Blog

NOAA

RSIG

VIEWS

NARSTO

AIRNow

	DataAccess	Interoperability
AIRNow	AIRNow itself provides AQI data to the public. Raw, numerical data is available to stakeholders via AIRNowTech. AIRNow Gateway is a new addition that provides data streams to a variety of customers, utilizing a web service infrastructure.	Data is available in a variety of common formats – KML, ASCII text, and web services.

AQS

3D-AQS

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI uses AIRNOw PM concentration measurements in its analysis applications. The AIRNOw data is accessed through the DataFed WCS interface.

NOAA

RSIG

VIEWS

NARSTO

AirQuest

	DataAccess	Interoperability
EPA AIRQuest Data Warehouse	Not Given	Not Given

AQS

3D-AQS

AIRNow

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

AQ Modeling

AQS

3D-AQS

AIRNow

AirQuest

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI serves soem of the HTAP 2001 model results and is developing prototype model analysis applciations for HTAP and a single day CMAQ run. NEISGEI provides WCS access to the RETRO and EDGAR global emission estimates. Fire emissions model ouput are in the process of being integrated.

NOAA

RSIG

VIEWS

NARSTO

CASTNET

	DataAccess	Interoperability
CASTNET	All data is provided on the CASTNET website after it is QA’ed. Ozone data is provided to the public through the CASTNET website and AirNow	Data is available within the EPA firewall via SQL*Net and ODBC drivers. Data are available via the Web as prepackaged data sets and a data query wizard.

AQS

3D-AQS

AIRNow

Ozone data is provided to the public through AirNow.

AirQuest

AQ Modeling

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

DAACs

	DataAccess	Interoperability
NASA Atmospheric Science Data Center	Several custom order tools and subset tools.	Metadata managed in PostGres POSTGIS open source database

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI accesses NASA MODIS fire products through the NASA DAACs for use in analysis applications

NOAA

RSIG

VIEWS

NARSTO

DataFed

	DataAccess	Interoperability
DataFed

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI uses DataFed to register and serve emissions data through OGC WMS and WCS
NEISGEI uses the DataFed service workflow engine to create web applications
NEISGEI uses the DataFed Browser and applications for visualization and analysis
DataFed use WMS and WCS services from NEISGEI

NOAA

RSIG

VIEWS

NARSTO

EMF

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

ESIP

	DataAccess	Interoperability
ESIP	Promote the integration and flow of Earth science data from collection and analysis to end-use.	ESIP promotes the use of standards for data interoperability. The ESIP semantic web cluster is exploring new technologies for enhancing data access and interoperability.

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI provides DataSpace pages for emissions data and has developed metadata translators to create FGDC and SERF metadata records for data catalogs.

NOAA

RSIG

VIEWS

NARSTO

GeoWeb

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

Giovanni

	DataAccess	Interoperability
GIOVANNI	Giovanni provides access to the original and their subsets in various formats: HDF, netCDF, ASCII, kml/kmz (for Google Earth)	SOA, WMS, WCS, OPeNDAP, custom arrangements

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

HEI AQDB

IDD/LDM

NEISGEI

NEISGEI accesses OMI data through the DataFed WCS (which accesses the Giovanni WCS) for use in analysis applications

NOAA

RSIG

VIEWS

NARSTO

HEI AQDB

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

IDD/LDM

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

NEISGEI

	DataAccess	Interoperability
NEISGEI	Standards based access to emissions and related data. Uses DataFed for data registration and access.	OGC standards (WMS, WCS, WFS)

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

DataFed use WMS and WCS services from NEISGEI

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NOAA

NEISGEI uses the NOAA Hazard Mapping System WFS and WMS in its analysis applications.

RSIG

VIEWS

NARSTO

NOAA

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

NARSTO

RSIG

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

VIEWS

NARSTO

VIEWS

	DataAccess	Interoperability
VIEWS	The VIEWS website provides easy online access to the integrated database through a wide variety of tools and applications. Users are encouraged to register with the website, but no account or login is required to use any of the VIEWS resources. The entire contents of the integrated database are freely and openly available for ad hoc querying, display, and download. In addition, users are encouraged to submit custom requests for data and to provide additional relevant datasets for inclusion in the database.	Raw data and metadata can be obtained from VIEWS in a variety of output mediums: Delimited or fixed width ASCII text files, Microsoft Excel workbooks, static HTML tables, and/or interactive HTML "data grids". In addition, the user can select the specific fields that are included in the output results and can specify a variety of output options, such as "wide" or "skinny" format, date format, missing data placholder, quoted text, etc. The VIEWS team is also working to provide the option to output data in XML and as XML SOAP responses.

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

NARSTO

AQS

3D-AQS

AIRNow

AirQuest

AQ Modeling

CASTNET

DAACs

DataFed

EMF

ESIP

GeoWeb

Giovanni

HEI AQDB

IDD/LDM

NEISGEI

NOAA

RSIG

VIEWS

Community Air Quality Data System Workspace Data Summit Workspace2008-04-14Data System Connectivity MatrixFalke

@@ Line 19: / Line 19: @@
 == AQS ==
-{{#ask:[[Category:DataSystem]][[DataSystemName::EPA AQS]][[DataSystemValueAccess::*|DataAccess]][[DataSystemArchInterop::*|Interoperability]]}}
+{{#ask:[[Category:DataSystem]][[DataSystemName::EPA AQS]]}}
 === 3D-AQS ===
@@ Line 65: / Line 65: @@
 == 3D-AQS ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=3D-AQS]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::3D-AQS]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 106: / Line 110: @@
 == AIRNow ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=AIRNow]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::AIRNow]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 146: / Line 155: @@
 == AirQuest ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=EPA AIRQuest Data Warehouse]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::EPA AIRQuest Data Warehouse]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 225: / Line 238: @@
 == CASTNET ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=CASTNET]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::CASTNET]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 265: / Line 283: @@
 == DAACs ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=NASA Atmospheric Science Data Center]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::NASA Atmospheric Science Data Center]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 304: / Line 326: @@
 == DataFed ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=DataFed]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::DataFed]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 346: / Line 373: @@
 == EMF ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=EMF]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::EMF]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 385: / Line 417: @@
 == ESIP ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=ESIP]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::ESIP]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 426: / Line 463: @@
 == GeoWeb ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=GeoWeb]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::GeoWeb]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 467: / Line 509: @@
 == Giovanni ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=GIOVANNI]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::GIOVANNI]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 507: / Line 554: @@
 == HEI AQDB ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=HEI]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::HEI]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 547: / Line 599: @@
 == IDD/LDM ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=Unidata IDD Data System]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::Unidata IDD Data System]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 586: / Line 643: @@
 == NEISGEI ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=NEISGEI]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::NEISGEI]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 665: / Line 727: @@
 == RSIG ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=RSIG]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::RSIG]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 704: / Line 771: @@
 == VIEWS ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=VIEWS]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::VIEWS]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===
@@ Line 742: / Line 814: @@
 == NARSTO ==
-<ask limit="100" >[[Category:DataSystem]][[DataSystemName:=NARTO]][[DataSystemValueAccess:=*|DataAccess]][[DataSystemArchInterop:=*|Interoperability]]</ask><br>
+{{#ask: [[Category:DataSystem]][[DataSystemName::NARTO]]
+|?DataSystemValueAccess=DataAccess
+|?DataSystemArchInterop=Interoperability
+|limit=100
+}}
 === AQS ===