Difference between revisions of "Candidate Technical Topics"
Line 2: | Line 2: | ||
==Air Quality Data Network (ADN), Non-IT Issues== | ==Air Quality Data Network (ADN), Non-IT Issues== | ||
+ | [[AQ Network From Virtual to Real|Virtual to Real]] | ||
Purpose and scope of ADN | AQ network stakeholders | Relationship to integrating initiatives | Governance, legitimacy, impediments | Purpose and scope of ADN | AQ network stakeholders | Relationship to integrating initiatives | Governance, legitimacy, impediments | ||
===What is the purpose of ADN? === | ===What is the purpose of ADN? === | ||
− | + | * Facilitate access to air quality information (measurements, model results, analyses) in order to enable users (stakeholders) to make better informed choices. | |
− | + | * Boost scientific understanding of air chemistry and pollution transport processes by enabling synthesis views based on multi-platform observations and model ensembles. | |
− | ===Who are the | + | * Reduce chaos by improving standardisation and documentation of existing data sets and through exposing data processing and quality control procedures |
+ | * Ensure reproducability of scientific analyses by allowing for traceability of data sets and definition of responsibilities within the data chain. | ||
+ | ===Who is involved in the ADN and what are their roles?=== | ||
+ | * Data providers: mandated data origin vs. scientific data sets; what are the implications of a real ADN for them? | ||
+ | * Data federators/network hubs: who does it and why? Who has a mandate? What are the respective roles and focal points? | ||
+ | * Users: Who are they? What is the interaction with them? Who should become a user but doesn't know about it yet? | ||
===What organizations are stakeholders in the network? How do they relate to ADN?=== | ===What organizations are stakeholders in the network? How do they relate to ADN?=== | ||
===What is the ADN governance, legitimacy, impediments=== | ===What is the ADN governance, legitimacy, impediments=== | ||
===What are the minimum requirements for ADN? === | ===What are the minimum requirements for ADN? === | ||
− | What few things must be the same, so everything els can be different. Autonomy - Interoperability balance... | + | What few things must be the same, so everything els can be different. |
+ | * Autonomy - Interoperability balance... | ||
+ | * Who formulates the requirements? | ||
+ | * When is an ADN an ADN? | ||
===What is the scope of AQN? === | ===What is the scope of AQN? === | ||
Geographic, Variables, Ambient fixed station observations, satellite observations, emissions, models? | Geographic, Variables, Ambient fixed station observations, satellite observations, emissions, models? |
Revision as of 01:39, August 1, 2011
< Back to | Workshops | Air Quality Data Network
Air Quality Data Network (ADN), Non-IT Issues
Virtual to Real Purpose and scope of ADN | AQ network stakeholders | Relationship to integrating initiatives | Governance, legitimacy, impediments
What is the purpose of ADN?
- Facilitate access to air quality information (measurements, model results, analyses) in order to enable users (stakeholders) to make better informed choices.
- Boost scientific understanding of air chemistry and pollution transport processes by enabling synthesis views based on multi-platform observations and model ensembles.
- Reduce chaos by improving standardisation and documentation of existing data sets and through exposing data processing and quality control procedures
- Ensure reproducability of scientific analyses by allowing for traceability of data sets and definition of responsibilities within the data chain.
Who is involved in the ADN and what are their roles?
- Data providers: mandated data origin vs. scientific data sets; what are the implications of a real ADN for them?
- Data federators/network hubs: who does it and why? Who has a mandate? What are the respective roles and focal points?
- Users: Who are they? What is the interaction with them? Who should become a user but doesn't know about it yet?
What organizations are stakeholders in the network? How do they relate to ADN?
What is the ADN governance, legitimacy, impediments
What are the minimum requirements for ADN?
What few things must be the same, so everything els can be different.
- Autonomy - Interoperability balance...
- Who formulates the requirements?
- When is an ADN an ADN?
What is the scope of AQN?
Geographic, Variables, Ambient fixed station observations, satellite observations, emissions, models?
What data (processing) level served through ADN?
Is ADN a decider? Why not the Provider? Data Raw, Derived;
Data Servers: Technical Realization (IT) Issues and Solutions
netCDF, CF, WCS standards and conventions | Implementation for gridded and station data | Development tools | Server performance
Issues re. the use of netCDF and other data formats
netCDF is standard format for multi-dimensional data. Cf-netCDF is used both as an archival format of grid data as well as a payload format for WCS queries.
- Issue: ambiguity of CF
- Issue: We should define a standard python interface (PyNIO, python-netcdf4, scipy.io.netcdf?)
- Issue: Delivery of (small) data sets in ASCII/csv format
- Issue: Reading of grib data (?)
Use of WMS, WCS, WFS .. in combination?
Data display/preview is through WMS. AQ data can be delivered through WCS, WFS. In AComServ, WCS for transferring ndim grid and point-station data; WFS for deliver monitoring station descriptions.
- Issue: WMS interface for preview; "latest" token for dynamic links?
WCS versions
WCS is implemented in multiple versions: 1.0, 1.12, 2.0. The AQ Community Server (AComServ) is now implemented using WCS 1.1.2. Define here the WCS version (WCS 2.0) issue in about one sentence
Gridded data service through WCS
This generally works well.
- Issue: Extraction of vertical levels?
- Issue: Ambiguity of WCS; core plus extended (do we know what is valid?)
Delivery of station-point data
- Issue: use WCS or WFS, Combination of both?
- Access rights?
Data server performance issues/solutions?
Define performance issues, measurements
Server co-development tools, methods
Server code is maintained through SourceForge, Darcs code repositories are available at WUSTL and in Juelich.
- Issues: Version control, Platform independence, Documentation
Relationship to non-AComServ WCS servers
- Issue: protocol compatibility, standard compliance, data format(s)
Linkages to non-WCS servers
- Issue: is there a need?
- Issue: which protocols? (OpenDAP?, GIS servers?)
Data Network: Technical Realization (IT) Issues and Solutions
Network components, servers, clients, catalog | Mediated access | Catalog implementation, integration | Network level data flow, statistics, performance
What is the design philosophy
Service oriented (everything is a service), Component and network design for change; open source (everything?!)
Functionality of an Air Quality Data Network Catalog (ADNC)?
Content and structure (granularity) of ADNC?
Interoperability of ADNC
Interoperability with whom? what standards are needed? CF Naming extensions? ===