Difference between revisions of "NASA ACCESS09: Tools and Methods for Finding and Accessing Air Quality Data"

From Earth Science Information Partners (ESIP)
Line 93: Line 93:
 
* Agencies: EPA, NASA, NOAA, DOE ....
 
* Agencies: EPA, NASA, NOAA, DOE ....
 
* Intrastructure first
 
* Intrastructure first
 +
 +
== links ==
 +
[http://wiki.esipfed.org/index.php/Data_System_Governance_and_Sustainability Data_System_Governance_and_Sustainability and Synery]
 +
 +
[http://wiki.esipfed.org/index.php/Interoperability_of_Air_Quality_Data_Systems Interoperability_of_Air_Quality_Data_Systems]
 +
 +
[http://wiki.esipfed.org/index.php/Data_Systems_Architecture Data_Systems_Architecture]
 +
 +
[http://wiki.esipfed.org/index.php/Desired_Characteristics_of_Air_Quality_Data_Systems Desired_Characteristics_of_Air_Quality_Data_Systems]
 +
 +
[http://wiki.esipfed.org/index.php/Air_Quality_Data_Processing_and_Portal_Systems Air_Quality_Data_Processing_and_Portal_Systems]
 +
 +
[http://wiki.esipfed.org/index.php/Air_Quality_Data_Providers Air_Quality_Data_Providers]
 +
 +
[http://wiki.esipfed.org/index.php/AQ_Data_System_Clients_and_User_Groups AQ_Data_System_Applications Clients_and_User_Groups]
 +
 +
[http://wiki.esipfed.org/images/9/95/Community_Air_Quality_Data_Systems_Strategy.doc Community_Air_Quality_Data_Systems_Strategy]
 +
 +
[http://wiki.esipfed.org/index.php/AQ_Data_System_Strategy_Introduction_and_Purpose AQ_Data_System_Strategy_Introduction_and_Purpose]

Revision as of 11:04, May 31, 2009

Air Quality Cluster > AQIP Main Page > Proposal | NASA ACCESS Solicitation | Context | Resources | Forum | Participants

Outline

Background

Problem

  • Lots of data resources in NASA, elsewhere
  • Not available as data as services
  • if it is a service, e.g. openDaP, may need rich clients, hard coded, loose coupling not easy
  • Even if reusable service is available it cannot be found.
  • The Users Dilemma (direct problem)
    • There are no data for what the user needs
    • If there are needed data, the user can not find them
    • If the user can find them, she can not access them
    • If the user can access then, she does not know how good they are
    • If he knows how good they are, she can not merge them with other data.
  • Providers Dilemma (indirect problem)
    • There are no users for the data
    • If there are users, the provider can not find them
    • If she can find data, she does not know how to deliver them
    • If she can deliver them, she does not know how to make it valuable
    • If the she can make it more valuable...

Provider and User Oriented Designs

  • Providers offers it wares ... to reach maxinum users in many applications

Approach

  • Service Orientation, while accepted has not been widely adapted for serving NASA products
  • SOA allows the creation of loosely coupled, agile, data systems
  • SOA -> requires ability to Publish, Find, Bind (Register, Discover, Access)
  • Stages: Acquisition, Repackaging, Usage
    • Acquisition is a stovepipe
    • Usage is value chain
    • In-between is the 'market'

The Network

  • Fan-In, Fan-Out
  • (so is GCI) not central
  • holarchy , data up into the pool though the aggregator network and down the disaggregator/filter network

ScaleFreeNetwork3.png

  • Data distributed through Scale-free aggregation network. Metadata contributed along the line of usage. Homogenized and shared.

Data Service Publication

  • Data as Service
    • Wrappers, reusable tools and methods ( dataset classes)
    • To illustrate the Network, Coding (faceting) through metadata, WMS to show data
    • WCS next
  • Binding to data through standard data access protocols, publishing and finding requires metadata system


Data Discovery

  • Metadata system for publishing and finding content has to be jointly developed between data providers and users.
  • Generic catalog systems - metadata collection of not only what provider has done but also tracking what users need
    • Collecting and Enhancing Metadata from observing Users
  • Communication along the value chain, in both direction;
  • Metadata the glue and the message
  • Market approach; many providers; many users; may products
  • Faceted search
    • user is happy
  • Search by usage data

Description on how users will discover and use services provided by NASA, other Agencies, academia..

  • Detail on discovery services
  • System components for persistent availability of these services
    • machine-to-machine interface
    • GUI interface

Classes of Users

  • by value chain
  • by level of experience
  • by ...

Data Assess and Usage

Performance Measurement and Feedback

Metadata from Providers

Metadata from Users

  • Google Analytics - provides feedback and helps market process - creates values to both users and producers. Where do users come from (spatial, internet, i.e. search engine, direct Url), which pages are most popular, where do they go next, how much time do they spend on the site, how many leave after just one page?, new vs. returning visitors, ...
  • Amazon - what do customers ultimately buy after viewing this product? popularity in different categories, what else did they buy at the same time? targeted advertising - interested in this product, may be interested in this company
  • Ebay - knows recent searches, so on return displays products of interest,
  • Google Reader - items posted, items read, which blogs did you read more from, how active are the blogs you read? how obscure are the blogs you read (# of subscribers), time of day blogs are posted, day of week blogs are posted.
  • Blogger?/Wordpress - Technorati - where do readers come from?

Metadata from Mediators

Management

Partnership

  • Toward an Air Quality Information Partnership (AQIP)
  • Agencies: EPA, NASA, NOAA, DOE ....
  • Intrastructure first

links

Data_System_Governance_and_Sustainability and Synery

Interoperability_of_Air_Quality_Data_Systems

Data_Systems_Architecture

Desired_Characteristics_of_Air_Quality_Data_Systems

Air_Quality_Data_Processing_and_Portal_Systems

Air_Quality_Data_Providers

AQ_Data_System_Applications Clients_and_User_Groups

Community_Air_Quality_Data_Systems_Strategy

AQ_Data_System_Strategy_Introduction_and_Purpose