Difference between revisions of "ESIP FedSearchWorkshop 2010"

From Earth Science Information Partners (ESIP)
Line 10: Line 10:
 
===ECHO Server and Client (Newman - 10 min)===
 
===ECHO Server and Client (Newman - 10 min)===
 
ECHO provided an ESIP server following specifications from the GES-DISC and created a highly-used client almost as an after thought.
 
ECHO provided an ESIP server following specifications from the GES-DISC and created a highly-used client almost as an after thought.
*[[Media:ECHO-ESIP.pptx]]
+
*[[Media:ECHO-ESIP.ppt]]
  
 
=== WSNEWS Reusable Solr-based Server + Python downloader client (Hua - 10 min)===
 
=== WSNEWS Reusable Solr-based Server + Python downloader client (Hua - 10 min)===

Revision as of 10:26, July 26, 2010

Intro and Demos (45 min)

For newbies and experts alike!

What is the ESIP Federated Search framework? (Lynnes - 10 min)

Client / Server Demos and Implementations

Mirador Client and Server (Lynnes - 5 min)

We'll show the Mirador client accessing ECHO, GHRC and WSNEWS (see below).

ECHO Server and Client (Newman - 10 min)

ECHO provided an ESIP server following specifications from the GES-DISC and created a highly-used client almost as an after thought.

WSNEWS Reusable Solr-based Server + Python downloader client (Hua - 10 min)

We will show our Federated OpenSearch server which was designed from the ground up to be simple, fast, lightweight, and portable. The talk will walk through our server implementation which extended Apache Solr (with its fast full-text search) with added space+time constraints. We will also show a simple and lightweight client used to automatically download all granules from a search result.

OpenSearch Perl Client (Duggan - 10 min)

I'd like to talk about and demo our implementation; it is an opensearch/federated search client written in Perl. We've been using it in production for almost a year where it's been mirroring data from our processing system to a shared computing environment. It has had to handle a lot of edge cases and has been heavily optimized.

Work It Out (45 min)

where we work on unresolved issues in the ESIP Federated Search framework. (Newbies are welcome to watch us make sausage...yum!)

Actually, we will briefly discuss each item, then designate a book boss to lead a solution to the issue.

  • Resolving duplicate entries
    • Datasets from multiple servers
    • Granules from same or multiple servers
  • Handling exceptions (Doug Newman)
  • Extending search to other attributes (Ruth Duerr)
    • Granule level
    • Dataset level
  • Recommendations/Best Practices for response contents
    • Space and time extents
  • Versioning the ESIP Framework
  • Granule heterogeneity within datasets
  • Incorporating data services
    • Pomegranate and w10n-sci
    • OPeNDAP (TBD)
    • Integration with Service and Data casting?
  • Addressing attribution and provenance and local data management issues
  • Addressing semantic heterogeneity problems in keyword search (now) an d attribute search (later)