2011 Rant and Raves Webinar Series and Telecon Information

ESIP IT&I Telecom Wednesday Oct 5, 2011

Agenda: Two Rant and Rave presentation.

Subsetting via Open Search From Existing THREDDS Catalog Services

Jerry Pan

This presentation will cover the following: 1) what is THREDDS Data Server and THREDDS catalog service and what is Open Search formats, 2) a simple Web Service application that uses the catalog service to serve Open Search requests for subsets of granules, and 3) some wishes (rants) on what THREDDS catalog does not do currently.

The EOSDIS Simple Subset Wizard

Chris Lynnes

The EOSDIS Simple Subset Wizard (SSW) is based on the radical premise that subsetting Earth science data should be...simple. SSW (http://disc.gsfc.nasa.gov/SSW/) provides a single, stripped-down user interface that allows users to make subset requests to 10 of the 12 EOSDIS Data Centers, rather than learning and using 10 or more different subset user interfaces. Under the hood, SSW uses subset agents, written to have a common REST-based front end and a back end that does whatever it has to in order to interface with the subsetter. The SSW is engineered for maximum reusability, both in the AJAX-based, embeddable user interface and in the SSW subset agents, which are callable by machine programs as well.

Call-In Information:

To start the audio portion of the Personal Conference meeting

Call-in toll-free number (US/Canada): 1-877-668-4493 Call-in toll number (US/Canada): +1-408-600-3600 Call-in toll number (US/Canada)*: +1-571-918-6008 Global call-in numbers: https://esipfed.webex.com/esipfed/globalcallin.php?serviceType=MC&ED=9910728&tollFree=1 Toll-free dialing restrictions: http://www.webex.com/pdf/tollfree_restrictions.pdf

Attendee access code: 231 367 82

Call-in toll number (US/Canada) should only be used if the primary number does not work.

To start the online portion of the Personal Conference meeting

1. Go to https://esipfed.webex.com 2. Click the “Meeting Center” tab 3. Select the IT&I meeting If a password is required, enter the Meeting Password: 23136782

ESIP IT&I Telecom Wednesday September 6, 2011

Agenda:

Product and Services RFP discussion

Develop Re-usable Authoring Tools for FGDC/ISO-compliant Metadata

The ESIP Information Technology and Interoperability (IT&I) Committee proposes the development of a suite of metadata authoring tools that will be reusable across Earth science data repositories. The tools will be developed as a Drupal profile (GeoDrupal), that can be used by data producers to create/author metadata information for geospatial data sets, either through an easy-to-use, interactive, web-based interface, or by uploading XML definitions. The resulting metadata will be FGDC/ISO compliant. Additionally, this task will investigate the development of metadata translation tools to assist in the conversion of existing metadata to other formats. Several Earth science data centers utilize an internal metadata format that is often useful to have converted to additional standards (i.e. GCMD DIF & SERF, ECHO, FGDC, etc.) The software will be published and shared at Drupal.org on behalf of the ESIP Federation, making it freely available for deployment at multiple sites. The modules necessary for this functionality will be incrementally designed and implemented under the direction of the IT&I committee.

ESIP Community Benefits: Provide re-usable metadata authoring tools. Cost: $6K to develop, test and deploy within the Testbed portal

Drupal Working Group Kickoff Telecom

Please call in and add your ideas for the new Drupal Working Group. We will be discussing the group's mission and core activities. Also you can learn about the ESIP openatrium site as a place for sharing Drupal issues, solutions, and features. And we want to start a conversation with Erin about any needs the Federation may have about its new Drupal site. Also, we will be having a mix of telecons and webex sessions over the next several months to give DruWGies an opportunity to show off what works and what doesn't work from them in Drupal.

Call-In Information:

To start the audio portion of the Personal Conference meeting

Call-in toll-free number (US/Canada): 1-877-668-4493 Call-in toll number (US/Canada): +1-408-600-3600 Call-in toll number (US/Canada)*: +1-571-918-6008 Global call-in numbers: https://esipfed.webex.com/esipfed/globalcallin.php?serviceType=MC&ED=9910728&tollFree=1 Toll-free dialing restrictions: http://www.webex.com/pdf/tollfree_restrictions.pdf

Attendee access code: 231 367 82

Call-in toll number (US/Canada) should only be used if the primary number does not work.

To start the online portion of the Personal Conference meeting

1. Go to https://esipfed.webex.com 2. Click the “Meeting Center” tab 3. Select the IT&I meeting If a password is required, enter the Meeting Password: 23136782

ESIP IT&I Telecom Wednesday August 3, 2011

Attendance: Rahul Ramachandran, Chris Lynnes, Bruce Caron, Yuechen Chi, Manil Maskey, Erin Robinson Agenda:

Recap of the business meeting discussion at the ESIP Summer Meeting

See notes from Chris:

- Most of discussion was based on icommons about what would be published there and potential conflicts with publishing two places
- Rahul suggested that what is published in icommons is not same things that would be eligible for journal pubication
- icommons will have doi/issn so it can be indexed with google scholar.
- best icommons articles could be combined into a special issue of a journal
- success may eventually move to full blown publishing platform (PLoS)
IT&I Budget discussion

Development of ESIP infrastructure activities (ESIP iCommons Publication infrastructure)

Finish the ESIP Drupal based publication platform
- Current version has microarticle content type; upload; citation refs and then workflow is set to go to managing editor

Provide tech and development support to the ESIP website upgrades

Cleaning and customizing existing Drupal installation
Adding new modules
Running routine maintenance

Support the ESIP Energy Cluster effort (maybe)

Create a Drupal based community platform to support the Energy cluster
- Group decided to take out energy effort
Drupal Cluster formed at Summer Meeting
- Group decided to add $4k for travel for a few members to drupalcon

Total:

$15K for a ½ time student well versed in Drupal
$5K for Graphics Designer

Notes from Chris Lynnes:

Jerry Pan and I agreed to volunteer for a joint Rave on our Simple Subset Wizard and his OpenSearch server for THREDDS Data Server. We both feel that they are too simple to warrant a Rave on their own, and they do work together.
Much of the discussion revolved around the Intellectual Commons Platform. Questions like: how much / how strong a peer review? How do we get enough submissions? There was some idea of publishing preprint-style articles on it, but then also How do we deal with AGU's Dual Publication policy?

Call-In Information:

To start the audio portion of the Personal Conference meeting

Call-in toll-free number (US/Canada): 1-877-668-4493 Call-in toll number (US/Canada): +1-408-600-3600 Call-in toll number (US/Canada)*: +1-571-918-6008 Global call-in numbers: https://esipfed.webex.com/esipfed/globalcallin.php?serviceType=MC&ED=9910728&tollFree=1 Toll-free dialing restrictions: http://www.webex.com/pdf/tollfree_restrictions.pdf

Attendee access code: 231 367 82

Call-in toll number (US/Canada) should only be used if the primary number does not work.

To start the online portion of the Personal Conference meeting

1. Go to https://esipfed.webex.com 2. Click the “Meeting Center” tab 3. Select the IT&I meeting If a password is required, enter the Meeting Password: 23136782

ESIP IT&I “Rants N Raves” Webinar July 6 2011 1PM CT

The ESIP Information Technology and Interoperability Committee continues it’s “Rants N Raves’ Webinar series. The “Rants N Raves” Webinar provides a platform to any ESIP member to present any Information Technology and Interoperability related issues, seek suggestions/ideas or present cool new technology useful to the ESIP community.

This months Rants N Raves Presentation: A Drupal-based Metadata Wizard for USGIN's Minimum Useful Metadata Model

By

Wolfgang Grunberg (now Arizona Game and Fish Department), Ryan Clark (Arizona Geological Survey), and Steve Richard (Arizona Geological Survey)

The US Geoscience Information Network (USGIN; http://lab.usgin.org/) strives to develop and implement the standards and protocols for a distributed and interoperable geospatial data and metadata sharing network. For most content owners and managers, established geospatial metadata standards (such as ISO 19139, FGDC CSDGM) and metadata tools are in general too difficult, painful, or buggy to adopt without specialized staffing. Our attempts at solving the practicality issues we encountered was to go back to a format agnostic metadata model (http://lab.usgin.org/groups/metadata-interest-group/recommendations-metadata-content-describe-geoscience-resources) that could be implemented in something as simple as MS Excel (http://repository.stategeothermaldata.org/uri_gin/aasg/dlio/767) or as a custom app – the Metadata Wizard (http://mw.usgin.org/). The Metadata Wizard’s goal was to make metadata creation as painless as possible while allowing the support of multiple metadata standards and profiles. We prototyped the Metadata Wizard in the Drupal 6 CMS because of our familiarity with it and because of Drupal’s extended library of modules.

Other issues on the agenda:

IT&I Business Meeting Friday

Finalizing the “Science on Drupal” session for the summer meeting

Intro to Drupal : Jerry? Erin?
Show and Tell:

Thomas Huang – JPL
Bruce Caron – NMRI
Helen Conover – GHRC?
Jerry Pan – ORNL
Rahul Ramachandran – UAH
Andy Maffei - WHOI
Others?

CALL IN INFO: Topic: IT & I July 6, 2011 Time: 1:00 pm, Central Daylight Time (Chicago, GMT-05:00)

Call-In Information:

To start the audio portion of the Personal Conference meeting

Call-in toll-free number (US/Canada): 1-877-668-4493 Call-in toll number (US/Canada): +1-408-600-3600 Call-in toll number (US/Canada)*: +1-571-918-6008 Global call-in numbers: https://esipfed.webex.com/esipfed/globalcallin.php?serviceType=MC&ED=9910728&tollFree=1 Toll-free dialing restrictions: http://www.webex.com/pdf/tollfree_restrictions.pdf

Attendee access code: 231 367 82

Call-in toll number (US/Canada) should only be used if the primary number does not work.

To start the online portion of the Personal Conference meeting

1. Go to https://esipfed.webex.com 2. Click the “Meeting Center” tab 3. Select the IT&I meeting If a password is required, enter the Meeting Password: 23136782

ESIP IT & I Telecon May 11 2010 at 02:00 PM ET

- Attendees: Erin, Ken Keiser, Rick Martin, Jerry Pan, Tyler Stevens, Rahul Ramachandran, Bruce Caron

Agenda:

Last call for IT workshops, breakout session proposals for the Summer Meeting
ESIP IT&I Breakout session
Review existing agenda for the Summer Meeting
- URL - http://wiki.esipfed.org/index.php/July_13,_2011
ESIP Commons Publication status
Products and Services - Ken Keiser

Task 3. Metadata for Customized Product-Services Many Federation members offer virtual, hybrid products-services that are created on- demand. Full metadata descriptions require new standards that are robust enough to describe and invoke these offerings. We will explore new metadata options for our members that capture the description, capabilities, and provenance of such products, and their impacts on cataloging. ESIP Community Benefits: Better description of innovative Federation products and services Cost: $6K to setup and implement metadata extensions for several virtual data products that are redirected by the testbed, as identified by the Products and Services Committee.

Meeting Notes IT Workshops and Breakout Sessions

IQ Cluster - Greg L.
ISO Session - Teb Habberman (need to connect Thomas with Ted)
Semantic Web Cluster (Peter Fox)
Preservation Ontology - Hook Hua
Cloud Computing - Phil/Rick/Thomas
Data Preservation Track 4
- Provenance
- Discovery
- Earth Science Collaboratory
Science on Drupal
- Session 1: Intro to Drupal
- Session 2: Show and Tell (Modules)
- Session 3: Birds of Feather

Product and Services Testbed Proposal Ideas:

Drupal module to store metadata (follows FGDC/ISO specs)

ESIP IT & Interop Telecon Apr 6 2010 at 02:00 PM ET

Attendees: Bruce, Curt, Hook, Erin, Carol, Chris
Agenda for ESIP meeting
- Business to discuss at ESIP meeting
  - Interoperability packet from Innovim
    - complete package on wiki as Powerpoint: are they done?
    - add to Drupal site when ready to go, make more searchable, edit and supplement as needed
    - maybe go into the Publication Mechanism???
    - need to get it used and make it into a living resource
  - Publication Mechanism
    - Google Knol too limited; could be moribund
    - Probably Drupal
    - Rahul + Sunil ready to roll with Drupal
- Mode of tackling Business issues
  - Have a facilitator for now that can push along before the meeting, then finish up at the F2F at ESIP
    - Rahul (or delegate) for Publication mechanism (?)
      - BTW, are these publications living resources (editable over time), or fixed like a traditional pub?
        versioning problematic for registries, though see PubMed model
        
        Or maybe we have two classes/stages: living resources -> stable pub
    - Karl/Chris with support from Erin for Innovim Interoperability Package
      - Think about how new content would get added
- Workshops
  - Drupal for Science ?
    - Bring together drupalizers in fed w/people wanting to learn about it as a framework
    - Start small with one session this summer, then expand later
    - Carol: May have more workshops than space Tues-Wed, but Thurs. is breakouts that can take overflow workshop topics
  - Bruce: See Best Practices for Workshops
- Breakouts?
  - ESIP ITIC breakout to cover business and planning
  - Coordination with other clusters vs. ITIC-hosted activities? Too many clusters? With too many overlapping members?
    - Carol: Possibly ITIC may adopt the ESC cluster? Or just the cluster goals?
      - Advantage might be seed funding for some early efforts
      - Chris: suggest adding this to topics of business section (Chris will be Facilitator)
Walkon topic: Have committees help out with visioneering on future meeting things
- Maybe Collaboration, esp. for Washington meeting
- Add to Future Meeting Themes

""Rants and Raves Webinar 2011 Series - March 02 at 02:00 PM EST""

As part of its Rants and Raves Webinar series, ESIP IT&I presents a talk by Dr. Brand Neimann.

Title: Build an ESIP Data.gov and the Atlas of Science in the Cloud

Short Abstract: During a recent FESIP Visualization Telecon (November 8, 2010), I suggested that ESIP build a Semantic Web application for Data.gov and that I would like to help and show that for the Winter Meeting Poster Session on January 4, 2011. This presentation shows how the ESIP Drupal Web Site and Media Wiki content can be turned into a Data.gov database application using Gov 2.0 cloud platform tools that have been used in a series of Data Science Products.

Wiki Page: http://semanticommunity.info/Federation_of_Earth_Science_Information_Partners/ESIP_Data.gov_Application

Slides: http://semanticommunity.info/@api/deki/files/8232/=BrandNiemann01042011.ppt

Bio: Brand Niemann is the Director and Senior Data Scientist of the Semantic Community and former Senior Enterprise Architect and Data Scientist at the U.S. Environmental Protection Agency.

Other Issues on the Agenda: - Planning for the summer meeting

1. Please join my meeting, Wednesday, March 02 at 02:00 PM EST. https://www1.gotomeeting.com/join/321055673

2. Use your microphone and speakers (VoIP) - a headset is recommended. Or, call in using your telephone.

Dial +1 (314) 627-1506 Access Code: 321-055-673 Audio PIN: Shown after joining the meeting

Meeting ID: 321-055-673

Rants and Raves Webinar 2011 Series Kickoff - February 02 at 02:00 PM EST

The ESIP Information Technology and Interoperability Committee continues its Rants and Raves Webinar series. The Rants and Raves Webinar provides a platform to any ESIP member to present any Information Technology and Interoperability related issues, seek suggestions/ideas or present cool new technology useful to the ESIP community. Dr. Kuo will present a proposal for a data analysis environment based on his perspective as a practicing scientist.

Improving Interoperability and Science Productivity: Proposal for A Data Analysis Environment

By Dr. Kwo-sen Kuo, Principal Scientist at Caelum Research Corp.

There is currently a serious lack of Earth science data interoperability. Combining/Fusing data products even from the same instrument, say MODIS, (but for different science disciplines, such as atmosphere, ocean, land, etc.) is often a laborious undertaking, let alone data from different instruments or platforms. A Data Analysis Environment is therefore proposed to make data fusion easier for the scientist users to improve data interoperability and, in turn, science productivity. Motivations, requirements, and envisioned functionalities of the environment will be discussed at this meeting.

Other Issues on the Agenda: - Addressing Erin’s Collaboration Check-in questionaire Telecon Instructions:

1. Please join my meeting, Wednesday, February 02 at 02:00 PM EST. https://www1.gotomeeting.com/join/584109752

2. Use your microphone and speakers (VoIP) - a headset is recommended. Or, call in using your telephone.

Dial +1 (909) 259-0011 Access Code: 584-109-752 Audio PIN: Shown after joining the meeting

Meeting ID: 584-109-752

File:Download Presentation.pdf

File:Download Collaboration Questionnaire.pdf