Testbed Session at ESIP Winter Meeting, Jan 6, 2012

Back to: Products and Services

WHAT: The ESIP Testbed - An Infrastructure for Community Collaboration
WHEN: Friday, January 6, 2012 from 10:30am-12:00PM
WHERE: In the Potomac meeting room (location is probably subject to change)

Agenda:

• Testbed Overview and promotion - maybe a standup survey? (Ken)
  • Quick poll of attendees - simple binary questions
    • Did you know ESIP has a Testbed?
    • Would you consider using cloud resources for your work?
    • others?
    • Maybe print up stickers or some other handout as tokens of appreciation for survey responses
• ESIP Front Office Perspective on the Testbed (Carol/Erin)
  • Importance to the Federation
  • Options for expansion/moving forward
• Current Tasks - very brief overview
  • Portal - Phil/Chen
  • Discovery - Christine/Hook
  • Quality - Phil/Greg/Rezgui
  • Metadata - Jerry/Rahul
  • Preservation - Nancy
• Cloud Resources - A Testbed task, then the Testbed Infrastructure' - Phil
  • A testbed of cloud resources
  • A cloud to host testbed tasks/services
• Open Discussion (and buffer for going over on other presentations)
  • When to move tasks from Testbed to Production
  • Other discussion topics?
  • Maybe a follow-up survey to see if anyone has new appreciation of the Testbed

Presentations: All combined into one file - (pdf)

Session Notes

The ESIP Testbed - An Infrastructure for Community Collaboration (~30 participants)

• Testbed Overview and promotion - maybe a standup survey? (Ken)
  • Quick poll of attendees - simple binary questions
    • Did you know ESIP has a Testbed?
      • Y= N=7

• Would you consider using cloud resources for your work?
  • Y=3 N=

Intro

• Originated from the products and services committee
  • Improve visibility of the work
  • Proposal for funding of new activities
  • Establishment of testbed configuration board
  • Future: improve visibility, work with implementation teams, integrate with ESIP commons
  • Esipfed.org/testbed-activities
  • Monthly telecons will be used to report out on testbed activities

ESIP Front Office Perspective on the Testbed - Carol/Erin

• Knowledge and technology transfer by experts
  • Testbed shows results of community driven approaches
  • Testbed: a structured approach for evaluating a technology, software, or even process (committee should settle on a formal definition)
  • What is the testbed going to look like?
  • The products and services committee should better define the testbed and the governance/management/policies of the testbed,
  • How will other groups utilize the testbed?
  • There should be options for expansion/moving forward with the testbed.
    • Current Tasks - very brief overview (3 min each, 1-2 slides)

Portal - Phil/Chen

• Need a more customized portal for the testbed other than the wiki, configurable to developers, and more visible for other ESIP members and the public
  • Use Drupal based system for testbed (task intro, community forum, and project management components) – some components will only be available internally

Discovery - Christine/Hook

• Organization of data resources and advertising these data/services through data casting.
  • ESRI Geoportal solution

Quality - Phil/Greg/Rezgui

• Provide a quality measure for ESIP products and services
• Develop an automatic classification/annotation system that accesses, monitors, and accurately report on the quality of data products
• Quality model: quality metrics (i..e accuracy, precision, timeliness) and draw from several quality standards (i.e. ISO 8000, FIPS….)
• For services: ISO 9126 (software quality model)
• Classification engine: derives quality based on developed model

Metadata - Jerry/Rahul

• Generic metadata editor supporting system using Drupal CMS
  • Tool can be reusable to support multiple metadata standards and their variations
    • GUI can choose a sub-set of the schema (profile)
    • Complete Wizard forms, auto pick-list, complete ISO support

Preservation - Nancy

• Explore the operational and implementation issues resulting from assigning identifiers to data content
  • A real use follow-up to the citation paper published by Ruth Durr (NSIDC) – looking at 9 ID schemes
  • Value for services associated with each ID scheme (resolution service, making MD available to indexing services)

Cloud Resources - A Testbed task, then the Testbed Infrastructure - Phil

• A testbed of cloud resources/ A cloud to host testbed tasks/services
  • Requirements for cloud computing adoption for the ESIP testbed
  • Develop an execution plan by summer ESIP meeting
  • Identify cloud resources (Amazon, Microsoft, Nebula, private cloud)
  • Cloud computing requirements for the Earth science community

Open Discussion (and buffer for going over on other presentations)

• Possible Future tasks:
  • Semantic web activities
    • When to move tasks from Testbed to Production

• Other discussion topics?
  • • Who gets first priority in the testbed??
    • Would be this be addressed in the governance model?
    • Funding considerations, clear on proposal requirements
    • Maybe a follow-up survey to see if anyone has new appreciation of the Testbed
    • What do you want to get out of the testbed?
    • Is there a way to extract from AGU presentations a list of problems/issues that can be put into a testbed. Hadbu from AGU???
    • Making the testbed results reusable for other applications and organizations – need a procedure for this (action item) – perhaps task/role of the testbed configuration board
    • Security issues at NASA data centers with being behind firewalls and numerous security procedures
    • Who is interested in participating in the testbed?
      • Y=almost everyone