Difference between revisions of "Interagency Data Stewardship/LifeCycle/Jul2009MeetingPlans"

From Earth Science Information Partners (ESIP)
 
(30 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 
Please contribute your thoughts and suggestions on our upcoming plans for including Cluster Activities at the upcoming summer ESIP meeting (Santa Barbara, July 2009).
 
Please contribute your thoughts and suggestions on our upcoming plans for including Cluster Activities at the upcoming summer ESIP meeting (Santa Barbara, July 2009).
  
'''This page was completely reworked on March 11, 2009 - Please review the history if you need access to prior versions.'''
+
Back to the [[Preservation_and_Stewardship| Preservation and Stewardship Cluster]] home page.
  
Current plans call for a session during the technology showcase on Day 1, two separate sessions early the next day, followed by a whole day spread over two days devoted to a provenance/context workshop.  Session descriptions, goals, outcomes, and potential speakers follow:
+
Please see the [[Interagency_Data_Stewardship/LifeCycle/Jul2009MeetingPlans/Schedule| current schedule]].  Session descriptions, goals, outcomes, and speakers follow:
  
*'''Preservation technologies''' to be given during Day 1 (~2 hours)
+
 
 +
*'''Preservation technologies''' to be given during Day 1 as a series of 1.5 hour technical workshops (perhaps a few may be split in half?)
 
**The intent of this session is to determine and begin to assess preservation technologies that exist in the market place (both commercial and open source)
 
**The intent of this session is to determine and begin to assess preservation technologies that exist in the market place (both commercial and open source)
 
**There would be presentations on technologies like Fedora, DSpace, DuraSpace, IRods, NCore, LOCKSS, as well as a variety of workflow related technologies, etc.
 
**There would be presentations on technologies like Fedora, DSpace, DuraSpace, IRods, NCore, LOCKSS, as well as a variety of workflow related technologies, etc.
Line 14: Line 15:
 
***Special emphasis given to discussion of how provenance/context is handled
 
***Special emphasis given to discussion of how provenance/context is handled
 
**Suggested speakers
 
**Suggested speakers
***Fedora and maybe Duraspace - Thornton Staples
+
***Fedora and Duraspace - Thornton Staples - '''confirmed'''
***LOCKSS - Vicky Reich or David Rosenthal
+
***LOCKSS - Vicky Reich - '''confirmed'''
*'''Standards''' - this session should be held prior to the start of the Provenance and Context workshop (~2 hours)
+
***iRODS - Reagan Moore - '''confirmed'''
 +
***iExperiment - Paolo Missier - '''confirmed'''
 +
 
 +
 
 +
*'''Standards''' - this session could be held in the midst of the Provenance and Context workshop (~2 hours)
 +
**Session Goals
 +
***Standards training
 +
***Raising awareness within the community of the standards that exist in the earth science
 +
***Determine where additional standards work is needed, where agency collaboration can help move things forward, etc.
 
**Presentations would be given on the following topics
 
**Presentations would be given on the following topics
 
***Preservation standards
 
***Preservation standards
Line 22: Line 31:
 
***Data formats - Discuss what is important in data formats to ensure long term preservation of data – talk about HDF, HDF-EOS and NetCDF in this context. What about agencies other than NASA and NOAA? What formats do they use? How does one ensure that data stored in HDF/HDF-EOS/NetCDF continue to be readable and understandable 50 years from now? Etc.  
 
***Data formats - Discuss what is important in data formats to ensure long term preservation of data – talk about HDF, HDF-EOS and NetCDF in this context. What about agencies other than NASA and NOAA? What formats do they use? How does one ensure that data stored in HDF/HDF-EOS/NetCDF continue to be readable and understandable 50 years from now? Etc.  
 
***Metadata formats – treat similarly to data formats considering metadata standards currently in use (ISO standards, North American Profile, CF-1, COARDS, PREMIS).  
 
***Metadata formats – treat similarly to data formats considering metadata standards currently in use (ISO standards, North American Profile, CF-1, COARDS, PREMIS).  
**The purpose of this session is both standards training and to raise awareness within the community of the standards that exist in the earth science.  It is also to determine where additional standards work is needed, where agency collaboration can help move things forward, etc.
 
 
**Suggested speakers:
 
**Suggested speakers:
***Mike Folk on HDF efforts to improve data preservation
+
*** OAIS ''(Handle this as a panel discussion following a 10-15 minute overview; total time ~30 minutes)''
***Rebecca Guenther - PREMIS
+
****Lou Reich/John Granger (overview) '''confirmed'''
*'''The View from the Field''' (~2 hours)
+
****Ken McDonald (NOAA usage) '''confirmed'''
 +
****John Moses/Jeanne Behnke (NASA EOSDIS Data Centers' usage) '''confirmed'''
 +
***Data Formats (total time ~40 minutes)
 +
****Mike Folk - HDF efforts to improve data preservation (15 minutes) - '''confirmed'''
 +
****Russ Rew - NetCDF and data preservation (15 minutes) - '''confirmed'''
 +
****Discussion (10 minutes)- all
 +
***Metadata content and format standards (total time ~50 minutes)
 +
****Ted Habermann - FGDC and ISO standards (15 minutes) - '''confirmed'''
 +
****Siri Jodha Singh Khalsa - NASA ECS Data Model (10 minutes) - '''confirmed'''
 +
****Rebecca Guenther - PREMIS (15 minutes) - '''not confirmed''' - suggests Nancy Hoebelheinrich - Nancy '''confirmed'''
 +
****Discussion (10 minutes) - all
 +
 
 +
 
 +
*'''Rescuing the past''' (~1 hour)
 +
**This session is about people's experiences in dealing with data from the past.  What are the lessons that should be learned for the future?
 +
**Suggested speakers:
 +
***John Moses - NASA (15 min) - '''confirmed'''
 +
***Dennis Wingo (15 min)- '''confirmed'''
 +
***Tom Ross (15 min) - NOAA -  '''confirmed''' - but need to work out teleconferencing capabilities
 +
***Discussion (15 min)
 +
 
 +
 
 +
*'''The View from the Field''' (2 hours)
 
**What are other disciplines and agencies doing for preservation/stewardship?  How do they deal with databases, collections of files, physical objects, ad-hoc services such as work flows?  How do they deal with provenance?  Any lessons to be learned and incorporated into earth science practice?   
 
**What are other disciplines and agencies doing for preservation/stewardship?  How do they deal with databases, collections of files, physical objects, ad-hoc services such as work flows?  How do they deal with provenance?  Any lessons to be learned and incorporated into earth science practice?   
 
**Biology, Astronomy, Medicine, etc. are potential disciplines to be covered
 
**Biology, Astronomy, Medicine, etc. are potential disciplines to be covered
**Suggested speakers:
+
**Suggested speakers (12 min per speaker):
***Clifford Duke - Ecological Society of America
+
***Bruce Wilson representing Clifford Duke - Ecological Society of America workshops on data sharing.  Link to [[media: ESA_Data_Sharing_for_ESIP_2009-07-08.ppt | Slides]]Link to [http://www.esa.org/science_resources/datasharing.php  ESA Workshop web site]
**Representatives from the Library of Congress, NARA, and NSF would also be asked to presentNARA and LOC would be asked to cover:
+
***Nirav Merchant - iPlant - '''confirmed'''
***What are they doing in regards to earth science data?
+
***George Djorgovski - National Virtual Observatory/Cal Tech - '''confirmed'''
***What programs do they have moving preservation practice forward?  Status and results.
+
***Steve Hughes - Planetary Data Systems/JPL - '''confirmed'''
***What standards they use and promulate?
+
***Reagan Moore - NARA - '''confirmed'''
***What do they do for provenance and records tracking?
+
***Steve Morris - LOC - '''confirmed'''
***How do they deal with harmonization issues (i.e. with heterogenous standards, policies, and practices)?
+
**Moved the presentations re workflow related technologies to this session:
**NSF would be asked to cover:
+
****Brian Wilson (JPL) - sciflo - '''confirmed'''
****A description of the NSF program, status, and results
+
****Paolo Missier - iExperiment.org (will also give a 90 min presentation on Tuesday) '''confirmed'''
**Speaker suggestions:
 
***Bob Chadduck - NARA
 
***Laura Campbell - LOC
 
 
 
  
*'''Provenance and Context part 1'''
+
*'''Provenance and Context Workshop'''
The bulk of the time would be spent on a Provenance/Context Workshop (roughly 8 hours spread over 2 days) with agenda:
+
The bulk of the time would be spent on a Provenance/Context Workshop (5 hours spread over 2 days) with agenda:
 +
**Session 1 (2 hours):
 
**'''Introduction''' - Purpose of the workshop, overview of agenda, process-- Duerr (5min)
 
**'''Introduction''' - Purpose of the workshop, overview of agenda, process-- Duerr (5min)
**'''Provenance and Context in the Field'''
+
***'''Prior work'''
***brief presentations (10 min each) from ~4 of our invited experts providing more detail on provenance and context.
+
****Summary from Winter Meeting--Raskin (15 min)
**'''Prior work'''
+
****Review of Guiding Documents: OAIS, PREMIS, USGCRP descriptions of provenance/context -- Duerr (30 Min)
***Summary from Winter Meeting--Raskin (15 min)
+
***'''Provenance and Context research'''  
***Review of Guiding Documents: OAIS, PREMIS, USGCRP descriptions of provenance/context -- Duerr (30 Min)
+
****3 15 min briefings on some of the research projects in this area and how they fit into overall research agenda
**'''Provenance and Context research'''  
+
****Speaker suggestions:
***3-4 15 min briefings on some of the research projects in this area and how they fit into overall research agenda
+
*****Jim Frew - '''confirmed'''
***Speaker suggestions:
+
*****Bruce Barkstrom - '''confirmed'''
****Jim Frew
+
*****Ruth Duerr - Creation of archive information packages '''confirmed'''
****Bruce Barkstrom
+
**'''Open Discussion (~25 min)'''
****Ruth Duerr - creation of archive packages
 
**'''Open Discussion'''
 
 
***Review what we learned in preceeding sessions
 
***Review what we learned in preceeding sessions
 
***Determine what's missing
 
***Determine what's missing
 
***Plan initial approach to creating final document
 
***Plan initial approach to creating final document
  
*'''Provenance and Context part 2'''
+
**'''Session 2 (1 hour)'''
**Review prior days plan. New ideas? Modifications.
+
***Review prior days plan. New ideas? Modifications.
**Create outline for a recommended Research Agenda and Short-term Action Plan
+
***Finalize [[Interagency_Data_Stewardship/LifeCycle/Jul2009MeetingPlans/ProvenanceReport|outline for a report]] with a recommended Research Agenda and Short-term Action Plan
**Break into small writing teams
+
***Break into small writing teams
**Reconvene and determine plan for finalizing document
+
 
 +
**''' Session 3 (2 hours)'''
 +
***Writing teams continue for first hour
 +
***Reconvene and determine plan for finalizing document
 +
 
 +
 
 +
*'''Cluster Meeting (Friday morning)'''
 +
** Agenda:
 +
*** Moving forward with results from the provenance workshop
 +
**** Unfinished business
 +
**** Any emergent topics?
 +
*** Unique identifiers
 +
**** Develop plan for testbed
 +
***** Identify data sets for test
 +
***** Identify ID schemes to use
 +
***** Define assessment strategy
 +
*** Other activities/topics for the group

Latest revision as of 14:48, July 8, 2009

Please contribute your thoughts and suggestions on our upcoming plans for including Cluster Activities at the upcoming summer ESIP meeting (Santa Barbara, July 2009).

Back to the Preservation and Stewardship Cluster home page.

Please see the current schedule. Session descriptions, goals, outcomes, and speakers follow:


  • Preservation technologies to be given during Day 1 as a series of 1.5 hour technical workshops (perhaps a few may be split in half?)
    • The intent of this session is to determine and begin to assess preservation technologies that exist in the market place (both commercial and open source)
    • There would be presentations on technologies like Fedora, DSpace, DuraSpace, IRods, NCore, LOCKSS, as well as a variety of workflow related technologies, etc.
    • Topics each speaker should cover:
      • Purpose of the technology (what aspects of data lifecycle does the technology support)
      • Capabilities
      • Known Limitations
      • Special emphasis given to discussion of how provenance/context is handled
    • Suggested speakers
      • Fedora and Duraspace - Thornton Staples - confirmed
      • LOCKSS - Vicky Reich - confirmed
      • iRODS - Reagan Moore - confirmed
      • iExperiment - Paolo Missier - confirmed


  • Standards - this session could be held in the midst of the Provenance and Context workshop (~2 hours)
    • Session Goals
      • Standards training
      • Raising awareness within the community of the standards that exist in the earth science
      • Determine where additional standards work is needed, where agency collaboration can help move things forward, etc.
    • Presentations would be given on the following topics
      • Preservation standards
        • OAIS - Have someone knowledgeable about OAIS to explain what it is, how it is being used by NOAA and other agencies. (Why is it important to use it? Is it a mandatory for agencies to use? If so, who made it mandatory?)
      • Data formats - Discuss what is important in data formats to ensure long term preservation of data – talk about HDF, HDF-EOS and NetCDF in this context. What about agencies other than NASA and NOAA? What formats do they use? How does one ensure that data stored in HDF/HDF-EOS/NetCDF continue to be readable and understandable 50 years from now? Etc.
      • Metadata formats – treat similarly to data formats considering metadata standards currently in use (ISO standards, North American Profile, CF-1, COARDS, PREMIS).
    • Suggested speakers:
      • OAIS (Handle this as a panel discussion following a 10-15 minute overview; total time ~30 minutes)
        • Lou Reich/John Granger (overview) confirmed
        • Ken McDonald (NOAA usage) confirmed
        • John Moses/Jeanne Behnke (NASA EOSDIS Data Centers' usage) confirmed
      • Data Formats (total time ~40 minutes)
        • Mike Folk - HDF efforts to improve data preservation (15 minutes) - confirmed
        • Russ Rew - NetCDF and data preservation (15 minutes) - confirmed
        • Discussion (10 minutes)- all
      • Metadata content and format standards (total time ~50 minutes)
        • Ted Habermann - FGDC and ISO standards (15 minutes) - confirmed
        • Siri Jodha Singh Khalsa - NASA ECS Data Model (10 minutes) - confirmed
        • Rebecca Guenther - PREMIS (15 minutes) - not confirmed - suggests Nancy Hoebelheinrich - Nancy confirmed
        • Discussion (10 minutes) - all


  • Rescuing the past (~1 hour)
    • This session is about people's experiences in dealing with data from the past. What are the lessons that should be learned for the future?
    • Suggested speakers:
      • John Moses - NASA (15 min) - confirmed
      • Dennis Wingo (15 min)- confirmed
      • Tom Ross (15 min) - NOAA - confirmed - but need to work out teleconferencing capabilities
      • Discussion (15 min)


  • The View from the Field (2 hours)
    • What are other disciplines and agencies doing for preservation/stewardship? How do they deal with databases, collections of files, physical objects, ad-hoc services such as work flows? How do they deal with provenance? Any lessons to be learned and incorporated into earth science practice?
    • Biology, Astronomy, Medicine, etc. are potential disciplines to be covered
    • Suggested speakers (12 min per speaker):
      • Bruce Wilson representing Clifford Duke - Ecological Society of America workshops on data sharing. Link to Slides. Link to ESA Workshop web site
      • Nirav Merchant - iPlant - confirmed
      • George Djorgovski - National Virtual Observatory/Cal Tech - confirmed
      • Steve Hughes - Planetary Data Systems/JPL - confirmed
      • Reagan Moore - NARA - confirmed
      • Steve Morris - LOC - confirmed
    • Moved the presentations re workflow related technologies to this session:
        • Brian Wilson (JPL) - sciflo - confirmed
        • Paolo Missier - iExperiment.org (will also give a 90 min presentation on Tuesday) confirmed
  • Provenance and Context Workshop

The bulk of the time would be spent on a Provenance/Context Workshop (5 hours spread over 2 days) with agenda:

    • Session 1 (2 hours):
    • Introduction - Purpose of the workshop, overview of agenda, process-- Duerr (5min)
      • Prior work
        • Summary from Winter Meeting--Raskin (15 min)
        • Review of Guiding Documents: OAIS, PREMIS, USGCRP descriptions of provenance/context -- Duerr (30 Min)
      • Provenance and Context research
        • 3 15 min briefings on some of the research projects in this area and how they fit into overall research agenda
        • Speaker suggestions:
          • Jim Frew - confirmed
          • Bruce Barkstrom - confirmed
          • Ruth Duerr - Creation of archive information packages confirmed
    • Open Discussion (~25 min)
      • Review what we learned in preceeding sessions
      • Determine what's missing
      • Plan initial approach to creating final document
    • Session 2 (1 hour)
      • Review prior days plan. New ideas? Modifications.
      • Finalize outline for a report with a recommended Research Agenda and Short-term Action Plan
      • Break into small writing teams
    • Session 3 (2 hours)
      • Writing teams continue for first hour
      • Reconvene and determine plan for finalizing document


  • Cluster Meeting (Friday morning)
    • Agenda:
      • Moving forward with results from the provenance workshop
        • Unfinished business
        • Any emergent topics?
      • Unique identifiers
        • Develop plan for testbed
          • Identify data sets for test
          • Identify ID schemes to use
          • Define assessment strategy
      • Other activities/topics for the group