Difference between revisions of "Data Management Course Outline"
From Earth Science Information Partners (ESIP)
(85 intermediate revisions by 11 users not shown) | |||
Line 9: | Line 9: | ||
== Module template and Author Guidelines == | == Module template and Author Guidelines == | ||
− | * [[Media:DataShortCourseModuleTemplate. | + | * [[Media:DataShortCourseModuleTemplate.pptx | Data management training module template (ppt) (Updated - Now with Voiceover scripts & revised Refs/Resources slides)]] |
* [[AuthorsGuide | Author Guidelines ]] | * [[AuthorsGuide | Author Guidelines ]] | ||
+ | * [[Module Review Criteria]] | ||
== For Scientists == | == For Scientists == | ||
Line 16: | Line 17: | ||
===The case for data stewardship=== | ===The case for data stewardship=== | ||
− | * [[Media: | + | * [[Media:AgencyRequirementsV2.ppt | Agency requirements ]]- Ruth |
− | **[[Media:NSFDataManagementPlans. | + | **[[Media:NSFDataManagementPlans.pptx | NSF data management plans]] - Ruth |
− | **NASA science data policy - Ron Weaver | + | **[[Media:CDSAgencyRequirementsNASADataPolicy_REV02.ppt |NASA science data policy]] - Ron Weaver |
**[[Media:DMSC_Agency_NOAA-Administrative-Order_212-15_V1.0.ppt | NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information]] - Jeff Arnfield/NCDC | **[[Media:DMSC_Agency_NOAA-Administrative-Order_212-15_V1.0.ppt | NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information]] - Jeff Arnfield/NCDC | ||
* [[Media:DataShortCourseModule_ROI_1.ppt | Return on Investment]] - Erin/Carol | * [[Media:DataShortCourseModule_ROI_1.ppt | Return on Investment]] - Erin/Carol | ||
**Return on Scientist's investment - Ruth | **Return on Scientist's investment - Ruth | ||
− | + | **Return on the public's investment - Ruth | |
− | **Return on public | + | **Verifiable science - Tying your data to standards, metrics, and benchmarks |
− | * Verifiable science | ||
− | |||
* Facilitating science through interoperable discovery and access - Jeff Arnfield/NCDC | * Facilitating science through interoperable discovery and access - Jeff Arnfield/NCDC | ||
− | * [[Media: | + | * [[Media:CaseforDataStewardshipEnhancingRepMayernik_update.pptx| Enhancing your reputation]] - Matt Mayernik/NCAR |
− | * [[Media: | + | * [[Media:CaseforDataStewardshipPreservingSciRecordMayernik_update.pptx| Preserving the Scientific Record]] - Matt |
− | ** [[Media: | + | ** [[Media:PreservingScientificRecordArchiveRelationsMayernik_updated.pptx| Establishing Relationships with archives]] - Matt |
− | **Preserving a Record of Environmental Change - Matt | + | ** [[Media:PreservingScientificRecordEnvChangeMayernik_update.pptx| Preserving a Record of Environmental Change]] - Matt |
− | ** | + | ** [[Media:PreservingScientificRecordCaseStudy1Mayernik_updated.pptx| Case Study 1 - NSIDC Glacier Photos]] - Matt |
+ | ** [[Media:PreservingScientificRecordCaseStudy2Mayernik_update.pptx| Case Study 2 - Arctic Temperature Variability Data]] - Matt | ||
* What Not to do when Archiving Data! | * What Not to do when Archiving Data! | ||
===Data Management plans=== | ===Data Management plans=== | ||
− | *[[Media:WhyDoADataManagementPlan. | + | *[[Media:WhyDoADataManagementPlan.pptx | Why do a data management plan?]] - Ruth |
− | *[[Media:ElementsOfDataManagementPlanV1. | + | *[[Media:ElementsOfDataManagementPlanV1.pptx | Elements of a plan]] - Ruth |
− | **Identify materials to be created - Ruth | + | **[[Media:DMP-IdentifyingMaterialsToBeCreated.pptx | Identify materials to be created]] - Ruth |
− | ** | + | **[[Media:DMP-OrganizationAndStandards.ppt | Organization and standards]] - Ruth |
− | ** | + | **[[Media:DMP-RolesNResponsibilities.ppt | Roles and responsibilities]] - Ruth |
− | + | **[[Media:DMP-AccessSharingReusePolicies.ppt | Data access, sharing, and re-use policies]] - Ruth | |
− | ** | + | **[[Media:DMP-BackupsArchivingPreservation.ppt | Backups, archives, and preservation strategy]] - Ruth |
− | |||
− | |||
− | **Backups, archives, and preservation strategy - Ruth | ||
*Estimating effort and resources required - Ruth | *Estimating effort and resources required - Ruth | ||
− | |||
− | |||
*Some available resources to help with developing your plan - Ruth | *Some available resources to help with developing your plan - Ruth | ||
Line 55: | Line 50: | ||
*Managing your data - Ruth | *Managing your data - Ruth | ||
**Data identifiers and locators | **Data identifiers and locators | ||
− | **[[Media:FileNamingModuleV1.ppt | File | + | **[[Media:FileNamingModuleV1.ppt | Assign Descriptive File Names]] Bob Cook/ORNL |
**[[Media:DataBackupV1.ppt | Backing up your data ]] Bob Cook/ORNL | **[[Media:DataBackupV1.ppt | Backing up your data ]] Bob Cook/ORNL | ||
**Write it down! Maintaining contemporaneous documentation | **Write it down! Maintaining contemporaneous documentation | ||
***Who, what, when, where, why, how | ***Who, what, when, where, why, how | ||
***Tracking and describing changes to the data | ***Tracking and describing changes to the data | ||
− | ***Lab-based approaches to Data Management | + | ***[[Media:ESIPmod-DataMngmtInTheLab_20120226_ly.ppt | Lab-based approaches to Data Management]] - Lynn Yarmey/NSIDC |
− | |||
*Data Formats - Ruth | *Data Formats - Ruth | ||
**[[Media:DMSC_AvoidingProprietaryFormats.ppt | Avoiding proprietary formats]] - Al Fleig | **[[Media:DMSC_AvoidingProprietaryFormats.ppt | Avoiding proprietary formats]] - Al Fleig | ||
Line 68: | Line 62: | ||
**[[Media:DMSC_SelfDescribingFormats.ppt | Using self-describing data formats]] - Curt Tilmes/NASA | **[[Media:DMSC_SelfDescribingFormats.ppt | Using self-describing data formats]] - Curt Tilmes/NASA | ||
*Creating documentation and metadata | *Creating documentation and metadata | ||
− | **[[Media:ESIP_Short_Course_Data_Citation_2012-02-14.ppt | | + | **[[Media:ESIPmod-IntroToMetadataAndStandards_20121119_ly.ppt |Introduction to Metadata and Metadata Standards]] - Lynn Yarmey/NSIDC |
+ | **[[Media:ESIP_Short_Course_Data_Citation_2012-02-14.ppt | Creating a citation for your data]] Bob Cook/ORNL | ||
**[[Media:DMSC_Metadata_Recording-provenance-and-context_V1.0.ppt | Recording provenance and context]] - Jeff Arnfield/NCDC | **[[Media:DMSC_Metadata_Recording-provenance-and-context_V1.0.ppt | Recording provenance and context]] - Jeff Arnfield/NCDC | ||
**For your collections as a whole | **For your collections as a whole | ||
**Creating item level metadata | **Creating item level metadata | ||
− | **[[Media: | + | **[[Media:GCMD Metadata Discovery Comments.pptx |Metadata for discovery]] - Tyler Stevens/GCMD |
**Metadata for access and use - Jeff Arnfield/NCDC | **Metadata for access and use - Jeff Arnfield/NCDC | ||
**Metadata for archiving - Jeff Arnfield/NCDC | **Metadata for archiving - Jeff Arnfield/NCDC | ||
**Metadata for tracking data processing | **Metadata for tracking data processing | ||
**Individual agencies, archives and registries may have specific requirements | **Individual agencies, archives and registries may have specific requirements | ||
− | + | *Working with your archive - Ron Weaver/NSIDC | |
− | |||
− | *Working with your archive | ||
**Planning for longer term preservation - Jeff Arnfield/NCDC | **Planning for longer term preservation - Jeff Arnfield/NCDC | ||
**Work with your archive early and often - Jeff Arnfield/NCDC | **Work with your archive early and often - Jeff Arnfield/NCDC | ||
− | **Broadening your user community - Bob Downs | + | **[[Media:DataShortCourseModule-BroadeningUserCommunityV1.pptx | Broadening your user community]] - Bob Downs |
− | *Advertising your data | + | *[[Media:LocalDataManagementAdvertisingYourDataHoebelheinrich_final.pptx | Advertising your data]] - Nancy Hoebelheinrich/Knowledge Motifs |
− | **Agency | + | **[[Media:AdvertisingYourDataAgencyReqsHoebelheinrich_final.pptx | Agency requirements for submitting metadata ]]- Nancy Hoebelheinrich/Knowledge Motifs |
**Journals and publications | **Journals and publications | ||
**Agency/institution web sites | **Agency/institution web sites | ||
− | **Using portals and registries | + | **[[Media:AdvertisingYourDataUsingPortalsRegistriesHoebelheinrich_final.pptx | Using data portals and metadata registries]]- Nancy Hoebelheinrich/Knowledge Motifs |
***Publishing metadata to a Web Accessible Folder | ***Publishing metadata to a Web Accessible Folder | ||
− | ***[[Media: | + | ***[[Media:GCMD Metadata Publish Comments.pptx |Submitting metadata to GCMD]] - Tyler Stevens/GCMD |
***Publishing metadata to ECHO | ***Publishing metadata to ECHO | ||
***Publishing metadata to Data.Gov | ***Publishing metadata to Data.Gov | ||
***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate | ***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate | ||
− | ** | + | **Casting your data - Ruth Duerr |
− | *Providing access to your data - | + | *[[Media:ProvidingAccesstoYourDataMayernik.pptx | Providing access to your data]] - Matt Mayernik/NCAR ; Rama has volunteered to review this section |
− | **[[Media:DataShortCourseModule-DeterminingAudienceV1. | + | **[[Media:DataShortCourseModule-DeterminingAudienceV1.pptx | Determining your audience]] - Bob Downs |
**Who gets to access your data | **Who gets to access your data | ||
***Agency best practices & policies | ***Agency best practices & policies | ||
− | **Access mechanisms - Bob Downs | + | **[[Media:DataShortCourseModule-AccessMechanismsV1.pptx | Access mechanisms]] - Bob Downs |
− | **[[Media:DataShortCourseModule-TrackingDataUsageV1. | + | **[[Media:DataShortCourseModule-TrackingDataUsageV1.pptx | Tracking data usage]] - Bob Downs |
− | **[[Media:DataShortCourseModule-HandlingSensitiveDataV1. | + | **[[Media:DataShortCourseModule-HandlingSensitiveDataV1.pptx | Handling Sensitive Data]] - Bob Downs |
− | **[[Media:DataShortCourseModule-RightsV1. | + | **[[Media:DataShortCourseModule-RightsV1.pptx | Rights]] - Bob Downs |
*Additional Products | *Additional Products | ||
− | ** | + | **[[Media:ESIPmod-WritingSharableCode_20120226_ly.ppt | Writing Sharable Code]] - Lynn Yarmey/NSIDC |
− | |||
− | |||
===Preservation strategies=== | ===Preservation strategies=== | ||
− | *Sponsor (e.g., Agency) or institution requirements - Ron Weaver /NSIDC | + | ''I have added draft sections below, the references need work -Ron Weaver'' |
− | *Options for archiving your data - Ron Weaver/NSIDC | + | |
− | **What archives are out there? - Ron Weaver/NSIDC | + | *[[Media:PS1_SponsorRequirements.pptx| Sponsor (e.g., Agency) or institution requirements]] - Ron Weaver /NSIDC |
− | ***Discipline or institutional archives | + | *[[Media:PS2_OptionsForArchiving.pptx | Options for archiving your data]] - Ron Weaver/NSIDC |
− | ***Finding an archive | + | **What archives are out there? - Ron Weaver/NSIDC (part of above) |
− | **What to do if there is no archive out there - Ron Weaver/NSIDC | + | ***Discipline or institutional archives (part of above) |
− | *What data goes into a Long-term archive? - Ron Weaver/NSIDC | + | ***Finding an archive (part of above) |
+ | **What to do if there is no archive out there - Ron Weaver/NSIDC (part of above) | ||
+ | *[[Media:PS3_WhatIsInLTA.ppt | What data goes into a Long-term archive?]] - Ron Weaver/NSIDC | ||
*[[Media:DMSC_Preservation_What-do-long-term-archives-do-with-my-data.ppt | What do long term archives do with my data?]] - Jeff Arnfield/NCDC | *[[Media:DMSC_Preservation_What-do-long-term-archives-do-with-my-data.ppt | What do long term archives do with my data?]] - Jeff Arnfield/NCDC | ||
− | *Data transfer & submission agreements - Ron Weaver/NSIDC | + | *[[Media:PS5_TransferAgreements.ppt | Data transfer & submission agreements]] - Ron Weaver/NSIDC |
** See "Submission Agreements" section under "For Data Managers" | ** See "Submission Agreements" section under "For Data Managers" | ||
** Agency/archive specific requirements my vary | ** Agency/archive specific requirements my vary | ||
*[[Media:DMSC_IntroOAISRefModel.ppt | Intro to the OAIS Reference Model]] - Curt Tilmes | *[[Media:DMSC_IntroOAISRefModel.ppt | Intro to the OAIS Reference Model]] - Curt Tilmes | ||
− | *Emerging standards for preservation - Ron Weaver/NSIDC | + | * [[Media:PS7_EmergingStandards.ppt| Emerging standards for preservation]] - Ron Weaver/NSIDC |
*Metadata | *Metadata | ||
=== Responsible Data Use === | === Responsible Data Use === | ||
− | *[[Media: | + | *[[Media:ResponsibleDataUseCitationAndCreditMayernik.pptx | Citation and credit]] - Matt Mayernik/NCAR |
− | *[[Media:DataShortCourseModule-DataRestrictionsV1. | + | *[[Media:DataShortCourseModule-DataRestrictionsV1.pptx | Data restrictions]] - Bob Downs |
− | *[[Media: | + | *[[Media:ResponsibleDataUseCopyrightAndDataMayernik.pptx | Copyright and Data]] - Matt |
− | *Feedback | + | *[[Media:RDU-Feedback.ppt | Providing Feedback]] - Ruth |
*Collaboration | *Collaboration | ||
*Community participation | *Community participation |
Latest revision as of 10:11, January 24, 2013
Back to the main data management training page
NOTE: We agreed that the target audience initially would be scientists
Caution!!!!
All of the modules on this site are draft materials only! They are made available here so that interested parties can see what is in development and have the chance to comment. Once modules have completed the peer and editorial review process, they will be moved to the ESIP Information Commons and placed under revision control.
Module template and Author Guidelines
- Data management training module template (ppt) (Updated - Now with Voiceover scripts & revised Refs/Resources slides)
- Author Guidelines
- Module Review Criteria
For Scientists
The case for data stewardship
- Agency requirements - Ruth
- NSF data management plans - Ruth
- NASA science data policy - Ron Weaver
- NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information - Jeff Arnfield/NCDC
- Return on Investment - Erin/Carol
- Return on Scientist's investment - Ruth
- Return on the public's investment - Ruth
- Verifiable science - Tying your data to standards, metrics, and benchmarks
- Facilitating science through interoperable discovery and access - Jeff Arnfield/NCDC
- Enhancing your reputation - Matt Mayernik/NCAR
- Preserving the Scientific Record - Matt
- What Not to do when Archiving Data!
Data Management plans
- Why do a data management plan? - Ruth
- Elements of a plan - Ruth
- Estimating effort and resources required - Ruth
- Some available resources to help with developing your plan - Ruth
Local Data Management
- Managing your data - Ruth
- Data identifiers and locators
- Assign Descriptive File Names Bob Cook/ORNL
- Backing up your data Bob Cook/ORNL
- Write it down! Maintaining contemporaneous documentation
- Who, what, when, where, why, how
- Tracking and describing changes to the data
- Lab-based approaches to Data Management - Lynn Yarmey/NSIDC
- Data Formats - Ruth
- Avoiding proprietary formats - Al Fleig
- Choosing and adopting community accepted standards - Curt Tilmes/NASA
- Building understandable spreadsheets - Jeff Arnfield/NCDC
- Using self-describing data formats - Curt Tilmes/NASA
- Creating documentation and metadata
- Introduction to Metadata and Metadata Standards - Lynn Yarmey/NSIDC
- Creating a citation for your data Bob Cook/ORNL
- Recording provenance and context - Jeff Arnfield/NCDC
- For your collections as a whole
- Creating item level metadata
- Metadata for discovery - Tyler Stevens/GCMD
- Metadata for access and use - Jeff Arnfield/NCDC
- Metadata for archiving - Jeff Arnfield/NCDC
- Metadata for tracking data processing
- Individual agencies, archives and registries may have specific requirements
- Working with your archive - Ron Weaver/NSIDC
- Planning for longer term preservation - Jeff Arnfield/NCDC
- Work with your archive early and often - Jeff Arnfield/NCDC
- Broadening your user community - Bob Downs
- Advertising your data - Nancy Hoebelheinrich/Knowledge Motifs
- Agency requirements for submitting metadata - Nancy Hoebelheinrich/Knowledge Motifs
- Journals and publications
- Agency/institution web sites
- Using data portals and metadata registries- Nancy Hoebelheinrich/Knowledge Motifs
- Publishing metadata to a Web Accessible Folder
- Submitting metadata to GCMD - Tyler Stevens/GCMD
- Publishing metadata to ECHO
- Publishing metadata to Data.Gov
- NOTE: Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate
- Casting your data - Ruth Duerr
- Providing access to your data - Matt Mayernik/NCAR ; Rama has volunteered to review this section
- Determining your audience - Bob Downs
- Who gets to access your data
- Agency best practices & policies
- Access mechanisms - Bob Downs
- Tracking data usage - Bob Downs
- Handling Sensitive Data - Bob Downs
- Rights - Bob Downs
- Additional Products
- Writing Sharable Code - Lynn Yarmey/NSIDC
Preservation strategies
I have added draft sections below, the references need work -Ron Weaver
- Sponsor (e.g., Agency) or institution requirements - Ron Weaver /NSIDC
- Options for archiving your data - Ron Weaver/NSIDC
- What archives are out there? - Ron Weaver/NSIDC (part of above)
- Discipline or institutional archives (part of above)
- Finding an archive (part of above)
- What to do if there is no archive out there - Ron Weaver/NSIDC (part of above)
- What archives are out there? - Ron Weaver/NSIDC (part of above)
- What data goes into a Long-term archive? - Ron Weaver/NSIDC
- What do long term archives do with my data? - Jeff Arnfield/NCDC
- Data transfer & submission agreements - Ron Weaver/NSIDC
- See "Submission Agreements" section under "For Data Managers"
- Agency/archive specific requirements my vary
- Intro to the OAIS Reference Model - Curt Tilmes
- Emerging standards for preservation - Ron Weaver/NSIDC
- Metadata
Responsible Data Use
- Citation and credit - Matt Mayernik/NCAR
- Data restrictions - Bob Downs
- Copyright and Data - Matt
- Providing Feedback - Ruth
- Collaboration
- Community participation
For Data Managers
- Data Management plan support
- Collection or acquisition policies
- Intro to OAIS reference model
- Initial Assessment and appraisal
- Identify information to be preserved
- main features and properties
- dependencies on information here or elsewhere
- Identify objects to be received
- Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)
- What complementary information is needed for data useful for climate studies (USGCRP list)
- Assessing potential designated communities
- Assessing probable curation duration
- Assessing data transfer options
- Defining access paths
- Assessing costs and feasibility
- Metadata, metadata standards, and levels of metadata
- Identify information to be preserved
- Submission agreements
- Data integrity
- Contacts
- Schedule
- Operational Procedures
- Error reconciliation
- Constraints
- other aspects necessary for understanding how to support the data
- Preparing for ingest
- Ingesting data
- Validation checks
- Identifiers
- Citations
- Levels of service
- Periodic re-assessment
- Curation activities
- Media migration
- Format migration