https://wiki.esipfed.org/w/api.php?action=feedcontributions&user=Jarnfiel&feedformat=atomEarth Science Information Partners (ESIP) - User contributions [en]2024-03-28T13:14:30ZUser contributionsMediaWiki 1.35.14https://wiki.esipfed.org/w/index.php?title=Voiceover_Script&diff=42041Voiceover Script2012-12-01T02:34:33Z<p>Jarnfiel: /* Title Slide: Script to be read */ The O in the acronym NOAA stands for "Oceanic", not "Oceanographic"!!</p>
<hr />
<div>[[AuthorsGuide| Back to the Authors Guide page]]<br />
<br />
[[Module Review Criteria| Back to the Module Review Criteria page]]<br />
<br />
<br />
== ''Draft'' Voiceover Scripts for modules in common ==<br />
<br />
NOTE: It is not necessary for every module to include an Overview or Relevance slide, as long as these concepts are covered in your voiceover script. Likewise, you may not need both a References and a Resources slide. <br />
<br />
=== Title Slide: Script to be read === <br />
<br />
* This training module is part of the ESIP Federation's Data Management Course for Scientists. The subject of this module is [name of category / name of subcategory, if any, e.g., "The case for data stewardship / Agency Requirements"]. The title of this module is [Subtitle]authored by [Author Name] from [full Organization Name, no acronyms]. Besides the Earth Science Information Partners (ESIP) Federation, sponsors of this Data Management Course are the DataConservancy, and the United States National Oceanic and Atmospheric Administration, NOAA.<br />
<br />
=== Overview Slide: Script to be read (may not be called Overview) ===<br />
<br />
* Just to give you an overview of what this module will cover, we have defined this module as: <br />
<br />
* We think the following information might be helpful for you to understand as background for the topics covered in this module: <br />
<br />
* As a high level overview, we'll touch upon these topics in this module:<br />
<br />
<br />
=== Relevance to Data Management Slide: Script to be read ===<br />
<br />
* Now that you have an idea of what this module will cover, you might be wondering why these topics are important for data management. To answer that question, please consider the following:<br />
<br />
* At this point, it might seem that managing your data involves a lot more effort than may be warranted. If so, there are both incentives and warnings to share that might help motivate you to do your part for data management. As incentives, think about these possibilities: <br />
<br />
* On the other hand, a few warning thoughts might be in order. For instance:<br />
<br />
<br />
=== Resources Slide: Script to be read ===<br />
<br />
* We've collected some additional resources that might you might find helpful should you need more information about some of the areas that we've covered briefly. We'd also like to explain why we think they might be useful. <br />
<br />
<br />
=== References Slide: Script to be read===<br />
<br />
* Within this module, we've made reference to a number of published information sources that we think you may want to review when you want more in-depth information. The most relevant references are listed here.<br />
<br />
<br />
=== Other Relevant Modules Slide: Script to be read===<br />
<br />
* The modules of the ESIP Data Management Course have been designed to complement and supplement each other. In light of this plan, we think you might find the following, related modules relevant to you as you gain a better understanding of data management:</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=38507Data Management Course Outline2012-03-06T19:10:12Z<p>Jarnfiel: </p>
<hr />
<div>[http://wiki.esipfed.org/index.php/Data_Management_Short_Course Back to the main data management training page]<br />
<br />
'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== Caution!!!! ==<br />
<br />
All of the modules on this site are draft materials only! They are made available here so that interested parties can see what is in development and have the chance to comment. Once modules have completed the peer and editorial review process, they will be moved to the ESIP Information Commons and placed under revision control.<br />
<br />
== Module template and Author Guidelines ==<br />
<br />
* [[Media:DataShortCourseModuleTemplate.ppt | Data management training module template (ppt)]]<br />
* [[AuthorsGuide | Author Guidelines ]]<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* [[Media:AgencyRequirementsV1.ppt | Agency requirements ]]- Ruth<br />
**[[Media:NSFDataManagementPlans.ppt | NSF data management plans]] - Ruth<br />
**[[Media:NASADataManagementPlans.ppt |NASA science data policy]] - Ron Weaver<br />
**[[Media:DMSC_Agency_NOAA-Administrative-Order_212-15_V1.0.ppt | NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information]] - Jeff Arnfield/NCDC<br />
* [[Media:DataShortCourseModule_ROI_1.ppt | Return on Investment]] - Erin/Carol<br />
**Return on Scientist's investment - Ruth<br />
**Expanding the audience for your data- Ruth<br />
**Return on public investments- Ruth<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access - Jeff Arnfield/NCDC<br />
* [[Media:ESIP_module_enhancing.ppt| Enhancing your reputation]] - Matt Mayernik/NCAR<br />
* [[Media:ESIP_module_pres_sci_record.ppt| Preserving the Scientific Record]] - Matt<br />
** [[Media:ESIP_module_Archive_relations.ppt| Establishing Relationships with archives]] - Matt<br />
** [[Media:PreservingScientificRecordEnvChangeMayernik.pptx| Preserving a Record of Environmental Change]] - Matt<br />
** [[Media:PreservingScientificRecordCaseStudy1Mayernik.pptx| Case Study 1 - NSIDC Glacier Photos]] - Matt<br />
** [[Media:PreservingScientificRecordCaseStudy2Mayernik.pptx| Case Study 2 - Arctic Temperature Variability Data]] - Matt<br />
* What Not to do when Archiving Data!<br />
<br />
===Data Management plans===<br />
<br />
*[[Media:WhyDoADataManagementPlan.ppt | Why do a data management plan?]] - Ruth<br />
*[[Media:ElementsOfDataManagementPlanV1.ppt | Elements of a plan]] - Ruth<br />
**[[Media:DMP-IdentifyingMaterialsToBeCreated.ppt | Identify materials to be created]] - Ruth<br />
**[[Media:DMP-OrganizationAndStandards.ppt | Organization and standards]] - Ruth<br />
**Roles and responsibilities - Ruth<br />
**Describing and documenting your data, including metadata - Ruth<br />
**Data access, sharing, and re-use policies - Ruth<br />
**Backups, archives, and preservation strategy - Ruth<br />
*Estimating effort and resources required - Ruth<br />
**Hardware, software capabilities required - Ruth<br />
**Personnel resources and skills needed - Ruth<br />
*Some available resources to help with developing your plan - Ruth<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data - Ruth<br />
**Data identifiers and locators<br />
**[[Media:FileNamingModuleV1.ppt | File naming conventions]] Bob Cook/ORNL<br />
**[[Media:DataBackupV1.ppt | Backing up your data ]] Bob Cook/ORNL<br />
**Write it down! Maintaining contemporaneous documentation<br />
***Who, what, when, where, why, how<br />
***Tracking and describing changes to the data<br />
***[[Media:ESIPmod-DataMngmtInTheLab_20120226_ly.ppt | Lab-based approaches to Data Management]] - Lynn Yarmey/NSIDC<br />
*Data Formats - Ruth<br />
**[[Media:DMSC_AvoidingProprietaryFormats.ppt | Avoiding proprietary formats]] - Al Fleig<br />
**[[Media:ChoosingAndAdoptingCommunityAcceptedStandardsTilmes.ppt | Choosing and adopting community accepted standards]] - Curt Tilmes/NASA<br />
**[[Media:DMSC_DataFormats_Building-understandable-spreadsheets_V1.0.ppt | Building understandable spreadsheets]] - Jeff Arnfield/NCDC<br />
**[[Media:DMSC_SelfDescribingFormats.ppt | Using self-describing data formats]] - Curt Tilmes/NASA<br />
*Creating documentation and metadata <br />
**[[Media:ESIPmod-IntroToMetadataAndStandards_20120226_ly.ppt |Introduction to Metadata and Metadata Standards]] - Lynn Yarmey/NSIDC<br />
**[[Media:ESIP_Short_Course_Data_Citation_2012-02-14.ppt | Developing a citation for your data]] Bob Cook/ORNL<br />
**[[Media:DMSC_Metadata_Recording-provenance-and-context_V1.0.ppt | Recording provenance and context]] - Jeff Arnfield/NCDC<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**[[Media:DataShortCourseModuleTemplate_GCMD_Metadata_Discovery.ppt |Metadata for discovery]] - Tyler Stevens/GCMD<br />
**[[Media:DMSC_Metadata_Metadata-for-access-and-use_V1.0.ppt | Metadata for access and use]] - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Individual agencies, archives and registries may have specific requirements<br />
*Working with your archive organization - Ron Weaver/NSIDC<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
**Work with your archive early and often - Jeff Arnfield/NCDC<br />
**[[Media:DataShortCourseModule-BroadeningUserCommunityV1.ppt | Broadening your user community]] - Bob Downs<br />
*Advertising your data<br />
**Agency/institution requirements for publishing metadata<br />
**Journals and publications<br />
**Agency/institution web sites<br />
**Using portals and registries<br />
***Publishing metadata to a Web Accessible Folder<br />
***[[Media:DataShortCourseModuleTemplate_GCMD_Metadata_Publish.ppt |Publishing metadata to GCMD]] - Tyler Stevens/GCMD<br />
***Publishing metadata to ECHO<br />
***Publishing metadata to Data.Gov<br />
***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate<br />
**Datacasting<br />
*Providing access to your data - Bob Downs/Chris Lenhardt/Ron Weaver (whole section); Rama has volunteered to review this section<br />
**[[Media:DataShortCourseModule-DeterminingAudienceV1.ppt | Determining your audience]] - Bob Downs<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**[[Media:DataShortCourseModule-AccessMechanismsV1.ppt | Access mechanisms]] - Bob Downs<br />
**[[Media:DataShortCourseModule-TrackingDataUsageV1.ppt | Tracking data usage]] - Bob Downs<br />
**[[Media:DataShortCourseModule-HandlingSensitiveDataV1.ppt | Handling Sensitive Data]] - Bob Downs<br />
**[[Media:DataShortCourseModule-RightsV1.ppt | Rights]] - Bob Downs<br />
*Additional Products<br />
**[[Media:ESIPmod-WritingSharableCode_20120226_ly.ppt | Writing Sharable Code]] - Lynn Yarmey/NSIDC<br />
<br />
===Preservation strategies===<br />
<br />
''I have added draft sections below, the references need work -Ron Weaver''<br />
<br />
*Sponsor (e.g., Agency) or institution requirements[[Media:PS1_SponsorRequirements.pptx]] - Ron Weaver /NSIDC<br />
*Options for archiving your data - Ron Weaver/NSIDC[[Media:PS2_OptionsForArchiving.pptx]]<br />
**What archives are out there? - Ron Weaver/NSIDC (part of above)<br />
***Discipline or institutional archives (part of above)<br />
***Finding an archive (part of above)<br />
**What to do if there is no archive out there - Ron Weaver/NSIDC (part of above)<br />
*What data goes into a Long-term archive?[[Media:PS3_WhatIsInLTA.ppt ]] - Ron Weaver/NSIDC<br />
*[[Media:DMSC_Preservation_What-do-long-term-archives-do-with-my-data.ppt | What do long term archives do with my data?]] - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements [[Media:PS5_TransferAgreements.ppt]]- Ron Weaver/NSIDC<br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*[[Media:DMSC_IntroOAISRefModel.ppt | Intro to the OAIS Reference Model]] - Curt Tilmes<br />
*Emerging standards for preservation [[Media:PS7_EmergingStandards.ppt]] - Ron Weaver/NSIDC<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*[[Media:ESIP_module_citation_credit.ppt | Citation and credit]] - Matt Mayernik/NCAR<br />
*[[Media:DataShortCourseModule-DataRestrictionsV1.ppt | Data restrictions]] - Bob Downs<br />
*[[Media:ESIP_module_data_use.ppt | Fair access and use]] - Matt<br />
*Feedback and metrics - Ruth<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=38506Data Management Course Outline2012-03-06T19:08:59Z<p>Jarnfiel: </p>
<hr />
<div>[http://wiki.esipfed.org/index.php/Data_Management_Short_Course Back to the main data management training page]<br />
<br />
'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== Caution!!!! ==<br />
<br />
All of the modules on this site are draft materials only! They are made available here so that interested parties can see what is in development and have the chance to comment. Once modules have completed the peer and editorial review process, they will be moved to the ESIP Information Commons and placed under revision control.<br />
<br />
== Module template and Author Guidelines ==<br />
<br />
* [[Media:DataShortCourseModuleTemplate.ppt | Data management training module template (ppt)]]<br />
* [[AuthorsGuide | Author Guidelines ]]<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* [[Media:AgencyRequirementsV1.ppt | Agency requirements ]]- Ruth<br />
**[[Media:NSFDataManagementPlans.ppt | NSF data management plans]] - Ruth<br />
**[[Media:NASADataManagementPlans.ppt |NASA science data policy]] - Ron Weaver<br />
**[[Media:DMSC_Agency_NOAA-Administrative-Order_212-15_V1.0.ppt | NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information]] - Jeff Arnfield/NCDC<br />
* [[Media:DataShortCourseModule_ROI_1.ppt | Return on Investment]] - Erin/Carol<br />
**Return on Scientist's investment - Ruth<br />
**Expanding the audience for your data- Ruth<br />
**Return on public investments- Ruth<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access - Jeff Arnfield/NCDC<br />
* [[Media:ESIP_module_enhancing.ppt| Enhancing your reputation]] - Matt Mayernik/NCAR<br />
* [[Media:ESIP_module_pres_sci_record.ppt| Preserving the Scientific Record]] - Matt<br />
** [[Media:ESIP_module_Archive_relations.ppt| Establishing Relationships with archives]] - Matt<br />
** [[Media:PreservingScientificRecordEnvChangeMayernik.pptx| Preserving a Record of Environmental Change]] - Matt<br />
** [[Media:PreservingScientificRecordCaseStudy1Mayernik.pptx| Case Study 1 - NSIDC Glacier Photos]] - Matt<br />
** [[Media:PreservingScientificRecordCaseStudy2Mayernik.pptx| Case Study 2 - Arctic Temperature Variability Data]] - Matt<br />
* What Not to do when Archiving Data!<br />
<br />
===Data Management plans===<br />
<br />
*[[Media:WhyDoADataManagementPlan.ppt | Why do a data management plan?]] - Ruth<br />
*[[Media:ElementsOfDataManagementPlanV1.ppt | Elements of a plan]] - Ruth<br />
**[[Media:DMP-IdentifyingMaterialsToBeCreated.ppt | Identify materials to be created]] - Ruth<br />
**[[Media:DMP-OrganizationAndStandards.ppt | Organization and standards]] - Ruth<br />
**Roles and responsibilities - Ruth<br />
**Describing and documenting your data, including metadata - Ruth<br />
**Data access, sharing, and re-use policies - Ruth<br />
**Backups, archives, and preservation strategy - Ruth<br />
*Estimating effort and resources required - Ruth<br />
**Hardware, software capabilities required - Ruth<br />
**Personnel resources and skills needed - Ruth<br />
*Some available resources to help with developing your plan - Ruth<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data - Ruth<br />
**Data identifiers and locators<br />
**[[Media:FileNamingModuleV1.ppt | File naming conventions]] Bob Cook/ORNL<br />
**[[Media:DataBackupV1.ppt | Backing up your data ]] Bob Cook/ORNL<br />
**Write it down! Maintaining contemporaneous documentation<br />
***Who, what, when, where, why, how<br />
***Tracking and describing changes to the data<br />
***[[Media:ESIPmod-DataMngmtInTheLab_20120226_ly.ppt | Lab-based approaches to Data Management]] - Lynn Yarmey/NSIDC<br />
*Data Formats - Ruth<br />
**[[Media:DMSC_AvoidingProprietaryFormats.ppt | Avoiding proprietary formats]] - Al Fleig<br />
**[[Media:ChoosingAndAdoptingCommunityAcceptedStandardsTilmes.ppt | Choosing and adopting community accepted standards]] - Curt Tilmes/NASA<br />
**[[Media:DMSC_DataFormats_Building-understandable-spreadsheets_V1.0.ppt | Building understandable spreadsheets]] - Jeff Arnfield/NCDC<br />
**[[Media:DMSC_SelfDescribingFormats.ppt | Using self-describing data formats]] - Curt Tilmes/NASA<br />
*Creating documentation and metadata <br />
**[[Media:ESIPmod-IntroToMetadataAndStandards_20120226_ly.ppt |Introduction to Metadata and Metadata Standards]] - Lynn Yarmey/NSIDC<br />
**[[Media:ESIP_Short_Course_Data_Citation_2012-02-14.ppt | Developing a citation for your data]] Bob Cook/ORNL<br />
**[[Media:DMSC_Metadata_Recording-provenance-and-context_V1.0.ppt | Recording provenance and context]] - Jeff Arnfield/NCDC<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**[[Media:DataShortCourseModuleTemplate_GCMD_Metadata_Discovery.ppt |Metadata for discovery]] - Tyler Stevens/GCMD<br />
**[[Media:DMSC_Metadata_Access-and-use_V1.0.ppt | Metadata for access and use]] - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Individual agencies, archives and registries may have specific requirements<br />
*Working with your archive organization - Ron Weaver/NSIDC<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
**Work with your archive early and often - Jeff Arnfield/NCDC<br />
**[[Media:DataShortCourseModule-BroadeningUserCommunityV1.ppt | Broadening your user community]] - Bob Downs<br />
*Advertising your data<br />
**Agency/institution requirements for publishing metadata<br />
**Journals and publications<br />
**Agency/institution web sites<br />
**Using portals and registries<br />
***Publishing metadata to a Web Accessible Folder<br />
***[[Media:DataShortCourseModuleTemplate_GCMD_Metadata_Publish.ppt |Publishing metadata to GCMD]] - Tyler Stevens/GCMD<br />
***Publishing metadata to ECHO<br />
***Publishing metadata to Data.Gov<br />
***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate<br />
**Datacasting<br />
*Providing access to your data - Bob Downs/Chris Lenhardt/Ron Weaver (whole section); Rama has volunteered to review this section<br />
**[[Media:DataShortCourseModule-DeterminingAudienceV1.ppt | Determining your audience]] - Bob Downs<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**[[Media:DataShortCourseModule-AccessMechanismsV1.ppt | Access mechanisms]] - Bob Downs<br />
**[[Media:DataShortCourseModule-TrackingDataUsageV1.ppt | Tracking data usage]] - Bob Downs<br />
**[[Media:DataShortCourseModule-HandlingSensitiveDataV1.ppt | Handling Sensitive Data]] - Bob Downs<br />
**[[Media:DataShortCourseModule-RightsV1.ppt | Rights]] - Bob Downs<br />
*Additional Products<br />
**[[Media:ESIPmod-WritingSharableCode_20120226_ly.ppt | Writing Sharable Code]] - Lynn Yarmey/NSIDC<br />
<br />
===Preservation strategies===<br />
<br />
''I have added draft sections below, the references need work -Ron Weaver''<br />
<br />
*Sponsor (e.g., Agency) or institution requirements[[Media:PS1_SponsorRequirements.pptx]] - Ron Weaver /NSIDC<br />
*Options for archiving your data - Ron Weaver/NSIDC[[Media:PS2_OptionsForArchiving.pptx]]<br />
**What archives are out there? - Ron Weaver/NSIDC (part of above)<br />
***Discipline or institutional archives (part of above)<br />
***Finding an archive (part of above)<br />
**What to do if there is no archive out there - Ron Weaver/NSIDC (part of above)<br />
*What data goes into a Long-term archive?[[Media:PS3_WhatIsInLTA.ppt ]] - Ron Weaver/NSIDC<br />
*[[Media:DMSC_Preservation_What-do-long-term-archives-do-with-my-data.ppt | What do long term archives do with my data?]] - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements [[Media:PS5_TransferAgreements.ppt]]- Ron Weaver/NSIDC<br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*[[Media:DMSC_IntroOAISRefModel.ppt | Intro to the OAIS Reference Model]] - Curt Tilmes<br />
*Emerging standards for preservation [[Media:PS7_EmergingStandards.ppt]] - Ron Weaver/NSIDC<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*[[Media:ESIP_module_citation_credit.ppt | Citation and credit]] - Matt Mayernik/NCAR<br />
*[[Media:DataShortCourseModule-DataRestrictionsV1.ppt | Data restrictions]] - Bob Downs<br />
*[[Media:ESIP_module_data_use.ppt | Fair access and use]] - Matt<br />
*Feedback and metrics - Ruth<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=38150Data Management Course Outline2012-02-02T17:32:51Z<p>Jarnfiel: </p>
<hr />
<div>[http://wiki.esipfed.org/index.php/Data_Management_Short_Course Back to the main data management training page]<br />
<br />
'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== Caution!!!! ==<br />
<br />
All of the modules on this site are draft materials only! They are made available here so that interested parties can see what is in development and have the chance to comment. Once modules have completed the peer and editorial review process, they will be moved to the ESIP Information Commons and placed under revision control.<br />
<br />
== Module template and Author Guidelines ==<br />
<br />
* [[Media:DataShortCourseModuleTemplate.ppt | Data management training module template (ppt)]]<br />
* [[AuthorsGuide | Author Guidelines ]]<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* [[Media:AgencyRequirementsV1.ppt | Agency requirements ]]- Ruth<br />
**[[Media:NSFDataManagementPlans.ppt | NSF data management plans]] - Ruth<br />
**NASA science data policy - Ron Weaver<br />
**[[Media:DMSC_Agency_NOAA-Administrative-Order_212-15_V1.0.ppt | NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information]] - Jeff Arnfield/NCDC<br />
* [[Media:DataShortCourseModule_ROI_1.ppt | Return on Investment]] - Erin/Carol<br />
**Return on Scientist's investment - Ruth<br />
**Expanding the audience for your data- Ruth<br />
**Return on public investments- Ruth<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access - Jeff Arnfield/NCDC<br />
* [[Media:ESIP_module_enhancing.ppt| Enhancing your reputation]] - Matt Mayernik/NCAR<br />
* [[Media:ESIP_module_pres_sci_record.ppt| Preserving the Scientific Record]] - Matt<br />
** [[Media:ESIP_module_Archive_relations.ppt| Establishing Relationships with archives]] - Matt<br />
**Preserving a Record of Environmental Change - Matt<br />
**Other case studies? - Matt<br />
* What Not to do when Archiving Data!<br />
<br />
===Data Management plans===<br />
<br />
*[[Media:WhyDoADataManagementPlan.ppt | Why do a data management plan?]] - Ruth<br />
*[[Media:ElementsOfDataManagementPlanV1.ppt | Elements of a plan]] - Ruth<br />
**Identify materials to be created - Ruth<br />
**Identify your audience(s) - Ruth<br />
**Data organization - Ruth<br />
**Roles and responsibilities - Ruth<br />
**Describing and documenting your data, including metadata - Ruth<br />
**Standards used - Ruth<br />
**Data access, sharing, and re-use policies - Ruth<br />
**Backups, archives, and preservation strategy - Ruth<br />
*Estimating effort and resources required - Ruth<br />
**Hardware, software capabilities required - Ruth<br />
**Personnel resources and skills needed - Ruth<br />
*Some available resources to help with developing your plan - Ruth<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data - Ruth<br />
**Data identifiers and locators<br />
**[[Media:FileNamingModuleV1.ppt | File naming conventions]] (Cook)<br />
**[[Media:DataBackupV1.ppt | Backing up your data ]] (Cook)<br />
**Write it down! Maintaining contemporaneous documentation<br />
***Who, what, when, where, why, how<br />
***Tracking and describing changes to the data<br />
***Lab-based approaches to Data Management - Lynn Yarmey/NSIDC<br />
***Documenting the 'messy' sciences - Lynn Yarmey/NSIDC<br />
*Data Formats - Ruth<br />
**[[Media:DMSC_AvoidingProprietaryFormats.ppt | Avoiding proprietary formats]] - Al Fleig<br />
**[[Media:ChoosingAndAdoptingCommunityAcceptedStandardsTilmes.ppt | Choosing and adopting community accepted standards]] - Curt Tilmes/NASA<br />
**[[Media:DMSC_DataFormats_Building-understandable-spreadsheets_V1.0.ppt | Building understandable spreadsheets]] - Jeff Arnfield/NCDC<br />
**[[Media:DMSC_SelfDescribingFormats.ppt | Using self-describing data formats]] - Curt Tilmes/NASA<br />
*Creating documentation and metadata <br />
**Developing a citation for your data (Cook)<br />
**[[Media:DMSC_Metadata_Recording-provenance-and-context_V1.0.ppt | Recording provenance and context]] - Jeff Arnfield/NCDC<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**[[Media:DataShortCourseModuleTemplate_GCMD_Metadata_Discovery.ppt |Metadata for discovery]] - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing - Curt Tilmes<br />
**Individual agencies, archives and registries may have specific requirements<br />
**Introduction to Standards - Lynn Yarmey/NSIDC<br />
**Introduction to XML - Lynn Yarmey/NSIDC<br />
*Working with your archive organization - Ron Weaver/NSIDC<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
**Work with your archive early and often - Jeff Arnfield/NCDC<br />
**Broadening your user community - Bob Downs<br />
*Advertising your data<br />
**Agency/institution requirements for publishing metadata<br />
**Journals and publications<br />
**Agency/institution web sites<br />
**Using portals and registries<br />
***Publishing metadata to a Web Accessible Folder<br />
***[[Media:DataShortCourseModuleTemplate_GCMD_Metadata_Publish.ppt |Publishing metadata to GCMD]] - Tyler Stevens/GCMD<br />
***Publishing metadata to ECHO<br />
***Publishing metadata to Data.Gov<br />
***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate<br />
**Datacasting<br />
*Providing access to your data - Rama/Bob Downs/Chris Lenhardt/Ron Weaver (whole section)<br />
**[[Media:DataShortCourseModule-DeterminingAudienceV1.ppt | Determining your audience]] - Bob Downs<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**[[Media:DataShortCourseModule-TrackingDataUsageV1.ppt | Tracking data usage]] - Bob Downs<br />
**[[Media:DataShortCourseModule-HandlingSensitiveDataV1.ppt | Handling Sensitive Data]] - Bob Downs<br />
**[[Media:DataShortCourseModule-RightsV1.ppt | Rights]] - Bob Downs<br />
*Additional Products<br />
**Additional resources: What you already have that others can use - Lynn Yarmey/NSIDC<br />
**Writing Sharable Code - Lynn Yarmey/NSIDC<br />
**Sharing vocabularies - Lynn Yarmey/NSIDC<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements - Ron Weaver /NSIDC<br />
*Options for archiving your data - Ron Weaver/NSIDC<br />
**What archives are out there? - Ron Weaver/NSIDC<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there - Ron Weaver/NSIDC<br />
*What data goes into a Long-term archive? - Ron Weaver/NSIDC<br />
*[[Media:DMSC_Preservation_What-do-long-term-archives-do-with-my-data.ppt | What do long term archives do with my data?]] - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements - Ron Weaver/NSIDC<br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*[[Media:DMSC_IntroOAISRefModel.ppt | Intro to the OAIS Reference Model]] - Curt Tilmes<br />
*Emerging standards for preservation - Ron Weaver/NSIDC<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*[[Media:ESIP_module_citation_credit.ppt | Citation and credit]] - Matt Mayernik/NCAR<br />
*[[Media:DataShortCourseModule-DataRestrictionsV1.ppt | Data restrictions]] - Bob Downs<br />
*[[Media:ESIP_module_data_use.ppt | Fair access and use]] - Matt<br />
*Feedback and metrics - Ruth<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=File:DMSC_Preservation_What-do-long-term-archives-do-with-my-data.ppt&diff=36823File:DMSC Preservation What-do-long-term-archives-do-with-my-data.ppt2011-11-09T22:34:47Z<p>Jarnfiel: </p>
<hr />
<div></div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=36821Data Management Course Outline2011-11-09T22:33:52Z<p>Jarnfiel: Added "What do long-term archives do..." module</p>
<hr />
<div>[http://wiki.esipfed.org/index.php/Data_Management_Short_Course Back to the main data management training page]<br />
<br />
'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== Caution!!!! ==<br />
<br />
All of the modules on this site are draft materials only! They are made available here so that interested parties can see what is in development and have the chance to comment. Once modules have completed the peer and editorial review process, they will be moved to the ESIP Information Commons and placed under revision control.<br />
<br />
== Module template and Author Guidelines ==<br />
<br />
* [[Media:DataShortCourseModuleTemplate.ppt | Data management training module template (ppt)]]<br />
* [[AuthorsGuide | Author Guidelines ]]<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* [[Media:AgencyRequirementsV1.ppt | Agency requirements ]]- Ruth<br />
**[[Media:NSFDataManagementPlans.ppt | NSF data management plans]] - Ruth<br />
**NASA science data policy - Ron Weaver<br />
**[[Media:DMSC_Agency_NOAA-Administrative-Order_212-15_V1.0.ppt | NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information]] - Jeff Arnfield/NCDC<br />
* Return on Investment - Erin/Carol<br />
**[[Media:DataShortCourseModule_ROI_1.ppt| Return on Scientist's investment]] - Erin/Carol<br />
**Expanding the audience for your data- Erin/Carol<br />
**Return on public investments- Erin/Carol<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access - Jeff Arnfield/NCDC<br />
* [[Media:ESIP_module_enhancing.ppt| Enhancing your reputation]] - Matt Mayernik/NCAR<br />
* [[Media:ESIP_module_pres_sci_record.ppt| Preserving the Scientific Record]] - Matt<br />
** [[Media:ESIP_module_Archive_relations.ppt| Establishing Relationships with archives]] - Matt<br />
**Preserving a Record of Environmental Change - Matt<br />
**Other case studies? - Matt<br />
* What Not to do when Archiving Data!<br />
<br />
===Data Management plans===<br />
<br />
*[[Media:WhyDoADataManagementPlan.ppt | Why do a data management plan?]] - Ruth<br />
*[[Media:ElementsOfDataManagementPlanV1.ppt | Elements of a plan]] - Ruth<br />
**Identify materials to be created - Ruth<br />
**Identify your audience(s) - Ruth<br />
**Data organization - Ruth<br />
**Roles and responsibilities - Ruth<br />
**Describing and documenting your data, including metadata - Ruth<br />
**Standards used - Ruth<br />
**Data access, sharing, and re-use policies - Ruth<br />
**Backups, archives, and preservation strategy - Ruth<br />
*Estimating effort and resources required - Ruth<br />
**Hardware, software capabilities required - Ruth<br />
**Personnel resources and skills needed - Ruth<br />
*Some available resources to help with developing your plan - Ruth<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data - Ruth<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**[[Media:FileNamingModuleV1.ppt | File naming conventions]] (Cook)<br />
**[[Media:DataBackupV1.ppt | Backing up your data ]] (Cook)<br />
**Write it down! Maintaining contemporaneous documentation<br />
***Who, what, when, where, why, how<br />
***Tracking and describing changes to the data<br />
*Data Formats - Ruth<br />
**[[Media:DMSC_DataFormats_Building-understandable-spreadsheets_V1.0.ppt | Building understandable spreadsheets]] - Jeff Arnfield/NCDC<br />
**[[Media:DMSC_SelfDescribingFormats.ppt | Using self-describing data formats]] - Curt Tilmes<br />
**Choosing and adopting community accepted standards<br />
**[[Media:DMSC_AvoidingProprietaryFormats.ppt | Avoiding proprietary formats]] - Al Fleig<br />
*Creating documentation and metadata <br />
**Developing a citation for your data (Cook)<br />
**[[Media:DMSC_Metadata_Recording-provenance-and-context_V1.0.ppt | Recording provenance and context]] - Jeff Arnfield/NCDC<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**[[Media:DataShortCourseModuleTemplate_GCMD_Metadata_Discovery.ppt |Metadata for discovery]] - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing - Curt Tilmes<br />
**Individual agencies, archives and registries may have specific requirements<br />
*Working with your archive organization - Ron Weaver/NSIDC<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
**Work with your archive early and often - Jeff Arnfield/NCDC<br />
**Broadening your user community<br />
*Advertising your data<br />
**Agency/institution requirements for publishing metadata<br />
**Journals and publications<br />
**Agency/institution web sites<br />
**Using portals and registries<br />
***Publishing metadata to a Web Accessible Folder<br />
***[[Media:DataShortCourseModuleTemplate_GCMD_Metadata_Publish.ppt |Publishing metadata to GCMD]] - Tyler Stevens/GCMD<br />
***Publishing metadata to ECHO<br />
***Publishing metadata to Data.Gov<br />
***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate<br />
**Datacasting<br />
*Providing access to your data - Rama/Bob Downs/Chris Lenhardt/Ron Weaver (whole section)<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Tracking data usage<br />
**[[Media:DataShortCourseModule-HandlingSensitiveDataV1.ppt | Handling Sensitive Data]] - Bob Downs<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements - Ron Weaver /NSIDC<br />
*Options for archiving your data - Ron Weaver/NSIDC<br />
**What archives are out there? - Ron Weaver/NSIDC<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there - Ron Weaver/NSIDC<br />
*What data goes into a Long-term archive? - Ron Weaver/NSIDC<br />
*[[Media:DMSC_Preservation_What-do-long-term-archives-do-with-my-data.ppt | What do long term archives do with my data?]] - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements - Ron Weaver/NSIDC<br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*[[Media:DMSC_IntroOAISRefModel.ppt | Intro to the OAIS Reference Model]] - Curt Tilmes<br />
*Emerging standards for preservation - Ron Weaver/NSIDC<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*[[Media:ESIP_module_citation_credit.ppt | Citation and credit]] - Matt Mayernik/NCAR<br />
*[[Media:DataShortCourseModule-DataRestrictionsV1.ppt | Data restrictions]] - Bob Downs<br />
*[[Media:ESIP_module_data_use.ppt | Fair access and use]] - Matt<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=File:DMSC_Metadata_Recording-provenance-and-context_V1.0.ppt&diff=36484File:DMSC Metadata Recording-provenance-and-context V1.0.ppt2011-10-20T15:28:50Z<p>Jarnfiel: </p>
<hr />
<div></div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=36483Data Management Course Outline2011-10-20T15:27:40Z<p>Jarnfiel: </p>
<hr />
<div>[http://wiki.esipfed.org/index.php/Data_Management_Short_Course Back to the main data management training page]<br />
<br />
'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== Module template and Author Guidelines ==<br />
<br />
* [[Media:DataShortCourseModuleTemplate.ppt | Data management training module template (ppt)]]<br />
* [[AuthorsGuide | Author Guidelines ]]<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* [[Media:AgencyRequirementsV1.ppt | Agency requirements ]]- Ruth<br />
**[[Media:NSFDataManagementPlans.ppt | NSF data management plans]] - Ruth<br />
**NASA science data policy - Ron Weaver<br />
**[[Media:DMSC_Agency_NOAA-Administrative-Order_212-15_V1.0.ppt | NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information]] - Jeff Arnfield/NCDC<br />
* Return on Investment - Erin/Carol<br />
**[[Media:DataShortCourseModule_ROI_1.ppt| Return on Scientist's investment]] - Erin/Carol<br />
**Expanding the audience for your data- Erin/Carol<br />
**Return on public investments- Erin/Carol<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access - Jeff Arnfield/NCDC<br />
* [[Media:ESIP_module_enhancing.ppt| Enhancing your reputation]] - Matt Mayernik/NCAR<br />
* [[Media:ESIP_module_pres_sci_record.ppt| Preserving the Scientific Record]] - Matt<br />
**Establishing Relationships with archives - Matt<br />
**Preserving a Record of Environmental Change - Matt<br />
**Other case studies? - Matt<br />
* What Not to do when Archiving Data!<br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - Ruth<br />
**Identify materials to be created - Ruth<br />
**Identify your audience(s) - Ruth<br />
**Data organization - Ruth<br />
**Roles and responsibilities - Ruth<br />
**Describing and documenting your data, including metadata - Ruth<br />
**Standards used - Ruth<br />
**Data access, sharing, and re-use policies - Ruth<br />
**Backups, archives, and preservation strategy - Ruth<br />
*Estimating effort and resources required - Ruth<br />
**Hardware, software capabilities required - Ruth<br />
**Personnel resources and skills needed - Ruth<br />
*Some available resources to help with developing your plan - Ruth<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data - Ruth<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**[[Media:FileNamingModuleV1.ppt | File naming conventions]] (Cook)<br />
**[[Media:DataBackupV1.ppt | Backing up your data ]] (Cook)<br />
**Write it down! Maintaining contemporaneous documentation<br />
***Who, what, when, where, why, how<br />
***Tracking and describing changes to the data<br />
*Data Formats - Ruth<br />
**[[Media:DMSC_DataFormats_Building-understandable-spreadsheets_V1.0.ppt | Building understandable spreadsheets]] - Jeff Arnfield/NCDC<br />
**Using self-describing data formats - Curt Tilmes<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating documentation and metadata <br />
**Developing a citation for your data (Cook)<br />
**[[Media:DMSC_Metadata_Recording-provenance-and-context_V1.0.ppt | Recording provenance and context]] - Jeff Arnfield/NCDC<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**[[Media:DataShortCourseModuleTemplate_GCMD_Metadata_Discovery.ppt |Metadata for discovery]] - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing - Curt Tilmes<br />
**Individual agencies, archives and registries may have specific requirements<br />
*Working with your archive organization - Ron Weaver/NSIDC<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
**Work with your archive early and often - Jeff Arnfield/NCDC<br />
**Broadening your user community<br />
*Advertising your data<br />
**Agency/institution requirements for publishing metadata<br />
**Journals and publications<br />
**Agency/institution web sites<br />
**Using portals and registries<br />
***Publishing metadata to a Web Accessible Folder<br />
***[[Media:DataShortCourseModuleTemplate_GCMD_Metadata_Publish.ppt |Publishing metadata to GCMD]] - Tyler Stevens/GCMD<br />
***Publishing metadata to ECHO<br />
***Publishing metadata to Data.Gov<br />
***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate<br />
**Datacasting<br />
*Providing access to your data - Rama/Bob Downs/Chris Lenhardt/Ron Weaver (whole section)<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Tracking data usage<br />
**[[Media:DataShortCourseModule-HandlingSensitiveDataV1.ppt | Handling Sensitive Data]] - Bob Downs<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements - Ron Weaver /NSIDC<br />
*Options for archiving your data - Ron Weaver/NSIDC<br />
**What archives are out there? - Ron Weaver/NSIDC<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there - Ron Weaver/NSIDC<br />
*What data goes into a Long-term archive? - Ron Weaver/NSIDC<br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements - Ron Weaver/NSIDC<br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*Intro to the OAIS Reference Model - Curt Tilmes<br />
*Emerging standards for preservation - Ron Weaver/NSIDC<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*[[Media:ESIP_module_citation_credit.ppt | Citation and credit]] - Matt Mayernik/NCAR<br />
*[[Media:DataShortCourseModule-DataRestrictionsV1.ppt | Data restrictions]] - Bob Downs<br />
*Fair use - Matt<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=File:DMSC_Agency_NOAA-Administrative-Order_212-15_V1.0.ppt&diff=36322File:DMSC Agency NOAA-Administrative-Order 212-15 V1.0.ppt2011-10-07T21:37:17Z<p>Jarnfiel: Data Management Short Course - Agency requirements - NOAA Administrative Order 212-15</p>
<hr />
<div>Data Management Short Course - Agency requirements - NOAA Administrative Order 212-15</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=36321Data Management Course Outline2011-10-07T21:36:13Z<p>Jarnfiel: </p>
<hr />
<div>[http://wiki.esipfed.org/index.php/Data_Management_Short_Course Back to the main data management training page]<br />
<br />
'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== Module template and Author Guidelines ==<br />
<br />
* [[Media:DataShortCourseModuleTemplate.ppt | Data management training module template (ppt)]]<br />
* [[AuthorsGuide | Author Guidelines ]]<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* [[Media:AgencyRequirementsV1.ppt | Agency requirements ]]- Ruth<br />
**[[Media:NSFDataManagementPlans.ppt | NSF data management plans]] - Ruth<br />
**NASA science data policy - Ron Weaver<br />
**[[Media:DMSC_Agency_NOAA-Administrative-Order_212-15_V1.0.ppt | NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information]] - Jeff Arnfield/NCDC<br />
* Return on Investment - Erin/Carol<br />
**[[Media:DataShortCourseModule_ROI_1.ppt| Return on Scientist's investment]] - Erin/Carol<br />
**Expanding the audience for your data- Erin/Carol<br />
**Return on public investments- Erin/Carol<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access - Jeff Arnfield/NCDC<br />
* [[Media:ESIP_module_enhancing.ppt| Enhancing your reputation]] - Matt Mayernik/NCAR<br />
* [[Media:ESIP_module_pres_sci_record.ppt| Preserving the Scientific Record]] - Matt<br />
**Establishing Relationships with archives - Matt<br />
**Preserving a Record of Environmental Change - Matt<br />
**Other case studies? - Matt<br />
* What Not to do when Archiving Data!<br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - Ruth<br />
**Identify materials to be created - Ruth<br />
**Identify your audience(s) - Ruth<br />
**Data organization - Ruth<br />
**Roles and responsibilities - Ruth<br />
**Describing and documenting your data, including metadata - Ruth<br />
**Standards used - Ruth<br />
**Data access, sharing, and re-use policies - Ruth<br />
**Backups, archives, and preservation strategy - Ruth<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required - Ruth<br />
**Hardware, software capabilities required - Ruth<br />
**Personnel resources and skills needed - Ruth<br />
*Some available resources to help with developing your plan - Ruth<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data - Ruth<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Write it down! Maintaining contemporaneous documentation<br />
***Who, what, when, where, why, how<br />
***Tracking and describing changes to the data<br />
**'''QUESTIONS'''<br />
***Should we at least touch on version control, or is that adequately addressed by tracking/describing changes?<br />
*Data Formats - Ruth<br />
**[[Media:DMSC_DataFormats_Building-understandable-spreadsheets_V1.0.ppt | Building understandable spreadsheets]] - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating documentation and metadata <br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Individual agencies, archives and registries may have specific requirements<br />
*Working with your archive organization - Ron Weaver/NSIDC<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
**Work with your archive early and often - Jeff Arnfield/NCDC<br />
**Broadening your user community<br />
*Advertising your data<br />
**Agency/institution requirements for publishing metadata<br />
**Journals and publications<br />
**Agency/institution web sites<br />
**Using portals and registries<br />
***Publishing metadata to a Web Accessible Folder<br />
***Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
***Publishing metadata to ECHO<br />
***Publishing metadata to Data.Gov<br />
***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate<br />
**Datacasting<br />
*Providing access to your data - Rama/Bob Downs/Chris Lenhardt/Ron Weaver (whole section)<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements - Ron Weaver /NSIDC<br />
*Options for archiving your data - Ron Weaver/NSIDC<br />
**What archives are out there? - Ron Weaver/NSIDC<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there - Ron Weaver/NSIDC<br />
*What data goes into a Long-term archive? - Ron Weaver/NSIDC<br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements - Ron Weaver/NSIDC<br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation - Ron Weaver/NSIDC<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit - Matt Mayernik/NCAR<br />
*Data restrictions - Bob Downs<br />
*Fair use - Matt<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=File:DMSC_DataFormats_Building-understandable-spreadsheets_V1.0.ppt&diff=36312File:DMSC DataFormats Building-understandable-spreadsheets V1.0.ppt2011-10-07T19:25:44Z<p>Jarnfiel: uploaded a new version of &quot;File:DMSC DataFormats Building-understandable-spreadsheets V1.0.ppt&quot;: Data Management Short Course - Data Formats - Building understandable spreadsheets</p>
<hr />
<div>Data Management Short Course - Local Data Management - Building understandable spreadsheets</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=File:DMSC_DataFormats_Building-understandable-spreadsheets_V1.0.ppt&diff=36311File:DMSC DataFormats Building-understandable-spreadsheets V1.0.ppt2011-10-07T19:23:53Z<p>Jarnfiel: Data Management Short Course - Local Data Management - Building understandable spreadsheets</p>
<hr />
<div>Data Management Short Course - Local Data Management - Building understandable spreadsheets</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=36310Data Management Course Outline2011-10-07T19:22:13Z<p>Jarnfiel: </p>
<hr />
<div>[http://wiki.esipfed.org/index.php/Data_Management_Short_Course Back to the main data management training page]<br />
<br />
'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== Module template and Author Guidelines ==<br />
<br />
* [[Media:DataShortCourseModuleTemplate.ppt | Data management training module template (ppt)]]<br />
* [[AuthorsGuide | Author Guidelines ]]<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* [[Media:AgencyRequirementsV1.ppt | Agency requirements ]]- Ruth<br />
**[[Media:NSFDataManagementPlans.ppt | NSF data management plans]] - Ruth<br />
**NASA science data policy - Ron Weaver<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information - Jeff Arnfield/NCDC<br />
* Return on Investment - Erin/Carol<br />
**[[Media:DataShortCourseModule_ROI_1.ppt| Return on Scientist's investment]] - Erin/Carol<br />
**Expanding the audience for your data- Erin/Carol<br />
**Return on public investments- Erin/Carol<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access - Jeff Arnfield/NCDC<br />
* [[Media:ESIP_module_enhancing.ppt| Enhancing your reputation]] - Matt Mayernik/NCAR<br />
* [[Media:ESIP_module_pres_sci_record.ppt| Preserving the Scientific Record]] - Matt<br />
**Establishing Relationships with archives - Matt<br />
**Preserving a Record of Environmental Change - Matt<br />
**Other case studies? - Matt<br />
* What Not to do when Archiving Data!<br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - Ruth<br />
**Identify materials to be created - Ruth<br />
**Identify your audience(s) - Ruth<br />
**Data organization - Ruth<br />
**Roles and responsibilities - Ruth<br />
**Describing and documenting your data, including metadata - Ruth<br />
**Standards used - Ruth<br />
**Data access, sharing, and re-use policies - Ruth<br />
**Backups, archives, and preservation strategy - Ruth<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required - Ruth<br />
**Hardware, software capabilities required - Ruth<br />
**Personnel resources and skills needed - Ruth<br />
*Some available resources to help with developing your plan - Ruth<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data - Ruth<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Write it down! Maintaining contemporaneous documentation<br />
***Who, what, when, where, why, how<br />
***Tracking and describing changes to the data<br />
**'''QUESTIONS'''<br />
***Should we at least touch on version control, or is that adequately addressed by tracking/describing changes?<br />
*Data Formats - Ruth<br />
**[[Media:DMSC_DataFormats_Building-understandable-spreadsheets_V1.0.ppt | Building understandable spreadsheets]] - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating documentation and metadata <br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Individual agencies, archives and registries may have specific requirements<br />
*Working with your archive organization - Ron Weaver/NSIDC<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
**Work with your archive early and often - Jeff Arnfield/NCDC<br />
**Broadening your user community<br />
*Advertising your data<br />
**Agency/institution requirements for publishing metadata<br />
**Journals and publications<br />
**Agency/institution web sites<br />
**Using portals and registries<br />
***Publishing metadata to a Web Accessible Folder<br />
***Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
***Publishing metadata to ECHO<br />
***Publishing metadata to Data.Gov<br />
***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate<br />
**Datacasting<br />
*Providing access to your data - Rama/Bob Downs/Chris Lenhardt/Ron Weaver (whole section)<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements - Ron Weaver /NSIDC<br />
*Options for archiving your data - Ron Weaver/NSIDC<br />
**What archives are out there? - Ron Weaver/NSIDC<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there - Ron Weaver/NSIDC<br />
*What data goes into a Long-term archive? - Ron Weaver/NSIDC<br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements - Ron Weaver/NSIDC<br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation - Ron Weaver/NSIDC<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit - Matt Mayernik/NCAR<br />
*Data restrictions - Bob Downs<br />
*Fair use - Matt<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34812Data Management Course Outline2011-08-18T16:16:03Z<p>Jarnfiel: </p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== Module template ==<br />
<br />
* [[Media:DataShortCourseModuleTemplate.ppt | Data management training module template (ppt)]]<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements - Ruth<br />
**NSF data management plan - Ruth<br />
**NASA science data policy - Ron Weaver<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information - Jeff Arnfield/NCDC<br />
* Return on Investment - Erin/Carol<br />
**Return on your investment - Erin/Carol<br />
**Expanding the audience for your data- Erin/Carol<br />
**Return on public investments- Erin/Carol<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access - Jeff Arnfield/NCDC<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change <br />
**Other case studies?<br />
* What Not to do when Archiving Data! <br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - Ruth<br />
**Identify materials to be created - Ruth<br />
**Identify your audience(s) - Ruth<br />
**Data organization - Ruth<br />
**Roles and responsibilities - Ruth<br />
**Describing and documenting your data, including metadata - Ruth<br />
**Standards used - Ruth<br />
**Data access, sharing, and re-use policies - Ruth<br />
**Backups, archives, and preservation strategy - Ruth<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required - Ruth<br />
**Hardware, software capabilities required - Ruth<br />
**Personnel resources and skills needed - Ruth<br />
*Some available resources to help with developing your plan - Ruth<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data - Ruth<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Write it down! Maintaining contemporaneous documentation<br />
***Who, what, when, where, why, how<br />
***Tracking and describing changes to the data<br />
**'''QUESTIONS'''<br />
***Should we at least touch on version control, or is that adequately addressed by tracking/describing changes?<br />
*Data Formats - Ruth<br />
**Building understandable spreadsheets - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating documentation and metadata <br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Individual agencies, archives and registries may have specific requirements<br />
*Working with your archive organization - Ron Weaver/NSIDC<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
**Work with your archive early and often - Jeff Arnfield/NCDC<br />
**Broadening your user community<br />
*Advertising your data<br />
**Agency/institution requirements for publishing metadata<br />
**Journals and publications<br />
**Agency/institution web sites<br />
**Using portals and registries<br />
***Publishing metadata to a Web Accessible Folder<br />
***Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
***Publishing metadata to ECHO<br />
***Publishing metadata to Data.Gov<br />
***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate<br />
**Datacasting<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements - Ron Weaver /NSIDC<br />
*Options for archiving your data - Ron Weaver/NSIDC<br />
**What archives are out there? - Ron Weaver/NSIDC<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there - Ron Weaver/NSIDC<br />
*What data goes into a Long-term archive? - Ron Weaver/NSIDC<br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements - Ron Weaver/NSIDC<br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation - Ron Weaver/NSIDC<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34810Data Management Course Outline2011-08-18T16:11:49Z<p>Jarnfiel: </p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== Module template ==<br />
<br />
* [[Media:DataShortCourseModuleTemplate.ppt | Data management training module template (ppt)]]<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements - Ruth<br />
**NSF data management plan - Ruth<br />
**NASA science data policy - Ron Weaver<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information - Jeff Arnfield/NCDC<br />
* Return on Investment<br />
**Return on your investment <br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change <br />
**Other case studies?<br />
* What Not to do when Archiving Data! <br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - Ruth<br />
**Identify materials to be created - Ruth<br />
**Identify your audience(s) - Ruth<br />
**Data organization - Ruth<br />
**Roles and responsibilities - Ruth<br />
**Describing and documenting your data, including metadata - Ruth<br />
**Standards used - Ruth<br />
**Data access, sharing, and re-use policies - Ruth<br />
**Backups, archives, and preservation strategy - Ruth<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required - Ruth<br />
**Hardware, software capabilities required - Ruth<br />
**Personnel resources and skills needed - Ruth<br />
*Some available resources to help with developing your plan - Ruth<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data - Ruth<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Write it down! Maintaining contemporaneous documentation<br />
***Who, what, when, where, why, how<br />
***Tracking and describing changes to the data<br />
**'''QUESTIONS'''<br />
***Should we at least touch on version control, or is that adequately addressed by tracking/describing changes?<br />
*Data Formats - Ruth<br />
**Building understandable spreadsheets - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating documentation and metadata <br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Individual agencies, archives and registries may have specific requirements<br />
*Working with your archive organization - Ron Weaver/NSIDC<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
**Work with your archive early and often - Jeff Arnfield/NCDC<br />
**Broadening your user community<br />
*Advertising your data<br />
**Agency/institution requirements for publishing metadata<br />
**Journals and publications<br />
**Agency/institution web sites<br />
**Using portals and registries<br />
***Publishing metadata to a Web Accessible Folder<br />
***Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
***Publishing metadata to ECHO<br />
***Publishing metadata to Data.Gov<br />
***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate<br />
**Datacasting<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements - Ron Weaver /NSIDC<br />
*Options for archiving your data - Ron Weaver/NSIDC<br />
**What archives are out there? - Ron Weaver/NSIDC<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there - Ron Weaver/NSIDC<br />
*What data goes into a Long-term archive? - Ron Weaver/NSIDC<br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements - Ron Weaver/NSIDC<br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation - Ron Weaver/NSIDC<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34577Data Management Course Outline2011-08-05T14:18:51Z<p>Jarnfiel: /* Local Data Management */ rearranged based on esip-shortcourse e-mail discussion</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment <br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change <br />
**Other case studies?<br />
* What Not to do when Archiving Data! <br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - <br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing and documenting your data, including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Write it down! Maintaining contemporaneous documentation<br />
***Who, what, when, where, why, how<br />
***Tracking and describing changes to the data<br />
**'''QUESTIONS'''<br />
***Should we at least touch on version control, or is that adequately addressed by tracking/describing changes?<br />
*Data Formats<br />
**Building understandable spreadsheets - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating documentation and metadata <br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Individual agencies, archives and registries may have specific requirements<br />
*Working with your archive organization<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
**Work with your archive early and often - Jeff Arnfield/NCDC<br />
**Broadening your user community<br />
*Advertising your data<br />
**Agency/institution requirements for publishing metadata<br />
**Journals and publications<br />
**Agency/institution web sites<br />
**Using portals and registries<br />
***Publishing metadata to a Web Accessible Folder<br />
***Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
***Publishing metadata to ECHO<br />
***Publishing metadata to Data.Gov<br />
***'''NOTE:''' Need to address additional portals and registries beyond GCMD & ECHO. Add other entries as appropriate<br />
**Datacasting<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*What data goes into a Long-term archive? <br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements <br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34573Data Management Course Outline2011-08-04T17:11:28Z<p>Jarnfiel: /* Local Data Management */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment <br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change <br />
**Other case studies?<br />
* What Not to do when Archiving Data! <br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - <br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing and documenting your data, including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**Tracking and describing changes to the data<br />
**'''QUESTIONS''' <br />
***Citation, provenance and context are also documentation/metadata activities. Should they be grouped there instead?<br />
*Data Formats<br />
**Building understandable spreadsheets - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata <br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
**'''QUESTIONS''' <br />
*** Is "documentation" a friendlier, and more inclusive, term?<br />
*** The "publishing" items are most closely related to advertising/accessing data -- should they be moved there?<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
**'''QUESTIONS''' <br />
***Should "advertising your data" and "providing access" be separate sections or subsections? <br />
***Need to address portals and registries beyond GCMD & ECHO. Some agencies have specific requirements for publishing metadata.<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*What data goes into a Long-term archive? <br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements <br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34572Data Management Course Outline2011-08-04T17:10:13Z<p>Jarnfiel: </p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment <br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change <br />
**Other case studies?<br />
* What Not to do when Archiving Data! <br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - <br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing and documenting your data, including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**Tracking and describing changes to the data<br />
**'''QUESTIONS''' <br />
***Citation, provenance and context are also documentation/metadata activities. Should they be grouped there instead?<br />
*Data Formats<br />
**Building understandable spreadsheets - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata <br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
**'''QUESTIONS''' <br />
*** This section seems to overlap with "Preservation Strategies.Metadata"... should these sections be combined, or clearly differentiated? <br />
*** Is "documentation" a friendlier, and more inclusive, term?<br />
*** The "publishing" items are most closely related to advertising/accessing data -- should they be moved there?<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
**'''QUESTIONS''' <br />
***Should "advertising your data" and "providing access" be separate sections or subsections? <br />
***Need to address portals and registries beyond GCMD & ECHO. Some agencies have specific requirements for publishing metadata.<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*What data goes into a Long-term archive? <br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements <br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34571Data Management Course Outline2011-08-04T16:43:36Z<p>Jarnfiel: /* For Data Managers */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment <br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change <br />
**Other case studies?<br />
* What Not to do when Archiving Data! <br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - <br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing and documenting your data, including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**Tracking and describing changes to the data<br />
*Data Formats<br />
**Building understandable spreadsheets - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata (Overlap with "Preservation Strategies.Metadata"... should these sections be combined?)<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*What data goes into a Long-term archive? <br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements <br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**Data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34570Data Management Course Outline2011-08-04T16:43:04Z<p>Jarnfiel: /* Preservation strategies */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment <br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change <br />
**Other case studies?<br />
* What Not to do when Archiving Data! <br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - <br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing and documenting your data, including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**Tracking and describing changes to the data<br />
*Data Formats<br />
**Building understandable spreadsheets - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata (Overlap with "Preservation Strategies.Metadata"... should these sections be combined?)<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*What data goes into a Long-term archive? <br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Data transfer & submission agreements <br />
** See "Submission Agreements" section under "For Data Managers"<br />
** Agency/archive specific requirements my vary<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34569Data Management Course Outline2011-08-04T16:35:50Z<p>Jarnfiel: /* For Data Managers */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment <br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change <br />
**Other case studies?<br />
* What Not to do when Archiving Data! <br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - <br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing and documenting your data, including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**Tracking and describing changes to the data<br />
*Data Formats<br />
**Building understandable spreadsheets - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata (Overlap with "Preservation Strategies.Metadata"... should these sections be combined?)<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*Data transfer agreements (QUESTION: broaden this to "submission agreements?")<br />
*What data goes into a Long-term archive? <br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
**data integrity<br />
**Contacts<br />
**Schedule<br />
**Operational Procedures<br />
**Error reconciliation<br />
**Constraints<br />
**other aspects necessary for understanding how to support the data<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34568Data Management Course Outline2011-08-04T16:28:30Z<p>Jarnfiel: /* Preservation strategies */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment <br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change <br />
**Other case studies?<br />
* What Not to do when Archiving Data! <br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - <br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing and documenting your data, including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**Tracking and describing changes to the data<br />
*Data Formats<br />
**Building understandable spreadsheets - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata (Overlap with "Preservation Strategies.Metadata"... should these sections be combined?)<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*Data transfer agreements (QUESTION: broaden this to "submission agreements?")<br />
*What data goes into a Long-term archive? <br />
*What do long term archives do with my data? - Jeff Arnfield/NCDC<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34567Data Management Course Outline2011-08-04T16:25:56Z<p>Jarnfiel: /* Local Data Management */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment <br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change <br />
**Other case studies?<br />
* What Not to do when Archiving Data! <br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - <br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing and documenting your data, including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators - Jeff Arnfield/NCDC<br />
**File naming conventions (Cook)<br />
**Backing up your data (Cook)<br />
**Developing a citation for your data (Cook)<br />
**Recording provenance and context - Jeff Arnfield/NCDC<br />
**Tracking and describing changes to the data<br />
*Data Formats<br />
**Building understandable spreadsheets - Jeff Arnfield/NCDC<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata (Overlap with "Preservation Strategies.Metadata"... should these sections be combined?)<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use - Jeff Arnfield/NCDC<br />
**Metadata for archiving - Jeff Arnfield/NCDC<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation - Jeff Arnfield/NCDC<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*Data transfer agreements<br />
*What data goes into a Long-term archive? <br />
*What do long term archives do with my data? <br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata <br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34524Data Management Course Outline2011-08-02T15:53:47Z<p>Jarnfiel: /* Local Data Management */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment - Peter Fox<br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change - Tom Karl<br />
**Other case studies?<br />
* What Not to do when Archiving Data! - David Anderson (2:30)<br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - Ruth Duerr (needs redo and chopped into parts?)<br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing and documenting your data, including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators<br />
**File naming conventions<br />
**Backing up your data<br />
**Developing a citation for your data<br />
**Recording provenance and context<br />
**Tracking and describing changes to the data<br />
*Data Formats<br />
**Building understandable spreadsheets<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata (Overlap with "Preservation Strategies.Metadata"... should these sections be combined?)<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use<br />
**Metadata for archiving<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*Data transfer agreements<br />
*What data goes into a Long-term archive? - Ron Weaver (5:44)<br />
*What do long term archives do with my data? - Ken Casey<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata - Bob Cook (4:33)<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34474Data Management Course Outline2011-07-29T18:21:30Z<p>Jarnfiel: /* Data Management plans */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment - Peter Fox<br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change - Tom Karl<br />
**Other case studies?<br />
* What Not to do when Archiving Data! - David Anderson (2:30)<br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan?<br />
*Elements of a plan - Ruth Duerr (needs redo and chopped into parts?)<br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing and documenting your data, including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators<br />
**File naming conventions<br />
**Backing up your data<br />
**Developing a citation for your data<br />
**Recording provenance and context<br />
**Tracking and describing changes to the data<br />
*Data Formats<br />
**Building understandable spreadsheets<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use<br />
**Metadata for archiving<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*Data transfer agreements<br />
*What data goes into a Long-term archive? - Ron Weaver (5:44)<br />
*What do long term archives do with my data? - Ken Casey<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata - Bob Cook (4:33)<br />
<br />
=== Responsible Data Use ===<br />
<br />
*Citation and credit<br />
*Data restrictions<br />
*Fair use<br />
*Feedback and metrics<br />
*Collaboration<br />
*Community participation<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34207Data Management Course Outline2011-07-22T18:22:20Z<p>Jarnfiel: /* Local Data Management */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment - Peter Fox<br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change - Tom Karl<br />
**Other case studies?<br />
* What Not to do when Archiving Data! - David Anderson (2:30)<br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan<br />
*Elements of a plan - Ruth Duerr (needs redo and chopped into parts?<br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing your data including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators<br />
**File naming conventions<br />
**Backing up your data<br />
**Developing a citation for your data<br />
**Recording provenance and context<br />
**Tracking and describing changes to the data<br />
*Data Formats<br />
**Building understandable spreadsheets<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use<br />
**Metadata for archiving<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*Data transfer agreements<br />
*What data goes into a Long-term archive? - Ron Weaver (5:44)<br />
*What do long term archives do with my data? - Ken Casey<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata - Bob Cook (4:33)<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34206Data Management Course Outline2011-07-22T18:05:43Z<p>Jarnfiel: /* Local Data Management */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment - Peter Fox<br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change - Tom Karl<br />
**Other case studies?<br />
* What Not to do when Archiving Data! - David Anderson (2:30)<br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan<br />
*Elements of a plan - Ruth Duerr (needs redo and chopped into parts?<br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing your data including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators<br />
**File naming conventions<br />
**Backing up your data<br />
**Recording provenance and context<br />
**Tracking and describing changes to the data<br />
*Data Formats<br />
**Building understandable spreadsheets<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Developing a citation for your data<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use<br />
**Metadata for archiving<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*Data transfer agreements<br />
*What data goes into a Long-term archive? - Ron Weaver (5:44)<br />
*What do long term archives do with my data? - Ken Casey<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata - Bob Cook (4:33)<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=34205Data Management Course Outline2011-07-22T18:03:51Z<p>Jarnfiel: /* Local Data Management */ rearranged and grouped related items to reduce top-level entries</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment - Peter Fox<br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change - Tom Karl<br />
**Other case studies?<br />
* What Not to do when Archiving Data! - David Anderson (2:30)<br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan<br />
*Elements of a plan - Ruth Duerr (needs redo and chopped into parts?<br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing your data including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Managing your data<br />
**Data identifiers and locators<br />
**File naming conventions<br />
**Backing up your data<br />
**Recording provenance and context<br />
**Tracking and describing changes to the data<br />
*Data Formats<br />
**Building understandable spreadsheets<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Creating metadata<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery - Tyler Stevens/GCMD<br />
**Metadata for access and use<br />
**Metadata for archiving<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD - Tyler Stevens/GCMD<br />
**Publishing metadata to ECHO<br />
*Developing a citation for your data<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Advertising your data (i.e., data casting)<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*Data transfer agreements<br />
*What data goes into a Long-term archive? - Ron Weaver (5:44)<br />
*What do long term archives do with my data? - Ken Casey<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata - Bob Cook (4:33)<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=33872Data Management Course Outline2011-07-12T18:07:49Z<p>Jarnfiel: /* Data Management plans */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment - Peter Fox<br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change - Tom Karl<br />
**Other case studies?<br />
* What Not to do when Archiving Data! - David Anderson (2:30)<br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan<br />
*Elements of a plan - Ruth Duerr (needs redo and chopped into parts?<br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing your data including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable?<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Tracking and describing changes to the data<br />
*Data identifiers and locators<br />
*Creating metadata<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery<br />
**Metadata for access and use<br />
**Metadata for archiving<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD<br />
**Publishing metadata to ECHO<br />
*Advertising your data (i.e., data casting)<br />
*Recording provenance and context<br />
*Backing up your data<br />
*File naming conventions<br />
*Developing a citation for your data<br />
*Data Formats<br />
**Building understandable spreadsheets<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*Data transfer agreements<br />
*What data goes into a Long-term archive? - Ron Weaver (5:44)<br />
*What do long term archives do with my data? - Ken Casey<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata - Bob Cook (4:33)<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=33871Data Management Course Outline2011-07-12T18:07:26Z<p>Jarnfiel: /* Data Management plans */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment - Peter Fox<br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change - Tom Karl<br />
**Other case studies?<br />
* What Not to do when Archiving Data! - David Anderson (2:30)<br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan<br />
*Elements of a plan - Ruth Duerr (needs redo and chopped into parts?<br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing your data including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
**??QUESTION: Should the plan define (an) objective metric(s) to make implementation and compliance measurable? [[User:Jarnfiel|Jarnfiel]]<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Tracking and describing changes to the data<br />
*Data identifiers and locators<br />
*Creating metadata<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery<br />
**Metadata for access and use<br />
**Metadata for archiving<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD<br />
**Publishing metadata to ECHO<br />
*Advertising your data (i.e., data casting)<br />
*Recording provenance and context<br />
*Backing up your data<br />
*File naming conventions<br />
*Developing a citation for your data<br />
*Data Formats<br />
**Building understandable spreadsheets<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*Data transfer agreements<br />
*What data goes into a Long-term archive? - Ron Weaver (5:44)<br />
*What do long term archives do with my data? - Ken Casey<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata - Bob Cook (4:33)<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Data_Management_Course_Outline&diff=33868Data Management Course Outline2011-07-12T17:35:57Z<p>Jarnfiel: /* The case for data stewardship */</p>
<hr />
<div>'''NOTE''': ''We agreed that the target audience initially would be scientists''<br />
<br />
== For Scientists ==<br />
<br />
===The case for data stewardship===<br />
<br />
* Agency requirements <br />
**NSF data management plan<br />
**NASA science data policy<br />
**NOAA Administrative Order 212-15, Management of Environmental and Geospatial Data and Information<br />
* Return on Investment<br />
**Return on your investment - Peter Fox<br />
**Expanding the audience for your data<br />
**Return on public investments<br />
* Verifiable science<br />
**Tying your data to standards, metrics, and benchmarks<br />
* Facilitating science through interoperable discovery and access<br />
* Enhancing your reputation<br />
* Preserving the Scientific Record<br />
**Establishing Relationships with archives<br />
**Preserving a Record of Environmental Change - Tom Karl<br />
**Other case studies?<br />
* What Not to do when Archiving Data! - David Anderson (2:30)<br />
<br />
===Data Management plans===<br />
<br />
*Why do a data management plan<br />
*Elements of a plan - Ruth Duerr (needs redo and chopped into parts?<br />
**Identify materials to be created<br />
**Identify your audience(s)<br />
**Data organization<br />
**Roles and responsibilities<br />
**Describing your data including metadata <br />
**Standards used<br />
**Data access, sharing, and re-use policies<br />
**Backups, archives, and preservation strategy<br />
*Estimating effort and resources required<br />
**Hardware, software capabilities required<br />
**Personnel resources and skills needed<br />
*Some available resources to help with developing your plan<br />
<br />
===Local Data Management ===<br />
<br />
*Tracking and describing changes to the data<br />
*Data identifiers and locators<br />
*Creating metadata<br />
**For your collections as a whole<br />
**Creating item level metadata<br />
**Metadata for discovery<br />
**Metadata for access and use<br />
**Metadata for archiving<br />
**Metadata for tracking data processing<br />
**Publishing metadata to GCMD<br />
**Publishing metadata to ECHO<br />
*Advertising your data (i.e., data casting)<br />
*Recording provenance and context<br />
*Backing up your data<br />
*File naming conventions<br />
*Developing a citation for your data<br />
*Data Formats<br />
**Building understandable spreadsheets<br />
**Using self-describing data formats<br />
**Choosing and adopting community accepted standards<br />
**Avoiding proprietary formats<br />
*Working with your archive organization<br />
**Broadening your user community<br />
**Planning for longer term preservation<br />
*Providing access to your data<br />
**Evaluating who your audience is<br />
**Who gets to access your data<br />
***Agency best practices & policies<br />
**Access mechanisms<br />
**Tracking data usage<br />
**Handling sensitive data<br />
**Rights<br />
<br />
===Preservation strategies===<br />
<br />
*Sponsor (e.g., Agency) or institution requirements<br />
*Options for archiving your data<br />
**What archives are out there?<br />
***Discipline or institutional archives<br />
***Finding an archive<br />
**What to do if there is no archive out there<br />
*Data transfer agreements<br />
*What data goes into a Long-term archive? - Ron Weaver (5:44)<br />
*What do long term archives do with my data? - Ken Casey<br />
*Intro to the OAIS Reference Model<br />
*Emerging standards for preservation<br />
*Metadata - Bob Cook (4:33)<br />
<br />
==For Data Managers==<br />
<br />
*Data Management plan support<br />
*Collection or acquisition policies<br />
*Intro to OAIS reference model<br />
*Initial Assessment and appraisal<br />
**Identify information to be preserved<br />
***main features and properties<br />
***dependencies on information here or elsewhere<br />
**Identify objects to be received<br />
**Establish complementary information needs (e.g., format, data descriptions, provenance, reference information, context, fixity information)<br />
***What complementary information is needed for data useful for climate studies (USGCRP list)<br />
**Assessing potential designated communities<br />
**Assessing probable curation duration<br />
**Assessing data transfer options<br />
**Defining access paths<br />
**Assessing costs and feasibility<br />
**Metadata, metadata standards, and levels of metadata<br />
*Submission agreements<br />
*Preparing for ingest<br />
*Ingesting data<br />
**Validation checks<br />
**Identifiers<br />
**Citations<br />
**Levels of service<br />
*Periodic re-assessment<br />
*Curation activities<br />
**Media migration<br />
**Format migration</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Products_and_Services&diff=10311Products and Services2007-10-22T23:27:09Z<p>Jarnfiel: </p>
<hr />
<div>==Monthly Teleconference==<br />
The Products and Services Standing Committee holds a <br />
teleconference on the third Tuesday of every month at 1:30pm Eastern (10:30 Pacific).<br />
<br />
===Next call===<br />
:Tuesday, Oct 22 2007, 1:30-2:30 PM EST<br />
:800-508-7631 Access Code: *1297219* <br />
<br />
====Discussion topics:====<br />
# Identify goals, content for Winter Meeting technical workshops<br />
<br />
==Issues being addressed by Products and Service Standing Committee==<br />
:[[P&S Metadata Requirements|Metadata Requirements]]<br />
:[[P&S Data Quality|Data Quality]]<br />
:[[P&S Avoiding Duplicate Metadata Records|Avoiding Duplicate Metadata Records]] <br />
:[[Federation Inventory]]<br />
<br />
==Past Discussions: ==<br />
:[[P&S Monthly August 29, 2006]]<br />
:[[P&S Monthly May 23, 2006]]<br />
:[[P&S Monthly April 25, 2006]]<br />
:[[P&S Monthly March 28, 2006]]<br />
<br />
==Charge to Standing Committee from Bylaws Section 2== <br />
<br />
V.2.1 The ESIP Federation shall include a Standing Committee on Earth Science Products and Services. Its roles are:<br />
<br />
:a. To encourage the development, use and improvement of best science practices to ensure the quality, usability, and breadth of data and resultant information, products, and services;<br />
<br />
:b. To provide a Federation-wide forum for defining, developing and evaluating requirements for Federation Earth science products; and<br />
<br />
:c. To provide a Federation-wide forum for defining, developing and evaluating requirements for product services and user services.<br />
<br />
__NOTOC__</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Products_and_Services&diff=9745Products and Services2007-08-30T00:10:18Z<p>Jarnfiel: /* Monthly Teleconference */</p>
<hr />
<div>==Monthly Teleconference==<br />
The Products and Services Standing Committee holds a <br />
teleconference on the third Tuesday of every month at 1:30pm Eastern (10:30 Pacific).<br />
<br />
===Next call===<br />
:Tuesday, Sept 18 2007, 1:30-2:30 PM EST<br />
:800-508-7631 Access Code: *1297219* <br />
<br />
====Discussion topics:====<br />
# Comment on consolidated inventory workshop output<br />
# Refine inventory requirements<br />
# New business<br />
<br />
==Issues being addressed by Products and Service Standing Committee==<br />
:[[P&S Metadata Requirements|Metadata Requirements]]<br />
:[[P&S Data Quality|Data Quality]]<br />
:[[P&S Avoiding Duplicate Metadata Records|Avoiding Duplicate Metadata Records]] <br />
:[[Federation Inventory]]<br />
<br />
==Past Discussions: ==<br />
:[[P&S Monthly August 29, 2006]]<br />
:[[P&S Monthly May 23, 2006]]<br />
:[[P&S Monthly April 25, 2006]]<br />
:[[P&S Monthly March 28, 2006]]<br />
<br />
==Charge to Standing Committee from Bylaws Section 2== <br />
<br />
V.2.1 The ESIP Federation shall include a Standing Committee on Earth Science Products and Services. Its roles are:<br />
<br />
:a. To encourage the development, use and improvement of best science practices to ensure the quality, usability, and breadth of data and resultant information, products, and services;<br />
<br />
:b. To provide a Federation-wide forum for defining, developing and evaluating requirements for Federation Earth science products; and<br />
<br />
:c. To provide a Federation-wide forum for defining, developing and evaluating requirements for product services and user services.<br />
<br />
__NOTOC__</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Index.php&diff=9299Index.php2007-07-11T23:55:38Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div></div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Aerosol_Microphysics&diff=9298Aerosol Microphysics2007-07-11T23:55:20Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>'''[[AeroCom]]''' wiki discussion entry<br />
<br />
Go back to '''[[AeroCom/Working group structure]]'''<br />
<br />
See also summary of '''[[AeroCom/Recommendations]]''' <br />
<br />
==AeroCom working group '''Microphysics''' ==<br />
<br />
===Participants for analysis===<br />
<br />
===Participants for experiments===<br />
<br />
===Goals===<br />
<br />
===Processes and possible Diagnostics===<br />
<br />
===Short-term actions/experiments===<br />
<br />
===Data to look at===</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Vertical_profiles,_transport_and_removal&diff=9297Vertical profiles, transport and removal2007-07-11T23:54:56Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>'''[[AeroCom]]''' wiki discussion entry<br />
<br />
Go back to '''[[AeroCom/Working group structure]]'''<br />
<br />
See also summary of '''[[AeroCom/Recommendations]]''' <br />
<br />
==AeroCom working group '''Vertical profiles, transport and removal''' ==<br />
<br />
===Participants===<br />
Christiane Textor, Paul Ginoux, Rich Ferrare, Ralph Kahn,<br />
Oyvind Seeland, Philippe Stier,Dave Winker (&CALIPSO science team),<br />
Xhiahong Liu, Dorothy Koch, Trond Iverson, Graham Mann, Steve Ghan, <br />
Mian Chin, Hiuisheng Bian (GMI), Michael Schulz<br><br />
more?<br><br />
<br />
===Goals===<br />
* Understanding of model diversity in spatial distribution and in removal processes<br />
* Evaluate simulated spatial distribution and processes with observations<br />
* Establish/quantify an acceptable diversity in global aerosol simulations<br />
* Find methods to evaluate process parameterisations<br />
* Define dedicated diagnostics of model results <br />
* Elaborate recommendations<br />
* Collect data for model evaluation (vertical profiles&processes) including uncertainty <br />
<br />
* This working group has a special focus on dust.<br />
<br />
<br />
===Specific scientific questions===<br />
* How realistic are the simulated (vertical and horizontal) spatial aerosol distributions?<br />
* How to validate aerosol processes?<br />
* Is the diversity of simulated vertical dispersal caused by differences in transport or by removal processes?<br />
* How much complexity of aerosol models is necessary?<br />
* more<br />
<br />
<br />
===Processes and possible Diagnostics===<br />
Document model parameterisations <br><br />
Assemble observed vertical profiles to evaluate models<br><br />
PBL vs. Troposphere, look at mesoscale models<br><br />
Exchange modules (use in the same GCM, link to GMI)<br><br />
<br />
<br />
===Short-term actions/experiments===<br />
Compare AeroCom data to observations<br><br />
Redo simulation for 2003 with specific diagnostics<br><br />
Passive tracer experiment (HTAP CO-experiments)<br><br />
Validate model results with observed vertical LIDAR profiles: Rich and Christiane<br><br />
Ensure a link to the scavenging workshop planned by NCAR and NASA (P. Rash and J. Rodriguez).<br />
<br />
The first months of Calipso data should be a primary goal for<br />
a joint experiment. July-August 2006. Emissions from biomass burning<br />
should be up to date. Charles Ichoku proposed to prepare an<br />
emission dataset based on radiative power energy and MODIS fire spots.<br />
Guido van der Werf is investigating the burnt area product readiness.<br />
<br />
===Data to look at===<br />
* vertical distribution<br />
ground-based networks: lidar backscatter (corrected), extinction ARM MPLNET EARLINET<br><br />
satellites: GLASS, MISR?, CALIPSO<br />
aircraft campaigns<br />
<br />
* horizontal distribution<br />
station data (surf conc) networks<br><br />
satellite data (e.g. on dust episodes to pin down horizontal transport)<br><br />
<br />
* processes<br />
wet deposition of SO4?<br><br />
??<br />
<br />
<br />
===Contact persons/experts===<br />
provide vertical profile LIDAR data: Rich Ferrare<br><br />
CALIPSO: Dave Winker<br><br />
MISR: Ralph Kahn <br><br />
Access to AeroCom data base: Christiane Textor<br><br />
Dust questions: Paul Ginoux<br></div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Dust&diff=9296Dust2007-07-11T23:54:24Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>Go back to '''[[AeroCom]]''' wiki discussion entry / '''[[AeroCom/Working group structure]]''' <br />
<br />
Enter the '''[[Talk:Dust|Discussion on dust]]''' or click on the flag 'discussion' above.<br />
<br />
----<br />
<br />
'''AeroCom working group DUST''' <br />
<br />
===Participants===<br />
Ginoux, Balkanski, Mahowald, Schulz, Miller, Tegen, Zender, <br />
Winker, Mann, Takemura, (Textor)<br />
<br />
-<br />
NEXT Telephone conference: probably march 07, organised from NCAR<br />
<br />
===Goals===<br />
<br />
Investigate the possible climate impact of anthropogenic dust sources<br><br />
Compare dust simulations to multiple observational datasets<br><br />
Recommend properties for dust size and refractive index<br><br />
<br />
===Short term actions===<br />
<br />
- Provide specifications for a land use related dust source<br />
to be implemented by participating modellers (Mahowald)<br><br />
- Pull out of dust variables for one AeroCom model (Schulz)<br><br />
- passed on to R. Miller for initial testing of Cakmur analysis<br><br />
- establish an observational database beyond Cakmur et al and AeroCom<br><br />
- revisit HTAP dust experiment design (see MS email to AeroCom in Dec)<br><br />
- eventually come together at AGU Acapulco conference in May 2007<br><br />
- suggest input for C. Zender for Perrugia conference<br />
===List of Observational data to be included in analysis===<br />
<br />
Al in ocean water<br />
<br />
Visibility<br />
<br />
IDDI index<br />
<br />
Satellite AOD in dust dominated regions<br />
(MISR, MODIS, TOMS, DEEPBLUE-MODIS, CALIPSO, Aeronet, Calipso)<br />
<br />
Coarse mode satellite derived AOD in dust regions?<br />
<br />
Deposition<br />
DIRTMAP, Fe, Ca in rain<br />
<br />
Surface concentrations<br />
Aeroce, Asian network<br />
<br />
Refractive index and size in literature<br />
<br />
===Processes and possible Diagnostics===<br />
<br />
Dust erosion - wind frequency and speed ; threshold velocities;<br />
effective source fluxes; source size distribution<br />
<br />
Dust settling - dry removal velocities per size bin;<br />
<br />
Wet Dust removal - wet scavenging efficients; vertical distribution;<br />
wet deposition of Calcium, dust; <br />
<br />
Scattering and absorption - refractive index; AOD; size; absorption<br />
<br />
<br />
[[Image:Sink DUST an2000 mALLYEAR WORLD Fraction.ps.png|Sink repartitioning among AeroCom models]]<br />
Figure taken from [http://www.copernicus.org/EGU/acp/acp/6/1777/acp-6-1777.pdf Textor et al., ACP 2006]</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Ongoing_activities&diff=9295Ongoing activities2007-07-11T23:54:10Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>==2006-2007 Committee Activities==<br />
<br />
This page provides a single point of access for information about the ongoing activities of the ''Information Technology and Interoperability'' Committee. If you have any questions regarding these activities, or you want to become active in the committee, contact the committee Chair ([[mailto:kbene@unm.edu Karl Benedict]]). <br />
<br />
===Recommendations for the 2006-2007 Committee work plan===<br />
<br />
* Development of strategy to encourage deployment and use of ''standards-based'' services and capabilities by Federation members<br />
** Provide a bootable CD/DVD that includes most (if not all) of the well known interoperability tools/technology (P. Nacionales)<br />
* Re-engage in discussions of ''semantic interoperability'' within the Federation and with the broader Earth Science community<br />
* Provide concrete illustrations of the benefits of interoperable services through solution-based demonstrations (collaborate with ''Products and Services Committee'' and ''Web Services Cluster'')<br />
** Provide working examples/demonstrations in a self-contained CD/DVD (a bootable CD/DVD) (P. Nacionales)<br />
* Provide technical input on the development and deployment of the collection of capabilities that comprise the ''Earth Information Exchange''<br />
* Contribute to the planning for the technical content for the Winter and Summer 2007 ESIP Federation Meetings. <br />
<br />
Any other suggestions?<br />
<br />
* Work to infuse Federation web services technology and service chaining into use cases being developed by the six Applications Clusters (T. Yunck)</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Commercial_Development_Restructuring&diff=9294Commercial Development Restructuring2007-07-11T23:53:49Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>Back to: [[Commercial Development]]<br />
==Reasons for change==<br />
#Standing Committees are supposed to have "standing" because they serve all ESIPs.<br />
#The Commercial Development Standing Committee was serving a small number of commercial ESIPs with the hope that this would serve to benefit all ESIPs. The original activities included developing an ecommerce section on the esipfed.org site. This was of interest to non-commercial ESIPs as a tool to reimburse the expense of delivering discs and maintaining user service personnel.<br />
#The proposed changes are in response to low participation in the Standing Committee with the hope that expanded activities will have broader interest.<br />
<br />
==Original Bylaw==<br />
'''Section 5: Standing Committee for Commercial Development'''<br />
<br />
V.5.1 The ESIP Federation shall include a Standing Committee for Commercial Development. Its purpose is to foster commercial development of Earth science information. Its roles are:<br />
<br />
:a. To explore mutually beneficial activities with commercial providers of Earth science data, products, and services;<br />
:b. To provide ESIP partners with resources that will facilitate the development of commercially valuable products;<br />
:c. To develop organizational models and practices that will bridge between individual ESIP partner institutions, in order to facilitate the transfer of technology into the commercial for-profit sector;<br />
:d. To encourage and stimulate the development of the commercial activities of its partners and to encourage and stimulate the broader environmental informational economy.<br />
<br />
==Proposed==<br />
'''Section 5: Standing Committee for Economic Development'''<br />
<br />
:The ESIP Federation shall include a Standing Committee for Economic Development. Its purpose is to foster improvements in all economic aspects of Earth science. Its roles are:<br />
::a. To explore mutually beneficial activities with commercial providers of Earth science data, products, and services;<br />
::b. To provide ESIPs with resources that will facilitate the development of commercially valuable products;<br />
::c. To explore issues concerning intellectual property and provide advice to individual ESIPs and the Earth Science community at large;<br />
::d. To develop and implement economic models and practices that will bridge between individual ESIP partner institutions in order to sustain and grow Earth science through the transfer of its products and services into the commercial, academic, and government sectors;<br />
::e. To encourage and stimulate the activities of its Partners by working to stimulate the broader environmental information economy.<br />
<br />
==Detailed Discussion==<br />
(Please insert comments below.)<br />
#I wanted to refocus the Committee on broader issues to increase the amount of money available to the Federation and its Partners. A major issue is the new Section c concerning "intellectual property". [[User:HowardBurrows|HowardBurrows]] 11:42, 25 July 2006 (EDT)</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=P%26S_Avoiding_Duplicate_Metadata_Records&diff=9293P&S Avoiding Duplicate Metadata Records2007-07-11T23:53:31Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>''Back to:'' [[Products and Services]]<br />
----<br />
A teleconference was held Tuesday Feb 14, 2pm EST (11am PST)<br />
<br />
:Participants:<br />
<br />
::Jeff Arnfield jeff.arnfield@noaa.gov;<br />
::Keith Wichmann keith.wichmann@gst.com;<br />
::Gene Major major@gcmd.gsfc.nasa.gov;<br />
::Phil Yang cyang3@gmu.edu;<br />
::Rob Raskin raskin@jpl.nasa.gov<br />
<br />
==General Results==<br />
*From review of GeoSpatial OneStop, it is clear that several metadata repositories hold the records for the same datasets<br />
*It is not wrong to have multiple partially redundant repositories<br />
*Must have a way to resolve inconsistencies<br />
::Possibly authorize one of the sites as "official" record<br />
<br />
*The following paper by Ted Habermann discusses options for dealing with multiple records from different sources:<br />
:: [[Media:Habermann_-_Whose_metadata_is_this_anyway.doc|Whose metadata is this anyway?]]</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=US_GEO_-_ESIP_Coordination&diff=9292US GEO - ESIP Coordination2007-07-11T23:53:05Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>During the Summer 2006 ESIP meeting, an opportunity surfaced for ESIP to coordinate with the US GEO in sharing capabilities for developing air quality information systems. A framework for facilitating this coordination is being pursued.<br />
<br />
* [[Draft Concept Outline by Dick Wertz]], ESIP [http://capita.wustl.edu/AQCluster/USGEO/AirQualityClusterConceptPaper.doc download doc]<br />
* [[AQ Collaborative Framework by Frank Lindsay]], NASA [http://wiki.esipfed.org/images/2/2f/AQ_Framework_Paper_-_Lindsay.doc download doc]<br />
* [[Thoughts by Steve Young]], EPA<br />
* [[Approach by Rudy Husar]], Washington University<br />
* Meeting Notes</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=CFpeople&diff=9291CFpeople2007-07-11T23:52:45Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>{{CF-links}}<br />
__NOTOC__<br />
<br />
'''People who contributed to this wiki'''<br />
<br />
#Olivier Boucher<br />
#Frank Dentener<br />
#Rudy Husar<br />
#Jonathan Gregory<br />
#KyleHalliday<br />
#BryanLawrence<br />
#Vincent-Henri Peuch<br />
#Sebastian Rast<br />
#Martin Schultz<br />
#Michael Schulz<br />
#Ranjeet Sokhi<br />
#David Stevenson<br />
#Karl Taylor<br />
#Christiane Textor<br />
#Peter van Velthoven</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=User_access_to_satellite_data&diff=9290User access to satellite data2007-07-11T23:52:23Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>==Use Case AQ.SatelliteData.1.a==<br />
<br />
<br />
==Purpose==<br />
Earth Information Exchange<br />
<br />
Access to satellite data using queries over a continuous space-time-parameter domain.<br />
<br />
==Revision Information==<br />
Version 0.1.a <br />
<br />
Prepared by: <br />
Rudolf Husar<br />
Washington University <br />
<br />
and <br />
<br />
Stefan Falke<br />
Washington University and<br />
Northrop Grumman IT - TASC<br />
<br />
created: February 26, 2007<br />
<br />
Revision History<br />
<br />
Modified by <br />
<Modifier Name/Affil>, <br />
<Date/time>, <br />
<Brief Description><br />
<br />
==Use Case Identification==<br />
<br />
===Use Case Designation===<br />
<br />
AQ.SatelliteData.1.a<br />
<br />
===Use Case Name===<br />
Short name: Satellite data access<br />
<br />
Long name: Air quality user-access to satellite data by space-time-parameter queries<br />
<br />
==Use Case Definition==<br />
The AQ cluster has a fundamental need for a set of CORE web services that allow meaningful user-access to satellite data. These services include:<br />
* Data access by space-time-parameter query on granules <br />
* Subsetting that clips the data to user-specified BBOX<br />
* Mosaicing that splices granule mosaic into a coherent dataset <br />
<br />
The proper chaining of these services results in a higher order service, WCS, that returns the requested satellite data for the BBOX, Time, Parameter. Not more not less. Such a WCS service was in fact used in the Web service chaining experiment. Extending that service to return numeric satellite data (not just images) is the goal.<br />
<br />
===Actors===<br />
<br />
====Primary Actors====<br />
<br />
Air quality analysts interested in using satellite data for assessing air pollution, comparing satellite and surface data, "ground-truthing" model results.<br />
<br />
====Other Actors====<br />
<br />
===Preconditions===<br />
*1. Satellite data are available through open interfaces<br />
*2. Data access service specifications, e.g. OGC Web Coverage Service (WCS), can be implemented by data provider or mediator<br />
*3.<br />
<br />
===Postconditions===<br />
*1. Satellite data in a numeric data format (as opposed to image format) covering the spatial area, time range, and parameters that were specified in the query.<br />
<br />
===Normal Flow (Process Model)===<br />
*1) The user finds a WCS serving satellite data<br />
*2) The user submits a WCS GetCoverage request that includes bounding box, time, and parameter filters<br />
*3) The satellite data server provides the data that meets the query criteria. In the process, the data provider may need to execute swath mosaicking and data subsetting services.<br />
<br />
===Alternative Flows===<br />
<br />
===Successful Outcomes===<br />
*1.Operation succeeds and user obtains satellite dataset adhering to the requested spatial, temporal, and parameter filters.<br />
<br />
===Failure Outcomes===<br />
*1.<br />
*2.<br />
<br />
===Special Functional Requirements===<br />
None<br />
<br />
===Extension Points===<br />
*AQ.SatelliteAccess.1.b <br />
NASA GSFC DISC implementation of WCS for OMI NO2 access<br />
<br />
==Diagrams==<br />
<br />
===Use Case Diagram===<br />
<br />
===State Diagram (optional)===<br />
<br />
===Activity Diagram (optional)===<br />
<br />
===Other Diagrams (optional)===<br />
<br />
==Non-Functional Requirements (optional)==<br />
<br />
===Performance===<br />
<br />
===Reliability===<br />
<br />
===Scalability===<br />
<br />
===Usability===<br />
<br />
===Security===<br />
<br />
===Other Non-functional Requirements===<br />
<br />
==Selected Approach==<br />
<br />
===Overall Technical Approach===<br />
<br />
===Architecture===<br />
<br />
===Participating Organizations/Projects===<br />
<br />
===Technology A===<br />
<br />
====Description====<br />
<br />
====Benefits====<br />
<br />
====Limitations====<br />
<br />
===Technology B===<br />
<br />
====Description====<br />
<br />
====Benefits====<br />
<br />
====Limitations====<br />
<br />
==References (optional)==</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=OGC_Implementation_with_MapServer&diff=9289OGC Implementation with MapServer2007-07-11T23:52:08Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>This workshop provided an overview, with examples of how services based upon the Open Geospatial Consortium's Web Map, Web Feature, and Web Coverage Service specifications may be implemented using the Open Source MapServer platform. A more detailed overview and comparison of the OGC WxS specifications may be found in the reference document ([[media:Ogcworkshop.pdf|''The Open Geospatial Consortium Web Map, Web Feature, and Web Coverage Service Standards - An Overview'']]) created by Karl Benedict for the 2005 Summer Federation meeting in San Diego, CA. <br />
<br />
Presentation File: [[media:Ogc_mapserver.pdf|(PDF)]]<br />
<br />
[[Iti_2006workshops|Back to the Technical Workshops page]]</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Agreed_Items_of_Discussion_Future_Atmospheric_Chemistry_and_Aerosol_Terms&diff=9288Agreed Items of Discussion Future Atmospheric Chemistry and Aerosol Terms2007-07-11T23:51:46Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>Go back to [http://wiki.esipfed.org/index.php/Air_Quality/Chemistry_Naming_Conventions Start page of CF compliant Atmospheric Chemistry and Aerosol Names]<br />
<br />
Go back to [http://wiki.esipfed.org/index.php/Talk:CF_Standard_Names_-_Future_Atmospheric_Chemistry_and_Aerosol_Terms Recent Items of Discussion on Future Atmospheric Chemistry and Aerosol Terms]<br />
<br />
----<br />
<br />
<br />
==JGregory: Content Explanation==<br />
:We have used "content" in a lot of standard names to mean the amount of something per unit area i.e. a vertical integral. Do you think e.g. "atmosphere ozone content" in kg m-2 isn't clear enough terminology? --[[User:JonathanGregory|JonathanGregory]] 16:51, 22 May 2006 (EDT)<br />
===......RHusar: Content Explanation===<br />
::'Vertical burden' is also used to describe measured column concentrations. It may take a bit of getting used to, but I have no objections to ozone_content. --[[User:Rhusar|Rhusar]] 19:19, 22 May 2006 (EDT)<br />
===......CTextor: Content Explanation===<br />
::I think in the chemistry/aerosol community "content" would rather be understood as a total mass, the amount of something per unit area would rather be called 'load' or 'column'. Therefore I would now suggest to use vertical_burden which seems less ambiguous to me. --[[User:Christiane|Christiane]] 12:11, 2 June 2006 (EDT)<br />
<br />
==JGregory:in_air vs. atmosphere==<br />
:The difference between atmosphere and in_air is that atmosphere is used to refer to large-scale properties, and in_air to locally measured ones. Hence the distinction between e.g. mass concentration in air, and atmosphere content. Chemical concentrations would be in_air (as you have done), and hence distinguished from in_sea_water etc. If a given quantity could appear in places other than air, it is correct to be explicit. --[[User:JonathanGregory|JonathanGregory]] 16:51, 22 May 2006 (EDT)<br />
<br />
==JGregory: mole or mass fractions==<br />
:You may indeed prefer mole_fraction for some quantities and mass_fraction for others. That would be your own decision for your project, but of course another project might make a different choice. --[[User:JonathanGregory|JonathanGregory]] 16:51, 22 May 2006 (EDT)<br />
===......CTextor: mole or mass fractions===<br />
::The use of either mole_ or mass_ fraction varies within the community, so I followed the suggestions of the PRISM project. But then aerosols should allways be in mass and gases in mole fraction for consistency. --[[User:Christiane|Christiane]] 12:11, 2 June 2006 (EDT)<br />
<br />
==JGregory: Units==<br />
:It doesn't matter to CF what units are used, so long as they are udunits. Any dimensionally equivalent unit can be used for a given standard name. <br />
However, kgC and kgS aren't SI units. I think the unit has to be kg. This implies that it's the standard name which must somehow indicate that it is the<br />
mass of C or mass of S which is being referred to, rather than the mass of the compound e.g. dry_deposition_flux_of_sulfur_as_sulfate_at_surface. <br />
--[[User:JonathanGregory|JonathanGregory]] 16:51, 22 May 2006 (EDT)<br />
===......CTextor: Units===<br />
::changed for carbon, sulfate, and nitrogen species:<br />
::{|{{prettytable}}<br />
|- <br />
| width="321" Height="12,75" | mass_concentration_of_sulfate_as_sulfate_aerosol_in_air<br />
<br />
|- <br />
| Height="12,75" | mass_concentration_of_nitrate_as_nitrate_aerosol_in_air<br />
<br />
|- <br />
| Height="12,75" | mass_concentration_of_ammonium_sulfate_aerosol_in_air<br />
<br />
|- <br />
| Height="12,75" | mass_concentration_of_seasalt_aerosol_in_air<br />
<br />
|- <br />
| Height="25,5" | mass_concentration_of_organic_carbon_aerosol_from_terpenes_as_particulate_organic_carbon_aerosol_in_air <br />
<br />
|- <br />
| Height="25,5" | mass_concentration_of_organic_carbon_as_particulate_organic_carbon_aerosol_in_air <br />
<br />
|- <br />
| Height="25,5" | mass_concentration_of_hydrophilic_organic_carbon_as_particulate_organic_carbon_aerosol_in_air<br />
<br />
|- <br />
| Height="25,5" | mass_concentration_of_hydrophobic_organic_carbon_as_particulate_organic_carbon_aerosol_in_air<br />
<br />
|- <br />
| Height="12,75" | mass_concentration_of_black_carbon_aerosol_in_air <br />
<br />
|- <br />
| Height="12,75" | mass_concentration_of_hydrophilic_black_carbon_aerosol_in_air<br />
<br />
|- <br />
| Height="12,75" | mass_concentration_of_hydrophobic_black_carbon_aerosol_in_air<br />
<br />
|- <br />
| Height="12,75" | mass_concentration_of_dust_aerosol_in_air<br />
<br />
|}<br />
::--[[User:Christiane|Christiane]] 15:53, 8 June 2006 (EDT)<br />
<br />
==JGregory: equivalent_thickness_at_stp_of_atmosphere_ozone_content==<br />
:equivalent_thickness_at_stp_of_atmosphere_ozone_content means the thickness (depth) of the layer you would get by collecting all the ozone in the atmospheric column at STP. It was named like that by analogy with the equivalent thickness (depth) of amounts of precipitation. Does that make sense? --[[User:JonathanGregory|JonathanGregory]] 16:51, 22 May 2006 (EDT)<br />
===......RHusar: Aerosol Scale Height===<br />
::I wonder if we can use the same naming for aerosol_scale_height, i.e. the height of an aerosol layer if the concentration was vertically uniform between the surface and scale height. --[[User:Rhusar|Rhusar]] 19:27, 22 May 2006 (EDT)<br />
===......CTextor: equivalent_thickness_at_stp_of_atmosphere_ozone_content===<br />
::The problem for me is STP, I realize that it is 'standard temperature and pressure'. I found it on wikipedia so I guess I should know...? --[[User:Christiane|Christiane]] 12:11, 2 June 2006 (EDT)<br />
<br />
<br />
==JGregory: Variable and File Names==<br />
:Names for variables and files would not be the subject of CF conventions --[[User:JonathanGregory|JonathanGregory]] 16:51, 22 May 2006 (EDT)<br />
===......CTextor: Variable and File Names===<br />
::I agree that this is not the focus of the CF conventions, but is still needed for model intercomparisons. We might want to open another discussion on the structure and names of files elsewhere. --[[User:Christiane|Christiane]] 12:11, 2 June 2006 (EDT)<br />
<br />
<br />
==JGregory: Avoid Abbreviations==<br />
:We try to avoid abbreviations like "turdry" and "seddry". Although they make the names longer, I think these should be spelled out in full. Would this be a case for using due_to e.g. dry_deposition_..._due_to_turbulence? --[[User:JonathanGregory|JonathanGregory]] 16:51, 22 May 2006 (EDT) <br />
===......CTextor: Avoid Abbreviations===<br />
::I will change this. --[[User:Christiane|Christiane]] 12:11, 2 June 2006 (EDT)<br />
<br />
<br />
==JGregory: Distinction between Net and Total Production==<br />
:It could be unclear to have a distinction between "production" and "net production". Is there a more explicit name for the former? Can you call it "gross production", for instance, like gross/net primary productivity of ecosystems? --[[User:JonathanGregory|JonathanGregory]] 16:51, 22 May 2006 (EDT)<br />
===......CTextor: Distinction between Net and Total Production ===<br />
:changed --[[User:Christiane|Christiane]] 17:54, 2 June 2006 (EDT)<br />
<br />
<br />
==PVelthoven (PV) / CTextor (CT): remarks to updates on June 8 from PV and answers from CT==<br />
:*'''PV:''' aerosols: It may be useful to have a way to distinguish the dry aerosol fraction from "aerosol".<br />
::'''CT:''' With aerosol I always refer to dry aerosol as it was done in AeroCom. I add dry in the explanation.<br />
<br />
:*'''PV:''' A decision should still be made whether IUPAC names or names common in atmospheric chemistry research should be used. There are a few species in your and my original list which are not IUPAC.<br />
::'''CT:''' There is a decision: IUPAC names should be used. Jonathan already mentioned this to me. Links provided by Jonathan and added to this web site.<br />
--[[User:Christiane|Christiane]] about 9 June 2006 (EDT)<br />
<br />
<br />
==JGregory(JG) / CTextor (CT): remarks to updates on June 12 from JG and answers from CT==<br />
:*'''JG:''' Thanks for your updates. I am not monitoring your wiki, so I'm depending on your emails to prompt me to look again. I think the debate is going well! If you send your email to the CF list the wiki might have a wider readership.<br />
::'''CT:''' will write an email to the CF list<br />
<br />
:*'''JG:''' I know that "burden" and "column" are common, but if you could get used to "content" it would have the advantage of consistency with other names. I agree that it might be misunderstood to mean the content integrated over the entire world, not per unit area, but this is also true of the existing stdnames which use "content". The units should clarify it, so it's not dangerously ambiguous! We would need some other phrase for the global total. So far no-one has asked for such a quantity. In existing names X_content where X is a material means kg m-2, and by analogy you could have number_content in m-2.<br />
::'''CT:''' ok, if this is the convention to be followed. anyway: so far, no variable has been constructed for content...<br />
<br />
:*'''JG:''' STP is a fairly standard abbreviation, but it is also listed in the CF stdname guidelines.<br />
::'''CT:''' sorry for not knowing.<br />
<br />
:*'''JG:''' Yes, I think we have avoided articles, because we haven't needed them, not on principle. However, prepositions do appear in some names.<br />
::'''CT:''' Yes!<br />
<br />
:*'''JG:''' Yes, if a species could appear in more than one medium, it should have in_air in_sea_water in_soil or whatever, to specify which.<br />
::'''CT:''' Yes!<br />
:*'''JG:''' in_air and in_atmosphere wouldn't be a clear distinction, because atmosphere is used in other names to refer to large-scale properties, not to a medium. I would suggest in_air, in_clear_air (outside clouds), in_cloudy_air, and in_cloud_water (with a _).<br />
::'''CT:''' This is how I wanted to use it. I hope it is clearer from the recent updates of the tables. <br />
<br />
:*'''JG:''' in_troposphere is a bit different. I think this quantity is actually in_air, but within the troposphere! in_troposphere is more like a vertical coordinate (like a named surface) than a medium, I would say. But we could also regard it as a large-scale designation, like atmosphere, and put it at the start, thus: troposphere_mole_fraction_of_ozone_in_air_from_stratosphere. Is that correct? <br />
::'''CT:''' With in_troposphere I mean a large scale property, but in all phases, i.e. in clouds and air. explanation added to table. But do I understand correctly that large scale properties should be at the beginning of the variable names, and locally measurable or origin information at the end of variable? <br />
<br />
:*'''JG:''' I don't understand the construction _of_X_compartment. What does this mean?<br />
::'''CT:''' Changed in updated versions, hope it is clearer now.<br />
<br />
:*'''JG:''' Why is "loss" preferred to "destruction", which would parallel "production" more nearly?<br />
::'''CT:''' Good point, I have changed it too "destruction"<br />
<br />
--[[User:Christiane|Christiane]] 13 June 2006 (EDT)<br />
<br />
==RanjeetSokhi(RS) / CTextor (CT): remarks on version June 12 from RS and answers from CT==<br />
<br />
:*'''RS:''' Table 2 - Nitric Oxide (NO) rather than Nitrogen Oxide<br />
::'''CT:''' I followed the IUPAC conventions here and changed it to nitrogen monooxide.<br />
<br />
:*'''RS:''' Aerosols <br />
:: you are missing PM10 (particles of aerodynamic size of 10um or less), similary PM2.5 and PM1<br />
:: coarse fraction = PM10-PM2.5<br />
:: fine fraction = PM2.5<br />
:: ultrafine fraction PM0.1<br />
:: accumulation mode particles = particles of size 0.1 to 1um<br />
:: Aitken mode particles = particles of size 0.1-0.01um<br />
:: nucleation mode particles = particles of size less than 0.01um<br />
::'''CT:''' I agree that these are missing, I have added them in the species list, but not in the 'proposed names section'. The philosophy of CF is to define names once they are really needed. The reason why I did not include them so far is that they are not commonly simulated in global models, but if needed these names can be included in order to be as broad as possible!<br />
--[[User:Christiane|Christiane]] 13 June 2006 (EDT)</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Component_Web_Services_and_Service_Chaining&diff=9287Component Web Services and Service Chaining2007-07-11T23:50:52Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>{{Back2Traj}}<br />
<font color="red"> <center><big>Page in progress</big></center></font><br />
<br />
The composite trajectory service consists of services for WCS data access, single trajectory calculation and trajectory aggregation. <br />
<br />
[[Image:TrajectoryService.png|600px]]<br />
<br />
The wind data are to be provided by servers that can deliver 4D model wind data (u,v,w,t).<br />
<br />
The single trajectory service uses the 4D input winds for a specific region and time and calculates forward or backward trajectories. Back trajectories are diagnostic tools that help elucidating where dirty air came from. Forward trajectories indicate the transport from known source regions downwind. The same algorithm is used for the forecast and historical 4D trajectories. Since the calculation of trajectories is part science part art it is desireable to have several trajectory algorithms to choose from. <br />
<br />
The trajectory aggregator is a compound service that can aggregate multiple trajectories using a variety of algorithms. Generally, the trajectory aggregator is linked to air quality monitoring data as the source of trajectory filter conditions. <br />
<br />
The new elements for this proposed trajectory server would include: <br />
* Real-time calculation of trajectories <br />
* Remote access to forecast (Unidata) and historical (NCDC) winds <br />
* WCS and netCDF-CF standards-based data access<br />
* Persistents of the compound trajectory service as a network of chained services<br />
<br />
With these services it is possible to build a variety of air quality analysis applications such as the Combined Aerosol Trajectory Tool, [http://datafedwiki.wustl.edu/index.php/CATT CATT], that has been developed over the past few years by community of air quality analysts. The new service would bring together and provide benefits to the air quality and meteorological communities.</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=GSN_Demo_-_Denver&diff=9286GSN Demo - Denver2007-07-11T23:50:31Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>[[TrajectoryService]]<br />
<br />
[[2006-07-30 GEOSS User V - AQ Data Systems]]<br />
<br />
[[category:GSN]][[category:Denver]][[Category:Demo]]</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Ed_Inventory&diff=9285Ed Inventory2007-07-11T23:48:35Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>Back to: [[Education]]<br />
----<br />
==General Issues for the Inventory of Assets==<br />
:We currently have an Education Center as part of the esipfed page: http://www.esipfed.org/education_center/<br />
<br />
:Plan is to help ESIPs register their educational assets with established repositories outside the Federation.<br />
<br />
:We will monitor and promote ESIP assets that are so registered, particularly as they relate to our societal benefit area cluster activities.<br />
<br />
:We will catalog educational needs and coordinate activities to fill these needs by recruiting elements from the broader inventory of Federation assets.<br />
<br />
==Selection of metadata standards==<br />
<br />
:Here is a set of groups and standards each aiming to create a common vocabulary to describe educational assets:<br />
::http://www.imsglobal.org/metadata/index.cfm <br />
::http://ltsc.ieee.org/wg12/index.html <br />
::http://ltsc.ieee.org/wg12/files/LOM_1484_12_1_v1_Final_Draft.pdf<br />
::http://dublincore.org/groups/education/<br />
::http://www.adlnet.org/index.cfm?fuseaction=scormabt<br />
::http://www.eduref.org/Eric/<br />
::http://www.dlese.org/Metadata/<br />
<br />
:A good step would be to see which of these are already being used by our ESIPs.<br />
:Then it would be useful to compare them to see if any are particularly useful for our purposes, both in building new educational products and in helping situated learners.<br />
<br />
<br />
==Selection of metadata repositories==<br />
<br />
:We are currently using our own site (historic) and the GCMD SERFs to register our products.<br />
<br />
:A suggestion is to continue to use GCMD for a high level description of each ESIP's assets, co-opting fields in the SERF to pass through to the more detailed respositories.<br />
<br />
:We need a list of established repositories, a record of which are currently being used by ESIPs, and a comparison of costs and benefits of each.<br />
::Several are known to be used by ESIPs: DLESE, Eisenhower Clearinghouse, Carleton SERC.<br />
::A start on the factors that we might want to compare<br />
:::What metadata standard do they use?<br />
:::Ease of entering metadata and registering products (what tools and help is provided?)<br />
:::Popularity and educational usage statistics on the repositories.<br />
:::Stability and long term persistence of the repository. (who funds it)</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=Getting_Started_with_MapServer&diff=9284Getting Started with MapServer2007-07-11T23:48:15Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div>The data and documentation for this workshop are now available online. I tried to upload them to the wiki but these files are too big so am providing external links. If you would like to read/download the documentation, please click on the Documentation link below. Likewise, if you would like to download the workshop data (and documentation), click on the Data link.<br />
<br />
*[[MS101_Documentation | Documentation]]<br />
<br />
*[[MS101_Data | Data]]<br />
<br />
[[Iti_2006workshops | Back to the Workshops page]]</div>Jarnfielhttps://wiki.esipfed.org/w/index.php?title=DataFed_Service_Chain_Example&diff=9283DataFed Service Chain Example2007-07-11T23:47:55Z<p>Jarnfiel: Reverting-SpamControl</p>
<hr />
<div><cEnter>'''WCS python demos by [[User:Hoijarvi|Hoijarvi]]'''</center><br />
<center>For questions regarding this page e-mail [[User:Hoijarvi|Hoijarvi]] </center><br />
==Background==<br />
=== Service Chaining Example: Outline ===<br />
This example uses python to<br />
* get point data<br />
* render it as an image<br />
* store the image on local computer<br />
<br />
See WCS page [[SOAPifying_WCS]]<br />
<br />
=== Getting Demo Script ===<br />
<br />
Download http://datafed.net/demo/soapchain.txt and save it with extension '''.py'''<br />
<br />
type from command line '''python soapchain.py''' and watch it run.<br />
<br />
There are no parameters, the script is hard coded for demo purposes.<br />
<br />
=== SOAP problems ===<br />
<br />
There are two problems with SOAP and large amounts of data.<br />
<br />
* First, data has to be passed as xml, which results to enormous amounts of data for large tables, causing performance problems.<br />
* Second, SOAP defines 4 MB size limit for messages, so large data transfers have to partitioned, making things more complicated.<br />
* Third problem is WCS binary data, although binary encoding with MIME attachments is possoble, I do not know any system that would use it.<br />
<br />
Datafed services have solved the issue by using common two phase pattern.<br />
The SOAP services return an envelope with small amount of metadata<br />
describing the result, and an uri pointer to the cached result.<br />
<br />
Datafed SOAP services use this pattern also while passing data<br />
into services. For example in this chase, the table url is passed<br />
from WCS to RenderMapPoint directly. Since the services are located<br />
in the same machine, they can access the table directly, without<br />
turning it into xml ever. <br />
<br />
==Service Chain Example: Python Script==<br />
=== Function execute_chain ===<br />
<br />
This is the main program for the service chain.<br />
* Query data with WCS,<br />
* Render it,<br />
* save locally<br />
<br />
Since the output envelope does not contain data,<br />
but a reference to data, get_table_url function returns<br />
the reference url to the data table, which is then passed into <br />
the rendering service. It also returns a reference to the image, <br />
which is still in the server.<br />
<br />
So the services don't pass data to each others, they pass a <br />
little metadata and a url to the data. If the services are in <br />
the same server, this bypasses reading and writing huge amounts <br />
of xml data.<br />
<br />
<pre><br />
def execute_chain():<br />
print "querying table"<br />
table_url = get_table_url()<br />
<br />
# table_url == http://webapps.datafed.net/storage.aspx?ID=GetCoverage_91<br />
# rendering service can get this directly from the cache with the ID GetCoverage_91<br />
<br />
print "rendering table " table_url<br />
image_url = get_image_url(table_url)<br />
<br />
# image_url == http://webapps.datafed.net/storage.aspx?ID=RenderMapPoint_92<br />
# image processing services could again get the big image directly from<br />
# the server cache with ID RenderMapPoint_92<br />
#<br />
# Now we get the result from the server and save it on the local drive.<br />
<br />
print "fetching image " image_url<br />
image_stream = urllib2.urlopen(image_url)<br />
try:<br />
print "writing image to file"<br />
dump_stream(image_stream, "soapchain.png")<br />
finally:<br />
image_stream.close()<br />
</pre><br />
<br />
=== Query Template for WCS ===<br />
<br />
<pre><br />
get_coverage_query = """<br />
<soap:Envelope xmlns:soap="http://schemas.xmlsoap.org/soap/envelope/"><br />
<soap:Body><br />
<wcs:GetCoverage version="1.0.0" service="WCS"<br />
xmlns:gml="http://www.opengis.net/gml" xmlns:wcs="http://www.opengis.net/wcs"><br />
<!-- datafed dataset_abbr.param_abbr defines the coverage name --><br />
<wcs:sourceCoverage>[[dataset_abbr]].[[param_abbr]]</wcs:sourceCoverage> <br />
<wcs:domainSubset><br />
<wcs:spatialSubset><br />
<!--<br />
This element queries the USA.<br />
The dataset has no elevation, so only lat and lon<br />
limits are needed. <br />
--><br />
<gml:Envelope srsName="WGS84(DD)"><br />
<gml:pos>[[lon_min]] [[lat_min]]</gml:pos><br />
<gml:pos>[[lon_max]] [[lat_max]]</gml:pos><br />
</gml:Envelope><br />
<gml:Grid dimension="2"><br />
<gml:limits><br />
<!--<br />
grid size. This is a point dataset, so these numbers have no meaning.<br />
--><br />
<gml:GridEnvelope><br />
<gml:low>0 0</gml:low><br />
<gml:high>99 99</gml:high><br />
</gml:GridEnvelope><br />
</gml:limits><br />
<gml:axisName>lat</gml:axisName><br />
<gml:axisName>lon</gml:axisName><br />
</gml:Grid><br />
</wcs:spatialSubset><br />
<wcs:temporalSubset><br />
<!--<br />
query data for one time only.<br />
--><br />
<gml:timePosition>[[datetime]]</gml:timePosition><br />
</wcs:temporalSubset><br />
</wcs:domainSubset><br />
<wcs:output><br />
<!--<br />
.NET dataset is a good format for point datasets<br />
--><br />
<wcs:format>dataset-schema</wcs:format><br />
</wcs:output><br />
</wcs:GetCoverage><br />
</soap:Body><br />
</soap:Envelope><br />
"""<br />
<br />
</pre><br />
<br />
=== Query Template for Render Call ===<br />
<br />
<pre><br />
render_point_query = """<br />
<soap:Envelope xmlns:soap="http://schemas.xmlsoap.org/soap/envelope/"><br />
<soap:Body><br />
<rmp:Render xmlns:rmp="http://datafed.net/xs/RenderMapPoint"><br />
<Table xmlns="http://datafed.net/xs/Table"><br />
<TableRef>[[tableref]]</TableRef><br />
</Table><br />
<rmp:Settings xmlns:mi="http://datafed.net/xs/MapImageLatLon"<br />
xmlns:ip="http://datafed.net/xs/ImagePrimitives"><br />
<rmp:image_desc><br />
<mi:zoom><br />
<mi:image_width>400</mi:image_width><br />
<mi:image_height>200</mi:image_height><br />
<mi:lat_min>[[lat_min]]</mi:lat_min><br />
<mi:lat_max>[[lat_max]]</mi:lat_max><br />
<mi:lon_min>[[lon_min]]</mi:lon_min><br />
<mi:lon_max>[[lon_max]]</mi:lon_max><br />
</mi:zoom><br />
<mi:bgcolor>0xE1FFF0</mi:bgcolor><br />
<mi:image_format>image/png</mi:image_format><br />
</rmp:image_desc><br />
<rmp:data_column>[[param_abbr]]</rmp:data_column><br />
<rmp:scale_min>0</rmp:scale_min><br />
<rmp:scale_max>[[scale_max]]</rmp:scale_max><br />
<rmp:sqrt>false</rmp:sqrt><br />
<rmp:symbol><br />
<ip:width>10</ip:width><br />
<ip:height>10</ip:height><br />
<ip:offset_x>0</ip:offset_x><br />
<ip:offset_y>0</ip:offset_y><br />
<ip:shape>circle</ip:shape><br />
<ip:num_of_sides>4</ip:num_of_sides><br />
<ip:baseline>false</ip:baseline><br />
</rmp:symbol><br />
<rmp:pen><br />
<ip:width>0.5</ip:width><br />
<ip:style>solid</ip:style><br />
<ip:color>red</ip:color><br />
</rmp:pen><br />
<rmp:brush><br />
<ip:style>solid</ip:style><br />
<ip:color>yellow</ip:color><br />
</rmp:brush><br />
<rmp:script><br />
used.symbol.width=symbol.width*norm_param_value;<br />
used.symbol.height=symbol.height*norm_param_value;<br />
</rmp:script><br />
</rmp:Settings><br />
</rmp:Render><br />
</soap:Body><br />
</soap:Envelope><br />
"""<br />
<br />
</pre><br />
<br />
=== Other Utility Functions ===<br />
* query_datafed: A generic soap call to datafed server.<br />
* replace_parameters: If you want to change most common parameters.<br />
* look_for_ns_name: xml utility<br />
* dump_stream: write image stream to file<br />
* get_table_url, get_image_url: soap calls</div>Jarnfiel