Difference between revisions of "Data Risk Factors"

From Earth Science Information Partners (ESIP)
Line 15: Line 15:
  
 
==== RELEVANT LITERATURE ====
 
==== RELEVANT LITERATURE ====
Anderson, William L., Faundeen, John L., Greenberg, Jane, & Taylor, Fraser. (2011). Metadata for data rescue and data at risk. In Conference on Ensuring Long-Term Preservation in Adding Value to Scientific and Technical Data. http://hdl.handle.net/2152/20056
+
# Anderson, William L., Faundeen, John L., Greenberg, Jane, & Taylor, Fraser. (2011). Metadata for data rescue and data at risk. In Conference on Ensuring Long-Term Preservation in Adding Value to Scientific and Technical Data. http://hdl.handle.net/2152/20056
 
+
# Downs, Robert R. & Chen, Robert S. (2017). Curation of scientific data at risk of loss: Data rescue and dissemination. In Johnston, Lisa (Ed). Curating Research Data. Volume One, Practical Strategies for Your Digital Repository. Association of College and Research Libraries. http://dx.doi.org/10.7916/D8W09BMQ  
Downs, Robert R. & Chen, Robert S. (2017). Curation of scientific data at risk of loss: Data rescue and dissemination. In Johnston, Lisa (Ed). Curating Research Data. Volume One, Practical Strategies for Your Digital Repository. Association of College and Research Libraries. http://dx.doi.org/10.7916/D8W09BMQ  
+
# Griffin, R.E. (2015). When are old data new data? GeoResJ, 6: 92–97. http://dx.doi.org/10.1016/j.grj.2015.02.004
 
+
# Hsu, L., Lehnert, K.A., Goodwillie, A., Delano, J.W., Gill, J.B., Tivey, M.A., Ferrini, V.L., Carbotte, S.M., Arko R.A. (2015). Rescue of long-tail data from the ocean bottom to the Moon: IEDA Data Rescue Mini-Awards, GeoResJ, 6:108-114, http://dx.doi.org/10.1016/j.grj.2015.02.012.  
Griffin, R.E. (2015). When are old data new data? GeoResJ, 6: 92–97. http://dx.doi.org/10.1016/j.grj.2015.02.004
+
# Michener, William K., et al. “Nongeospatial Metadata for the Ecological Sciences.” Ecological Applications, vol. 7, no. 1, Feb. 1997, pp. 330–42. [https://doi.org/10.1890/1051-0761(1997)007%5B0330:NMFTES%5D2.0.CO;2 https://doi.org/10.1890/1051-0761(1997)007[0330:NMFTES<nowiki>]</nowiki>2.0.CO;2]
 
+
# Ryan, H. (2014). Occam’s razor and file format endangerment factors. Proceedings of the 11th International Conference on Digital Preservation (iPres), October 6-10, 2014: Melbourne, Australia (pp. 179-188). https://www.nla.gov.au/sites/default/files/ipres2014-proceedings-version_1.pdf
Hsu, L., Lehnert, K.A., Goodwillie, A., Delano, J.W., Gill, J.B., Tivey, M.A., Ferrini, V.L., Carbotte, S.M., Arko R.A. (2015). Rescue of long-tail data from the ocean bottom to the Moon: IEDA Data Rescue Mini-Awards, GeoResJ, 6:108-114, http://dx.doi.org/10.1016/j.grj.2015.02.012.  
+
# Thompson, C.A., Robertson, W. D., & Greenberg, J. (2014). Where have all the scientific data gone? LIS perspective on the data-at-risk predicament. College & Research Libraries, 75(6), 842-861. https://doi.org/10.5860/crl.75.6.842  
 
 
Ryan, H. (2014). Occam’s razor and file format endangerment factors. Proceedings of the 11th International Conference on Digital Preservation (iPres), October 6-10, 2014: Melbourne, Australia (pp. 179-188). https://www.nla.gov.au/sites/default/files/ipres2014-proceedings-version_1.pdf
 
 
 
Thompson, C.A., Robertson, W. D., & Greenberg, J. (2014). Where have all the scientific data gone? LIS perspective on the data-at-risk predicament. College & Research Libraries, 75(6), 842-861. https://doi.org/10.5860/crl.75.6.842  
 
 
 
Michener, William K., et al. “Nongeospatial Metadata for the Ecological Sciences.” Ecological Applications, vol. 7, no. 1, Feb. 1997, pp. 330–42. [https://doi.org/10.1890/1051-0761(1997)007%5B0330:NMFTES%5D2.0.CO;2 https://doi.org/10.1890/1051-0761(1997)007[0330:NMFTES<nowiki>]</nowiki>2.0.CO;2]
 
  
  
 
==== ORGANIZATIONS & GUIDELINES ====
 
==== ORGANIZATIONS & GUIDELINES ====
Guidelines to the Rescue of Data At Risk, https://www.rd-alliance.org/guidelines-rescue-data-risk  
+
# Guidelines to the Rescue of Data At Risk, https://www.rd-alliance.org/guidelines-rescue-data-risk  
 
+
# Research Data Alliance Data Rescue Interest Group. https://www.rd-alliance.org/groups/data-rescue.html
Research Data Alliance Data Rescue Interest Group. https://www.rd-alliance.org/groups/data-rescue.html
+
# US Geological Survey. 2016 Data at Risk Project. https://www.fort.usgs.gov/ldi/2016-data-at-risk-project  
 
+
## Link to Risk Evaluations and Reporting criteria: https://www.fort.usgs.gov/ldi/evaluations-reports
US Geological Survey. 2016 Data at Risk Project. https://www.fort.usgs.gov/ldi/2016-data-at-risk-project  
+
# National Oceanic and Atmospheric Administration. Climate Database Modernization Program. https://www.ncdc.noaa.gov/climate-information/research-programs/climate-database-modernization-program
 
+
# International Environmental Data Rescue Organization (IEDRO), http://iedro.org/
-- Link to Risk Evaluations and Reporting criteria: https://www.fort.usgs.gov/ldi/evaluations-reports
+
# Tan, L. S., S. Burton, R. Crouthamel, A. van Engelen, R. Hutchinson, L. Nicodemus, T. C. Peterson, F. Rahimzadeh. (2004). Guidelines on Climate Data Rescue. WMO/TD No. 1210. Ed. by P. Llansó and H. Kontongomde. Geneva, Switzerland: World Meteorological Organization. http://www.wmo.int/pages/prog/wcp/wcdmp/documents/WCDMP-55.pdf
 
+
# Beaverson, Sheena. (2009). Data Deaccessioning Guidelines for the NSIDC DAAC. http://wiki.esipfed.org/images/8/87/Beaverson_DataPlan.pdf
National Oceanic and Atmospheric Administration. Climate Database Modernization Program. https://www.ncdc.noaa.gov/climate-information/research-programs/climate-database-modernization-program
+
# NESDIS Data Archive Board, (2002). Scientific Data Stewardship - Executive Summary.
 
+
# Digital Preservation Coalition - [http://dpconline.org/our-work/bit-list The 'Bit List' of Digitally Endangered Species]  
International Environmental Data Rescue Organization (IEDRO), http://iedro.org/
 
 
 
Tan, L. S., S. Burton, R. Crouthamel, A. van Engelen, R. Hutchinson, L. Nicodemus, T. C. Peterson, F. Rahimzadeh. (2004). Guidelines on Climate Data Rescue. WMO/TD No. 1210. Ed. by P. Llansó and H. Kontongomde. Geneva, Switzerland: World Meteorological Organization. http://www.wmo.int/pages/prog/wcp/wcdmp/documents/WCDMP-55.pdf
 
 
 
Beaverson, Sheena. (2009). Data Deaccessioning Guidelines for the NSIDC DAAC. http://wiki.esipfed.org/images/8/87/Beaverson_DataPlan.pdf
 
 
 
NESDIS Data Archive Board, (2002). Scientific Data Stewardship - Executive Summary.
 
 
 
Digital Preservation Coalition - [http://dpconline.org/our-work/bit-list The 'Bit List' of Digitally Endangered Species]  
 
  
  
Line 69: Line 54:
  
 
==== TRUSTED DATA REPOSITORY EVALUATION AND CERTIFICATIONS ====
 
==== TRUSTED DATA REPOSITORY EVALUATION AND CERTIFICATIONS ====
Center for Research Libraries and Online Computer Library Center, Inc. (2007). Trustworthy Repositories Audit & Certification: Criteria and Checklist. https://www.crl.edu/archiving-preservation/digital-archives/metrics-assessing-and-certifying/iso16363
+
# Center for Research Libraries and Online Computer Library Center, Inc. (2007). Trustworthy Repositories Audit & Certification: Criteria and Checklist. https://www.crl.edu/archiving-preservation/digital-archives/metrics-assessing-and-certifying/iso16363
 
+
# Data Preservation Sub-Committee of the USGS Fundamental Science Practices Advisory Committee (FSPAC). (2015). FSPAC Data Preservation Criteria for a Trusted Digital Repository. https://docs.google.com/spreadsheets/d/1DQ3XDRoe7THmoFxwPoV2lcEqkn0Q7SkrPQfizxm6fLU/edit#gid=1446608780
Data Preservation Sub-Committee of the USGS Fundamental Science Practices
+
# Data Seal of Approval and ICSU World Data System. (2016). Core Trustworthy Data Repositories Requirements. https://drive.google.com/file/d/0B4qnUFYMgSc-eDRSTE53bDUwd28/view
Advisory Committee (FSPAC). (2015). FSPAC Data Preservation Criteria for a Trusted Digital Repository. https://docs.google.com/spreadsheets/d/1DQ3XDRoe7THmoFxwPoV2lcEqkn0Q7SkrPQfizxm6fLU/edit#gid=1446608780
+
# McGovern, N. Y. (2016). DPM “Stack”: A Management Infrastructure Frame for Digital Preservation that Parallels Technical Infrastructure. https://www.dataone.org/sites/default/files/sites/all/documents/dws13dec2016.pdf
 
+
# Nestor Certification Working Group. (2013). Explanatory Notes on the Nestor Seal for Trustworthy Digital Archives. http://d-nb.info/1047613859/34
Data Seal of Approval and ICSU World Data System. (2016). Core Trustworthy Data Repositories Requirements. https://drive.google.com/file/d/0B4qnUFYMgSc-eDRSTE53bDUwd28/view
+
# Peng, G. (2015). The scientific data stewardship maturity assessment model template. Version: NCDC-CICS-SMM-0001-Rev.1 v4.0 06/23/2015. https://dx.doi.org/10.6084/m9.figshare.1211954
 
+
# Rans, J. and Whyte, A. (2017). Using RISE: the Research Infrastructure Self-Evaluation Framework. http://www.dcc.ac.uk/resources/how-guides/RISE
McGovern, N. Y. (2016). DPM “Stack”: A Management Infrastructure Frame for Digital Preservation that Parallels Technical Infrastructure.  
+
# Stall, S. (2016, December). So You want to Be Trustworthy: A repository’s Guide to Taking Reasonable Steps Towards Achieving ISO16363. Poster presented at the 2016 AGU Fall Meeting, San Francisco, CA.
https://www.dataone.org/sites/default/files/sites/all/documents/dws13dec2016.pdf
 
 
 
Nestor Certification Working Group. (2013). Explanatory Notes on the Nestor Seal for Trustworthy Digital Archives. http://d-nb.info/1047613859/34
 
 
 
Peng, G. (2015). The scientific data stewardship maturity assessment model template. Version: NCDC-CICS-SMM-0001-Rev.1 v4.0 06/23/2015. https://dx.doi.org/10.6084/m9.figshare.1211954
 
 
 
Rans, J. and Whyte, A. (2017). Using RISE: the Research Infrastructure Self-Evaluation Framework. http://www.dcc.ac.uk/resources/how-guides/RISE
 
 
 
Stall, S. (2016, December). So You want to Be Trustworthy: A repository’s Guide to Taking Reasonable Steps Towards Achieving ISO16363 . Poster presented at the 2016 AGU Fall Meeting, San Francisco, CA.
 
  
  
 
==== COMMITTEE MEMBER EXPERIENCE ====
 
==== COMMITTEE MEMBER EXPERIENCE ====
Downs, RR. 2009. Managing Risks to Scientific Data, Presented at the NYU/IBM Workshop on Managing Data Risk: Acquisition, Processing, Retention and Governance. New York, NY, April 24, 2009. Columbia University Academic Commons, https://doi.org/10.7916/D8697G5P.
+
# Downs, RR. 2009. Managing Risks to Scientific Data, Presented at the NYU/IBM Workshop on Managing Data Risk: Acquisition, Processing, Retention and Governance. New York, NY, April 24, 2009. Columbia University Academic Commons, https://doi.org/10.7916/D8697G5P.
 
+
# Ramapriyan, H.K. 2017. NASA's EOSDIS, Trust and Certification. Presented at 2017 ESIP Summer Meeting, Bloomington, IN. https://figshare.com/articles/NASA_s_EOSDIS_Trust_and_Certification/5258047
Ramapriyan, H.K. 2017. NASA's EOSDIS, Trust and Certification. Presented at 2017 ESIP Summer Meeting, Bloomington, IN.  
 
https://figshare.com/articles/NASA_s_EOSDIS_Trust_and_Certification/5258047
 

Revision as of 10:26, June 25, 2018

Data collections can face a variety of risk factors. This page provides a set of resources that will be used by members of the ESIP Data Stewardship Committee to analyze and categorize these factors. The goal of this activity is to inform and enable a) individuals and organizations who manage data collections, and b) individuals and organizations who are wanting to help to reduce the risks associated with data preservation and stewardship.

MEETING NOTES


GROUP DOCUMENTS


RELEVANT LITERATURE

  1. Anderson, William L., Faundeen, John L., Greenberg, Jane, & Taylor, Fraser. (2011). Metadata for data rescue and data at risk. In Conference on Ensuring Long-Term Preservation in Adding Value to Scientific and Technical Data. http://hdl.handle.net/2152/20056
  2. Downs, Robert R. & Chen, Robert S. (2017). Curation of scientific data at risk of loss: Data rescue and dissemination. In Johnston, Lisa (Ed). Curating Research Data. Volume One, Practical Strategies for Your Digital Repository. Association of College and Research Libraries. http://dx.doi.org/10.7916/D8W09BMQ
  3. Griffin, R.E. (2015). When are old data new data? GeoResJ, 6: 92–97. http://dx.doi.org/10.1016/j.grj.2015.02.004
  4. Hsu, L., Lehnert, K.A., Goodwillie, A., Delano, J.W., Gill, J.B., Tivey, M.A., Ferrini, V.L., Carbotte, S.M., Arko R.A. (2015). Rescue of long-tail data from the ocean bottom to the Moon: IEDA Data Rescue Mini-Awards, GeoResJ, 6:108-114, http://dx.doi.org/10.1016/j.grj.2015.02.012.
  5. Michener, William K., et al. “Nongeospatial Metadata for the Ecological Sciences.” Ecological Applications, vol. 7, no. 1, Feb. 1997, pp. 330–42. https://doi.org/10.1890/1051-0761(1997)007[0330:NMFTES]2.0.CO;2
  6. Ryan, H. (2014). Occam’s razor and file format endangerment factors. Proceedings of the 11th International Conference on Digital Preservation (iPres), October 6-10, 2014: Melbourne, Australia (pp. 179-188). https://www.nla.gov.au/sites/default/files/ipres2014-proceedings-version_1.pdf
  7. Thompson, C.A., Robertson, W. D., & Greenberg, J. (2014). Where have all the scientific data gone? LIS perspective on the data-at-risk predicament. College & Research Libraries, 75(6), 842-861. https://doi.org/10.5860/crl.75.6.842


ORGANIZATIONS & GUIDELINES

  1. Guidelines to the Rescue of Data At Risk, https://www.rd-alliance.org/guidelines-rescue-data-risk
  2. Research Data Alliance Data Rescue Interest Group. https://www.rd-alliance.org/groups/data-rescue.html
  3. US Geological Survey. 2016 Data at Risk Project. https://www.fort.usgs.gov/ldi/2016-data-at-risk-project
    1. Link to Risk Evaluations and Reporting criteria: https://www.fort.usgs.gov/ldi/evaluations-reports
  4. National Oceanic and Atmospheric Administration. Climate Database Modernization Program. https://www.ncdc.noaa.gov/climate-information/research-programs/climate-database-modernization-program
  5. International Environmental Data Rescue Organization (IEDRO), http://iedro.org/
  6. Tan, L. S., S. Burton, R. Crouthamel, A. van Engelen, R. Hutchinson, L. Nicodemus, T. C. Peterson, F. Rahimzadeh. (2004). Guidelines on Climate Data Rescue. WMO/TD No. 1210. Ed. by P. Llansó and H. Kontongomde. Geneva, Switzerland: World Meteorological Organization. http://www.wmo.int/pages/prog/wcp/wcdmp/documents/WCDMP-55.pdf
  7. Beaverson, Sheena. (2009). Data Deaccessioning Guidelines for the NSIDC DAAC. http://wiki.esipfed.org/images/8/87/Beaverson_DataPlan.pdf
  8. NESDIS Data Archive Board, (2002). Scientific Data Stewardship - Executive Summary.
  9. Digital Preservation Coalition - The 'Bit List' of Digitally Endangered Species


CODATA/RDA 2016 WORKSHOP

The Rescue of Data At Risk: An RDA / CODATA Workshop http://www.codata.org/task-groups/data-at-risk/dar-workshops

Agenda - http://www.codata.org/uploads/RescueofDataatRisk-WorkshopAgenda.pdf

Videos

Presentation slides - https://drive.google.com/drive/folders/0B_NJP_ik1Aj-M0Z5aG1tSFNDVmM?usp=sharing


TRUSTED DATA REPOSITORY EVALUATION AND CERTIFICATIONS

  1. Center for Research Libraries and Online Computer Library Center, Inc. (2007). Trustworthy Repositories Audit & Certification: Criteria and Checklist. https://www.crl.edu/archiving-preservation/digital-archives/metrics-assessing-and-certifying/iso16363
  2. Data Preservation Sub-Committee of the USGS Fundamental Science Practices Advisory Committee (FSPAC). (2015). FSPAC Data Preservation Criteria for a Trusted Digital Repository. https://docs.google.com/spreadsheets/d/1DQ3XDRoe7THmoFxwPoV2lcEqkn0Q7SkrPQfizxm6fLU/edit#gid=1446608780
  3. Data Seal of Approval and ICSU World Data System. (2016). Core Trustworthy Data Repositories Requirements. https://drive.google.com/file/d/0B4qnUFYMgSc-eDRSTE53bDUwd28/view
  4. McGovern, N. Y. (2016). DPM “Stack”: A Management Infrastructure Frame for Digital Preservation that Parallels Technical Infrastructure. https://www.dataone.org/sites/default/files/sites/all/documents/dws13dec2016.pdf
  5. Nestor Certification Working Group. (2013). Explanatory Notes on the Nestor Seal for Trustworthy Digital Archives. http://d-nb.info/1047613859/34
  6. Peng, G. (2015). The scientific data stewardship maturity assessment model template. Version: NCDC-CICS-SMM-0001-Rev.1 v4.0 06/23/2015. https://dx.doi.org/10.6084/m9.figshare.1211954
  7. Rans, J. and Whyte, A. (2017). Using RISE: the Research Infrastructure Self-Evaluation Framework. http://www.dcc.ac.uk/resources/how-guides/RISE
  8. Stall, S. (2016, December). So You want to Be Trustworthy: A repository’s Guide to Taking Reasonable Steps Towards Achieving ISO16363. Poster presented at the 2016 AGU Fall Meeting, San Francisco, CA.


COMMITTEE MEMBER EXPERIENCE

  1. Downs, RR. 2009. Managing Risks to Scientific Data, Presented at the NYU/IBM Workshop on Managing Data Risk: Acquisition, Processing, Retention and Governance. New York, NY, April 24, 2009. Columbia University Academic Commons, https://doi.org/10.7916/D8697G5P.
  2. Ramapriyan, H.K. 2017. NASA's EOSDIS, Trust and Certification. Presented at 2017 ESIP Summer Meeting, Bloomington, IN. https://figshare.com/articles/NASA_s_EOSDIS_Trust_and_Certification/5258047