https://wiki.esipfed.org/w/index.php?title=Evaluation_Privacy_Guidelines&feed=atom&action=historyEvaluation Privacy Guidelines - Revision history2024-03-29T02:13:22ZRevision history for this page on the wikiMediaWiki 1.35.14https://wiki.esipfed.org/w/index.php?title=Evaluation_Privacy_Guidelines&diff=53649&oldid=prevSscott at 04:41, April 21, 20162016-04-21T04:41:36Z<p></p>
<table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 04:41, April 21, 2016</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l1" >Line 1:</td>
<td colspan="2" class="diff-lineno">Line 1:</td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">"</del>Note: This document is currently being drafted and the text does not necessarily reflect the final policies and procedures of the evaluation process.<del class="diffchange diffchange-inline">"</del></div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">''</ins>Note: This document is currently being drafted and the text does not necessarily reflect the final policies and procedures of the evaluation process.<ins class="diffchange diffchange-inline">''</ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>==Testbed Evaluation Privacy Guidelines==</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>==Testbed Evaluation Privacy Guidelines==</div></td></tr>
<tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l5" >Line 5:</td>
<td colspan="2" class="diff-lineno">Line 5:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>The evaluation process is collaborative; however, there are some privacy expectations for the evaluators and the PIs. </div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>The evaluation process is collaborative; however, there are some privacy expectations for the evaluators and the PIs. </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>For PIs and other project members, it’s important to note that certain evaluation criteria assume that the codebase or other items are publicly available. However, we understand that this evaluation process may occur during a development cycle or involve a private codebase for other reasons. Please refer to (Tech Evaluation Thresholds <del class="diffchange diffchange-inline">| FPO</del>) for the private codebase constraint. For the former, please note when providing access to the codebase (or other documents) if those items are intended to remain private so that the collaboration space can be managed correctly for those items. Evaluators are expected to respect the PIs’ privacy concerns in these matters. </div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>For PIs and other project members, it’s important to note that certain evaluation criteria assume that the codebase or other items are publicly available. However, we understand that this evaluation process may occur during a development cycle or involve a private codebase for other reasons. Please refer to (<ins class="diffchange diffchange-inline">'''INSERT''' </ins>Tech Evaluation Thresholds) for the private codebase constraint. For the former, please note when providing access to the codebase (or other documents) if those items are intended to remain private so that the collaboration space can be managed correctly for those items. Evaluators are expected to respect the PIs’ privacy concerns in these matters. </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>ESIP will continue to improve and assess the evaluation process itself. To do that, staff may access the evaluation documents, such as the TEF spreadsheets, for analysis purposes. The outcomes of any analyses may be made public to the ESIP community or the larger geosciences community through presentations or published articles. The analyses will anonymize the evaluators; PIs, due to the nature of the projects and the process, will not be anonymized. </div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>ESIP will continue to improve and assess the evaluation process itself. To do that, staff may access the evaluation documents, such as the TEF spreadsheets, for analysis purposes. The outcomes of any analyses may be made public to the ESIP community or the larger geosciences community through presentations or published articles. The analyses will anonymize the evaluators; PIs, due to the nature of the projects and the process, will not be anonymized. </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>===Shared Collaboration Space===</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>===Shared Collaboration Space===</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>The TEF uses the Open Science Framework collaborative workspace for document sharing, working notes and other collaborative activities. For the most part, the way the space is used is up to the larger evaluation group. (<del class="diffchange diffchange-inline">""</del>INSERT:<del class="diffchange diffchange-inline">"" </del>note if any part of the OSF space is public-facing.)</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>The TEF uses the Open Science Framework collaborative workspace for document sharing, working notes and other collaborative activities. For the most part, the way the space is used is up to the larger evaluation group. (<ins class="diffchange diffchange-inline">'''</ins>INSERT:<ins class="diffchange diffchange-inline">''' </ins>note if any part of the OSF space is public-facing.)</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>To ensure that the evaluation is objective, the collaboration space does contain a space intended to be private to the evaluators. While ESIP will provide an OSF project with a private evaluator space at the start of the evaluation process, these spaces can be modified by the evaluation participants so consider where and how information is posted if you have concerns about access levels. </div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>To ensure that the evaluation is objective, the collaboration space does contain a space intended to be private to the evaluators. While ESIP will provide an OSF project with a private evaluator space at the start of the evaluation process, these spaces can be modified by the evaluation participants so consider where and how information is posted if you have concerns about access levels. </div></td></tr>
<tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l16" >Line 16:</td>
<td colspan="2" class="diff-lineno">Line 16:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>The collaboration space will be accessible to members of ESIP staff for administration purposes. For reference, the OSF user names of the staff will be provided to the participants. In addition, the evaluators space will be accessed during the report writing phase. </div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>The collaboration space will be accessible to members of ESIP staff for administration purposes. For reference, the OSF user names of the staff will be provided to the participants. In addition, the evaluators space will be accessed during the report writing phase. </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">""</del>INSERT:<del class="diffchange diffchange-inline">"" </del>policy for archiving the collaboration spaces, contingent on the capabilities of the OSF (can an archive be exported from the hosted platform at all?) and the features of that archive (if an archive can be exported, does it retain the permissions within the space?).</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">'''</ins>INSERT:<ins class="diffchange diffchange-inline">''' </ins>policy for archiving the collaboration spaces, contingent on the capabilities of the OSF (can an archive be exported from the hosted platform at all?) and the features of that archive (if an archive can be exported, does it retain the permissions within the space?).</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>===Draft and Final Reports===</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>===Draft and Final Reports===</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>This section is in progress and the text <del class="diffchange diffchange-inline">""</del>does not<del class="diffchange diffchange-inline">"" </del>reflect the final policies.</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>This section is in progress and the text <ins class="diffchange diffchange-inline">'''</ins>does not<ins class="diffchange diffchange-inline">''' </ins>reflect the final policies.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Release of final reports MAY depend on the organization requesting the evaluation. </div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Release of final reports MAY depend on the organization requesting the evaluation. </div></td></tr>
</table>Sscotthttps://wiki.esipfed.org/w/index.php?title=Evaluation_Privacy_Guidelines&diff=53648&oldid=prevSscott: Created page with ""Note: This document is currently being drafted and the text does not necessarily reflect the final policies and procedures of the evaluation process." ==Testbed Evaluation P..."2016-04-21T04:39:49Z<p>Created page with ""Note: This document is currently being drafted and the text does not necessarily reflect the final policies and procedures of the evaluation process." ==Testbed Evaluation P..."</p>
<p><b>New page</b></p><div>"Note: This document is currently being drafted and the text does not necessarily reflect the final policies and procedures of the evaluation process."<br />
<br />
==Testbed Evaluation Privacy Guidelines==<br />
<br />
The evaluation process is collaborative; however, there are some privacy expectations for the evaluators and the PIs. <br />
<br />
For PIs and other project members, it’s important to note that certain evaluation criteria assume that the codebase or other items are publicly available. However, we understand that this evaluation process may occur during a development cycle or involve a private codebase for other reasons. Please refer to (Tech Evaluation Thresholds | FPO) for the private codebase constraint. For the former, please note when providing access to the codebase (or other documents) if those items are intended to remain private so that the collaboration space can be managed correctly for those items. Evaluators are expected to respect the PIs’ privacy concerns in these matters. <br />
<br />
ESIP will continue to improve and assess the evaluation process itself. To do that, staff may access the evaluation documents, such as the TEF spreadsheets, for analysis purposes. The outcomes of any analyses may be made public to the ESIP community or the larger geosciences community through presentations or published articles. The analyses will anonymize the evaluators; PIs, due to the nature of the projects and the process, will not be anonymized. <br />
<br />
===Shared Collaboration Space===<br />
The TEF uses the Open Science Framework collaborative workspace for document sharing, working notes and other collaborative activities. For the most part, the way the space is used is up to the larger evaluation group. (""INSERT:"" note if any part of the OSF space is public-facing.)<br />
<br />
To ensure that the evaluation is objective, the collaboration space does contain a space intended to be private to the evaluators. While ESIP will provide an OSF project with a private evaluator space at the start of the evaluation process, these spaces can be modified by the evaluation participants so consider where and how information is posted if you have concerns about access levels. <br />
<br />
The collaboration space will be accessible to members of ESIP staff for administration purposes. For reference, the OSF user names of the staff will be provided to the participants. In addition, the evaluators space will be accessed during the report writing phase. <br />
<br />
""INSERT:"" policy for archiving the collaboration spaces, contingent on the capabilities of the OSF (can an archive be exported from the hosted platform at all?) and the features of that archive (if an archive can be exported, does it retain the permissions within the space?).<br />
<br />
===Draft and Final Reports===<br />
This section is in progress and the text ""does not"" reflect the final policies.<br />
<br />
* Release of final reports MAY depend on the organization requesting the evaluation. <br />
* We can assume the draft reports are confidential, where the drafts are provided to the PIs for a brief response period.<br />
* We can also assume that the final reports are confidential, delivered only to the PIs and the funding organization (or whoever is requesting the evaluation).<br />
* We have discussed analysis of the TEF spreadsheet and outcomes previously so, given the previous statements, what are the limits of the analysis and are those products public (if anonymized)?</div>Sscott