Difference between revisions of "Interoperability and Technology"

From Earth Science Information Partners (ESIP)
 
(22 intermediate revisions by the same user not shown)
Line 5: Line 5:
 
== Get Involved==
 
== Get Involved==
  
The [https://www.esipfed.org/get-involved/collaborate/iti IT&I committee] provides a venue for a monthly community webinar on current Information Technology and Interoperability topics. In early years, the webinar series was known as the "IT&I Rants and Raves" a title the committee is bringing back starting in 2023.
+
The [https://www.esipfed.org/get-involved/collaborate/iti IT&I committee] provides a venue for a monthly community webinar on current Information Technology and Interoperability topics.  
  
'''Rants and Raves''' are designed to get smart people to share insightful, provocative views of what's great and what's not about technology and interoperability in modern Earth science. We welcome, high energy talks on personal pet peeves: topics that you can't believe in this day and age we're still dealing with, or solutions that you can't believe that in this day and age more people aren't using.
+
'''IT&I Seminars''' are designed to get smart people to share insightful, provocative views of what's great and what's not about technology and interoperability in modern Earth science.
  
 
* '''[http://lists.esipfed.org/mailman/listinfo/esip-interoperability Join the ESIP IT&I Email List]'''
 
* '''[http://lists.esipfed.org/mailman/listinfo/esip-interoperability Join the ESIP IT&I Email List]'''
Line 15: Line 15:
 
Upcoming meetings 3pm ET ([https://www.esipfed.org/get-involved/community-calendar calendar])
 
Upcoming meetings 3pm ET ([https://www.esipfed.org/get-involved/community-calendar calendar])
  
July 13th: [https://staff.ucar.edu/users/schuster Doug Schuster] - Tools to Assist Simulation Based Researchers in Deciding What Project Outputs to Preserve and Share
+
[[File:ITI_June_2024.png|thumb|IT&I June 2024]]
  
This presentation will highlight findings from the NSF EarthCube
+
June 13th: Evaluation and recommendation of practices for publication of reproducible data and software releases in the USGS - [https://www.usgs.gov/centers/community-for-data-integration-cdi/science/evaluation-and-recommendation-practices#overview Alicia Rhoades, Dave Blodgett, Ellen Brown, Jesse Ross.]
Research Coordination Network project titled “What About Model Data? -
 
Best Practices for Preservation and Replicability”
 
(https://modeldatarcn.github.io/), which suggest that most simulation
 
based research projects only need to preserve and share selected model
 
outputs, along with the full simulation experiment workflow to
 
communicate knowledge. Challenges related to meeting community open science
 
expectations will also be highlighted.
 
  
[[File:ITI_August_Quarto.png|thumb|IT&I Quarto August 10th]]
+
USGS Fundamental Science Practices recognize data and software as separate information product types. In practice, (e.g., in model application) data are rarely complete without workflow code and workflows are often treated as software that include data. This project assembled a cross mission area team to build an understanding of current practices and develop a recommended path. The project conducted 27 interviews with USGS employees with a wide range of staff roles from across the bureau. The project also analyzed existing data and software releases to establish an evidence base of current practices for implemented information products. The project team recommends that a workshop be held at the next Community for Data Integration face to face or other venue. The workshop should consider the sum total of the findings of this project and plan specific actions that the Community can take or recommendations that the Community can advocate to the Fundamental Science Practices Advisory Council or others.
  
August 10th: [https://cscheid.net/v2/ Carlos Scheidegger] - Learning to love the upside down: Quarto and the two data science worlds
+
[[File:ITI_July_2024.png|thumb|IT&I July 2024]]
  
There are two wonderful data science worlds. You can be a jupyter expert: you work on jupyter notebooks, with access to myriad Julia, Python, and R packages, and excellent technical documentation systems. You can also be a knitr and rmarkdown expert: you work on rmarkdown notebooks, with access to myriad Julia, Python, and R packages, and excellent technical documentation systems.
+
July 11th: Update on OGC GeoZarr Standards Working Group - [https://www.briannapagan.com/ Dr. Brianna Rita Pagán]
  
But what if your colleague works on the wrong side of the fence? What if you spent years learning one of them, only to find that the job you love is in an organization that uses the other? In this talk, I’m going to tell you about quarto, a system for technical communication (software documentation, academic papers, websites, etc) that aspires to let you choose any of these worlds.
+
Zarr is a cloud-native data format for n-dimensional arrays that enables access to data in compressed chunks of the original array. Zarr facilitates portability and interoperability on both object stores and hard disks.
 +
 
 +
As a generic data format, Zarr has increasingly become popular to use for geospatial purposes. As such, in June 2022, OGC endorsed Zarr V2.0 as an OGC Community Standard. The purpose of the GeoZarr SWG is to have an explicitly geospatial Zarr Standard (GeoZarr) adopted by OGC that establishes flexible and inclusive conventions for the Zarr cloud-native format that meet the diverse requirements of the geospatial domain. These conventions aim to provide a clear and standardized framework for organizing and describing data that ensures unambiguous representation.
  
If you’re one to worry about Conway’s law and what this two-worlds situation does to an organization’s talent pool, or if you live in one side of the world and want to be able to collaborate with folks on the other side, I think you’ll find something of value in what I have to say. 
 
  
I’m also going to complain about software, mostly the one I write. Mostly.
 
  
  

Latest revision as of 10:18, May 23, 2024

Welcome to the Information Technology and Interoperability Committee Wiki
Committee Chair: Dave Blodgett

Get Involved

The IT&I committee provides a venue for a monthly community webinar on current Information Technology and Interoperability topics.

IT&I Seminars are designed to get smart people to share insightful, provocative views of what's great and what's not about technology and interoperability in modern Earth science.

Upcoming meetings 3pm ET (calendar)

IT&I June 2024

June 13th: Evaluation and recommendation of practices for publication of reproducible data and software releases in the USGS - Alicia Rhoades, Dave Blodgett, Ellen Brown, Jesse Ross.

USGS Fundamental Science Practices recognize data and software as separate information product types. In practice, (e.g., in model application) data are rarely complete without workflow code and workflows are often treated as software that include data. This project assembled a cross mission area team to build an understanding of current practices and develop a recommended path. The project conducted 27 interviews with USGS employees with a wide range of staff roles from across the bureau. The project also analyzed existing data and software releases to establish an evidence base of current practices for implemented information products. The project team recommends that a workshop be held at the next Community for Data Integration face to face or other venue. The workshop should consider the sum total of the findings of this project and plan specific actions that the Community can take or recommendations that the Community can advocate to the Fundamental Science Practices Advisory Council or others.

IT&I July 2024

July 11th: Update on OGC GeoZarr Standards Working Group - Dr. Brianna Rita Pagán

Zarr is a cloud-native data format for n-dimensional arrays that enables access to data in compressed chunks of the original array. Zarr facilitates portability and interoperability on both object stores and hard disks.

As a generic data format, Zarr has increasingly become popular to use for geospatial purposes. As such, in June 2022, OGC endorsed Zarr V2.0 as an OGC Community Standard. The purpose of the GeoZarr SWG is to have an explicitly geospatial Zarr Standard (GeoZarr) adopted by OGC that establishes flexible and inclusive conventions for the Zarr cloud-native format that meet the diverse requirements of the geospatial domain. These conventions aim to provide a clear and standardized framework for organizing and describing data that ensures unambiguous representation.



ESIP Vision

To be a leader in promoting the collection, stewardship and use of Earth science data, information and knowledge that are responsive to societal needs.

Information Technology and Interoperability Committee

The Information Technology and Interoperability Committee of the ESIP Federation is a standing committee created to:

  • ensure that data, information and services can be readily exchanged and integrated to improve Earth science data, information, products and services; and
  • encourage the use of standards and protocols relevant to interoperability;
  • encourage the use of best information technology practices to ensure the quality, usability and breadth of standards and protocols relevant to interoperability.

Archive

ISRSE 2009 Demonstration Information

More recent technical workshop information is integrated into the meeting content pages accessible from the home page.

Summer 2007 Technical Workshops

Metadata Catalogs

Committee Members

Summer 2006 Technical Workshops

Winter 2007 Technical Breakouts

IT

Client Side Technology Infusion Working Group

2010 Rant and Raves Webinar Series and Telecon Information

Summer 2010 Technical Workshops

Solicitation for Outreach Package Development

Summer Meeting 2010, Knoxville, TN Meeting Notes

Winter Meeting 2011, Washington DC

2011 Rant and Raves Webinar Series and Telecon Information

Jluly 12-13 Summer Meeting, Santa Fe, NM