Difference between revisions of "Earth Science Data: Why So Difficult?"
From Earth Science Information Partners (ESIP)
Line 7: | Line 7: | ||
Interested in learning more about the technologies mentioned in this presentation? Here are some places to go and things to do: | Interested in learning more about the technologies mentioned in this presentation? Here are some places to go and things to do: | ||
=== Check out the [[Federated_Search|ESIP Federated Search cluster]] for distributed search on a shoestring === | === Check out the [[Federated_Search|ESIP Federated Search cluster]] for distributed search on a shoestring === | ||
− | === Explore the wonders of OPeNDAP === | + | === Explore the wonders of [http://opendap.org/ OPeNDAP] === |
* Get ASCII subsets of the data! Go to [http://acdisc.sci.gsfc.nasa.gov/opendap/HDF-EOS5/Aura_OMI_Level3/OMAERUVd.003//2010/OMI-Aura_L3-OMAERUVd_2010m0131_v003-2010m0202t014811.he5.html http://acdisc.sci.gsfc.nasa.gov/opendap/HDF-EOS5/Aura_OMI_Level3/OMAERUVd.003//2010/OMI-Aura_L3-OMAERUVd_2010m0131_v003-2010m0202t014811.he5.html], select the variables of interest and click ascii. | * Get ASCII subsets of the data! Go to [http://acdisc.sci.gsfc.nasa.gov/opendap/HDF-EOS5/Aura_OMI_Level3/OMAERUVd.003//2010/OMI-Aura_L3-OMAERUVd_2010m0131_v003-2010m0202t014811.he5.html http://acdisc.sci.gsfc.nasa.gov/opendap/HDF-EOS5/Aura_OMI_Level3/OMAERUVd.003//2010/OMI-Aura_L3-OMAERUVd_2010m0131_v003-2010m0202t014811.he5.html], select the variables of interest and click ascii. | ||
* View Level 3 gridded data in Panoply! | * View Level 3 gridded data in Panoply! |
Revision as of 17:31, February 3, 2010
Abstract
Assembling a multi-sensor set of data for, say, a volcanic eruption means days of wandering cyberspace to find data and pry it loose from the custom search interfaces that jealously guard it. Following the Search is a slog of weeks reading format and QA documents, then cobbling together code to beat the data into a form that can be used safely in analysis tools. Why so difficult?$%#@^%!???
Above rant to be followed by a (mostly) calm and rational discussion of ways toward a solution.
Presentation (PDF)
Further Exploration
Interested in learning more about the technologies mentioned in this presentation? Here are some places to go and things to do:
Check out the ESIP Federated Search cluster for distributed search on a shoestring
Explore the wonders of OPeNDAP
- Get ASCII subsets of the data! Go to http://acdisc.sci.gsfc.nasa.gov/opendap/HDF-EOS5/Aura_OMI_Level3/OMAERUVd.003//2010/OMI-Aura_L3-OMAERUVd_2010m0131_v003-2010m0202t014811.he5.html, select the variables of interest and click ascii.
- View Level 3 gridded data in Panoply!
- First, download Panoply, an easy to use Java-based viewer for netCDF, HDF and GRIB data
- Open up Panoply, go to File-> Open Remote File, and paste in the following URL (N.B.: without .html extension): http://acdisc.sci.gsfc.nasa.gov/opendap/HDF-EOS5/Aura_OMI_Level3/OMDOAO3e.003/2004/OMI-Aura_L3-OMDOAO3e_2004m1001_v003-2008m0222t095640.he5. (Hint: Try viewing ColumnAmountO3 with a Map Projection of Azimuthal Equidistant Centered on 0 E, -90 N, for a good look at the ozone hole.)
- Level 2 swath data coming soon to OPeNDAP!! (Allows IDV to display swaths.)
See what you can do with netCDF/CF-1 formatted data
- Convert AIRS L2 Swath to netCDF/CF-1 and view in IDV!
- First, download IDV
- Then, acquire the AIRS data in netCDF form (this URL will execute an on-the-fly reformatting.)
- Then us the Data Chooser to read the data in.
- Select a parameter under 2D-Grids in the Field Selector, and "Color-Shaded Plan View" under Displays. Hint: the CO_total_column parameter under the 2D grids shows carbon monoxide emanating from fires in Greece in Aug 2007.