Difference between revisions of "Remote Sensing Information Gateway (RSIG)"

From Earth Science Information Partners (ESIP)
(Reverted edits by Michaele Brown (talk) to last revision by Michael E. Brown (Michaele brown))
 
(22 intermediate revisions by 5 users not shown)
Line 1: Line 1:
{{DataSystemProfile
+
The Remote Sensing Information Gateway (RSIG) is a tool for selecting, subsetting, downloading, assembling, and visualizing environmental data. After the data has been assembled, it can be stored on the user’s workstation, if desired. RSIG is developed by the US Environmental Protection Agency (EPA).
|DataSystemName=Remote Sensing Information Gateway (RSIG)
 
|DataSystemURL=http://linden.nesc.epa.gov/rsig/
 
|ContactName=Heidi Paulsen
 
|Contacte-mail=Paulsen.Heidi@epamail.epa.gov
 
|About=
 
:The RSIG applet allows users to interactively specify, visualize and save a subset of meteorological and air-quality data from a variety of sources including: NASA's Moderate Resolution Imaging Spectroradiometer (MODIS) and Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) satellite data, the National Oceanic and Atmospheric Administration's (NOAA) air quality forecasts, the Environmental Protection Agency's (EPA) Community Multi-scale Air Quality (CMAQ) model output, National Environmental Satellite, Data, and Information Service (NESDIS) biomass burning data, and AIRNow and Air Quality System (AQS) ground station measurements.
 
  
:Data subsets are interactively specified by user-selected variable,time-range and lon-lat box and quickly displayed together over a map and animated over time. Images and data may be saved on the user's computer in a variety of formats including: PNG, MPEG, KMZ, ASCII, XDR, NetCDF, and HDF for later analysis and integration with other applications.
+
The RSIG application is operated by selecting from among fifteen or so variables available from the following data sources:
 +
* NASA's [http://modis.gsfc.nasa.gov/ Moderate Resolution Imaging Spectroradiometer] (MODIS) satellite data
 +
* AIRNow data via the [http://www.airnowgateway.org/ AIRNow Gateway]
 +
* [http://www.epa.gov/ttn/airs/aqsdatamart/ Air Quality System] (AQS) data via the Air Quality Data Mart
 +
* EPA's [http://www.epa.gov/asmdnerl/CMAQ/index.html Community Multi-scale Air Quality (CMAQ)] model output
 +
* [http://www.star.nesdis.noaa.gov/star/AQ_emissions.php National Environmental Satellite, Data, and Information Service] (NESDIS) biomass burning data
 +
* [http://www.epa.gov/uvnet/access.html UVNet]
 +
* Ozone and PM2.5 Statistical Fused Air and Deposition Surfaces (SFADS) datasets originating from the [http://www.epa.gov/nerlesd1/land-sci/lcb/lcb_sads.html US EPA Landscape Characterization Branch]
  
:The RSIG applet accesses a set of remote OGC-WCS web server applications also developed at EPA and installed at the remote sites that store the data. By operating at the source, these servers and associated subset programs enable fast and convenient streaming of data subsets across the network to achieve an impressive response of "about a minute per day's worth of data". (Other applications, such as EGS and AirQuest, also benefit by utilizing these powerful server programs.)
+
More details on RSIG's data sources can be found at http://www.epa.gov/rsig.
  
|PresentationURL=http://linden.nesc.epa.gov/rsig/RSIG_architecture.pdf
+
The user runs RSIG to specify the time/spatial coordinates and the data products of interest. RSIG uses OGC-WCS-compliant servers/subsetter programs at remote sites, such as NASA Goddard or Sonoma Tech, to parse, aggregate, and subset data files on the data owner's server. RSIG then transfers to the user's workstation only the specified subset of data (variables, lon-lat box, time-range). Transmission volume over the Internet to the user is thereby greatly reduced (by three orders-of-magnitude) compared to the common approach of using FTP to transfer numerous large files.
|DataSystemHistory=n/a
 
|DataSystemAgencies=EPA
 
|DataSystemRef=n/a
 
|DataSystemDataSets=<br>
 
** AIRNow ground stations hourly Ozone and PM2.5 measurements. North America, 2003-present.
 
** AQS ground stations hourly and aggregated Ozone and PM2.5 measurements. North America, 1995-present.
 
** NESDIS Biomass Burning surface point values of PM2.5, CH4, CO2, CO, N2O, NH3, NOx, SO2, TNMHC. Currently selected week events in August 2005, July 2006, October 2007.
 
** NASA MODIS-4/6/7 satellite surface-integrated data including: Aerosol Optical Depth, Cloud Optical Thickness, Ozone, Pressure, Temperature, etc. Global 2000-present.
 
** NASA CALIPSO LIDAR satellite vertical data including: backscatter, pressure, temperature, ozone density, etc. Currently selected week events in August 2005, July 2006, October 2007.
 
** EPA CMAQ gridded model data including: O3, NO2, CO, PM25, WIND, etc. Currently Eastern US, 2001, August 2004, August 2005.
 
|DataSystemParam=See above
 
|PrimaryDataStorage=No. RSIG generally accesses data from other sources (and subsets it at the source).
 
|DataSystemValueConsolidation=Yes. RSIG visualizes data together over a map. It will also soon have the ability to regrid the data to a specified CMAQ grid to facilitate integration with other applications such as Hierarchical Baysian/Markov Chain Monte Carlo (HB/MCMC).
 
|DataSystemValueProcess=Yes. RSIG does subsetting, reformatting, conversion, and augmenting of data to facilitate visualization and subsequent analysis with other datasets. Examples include: aggregating across multiple files covering the user-specified date/time range, subsetting to a lon-lat box, striding over dense data points for fast visualization rasterization, decoding integer data to reals, lossless compression/decompression to speed-up transfer over the network, units conversion to SI and model-common units, data reordering to match model-common conventions such as ground-up, augmentation with longitude, latitude and elevation for each data value, and projecting and aggregating into model grid cells.
 
|DataSystemValueVis=Yes. RSIG provides a simple and quick interactive visualization of all data overlaid together on an appropriate map. It also has other custom visualizations such as a "curtain" for LIDAR data and other user-requested visualizations are planned.
 
|DataSystemValueDecisionSupport=Not presently. There are plans to enable RSIG to launch other applications such as HB/MCMC and visualize their results. Also, external applications such as AirQuest can utilize RSIG's WCS servers.
 
|EndtoEndIntegration=Not presently. There are plans for HB/MCMC launch and visualize...
 
|DataSystemValueOther=The primary value-added strengths of RSIG are its ease of use, performance and user-driven custom features.
 
|DataSystemArchInterop=RSIG uses Open Geospatial Consortium (OGC) Web Mapping Service (WMS) and Web Coverage Service (WCS) standards for specifying data subsets and a supports a variety of standard output formats (ASCII, NetCDF, KMZ, etc.) requested by users to enable data to be saved and input into other applications.
 
|DataSystemArchToolsMethods=RSIG components include an applet and set of documented WCS server applications and powerful subset and converter programs - all of which are freely available and accessible by others.  This applet/server/subset method has and will be reapplied to access additional data as requested by users and prioritized.
 
|DataSystemArchSecurity=Access outside the EPA is being addressed by installing the WCS servers and downloadable applet on the EPA Portal (badger.epa.gov).  This requires an EPA firewall modification to allow http-80 access from external computers to maple, an internal computer used for visualization.
 
|DataSystemArchUserFeedbck=
 
Principal Investigator:  Fred Dimmick, (919) 541-5537  and Jim Szykman (757)864-2709 Please send all questions and comments to RSIG developers directly at plessel.todd@epa.gov, 919-541-5500.  
 
}}
 
  
The Remote Sensing Information Gateway (RSIG) is a tool for selecting, downloading, assembling, and visualizing atmospheric data. After the data has been assembled, it can be stored on the user’s workstation, if desired. RSIG is developed by the US Environmental Protection Agency (EPA); see [[Image: rsig_10312007.pdf]] .
+
The RSIG Java client can then visualize the data on a latitude-longitude map, automatically locating the data in the correct geographic position.  
  
The RSIG application is operated by selecting from among fifteen or so variables available from the following data sources:
+
RSIG can also save the subset of data to a local disk in the following formats:
* NASA's Moderate Resolution Imaging Spectroradiometer (MODIS) and Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) data
+
* Binary External Data Representation (XDR) format (simple, efficient)
* Sonoma Tech's AIRNow and NOAA's Air Quality System (AQS) ozone and particulate-matter observations
+
* NetCDF-COARDS format
* EPA's Community Multiscale Air Quality (CMAQ) model output
+
* NetCDF-IOAPI format (regridding the data to a CMAQ grid)
* National Environmental Satellite, Data, and Information Service (NESDIS) biomass burning data
+
* HDF (unsubsetted satellite files)
 +
* ASCII tab-delimited spreadsheet
 +
* MCMC (used for input into HB model)
 +
* PNG images
 +
* MPG movies
 +
* KMZ movies (for display in Google Earth and similar applications)
 +
* GeoTIFF RGB format and 32-bit float format
 +
 
 +
== Access and Status ==
 +
The RSIG application is in use and evolving with new features and additional data sources. Users outside the EPA can access the application at http://www.epa.gov/rsig.
  
More details on RSIG's data sources can be found at http://linden.nesc.epa.gov/rsig/datainventory.html.
+
=== RSIG Update, May 1, 2009 ===
 +
On May 1, 2009, EMVL released a new version of RSIG. Among the new features and developments:
  
The application then assembles the data from local files or by submitting requests over the Internet to data repositories at NASA, NOAA, etc. RSIG then presents a visualization of the data on a latitude-longitude map, automatically locating the data in correct geographic position.  
+
* The entire 2002 CMAQ model output can be visualized and downloaded, including computed Aerosol Optical Depth (AOD) values
 +
* Images can now be saved in GeoTIFF RGB format and 32-bit float format. Both formats contain embedded georeferencing data, but the 32-bit float format has a rasterized/approximated data value at each pixel rather than a color.
 +
* RSIG now serves ozone and PM2.5 Statistical Fused Air and Deposition Surfaces (SFADS) datasets originating from the US EPA Landscape Characterization Branch.
 +
* RSIG can now optionally calculate and output Moderate Resolution Imaging Spectroradiometer (MODIS) polygon corners, enabling more accurate measurements by atmospheric researchers.
 +
* RSIG is now compatible with Internet Explorer 7.
  
RSIG uses program code that runs on NASA and NOAA servers to select and subset large datasets at the source computer center. Transmission over the Internet to the EPA is thereby accelerated compared to conventional techniques.
 
  
RSIG can save the collected data in the following formats:
+
== Java and Browser Requirements ==
* Binary External Data Representation (XDR) format
+
RSIG has a Web browser-based Java applet for interactive visualization.
* NetCDF format
 
* ASCII spreadsheet
 
* MPEG or PNG format files for visualized images
 
  
 +
RSIG requires Internet Explorer 7 or earlier, or Firefox 3 or earlier.
  
== Access and Status ==
+
'''Note:''' Run RSIG in its own browser window rather than in a browser tab. We have received reports of Java only partially redrawing the RSIG screen when switching between tabs. Running RSIG in its own browser window should alleviate this problem.
The RSIG documentation server is on the EPA Intranet at http://linden.nesc.epa.gov/rsig. The RSIG application is operable but is still in the final stages of development. The application can be accessed at http://rtpmeta.epa.gov/portal/rsig2D.html. All workstation users connected to the EPA network can access these servers. Those outside of the EPA network do not have access.
 
  
== Java Requirements ==
+
RSIG carries the following Java requirements:
RSIG is a Web browser-based application that runs as a Java applet. Therefore, RSIG carries the following Java requirements:
+
* Java Runtime Environment (JRE)
* Java Runtime Environment (JRE) 1.4 or better
+
* Configure Java memory to be larger than the default
 
* a .java.policy file saved to your Home directory. The .java.policy file is a simple text file that ensures you can save data from the RSIG applet to your computer.  
 
* a .java.policy file saved to your Home directory. The .java.policy file is a simple text file that ensures you can save data from the RSIG applet to your computer.  
  
The RSIG web site contains full information on installing the .java.policy file for Linux, UNIX, Mac OS, and Windows systems here: http://linden.nesc.epa.gov/rsig/javapolicy.html.
+
The RSIG web site contains full information on setting up Java for Linux, UNIX, Mac OS, and Windows systems, and includes the required .java.policy file.
 +
 
  
 
== Access to RSIG Data ==
 
== Access to RSIG Data ==
In addition to the Web browser-based Java applet, RSIG offers additional ways for researchers or applications to access data.
+
In addition to the Web browser-based Java applet, RSIG has an OGC-WCS/WMS-compliant web server application to enable streaming access to RSIG's data and images. This can effectively automate access to any data that RSIG can access and deliver the data to your application in various
 +
formats.
 +
For external users (outside the EPA network) use:
 +
http://www.epa.gov/rsig/. Refer to the site's section on "web Access to RSIG Data" for  usage examples.
  
''Streaming access.'' Applications with specific information needs can use RSIG's CGI scripts to enable streaming access to RSIG's data. This can effectively automate access to any data that RSIG can access and deliver the data to your application in the desired format. These scripts are in the review process, but are accessible within the EPA intranet. For more information: http://linden.nesc.epa.gov/rsig/rsig_cgi.html
+
== Sponsorship and Contacts ==
 
 
''Web server scripts.'' Assuming your application is running on an EPA computer inside the EPA firewall, then the application should access http://maple.rtpnc.epa.gov, which is the internal computer containing the web server scripts. (Tthe MODIS script is on a public NASA computer.) The scripts will eventually be hosted on external EPA computers for external/non-EPA clients. The server scripts are OGC-WCS-compliant. For more information: http://linden.nesc.epa.gov/rsig/webscripts.html
 
  
== Sponsorship and Contacts ==
+
The RSIG application has been sponsored and managed by the EPA Office of Research Development's (ORD) National Exposure Research Lab (NERL). The Principal Investigator is Dr. Jim Szykman. The application is being developed by the EPA's Environmental Modeling and Visualization Laboratory (EMVL).
  
The RSIG application has been sponsored and managed by ORD’s National Exposure Research Lab (NERL). Dr. Fred Dimmick, Chief of the Process Modeling Research Branch, is the responsible EPA manager. It is being developed by the EPA Environmental Modeling and Visualization Laboratory (EMVL).
+
* Dr. Jim Szykman, james.j.szykman@nasa.gov, EPA ORD (757) 864-2709
 +
* Heidi Paulsen, paulsen.heidi@epa.gov, EPA NCC (919) 541-1834
 +
* For technical support contact the EMVL contract developers:
 +
** Todd Plessel, plessel.todd@epa.gov, (919) 541-5500
 +
** Matt Freeman, freeman.matt@epa.gov, (919) 541-4293
  
* Dr. Fred Dimmick, dimmick.fred@epa.gov, EPA ORD (919) 541-5537
+
[[RSIG|See RSIG Data Summit Profile]]
* Dr. Joe Retzer, retzer.joseph@epa.gov, EPA NCC (919) 541-4190
 
* For technical information contact: Mike Uhl, uhl.mike@epa.gov, EPA EMVL (Lockheed Martin) (919) 541-4283
 

Latest revision as of 18:26, July 19, 2012

The Remote Sensing Information Gateway (RSIG) is a tool for selecting, subsetting, downloading, assembling, and visualizing environmental data. After the data has been assembled, it can be stored on the user’s workstation, if desired. RSIG is developed by the US Environmental Protection Agency (EPA).

The RSIG application is operated by selecting from among fifteen or so variables available from the following data sources:

More details on RSIG's data sources can be found at http://www.epa.gov/rsig.

The user runs RSIG to specify the time/spatial coordinates and the data products of interest. RSIG uses OGC-WCS-compliant servers/subsetter programs at remote sites, such as NASA Goddard or Sonoma Tech, to parse, aggregate, and subset data files on the data owner's server. RSIG then transfers to the user's workstation only the specified subset of data (variables, lon-lat box, time-range). Transmission volume over the Internet to the user is thereby greatly reduced (by three orders-of-magnitude) compared to the common approach of using FTP to transfer numerous large files.

The RSIG Java client can then visualize the data on a latitude-longitude map, automatically locating the data in the correct geographic position.

RSIG can also save the subset of data to a local disk in the following formats:

  • Binary External Data Representation (XDR) format (simple, efficient)
  • NetCDF-COARDS format
  • NetCDF-IOAPI format (regridding the data to a CMAQ grid)
  • HDF (unsubsetted satellite files)
  • ASCII tab-delimited spreadsheet
  • MCMC (used for input into HB model)
  • PNG images
  • MPG movies
  • KMZ movies (for display in Google Earth and similar applications)
  • GeoTIFF RGB format and 32-bit float format

Access and Status

The RSIG application is in use and evolving with new features and additional data sources. Users outside the EPA can access the application at http://www.epa.gov/rsig.

RSIG Update, May 1, 2009

On May 1, 2009, EMVL released a new version of RSIG. Among the new features and developments:

  • The entire 2002 CMAQ model output can be visualized and downloaded, including computed Aerosol Optical Depth (AOD) values
  • Images can now be saved in GeoTIFF RGB format and 32-bit float format. Both formats contain embedded georeferencing data, but the 32-bit float format has a rasterized/approximated data value at each pixel rather than a color.
  • RSIG now serves ozone and PM2.5 Statistical Fused Air and Deposition Surfaces (SFADS) datasets originating from the US EPA Landscape Characterization Branch.
  • RSIG can now optionally calculate and output Moderate Resolution Imaging Spectroradiometer (MODIS) polygon corners, enabling more accurate measurements by atmospheric researchers.
  • RSIG is now compatible with Internet Explorer 7.


Java and Browser Requirements

RSIG has a Web browser-based Java applet for interactive visualization.

RSIG requires Internet Explorer 7 or earlier, or Firefox 3 or earlier.

Note: Run RSIG in its own browser window rather than in a browser tab. We have received reports of Java only partially redrawing the RSIG screen when switching between tabs. Running RSIG in its own browser window should alleviate this problem.

RSIG carries the following Java requirements:

  • Java Runtime Environment (JRE)
  • Configure Java memory to be larger than the default
  • a .java.policy file saved to your Home directory. The .java.policy file is a simple text file that ensures you can save data from the RSIG applet to your computer.

The RSIG web site contains full information on setting up Java for Linux, UNIX, Mac OS, and Windows systems, and includes the required .java.policy file.


Access to RSIG Data

In addition to the Web browser-based Java applet, RSIG has an OGC-WCS/WMS-compliant web server application to enable streaming access to RSIG's data and images. This can effectively automate access to any data that RSIG can access and deliver the data to your application in various formats. For external users (outside the EPA network) use: http://www.epa.gov/rsig/. Refer to the site's section on "web Access to RSIG Data" for usage examples.

Sponsorship and Contacts

The RSIG application has been sponsored and managed by the EPA Office of Research Development's (ORD) National Exposure Research Lab (NERL). The Principal Investigator is Dr. Jim Szykman. The application is being developed by the EPA's Environmental Modeling and Visualization Laboratory (EMVL).

  • Dr. Jim Szykman, james.j.szykman@nasa.gov, EPA ORD (757) 864-2709
  • Heidi Paulsen, paulsen.heidi@epa.gov, EPA NCC (919) 541-1834
  • For technical support contact the EMVL contract developers:
    • Todd Plessel, plessel.todd@epa.gov, (919) 541-5500
    • Matt Freeman, freeman.matt@epa.gov, (919) 541-4293

See RSIG Data Summit Profile