IKONOS: Difference between revisions

From GRASS-Wiki
Jump to navigation Jump to search
m (→‎Calculate Planetary Reflectance: some important note on the DN to Radiance conversion example)
(remove hardcoded version specific urls, use latest version)
 
(46 intermediate revisions by 3 users not shown)
Line 1: Line 1:
= '''[This page is under construction]''' =
= Overview =


 
IKONOS is a commercial earth observation satellite. Details about the sensor are provided at Digital Globe's [http://www.digitalglobe.com/sites/default/files/DG_IKONOS_DS.pdf IKONOS Data Sheet]. [http://en.wikipedia.org/wiki/Ikonos Wikipedia's article on IKONOS] provides a nice overview as well.
IKONOS is a commercial earth observation satellite. Details about the sensor are provided at Digital Globe's [http://www.digitalglobe.com/sites/default/files/DG_IKONOS_DS.pdf IKONOS Data Sheet]


== Availability (Sample Data) ==
== Availability (Sample Data) ==
Line 10: Line 9:
* ISPRS provides a small [http://www.isprs.org/data/ikonos/ IKONOS data set], fragments from a Panchromatic image as well as from a Stereo product.
* ISPRS provides a small [http://www.isprs.org/data/ikonos/ IKONOS data set], fragments from a Panchromatic image as well as from a Stereo product.


== Pre-Processing Overview ==
 
== Modules overview ==
 
=== Outside of GRASS ===
 
Satellite imagery can be managed and, at some extent, pre-processed with various [http://www.gdal.org/gdal_utilities.html GDAL utilities].
 
 
* [http://www.gdal.org/gdalmanage.html gdalmanage]
* [http://www.gdal.org/gdalinfo.html gdalinfo]
* [http://www.gdal.org/gdal_translate.html gdal_translate]
* [http://www.gdal.org/gdalbuildvrt.html gdalbuildvrt]
* [http://www.gdal.org/gdalwarp.html gdalwarp]
 
=== Inside GRASS GIS ===
 
GRASS GIS features a complete set of modules and various add-ons enabling pre- and post-processing of IKONOS satellite imagery. The following lists offer an overview of related modules and add-ons.
 
 
* {{cmd|r.in.gdal}}
* {{cmd|r.mapcalc}}
* {{cmd|r.colors}}
* {{cmd|i.colors.enhance}}
* {{AddonSrc|imagery|i.fusion.hpf|version=7}}
* {{cmd|i.pansharpen}}
* [https://github.com/NikosAlexandris/i.ikonos.toar i.ikonos.toar]
* {{cmd|i.vi}}
* {{cmd|i.segment}}
 
== Pre-Processing ==
 
=== Overview ===


Typically, multispectral satellite data are converted into physical quantities such as ''Radiance'' or ''Reflectance'' before they are subjected in multispectral analysis techniques (image interpretation, band arithmetic, vegetation indices, matrix transformations, etc.). The latter can be differentiated in ''Top of Atmosphere Reflectance'' (ToAR) which does not account for atmospheric effects (absorption or scattering) and in ''Top of Canopy Reflectance'' (ToCR) which introduces a "correction" for atmospheric effects.
Typically, multispectral satellite data are converted into physical quantities such as ''Radiance'' or ''Reflectance'' before they are subjected in multispectral analysis techniques (image interpretation, band arithmetic, vegetation indices, matrix transformations, etc.). The latter can be differentiated in ''Top of Atmosphere Reflectance'' (ToAR) which does not account for atmospheric effects (absorption or scattering) and in ''Top of Canopy Reflectance'' (ToCR) which introduces a "correction" for atmospheric effects.




In order to derive Reflectance values, likewise as with remotely sensed data acquired by other sensors, IKONOS raw image digital numbers (DNs) need to be converted to ''at-sensor spectral Radiance'' values.  At-sensor spectral Radiance values are an important input for the equation to derive Reflectance values. Note, ''Spectal Radiance'' is the measure of the quantity of radiation that hits the sensor and typically expressed in <math>W * sr^−1 * m^−2 * nm^−1</math>, that is ''watts'' per ''unit source area'', per ''unit solid angle'', and per ''unit wavelength''.
In order to derive Reflectance values, likewise as with remotely sensed data acquired by other sensors, IKONOS raw image digital numbers (DNs) need to be converted to ''at-sensor spectral Radiance'' values.  At-sensor spectral Radiance values are an important input for the equation to derive Reflectance values. Note, ''Spectal Radiance'' is the measure of the quantity of radiation that hits the sensor and typically expressed in <math>\frac{W}{m^2*sr*nm}</math>, that is ''watts'' per ''unit source area'', per ''unit solid angle'', and per ''unit wavelength''.




Converting DNs to at-sensor Radiance can be done by using the following equation:
<ul>
* Converting DNs to at-sensor Radiance can be done by using the following equation:


<math>L\lambda = \frac{10^4 * DN\lambda}{CalCoef\lambda * Bandwidth\lambda}</math>
<math>L\lambda = \frac{10^4 * DN\lambda}{CalCoef\lambda * Bandwidth\lambda}</math>




Converting to Top of Atmosphere Reflectance, also referred to as Planetary Reflectance, can be done by using the following equation:
* Converting to Top of Atmosphere Reflectance, also referred to as Planetary Reflectance, can be done by using the following equation:
 
<math>\rho_p = \frac{\pi * L\lambda * d^2}{ESUN\lambda * cos(\Theta_S)}</math>


<math>\rho_p = \frac{\pi * L\lambda * d^2}{ESUN\lambda * cos(θ_S)}</math>


where:
<br />where:


<ul>
* <math>\rho</math> - Unitless Planetary Reflectance
* <math>\rho</math> - Unitless Planetary Reflectance
* <math>\pi</math> - mathematical constant (3.14159265358)
* <math>\pi</math> - mathematical constant (3.14159265358)
Line 34: Line 67:
* <math>d</math> - Earth-Sun distance in astronomical units, interpolated values
* <math>d</math> - Earth-Sun distance in astronomical units, interpolated values
* <math>Esun</math> - Mean solar exoatmospheric irradiance(s) (W/m2/μm), interpolated values
* <math>Esun</math> - Mean solar exoatmospheric irradiance(s) (W/m2/μm), interpolated values
* <math>cos(θ_s)</math> - Solar zenith angle, from the image acquisition's metadata
* <math>cos(\theta_s)</math> - {{wikipedia||Solar_zenith_angle}} from the image acquisition's metadata
</ul>
 
</ul>


== Modules overview ==
 
=== Importing data ===
 
==== File Formats & Metadata ====


''ToAdd''
''ToAdd''


== Pre-Processing ==
==== Importing ====
 
In the following example the publicly available IKONOS acqisition [ftp://ftp.glcf.umd.edu/glcf/China_earthquake_May_2008/IKONOS/po_58204_0000000.20001116.China-Sichuan/ po_58204_0000000.20001116.China-Sichuan] is used.
 


''ToAdd''
''ToAdd''
<ul>
* Location creation based on georeferenced data
</ul>
Once inside a Location that is defined by the spatial reference system in which the bands of interest are projected, they can be imported with the {{cmd|r.in.gdal}} module.
For example, GeoTIFF files can be imported by looping {{cmd|r.in.gdal}} over all of them
<source lang="bash">
for TIF in `echo *.tif`; do r.in.gdal in=${TIF} out=${TIF%%.*}; done
</source>
To keep the raw material untouched, we create another Mapset inside the same Location and copy over the bands giving, ''optionally'' at the same time, a new name for each.
<source lang="bash">
g.mapset -c pre-processing
g.copy rast=po_58204_blu_0000000,Blue_DNs
g.copy rast=po_58204_grn_0000000,Green_DNs
g.copy rast=po_58204_red_0000000,Red_DNs
g.copy rast=po_58204_nir_0000000,NIR_DNs
g.copy rast=po_58204_pan_0000000,Pan_DNs
</source>
=== Deriving Physical Quantities ===
Conversions are implemented in a GRASS module available at https://github.com/NikosAlexandris/i.ikonos.toar.


=== File Formats & Metadata ===


''ToAdd''
''Details''
 
Converting Digital Numbers to Radiance/Reflectance requires knowledge about the sensor's specific spectral band parameters. Those are, as extracted from the document ''IKONOS Planetary Reflectance and Mean Solar Exoatmospheric Irradiance'', by Martin Taylor (see references):
 
<source lang=bash>
Pan_CalCoef=161 ; Pan_Width=403 ; Pan_Esun=1375.8
Blue_CalCoef=728 ; Blue_Width=71.3 ; Blue_Esun=1930.9
Green_CalCoef=720 ; Green_Width=88.6 ; Green_Esun=1854.8
Red_CalCoef=949 ; Red_Width=65.8 ; Red_Esun=1556.5
NIR_CalCoef=843 ; NIR_Width=95.4 ; NIR_Esun=1156.9
</source>


=== Importing data ===
The following examples exemplify the conversion of raw Blue band digital numbers into Radiance and Reflectance.


''ToAdd''


=== Calculate Planetary Reflectance ===
==== Spectral Radiance ====


Converting a Blue Band (Digital Numbers) in to Spectral at-sensor Radiance in the ''correct'' units to be further used for the conversion in to unitless Reflectance:
Converting a Blue Band (Digital Numbers) in to Spectral at-sensor Radiance in the ''correct'' units to be further used for the conversion in to unitless Reflectance:


{{cmd|r.mapcalc}} <source lang="bash" enclose=none>"Blue_Radiance = ( (10000 * IKONOS_Blue_Band_DN) / (728 * 71.3) )"</source>
<source lang="bash">
# set the region
g.region rast=Blue_DNs -p
 
# convert DNs to spectral Radiance values
r.mapcalc "Blue_Radiance = ( (10000 * IKONOS_Blue_DNs) / (728 * 71.3) )"
</source>
 
==== Planetary Reflectance ====
 
The equation to derive Reflectance values incorporates in addition:
 
<ul>
* The mathematical constant {{wikipedia|Pi}} <source lang="bash" enclose=none>PI=3.14159265358</source>.
* The Earth-Sun distance in astronomical units which depends on the acquisition's day of year (DOY -- also referred to as Julian day, {{wikipedia|Ordinal_date}}) and can be retrieved from the following spreadsheet <http://landsathandbook.gsfc.nasa.gov/excel_docs/d.xls>.
* The mean solar exoatmospheric irradiance in <math>\frac{W}{m^2*\mu m}</math>. See 3rd column of (interplated) values given above.
* The cosine of the ''Solar Zenith Angle'' (SZA) at the time of the acquisition. The SZA can be calculated from its complementary ''Solar Elevation Angle'' (SEA) given in the image acquisition's metadata.
</ul>
 
 
In the following example we accept as the acquisition's <source lang="bash" enclose=none>DOY=166</source> and <source lang="bash" enclose=none>SEA=52.78880</source>. Hence, we get the Earth-Sun distance <source lang="bash" enclose=none>ESD=1.0157675</source> and <source lang="bash" enclose=none>SZA = 37.21120 deg</source>.
 


Converting the in-Blue spectral band at-sensor Radiance in to Planerary Reflectance:
Converting the in-Blue spectral band at-sensor Radiance in to Planerary Reflectance:


  {{cmd|r.mapcalc}} <source lang="bash" enclose=none>"Blue_Reflectance = ( ${PI} * Blue_Radiance * ${ESD}^2 ) / ( ${!BAND_Esun} * cos(${SZA}) )"</source>
<source lang="bash" enclose=none>PI=3.14159265358; ESD=1.0157675; BAND_Esun=1930.9; SZA=37.21120</source>
  {{cmd|r.mapcalc}} <source lang="bash" enclose=none>"Blue_Reflectance = ( ${PI} * Blue_Radiance * ${ESD}^2 ) / ( ${BAND_Esun} * cos(${SZA}) )"</source>
 
==== Automatising Conversions ====
 
The conversion process can be scripted to avoid repeating the same steps for each band separately.
 
===== Python =====
 
A custom python script, performing the operations of interest, might be like [https://github.com/NikosAlexandris/i.ikonos.toar i.ikonos.toar (for GRASS 7.x)]
===== Bash =====
In bash, such a script might be as the following example. '''Note,''' however, in this example script constants, band parameters and acquisition related metadata are hard-coded!
 
<source lang="bash">
#!/bin/bash
 
Pan_CalCoef=161 ; Pan_Width=403 ; Pan_Esun=1375.8
Blue_CalCoef=728 ; Blue_Width=71.3 ; Blue_Esun=1930.9
Green_CalCoef=720 ; Green_Width=88.6 ; Green_Esun=1854.8
Red_CalCoef=949 ; Red_Width=65.8 ; Red_Esun=1556.5
NIR_CalCoef=843 ; NIR_Width=95.4 ; NIR_Esun=1156.9
 
 
# set constants, band parameters and acquisition related metadata here!
 
# Pi, first 11 decimals
PI=3.14159265358
 
# Acquisition's Day of Year and estimated Earth-Sun Distance
DOY=166; ESD=1.0157675
 
# Sun Zenith Angle based on the acquisition's Sun Elevation Angle
SEA=52.78880; SZA=$(echo "90 - ${SEA}" | bc )
 
 
# bands to process
Spectral_Bands="Pan Blue Green Red NIR"


''ToAdd''
# loop over all bands
for BAND in ${Spectral_Bands}; do
 
  echo "Processing the ${BAND} spectral band"
 
  # set region
  g.region rast=${BAND}_DNs
 
  # set band parameters as variables
  eval BAND_CalCoef="${BAND}_CalCoef"
  eval BAND_Width="${BAND}_Width";
  echo "Band Parameters set to CalCoef=${!BAND_CalCoef}, Bandwidth=${!BAND_Width}"
 
  # conversion to Radiance
  r.mapcalc "${BAND}_Radiance = ( ( 10^4 * ${BAND}_DNs ) / ( ${!BAND_CalCoef} * ${!BAND_Width} ) )"
 
  # add info
  r.support map=${BAND}_Radiance \
  title="" \
  units="W / m2 / μm / ster" \
  description="At-sensor `echo ${BAND}` band spectral Radiance (W/m2/μm/sr)" \
  source1='"IKONOS Planetary Reflectance and Mean Solar Exoatmospheric Irradiance", by Martin Taylor, Geoeye'
 
  # set Earth-Sun distance
  eval BAND_Esun="${BAND}_Esun"; echo "Using Esun=${!BAND_Esun}"
 
  # calculate ToAR
  r.mapcalc "${BAND}_ToAR = \
( ${PI} * ${BAND}_Radiance * ${ESD}^2 ) / ( ${!BAND_Esun} * cos(${SZA}) )"
 
  # add some metadata
  r.support map=${BAND}_ToAR \
  title="echo ${BAND} band (Top of Atmosphere Reflectance)" \
  units="Unitless" \
  description="Top of Atmosphere `echo ${BAND}` band spectral Reflectance (unitless)" \
  source1='"IKONOS Planetary Reflectance and Mean Solar Exoatmospheric Irradiance", by Martin Taylor, Geoeye' \
  source2="e.g., the Image Provider!" \
  history="PI=3.14159265358; ESD=1.0157675; BAND_Esun=1930.9; SZA=37.21120"
 
done
</source>


=== Atmospheric correction ===
=== Atmospheric correction ===
Line 68: Line 244:
See [[Atmospheric correction]]
See [[Atmospheric correction]]


=== Color composites ===
== Post-Processing ==
 
Having beforehand satellite image data expressed in physical quantities (radiance or reflectance) is preferred to follow-up with digital image analysis techniques. A few common post-processing practices are Contrast-Enhancement, Pan-Sharpening and creating Pseudo- or True-Color Composites. Other well known enhancing manipualtions to support the analyses of satellite imagery, include deriving Vegetation Indices, transforming multi-spectral data based on [[Principal_Components_Analysis | PCA]] and Segmenting images.
 
=== Contrast Enhancement ===
 
''ToAdd''
 
=== Pan-Sharpening ===
 
[http://en.wikipedia.org/wiki/Pansharpened_image Pan-Sharpening] / [http://en.wikipedia.org/wiki/Image_fusion Fusion] is the process of merging high-resolution panchromatic and lower resolution multi-spectral imagery. [http://grass.osgeo.org/grass70/ GRASS 7] holds a dedicated pan-sharpening module, {{cmd|i.pansharpen}} which features three techniques for sharpening, namely the [http://wiki.awf.forst.uni-goettingen.de/wiki/index.php/Brovey_Transformation Brovey transformation], the classical IHS method and one that is based on [[Principal Components Analysis]] (PCA). Another algorithm deriving excellent detail and a realistic representation of original multispectral scene colors, is the High-Pass Filter Addition (HPFA) technique. It is available through the add-on {{AddonSrc|imagery|i.fusion.hpf|version=7}} (for GRASS 6, please refer to a bash shell script https://github.com/NikosAlexandris/i.fusion.hpf.sh which is, however, unmaintained).
 
 
One approach inside GRASS-GIS to get an acceptable color-balanced composite image after Pan-sharpening 11-bit IKONOS spectral bands comprises the following steps
 
<ul>
# rescale the 11-bit IKONOS spectral bands to 8-bit ranging in [0, 255] ({{cmd|r.rescale}})
# pan-sharpen with any of the featured methods (Brovey, IHS, PCA) ({{cmd|i.pansharpen}})
# color-balance by using the {{cmd|i.landsat.rgb}} module or manually adjusting the color tables of the bands of interest
# create a composite image by using the {{cmd|r.compose}} module
</ul>
 
==== Example Instructions for {{cmd|i.pansharpen}} ====
 
{{cmd|i.pansharpen}} works fine with 8-bit raster maps as an input. If the data to be processed are out of this range, that is out of <math>[0, 255]</math>, they can be rescaled to fit into this range by using GRASS' {{cmd|r.rescale}} module.
 
 
Given an IKONOS set of 11-bit spectral bands (Blue, Green, Red, NIR and Pan) ranging between <math>[0, 2047]</math>, and then querying for example the Blue band
<source lang="bash" enclose=none>r.info Blue_DNs -r</source>, would return
 
<source lang="bash">
min=0
max=2047
</source>
 
===== Rescaling single bands =====
 
Rescaling the Blue band to range between `[0, 255]`
<source lang="bash">
r.rescale in=Blue_DNs out=Blue_DNs_255 from=0,2047 to=0,255
</source>
 
The same step applies to both the rest of the multi-spectral bands and the Panchromatic band of interest. If working under Bash, To repeat the same command (given, it was the last on used in the GRASS' terminal), one can isntruct
 
<source lang="bash">
!!:gs/Blue/Green
</source>
 
This would substitute everywhere found on the last command the string "Blue" with the string "Green" and re-execute it.  The same can be done for the rest of the bands, namely Red, NIR and Pan. Some attention is required to instruct substitution of the ''last'' used string.
 
===== Rescaling all bands at once =====
 
Of course, one can always use a ''for'' loop
 
<source lang="bash">
for DN in `g.mlist rast pat=*DNs`; do r.rescale in=${DN} out=${DN}_255 from=0,2047 to=0,255; done
</source>
 
===== Pan-Sharpening =====
 
As usual when working with GRASS, it is required to set the region of interest, i.e. <source lang="bash" enclose=none>g.region rast=Blue_DNs_255</source> to match the extent of the band(s) or else. The resolution itself is taken care in this particular case by the module and the resulting pan-sharpened raster maps will of the same high(er) resolution as the Panchromatic band.
 
 
An example command for an IHS-based Pan-Sharpening action might look like
 
<source lang="bash">
i.pansharpen pan=Pan_DNs_255 ms1=Blue_DNs_255 ms2=Green_DNs_255 ms3=Red_DNs_255 output=sharptest255 sharpen=ihs
</source>
 
===== Color Re-Balancnig =====
 
After the process completion, the module outputs
 
<source lang="bash">
...
The following pan-sharpened output maps have been generated:
sharptest255_red
sharptest255_green
sharptest255_blue
 
To visualize output, run: g.region -p rast=sharptest255.red
d.rgb r=sharptest255_red g=sharptest255_green b=sharptest255_blue
 
If desired, combine channels into a single RGB map with 'r.composite'.
</source>
 
Normally it should be enough to re-balance the colors after the pan-sharpening action by using for example the {{cmd|i.landsat.rgb}} module or manual adjustment of each of the three bands that would compose an RGB image.
 
<source lang="bash">
i.landsat.rgb r=sharptest255_red g=sharptest255_green b=sharptest255_blue -p
</source>
 
===== Automatising Sharpening & RGB Composition =====
 
An ''experimental'' bash script to automatise the sharpening/fusion and RGB composition process is demonstrated here. The script uses the Spectral Reflectance values (double precision values), gained from previous steps (see above), and produces Pan-sharpened images by applying all of the three methods that {{addon|i.pansharpen}} offers. In addition, it attempts to produce True-Color composite images, without and with re-balancing the color tables by using the {{cmd|i.landsat.rgb}} module.
 
 
Initial tests indicate that at least one of the three sharpening methods, combined with re-balancing, produces very clear and balanced True-Color composites. Note, there is no 100% confidence that it will produce nice looking True-Color composites. Some of the methods might simply work, others might deliver fancy-colored images. As usual, some manual action might be required to get the re-balancing to work as best as possible.
 
 
The script can be expanded in terms of using more inputs by utilising bash's positional parameters.  However, care has to be taken to alter the instruction that concerns the conversion from double precision values to 8-bit integers.
 
 
<source lang="bash">
#!/bash/sh
 
# use in G7 only :-)
 
 
echo "Rescaling all images to 8-bit"
# convert to 8-bit first :-!
for Method_Input in \
"Pan ToAR" \
"Blue ToAR" \
"Green ToAR" \
"Red ToAR" \
"NIR ToAR"
 
do
 
  # parse "${Method_STR}" and set positional parameters
  set -- $Method_Input ; echo -e "\n" #echo $1 $2
 
 
  # input BAND is...
  eval BAND="${1}_${2}"
 
  # set region
  g.region rast=${BAND}
 
  # integerise
  r.mapcalc --v \
  "${BAND}_integerised = round( 1000000 * ${BAND} )" # how many decimals?
 
  # integerised BAND is...
  eval BAND="${1}_${2}_integerised"
 
  # get ${min} and ${max}
  eval `r.info -r ${BAND}`
 
  #
  r.rescale in=${1}_${2}_integerised out=${1}_${2}_255 from=${min},${max} to=0,255
 
done ########################################################################
echo "Rescaling done!"
 
 
# pan-sharpen High Resolution imagery ---------------------------------------
# needs setting some naming conventions
for Method_Input in \
"ihs ToAR" \
"brovey ToAR" \
"pca ToAR"
 
do
 
  # parse "${Method_STR}" and set positional parameters
  set -- $Method_Input ; echo $1 $2
 
  # some echo
  echo "Pan-Sharpening the <${2}> images based on the <${1}> method"
 
  i.pansharpen \
  sharpen=${1} \
  pan=Pan_${2}_255 \
  ms1=Blue_${2}_255 \
  ms2=Green_${2}_255 \
  ms3=Red_${2}_255 \
  output=sharp_${1}_${2}_255
 
done ########################################################################
 
 
# compose BGRs --------------------------------------------------------------
 
# loop over Methods and Input Types, compose RGBs
for Method_Input in \
"ihs ToAR" \
"brovey ToAR" \
"pca ToAR"
 
do
 
  # parse "${Method_STR}" and set positional parameters
  set -- $Method_Input ; echo $1 $2
 
  # region
  g.region rast=sharp_"${1}"_"${2}"_255_blue
 
  # compose
  r.composite --o \
  r=sharp_"${1}"_"${2}"_255_red \
  g=sharp_"${1}"_"${2}"_255_green \
  b=sharp_"${1}"_"${2}"_255_blue \
  out=rgb_sharpened_"${1}"_"${2}"_255
 
done #######################################################################
 
 
# re-balance & re-compose colors --------------------------------------------
 
for Method_Input in \
"ihs ToAR" \
"brovey ToAR" \
"pca ToAR"
 
do
 
  # parse "${Method_STR}" and set positional parameters
  set -- $Method_Input ; echo $1 $2
 
  # re-balance
  i.landsat.rgb -p \
  r=sharp_"${1}"_"${2}"_255_red \
  g=sharp_"${1}"_"${2}"_255_green \
  b=sharp_"${1}"_"${2}"_255_blue
 
  # region -- Really necessary, again?
  g.region rast=sharp_"${1}"_"${2}"_255_blue
 
  # re-compose
  r.composite --o \
  r=sharp_"${1}"_"${2}"_255_red \
  g=sharp_"${1}"_"${2}"_255_green \
  b=sharp_"${1}"_"${2}"_255_blue \
  out=rgb_sharpened_"${1}"_"${2}"_255_rebalanced
 
done ########################################################################
</source>
 
 
==== Pan-Sharpening based on the HPFA technique ====
 
The technique, implemented via the GRASS add-on {{AddonSrc|imagery|i.fusion.hpf|version=7}}, as indicated above, involves a convolution using a High Pass Filter (HPF) on the high resolution data, then combining this with the lower resolution multispectral data.
 
 
''Source: "Optimizing the High-Pass Filter Addition Technique for Image Fusion", Ute G. Gangkofner, Pushkar S. Pradhan, and Derrold W. Holcomb (2008)''
 
 
The algorithm's steps are:
 
# Computing the ratio of the low (Multi-Spectral) to the high (Panchromatic) resolution
# High Pass Filtering the Panchromatic Image
# Resampling the Multi-Spectral image to the higher resolution
# Adding a weighted High-Pass-Filtered image to the upsampled Multi-Spectral image
# Optionally, matching the histogram of the Pan-Sharpened image to the one of the original Multi-Spectral image
 
=== Color Composites ===


''ToAdd''
''ToAdd''


=== Pan Sharpening ===
== Vegetation Indices ==
 
''ToAdd''
 
== PCA ==


''ToAdd''
''ToAdd''
Line 82: Line 509:
== References / Sources ==
== References / Sources ==


* http://www.apollomapping.com/wp-content/user_uploads/2011/09/IKONOS_Esun_Calculations.pdf
* [http://www.apollomapping.com/wp-content/user_uploads/2011/09/IKONOS_Esun_Calculations.pdf IKONOS Planetary Reflectance and Me an Solar Exoatmospheric Irradiance, by Martin Taylor]
* http://web.unicen.edu.ar/crecic/docs/radrefl.pdf
* [http://web.unicen.edu.ar/crecic/docs/radrefl.pdf Ikonos DN Value Conversion to Planetary Reflectance Values, by David Fleming]
* Some short presentation about the DN to Reflectance conevrsion: [http://igett.delmar.edu/Resources/Remote%20Sensing%20Technology%20Training/Calculation-DN_to_Reflectance_Irish_20June08.pdf Calibrated Landsat Digital Number (DN) to Top of Atmosphere (TOA) Reflectance Conversion, by Richard Irish]
* [http://landsathandbook.gsfc.nasa.gov/data_prod/prog_sect11_3.html Landsat7 Science Data Users Handbook, Chapter 11, Section 3]
* [http://igett.delmar.edu/Resources/Remote%20Sensing%20Technology%20Training/Calculation-DN_to_Reflectance_Irish_20June08.pdf Calibrated Landsat Digital Number (DN) to Top of Atmosphere (TOA) Reflectance Conversion, by Richard Irish]
* from [http://landsat.usgs.gov/tools_access_all_faqs.php FAQs about the Landsat Missions]
** [http://landsat.usgs.gov/how_is_radiance_calculated.php How is radiance calculated?]
** [http://landsat.usgs.gov/at_sensor_reflectance_calculated.php How is at-sensor reflectance calculated?]


== See also ==
== See also ==
Line 97: Line 528:
[[Category: FAQ]]
[[Category: FAQ]]
[[Category: IKONOS]]
[[Category: IKONOS]]
[[Category: Image processing]]
[[Category: High Resolution]]
[[Category: Import]]
[[Category: Import]]
[[Category: Digital Numbers]]
[[Category: Digital Numbers]]
[[Category: Radiance]]
[[Category: Radiance]]
[[Category: Reflectance]]
[[Category: Reflectance]]
[[Category: Image processing]]

Latest revision as of 10:05, 4 December 2018

Overview

IKONOS is a commercial earth observation satellite. Details about the sensor are provided at Digital Globe's IKONOS Data Sheet. Wikipedia's article on IKONOS provides a nice overview as well.

Availability (Sample Data)


Modules overview

Outside of GRASS

Satellite imagery can be managed and, at some extent, pre-processed with various GDAL utilities.


Inside GRASS GIS

GRASS GIS features a complete set of modules and various add-ons enabling pre- and post-processing of IKONOS satellite imagery. The following lists offer an overview of related modules and add-ons.


Pre-Processing

Overview

Typically, multispectral satellite data are converted into physical quantities such as Radiance or Reflectance before they are subjected in multispectral analysis techniques (image interpretation, band arithmetic, vegetation indices, matrix transformations, etc.). The latter can be differentiated in Top of Atmosphere Reflectance (ToAR) which does not account for atmospheric effects (absorption or scattering) and in Top of Canopy Reflectance (ToCR) which introduces a "correction" for atmospheric effects.


In order to derive Reflectance values, likewise as with remotely sensed data acquired by other sensors, IKONOS raw image digital numbers (DNs) need to be converted to at-sensor spectral Radiance values. At-sensor spectral Radiance values are an important input for the equation to derive Reflectance values. Note, Spectal Radiance is the measure of the quantity of radiation that hits the sensor and typically expressed in Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \frac{W}{m^2*sr*nm}} , that is watts per unit source area, per unit solid angle, and per unit wavelength.


    • Converting DNs to at-sensor Radiance can be done by using the following equation:
    • Converting to Top of Atmosphere Reflectance, also referred to as Planetary Reflectance, can be done by using the following equation:
    Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \rho_p = \frac{\pi * L\lambda * d^2}{ESUN\lambda * cos(\Theta_S)}}
    where:
      • Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \rho} - Unitless Planetary Reflectance
      • Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \pi} - mathematical constant (3.14159265358)
      • Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle L\lambda} spectral Radiance at the sensor's aperture, from equation... ToADD
      • Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle d} - Earth-Sun distance in astronomical units, interpolated values
      • Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle Esun} - Mean solar exoatmospheric irradiance(s) (W/m2/μm), interpolated values
      • Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle cos(\theta_s)} - Solar_zenith_angle from the image acquisition's metadata


Importing data

File Formats & Metadata

ToAdd

Importing

In the following example the publicly available IKONOS acqisition po_58204_0000000.20001116.China-Sichuan is used.


ToAdd

    • Location creation based on georeferenced data


Once inside a Location that is defined by the spatial reference system in which the bands of interest are projected, they can be imported with the r.in.gdal module.

For example, GeoTIFF files can be imported by looping r.in.gdal over all of them

for TIF in `echo *.tif`; do r.in.gdal in=${TIF} out=${TIF%%.*}; done

To keep the raw material untouched, we create another Mapset inside the same Location and copy over the bands giving, optionally at the same time, a new name for each.

g.mapset -c pre-processing
g.copy rast=po_58204_blu_0000000,Blue_DNs
g.copy rast=po_58204_grn_0000000,Green_DNs
g.copy rast=po_58204_red_0000000,Red_DNs
g.copy rast=po_58204_nir_0000000,NIR_DNs
g.copy rast=po_58204_pan_0000000,Pan_DNs

Deriving Physical Quantities

Conversions are implemented in a GRASS module available at https://github.com/NikosAlexandris/i.ikonos.toar.


Details


Converting Digital Numbers to Radiance/Reflectance requires knowledge about the sensor's specific spectral band parameters. Those are, as extracted from the document IKONOS Planetary Reflectance and Mean Solar Exoatmospheric Irradiance, by Martin Taylor (see references):

 Pan_CalCoef=161	;	Pan_Width=403		;	Pan_Esun=1375.8
 Blue_CalCoef=728	;	Blue_Width=71.3		;	Blue_Esun=1930.9
 Green_CalCoef=720	;	Green_Width=88.6	;	Green_Esun=1854.8
 Red_CalCoef=949	;	Red_Width=65.8		;	Red_Esun=1556.5
 NIR_CalCoef=843	;	NIR_Width=95.4		;	NIR_Esun=1156.9

The following examples exemplify the conversion of raw Blue band digital numbers into Radiance and Reflectance.


Spectral Radiance

Converting a Blue Band (Digital Numbers) in to Spectral at-sensor Radiance in the correct units to be further used for the conversion in to unitless Reflectance:

# set the region
g.region rast=Blue_DNs -p

# convert DNs to spectral Radiance values
r.mapcalc "Blue_Radiance = ( (10000 * IKONOS_Blue_DNs) / (728 * 71.3) )"

Planetary Reflectance

The equation to derive Reflectance values incorporates in addition:

    • The mathematical constant Pi PI=3.14159265358.
    • The Earth-Sun distance in astronomical units which depends on the acquisition's day of year (DOY -- also referred to as Julian day, Ordinal_date) and can be retrieved from the following spreadsheet <http://landsathandbook.gsfc.nasa.gov/excel_docs/d.xls>.
    • The mean solar exoatmospheric irradiance in Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \frac{W}{m^2*\mu m}} . See 3rd column of (interplated) values given above.
    • The cosine of the Solar Zenith Angle (SZA) at the time of the acquisition. The SZA can be calculated from its complementary Solar Elevation Angle (SEA) given in the image acquisition's metadata.


In the following example we accept as the acquisition's DOY=166 and SEA=52.78880. Hence, we get the Earth-Sun distance ESD=1.0157675 and SZA = 37.21120 deg.


Converting the in-Blue spectral band at-sensor Radiance in to Planerary Reflectance:

PI=3.14159265358; ESD=1.0157675; BAND_Esun=1930.9; SZA=37.21120
r.mapcalc "Blue_Reflectance = ( ${PI} * Blue_Radiance * ${ESD}^2 ) / ( ${BAND_Esun} * cos(${SZA}) )"

Automatising Conversions

The conversion process can be scripted to avoid repeating the same steps for each band separately.

Python

A custom python script, performing the operations of interest, might be like i.ikonos.toar (for GRASS 7.x)

Bash

In bash, such a script might be as the following example. Note, however, in this example script constants, band parameters and acquisition related metadata are hard-coded!

#!/bin/bash

Pan_CalCoef=161		;	Pan_Width=403		;	Pan_Esun=1375.8
Blue_CalCoef=728	;	Blue_Width=71.3		;	Blue_Esun=1930.9
Green_CalCoef=720	;	Green_Width=88.6	;	Green_Esun=1854.8
Red_CalCoef=949		;	Red_Width=65.8		;	Red_Esun=1556.5
NIR_CalCoef=843		;	NIR_Width=95.4		;	NIR_Esun=1156.9


# set constants, band parameters and acquisition related metadata here!

# Pi, first 11 decimals
PI=3.14159265358

# Acquisition's Day of Year and estimated Earth-Sun Distance
DOY=166; ESD=1.0157675

# Sun Zenith Angle based on the acquisition's Sun Elevation Angle
SEA=52.78880; SZA=$(echo "90 - ${SEA}" | bc )


# bands to process
Spectral_Bands="Pan Blue Green Red NIR"

# loop over all bands
for BAND in ${Spectral_Bands}; do

  echo "Processing the ${BAND} spectral band"

  # set region
  g.region rast=${BAND}_DNs

  # set band parameters as variables
  eval BAND_CalCoef="${BAND}_CalCoef"
  eval BAND_Width="${BAND}_Width";
  echo "Band Parameters set to CalCoef=${!BAND_CalCoef}, Bandwidth=${!BAND_Width}"

  # conversion to Radiance
  r.mapcalc "${BAND}_Radiance = ( ( 10^4 * ${BAND}_DNs ) / ( ${!BAND_CalCoef} * ${!BAND_Width} ) )"

  # add info
  r.support map=${BAND}_Radiance \
  title="" \
  units="W / m2 / μm / ster" \
  description="At-sensor `echo ${BAND}` band spectral Radiance (W/m2/μm/sr)" \
  source1='"IKONOS Planetary Reflectance and Mean Solar Exoatmospheric Irradiance", by Martin Taylor, Geoeye'

  # set Earth-Sun distance
  eval BAND_Esun="${BAND}_Esun"; echo "Using Esun=${!BAND_Esun}"

  # calculate ToAR
  r.mapcalc "${BAND}_ToAR = \
	( ${PI} * ${BAND}_Radiance * ${ESD}^2 ) / ( ${!BAND_Esun} * cos(${SZA}) )"

  # add some metadata
  r.support map=${BAND}_ToAR \
  title="echo ${BAND} band (Top of Atmosphere Reflectance)" \
  units="Unitless" \
  description="Top of Atmosphere `echo ${BAND}` band spectral Reflectance (unitless)" \
  source1='"IKONOS Planetary Reflectance and Mean Solar Exoatmospheric Irradiance", by Martin Taylor, Geoeye' \
  source2="e.g., the Image Provider!" \
  history="PI=3.14159265358; ESD=1.0157675; BAND_Esun=1930.9; SZA=37.21120"

done

Atmospheric correction

See Atmospheric correction

Post-Processing

Having beforehand satellite image data expressed in physical quantities (radiance or reflectance) is preferred to follow-up with digital image analysis techniques. A few common post-processing practices are Contrast-Enhancement, Pan-Sharpening and creating Pseudo- or True-Color Composites. Other well known enhancing manipualtions to support the analyses of satellite imagery, include deriving Vegetation Indices, transforming multi-spectral data based on PCA and Segmenting images.

Contrast Enhancement

ToAdd

Pan-Sharpening

Pan-Sharpening / Fusion is the process of merging high-resolution panchromatic and lower resolution multi-spectral imagery. GRASS 7 holds a dedicated pan-sharpening module, i.pansharpen which features three techniques for sharpening, namely the Brovey transformation, the classical IHS method and one that is based on Principal Components Analysis (PCA). Another algorithm deriving excellent detail and a realistic representation of original multispectral scene colors, is the High-Pass Filter Addition (HPFA) technique. It is available through the add-on i.fusion.hpf (src) (for GRASS 6, please refer to a bash shell script https://github.com/NikosAlexandris/i.fusion.hpf.sh which is, however, unmaintained).


One approach inside GRASS-GIS to get an acceptable color-balanced composite image after Pan-sharpening 11-bit IKONOS spectral bands comprises the following steps

    1. rescale the 11-bit IKONOS spectral bands to 8-bit ranging in [0, 255] (r.rescale)
    2. pan-sharpen with any of the featured methods (Brovey, IHS, PCA) (i.pansharpen)
    3. color-balance by using the i.landsat.rgb module or manually adjusting the color tables of the bands of interest
    4. create a composite image by using the r.compose module

Example Instructions for i.pansharpen

i.pansharpen works fine with 8-bit raster maps as an input. If the data to be processed are out of this range, that is out of Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [0, 255]} , they can be rescaled to fit into this range by using GRASS' r.rescale module.


Given an IKONOS set of 11-bit spectral bands (Blue, Green, Red, NIR and Pan) ranging between Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [0, 2047]} , and then querying for example the Blue band r.info Blue_DNs -r, would return

min=0
max=2047
Rescaling single bands

Rescaling the Blue band to range between `[0, 255]`

r.rescale in=Blue_DNs out=Blue_DNs_255 from=0,2047 to=0,255

The same step applies to both the rest of the multi-spectral bands and the Panchromatic band of interest. If working under Bash, To repeat the same command (given, it was the last on used in the GRASS' terminal), one can isntruct

!!:gs/Blue/Green

This would substitute everywhere found on the last command the string "Blue" with the string "Green" and re-execute it. The same can be done for the rest of the bands, namely Red, NIR and Pan. Some attention is required to instruct substitution of the last used string.

Rescaling all bands at once

Of course, one can always use a for loop

for DN in `g.mlist rast pat=*DNs`; do r.rescale in=${DN} out=${DN}_255 from=0,2047 to=0,255; done
Pan-Sharpening

As usual when working with GRASS, it is required to set the region of interest, i.e. g.region rast=Blue_DNs_255 to match the extent of the band(s) or else. The resolution itself is taken care in this particular case by the module and the resulting pan-sharpened raster maps will of the same high(er) resolution as the Panchromatic band.


An example command for an IHS-based Pan-Sharpening action might look like

i.pansharpen pan=Pan_DNs_255 ms1=Blue_DNs_255 ms2=Green_DNs_255 ms3=Red_DNs_255 output=sharptest255 sharpen=ihs
Color Re-Balancnig

After the process completion, the module outputs

...
The following pan-sharpened output maps have been generated:
sharptest255_red
sharptest255_green
sharptest255_blue

To visualize output, run: g.region -p rast=sharptest255.red
d.rgb r=sharptest255_red g=sharptest255_green b=sharptest255_blue

If desired, combine channels into a single RGB map with 'r.composite'.

Normally it should be enough to re-balance the colors after the pan-sharpening action by using for example the i.landsat.rgb module or manual adjustment of each of the three bands that would compose an RGB image.

i.landsat.rgb r=sharptest255_red g=sharptest255_green b=sharptest255_blue -p
Automatising Sharpening & RGB Composition

An experimental bash script to automatise the sharpening/fusion and RGB composition process is demonstrated here. The script uses the Spectral Reflectance values (double precision values), gained from previous steps (see above), and produces Pan-sharpened images by applying all of the three methods that Template:Addon offers. In addition, it attempts to produce True-Color composite images, without and with re-balancing the color tables by using the i.landsat.rgb module.


Initial tests indicate that at least one of the three sharpening methods, combined with re-balancing, produces very clear and balanced True-Color composites. Note, there is no 100% confidence that it will produce nice looking True-Color composites. Some of the methods might simply work, others might deliver fancy-colored images. As usual, some manual action might be required to get the re-balancing to work as best as possible.


The script can be expanded in terms of using more inputs by utilising bash's positional parameters. However, care has to be taken to alter the instruction that concerns the conversion from double precision values to 8-bit integers.


#!/bash/sh

# use in G7 only :-)


echo "Rescaling all images to 8-bit"
# convert to 8-bit first :-!
for Method_Input in \
"Pan ToAR" \
"Blue ToAR" \
"Green ToAR" \
"Red ToAR" \
"NIR ToAR"

do

  # parse "${Method_STR}" and set positional parameters
  set -- $Method_Input ; echo -e "\n" #echo $1 $2


  # input BAND is...
  eval BAND="${1}_${2}"
  
  # set region
  g.region rast=${BAND}

  # integerise
  r.mapcalc --v \
  "${BAND}_integerised = round( 1000000 * ${BAND} )" # how many decimals?

  # integerised BAND is...
  eval BAND="${1}_${2}_integerised"

  # get ${min} and ${max}
  eval `r.info -r ${BAND}`

  #
  r.rescale in=${1}_${2}_integerised out=${1}_${2}_255 from=${min},${max} to=0,255

done ########################################################################
echo "Rescaling done!"


# pan-sharpen High Resolution imagery ---------------------------------------
# needs setting some naming conventions
for Method_Input in \
"ihs ToAR" \
"brovey ToAR" \
"pca ToAR"

do

  # parse "${Method_STR}" and set positional parameters
  set -- $Method_Input ; echo $1 $2

  # some echo
  echo "Pan-Sharpening the <${2}> images based on the <${1}> method"

  i.pansharpen \
  sharpen=${1} \
  pan=Pan_${2}_255 \
  ms1=Blue_${2}_255 \
  ms2=Green_${2}_255 \
  ms3=Red_${2}_255 \
  output=sharp_${1}_${2}_255

done ########################################################################


# compose BGRs --------------------------------------------------------------

# loop over Methods and Input Types, compose RGBs
for Method_Input in \
"ihs ToAR" \
"brovey ToAR" \
"pca ToAR"

do

  # parse "${Method_STR}" and set positional parameters
  set -- $Method_Input ; echo $1 $2

  # region
  g.region rast=sharp_"${1}"_"${2}"_255_blue

  # compose
  r.composite --o \
  r=sharp_"${1}"_"${2}"_255_red \
  g=sharp_"${1}"_"${2}"_255_green \
  b=sharp_"${1}"_"${2}"_255_blue \
  out=rgb_sharpened_"${1}"_"${2}"_255

done #######################################################################


# re-balance & re-compose colors --------------------------------------------

for Method_Input in \
"ihs ToAR" \
"brovey ToAR" \
"pca ToAR"

do

  # parse "${Method_STR}" and set positional parameters
  set -- $Method_Input ; echo $1 $2

  # re-balance
  i.landsat.rgb -p \
  r=sharp_"${1}"_"${2}"_255_red \
  g=sharp_"${1}"_"${2}"_255_green \
  b=sharp_"${1}"_"${2}"_255_blue

  # region -- Really necessary, again?
  g.region rast=sharp_"${1}"_"${2}"_255_blue

  # re-compose
  r.composite --o \
  r=sharp_"${1}"_"${2}"_255_red \
  g=sharp_"${1}"_"${2}"_255_green \
  b=sharp_"${1}"_"${2}"_255_blue \
  out=rgb_sharpened_"${1}"_"${2}"_255_rebalanced

done ########################################################################


Pan-Sharpening based on the HPFA technique

The technique, implemented via the GRASS add-on i.fusion.hpf (src), as indicated above, involves a convolution using a High Pass Filter (HPF) on the high resolution data, then combining this with the lower resolution multispectral data.


Source: "Optimizing the High-Pass Filter Addition Technique for Image Fusion", Ute G. Gangkofner, Pushkar S. Pradhan, and Derrold W. Holcomb (2008)


The algorithm's steps are:

  1. Computing the ratio of the low (Multi-Spectral) to the high (Panchromatic) resolution
  2. High Pass Filtering the Panchromatic Image
  3. Resampling the Multi-Spectral image to the higher resolution
  4. Adding a weighted High-Pass-Filtered image to the upsampled Multi-Spectral image
  5. Optionally, matching the histogram of the Pan-Sharpened image to the one of the original Multi-Spectral image

Color Composites

ToAdd

Vegetation Indices

ToAdd

PCA

ToAdd

IKONOS Image classification

See Image classification

References / Sources

See also


ToAdd