Global datasets: Difference between revisions
⚠️Reverse22 (talk | contribs) No edit summary |
⚠️Cmbarton (talk | contribs) |
||
(113 intermediate revisions by 15 users not shown) | |||
Line 9: | Line 9: | ||
GDEM global 30m elevation calculated from stereo-pair images collected by the Terra satellite. | GDEM global 30m elevation calculated from stereo-pair images collected by the Terra satellite. | ||
''"This is the most complete, consistent global digital elevation data yet made available to the world."'' | ''"This is the most complete, consistent global digital elevation data yet made available to the world."'' | ||
This is a very new dataset, at version 1 (treat as ''experimental''). Accuracy will be improved in forthcoming versions (validation with SRTM, etc.; [http:// | This is a very new dataset, at version 1 (treat as ''experimental''). Accuracy will be improved in forthcoming versions (validation with SRTM, etc.; [http://blog.neteler.org/aster-gdem-30m-quality-assessment/ see assessment here] and [http://www.viewfinderpanoramas.org/reviews.html#aster here]). | ||
* ''[https://lpdaac.usgs.gov/lpdaac/about/news_archive/monday_june_22_20092 pre-release announcement]'' | * ''[https://lpdaac.usgs.gov/lpdaac/about/news_archive/monday_june_22_20092 pre-release announcement]'' | ||
Line 15: | Line 15: | ||
* [https://wist.echo.nasa.gov/~wist/api/imswelcome/ Warehouse Inventory Search Tool] or [http://www.gdem.aster.ersdac.or.jp/search.jsp Easy search tool] (Data download) | * [https://wist.echo.nasa.gov/~wist/api/imswelcome/ Warehouse Inventory Search Tool] or [http://www.gdem.aster.ersdac.or.jp/search.jsp Easy search tool] (Data download) | ||
'''Tutorial:''' [ | '''Tutorial:''' [[ASTER topography]] | ||
''See also: [http://blog.neteler.org/aster-gdem-30m-quality-assessment/ ASTER GDEM 30m quality assessment]'' | |||
=== ASTER topography (GDEM V2) === | === ASTER topography (GDEM V2) === | ||
Improved ASTER GDEM 2 from 2011: | Improved ASTER GDEM 2 from 2011: | ||
* https://lpdaac.usgs.gov/products/aster_products_table/ | * https://lpdaac.usgs.gov/products/aster_products_table/astgtm | ||
The ASTER GDEM covers land surfaces between 83°N and 83°S and is comprised of 22,702 tiles. Tiles that contain at least 0.01% land area are included. The ASTER GDEM is distributed as Geographic Tagged Image File Format (GeoTIFF) files with geographic coordinates (latitude, longitude). The data are posted on a '''1 arc-second''' (approximately '''30–m at the equator''') grid and referenced to the 1984 World Geodetic System (WGS84)/ 1996 Earth Gravitational Model (EGM96) geoid. | |||
'''Notes:''' this DEM can be rather well filtered and smoothed with the [http://personalpages.manchester.ac.uk/staff/neil.mitchell/mdenoise/ Sun's denoising algorithm] (using GDAL and free / open source program <mdenoise> or simply GRASS add-on {{AddonCmd|r.denoise}}. | '''Notes:''' this DEM can be rather well filtered and smoothed with the [http://personalpages.manchester.ac.uk/staff/neil.mitchell/mdenoise/ Sun's denoising algorithm] (using GDAL and free / open source program <mdenoise> or simply GRASS add-on {{AddonCmd|r.denoise}}. | ||
Line 31: | Line 34: | ||
Also filtering with {{cmd|r.neighbors}} by "average" method and window size >=5 is quite useful to remove some noise from DEM. | Also filtering with {{cmd|r.neighbors}} by "average" method and window size >=5 is quite useful to remove some noise from DEM. | ||
''See also: [http:// | ''See also: [http://www.isprs2012.org/abstract/299.asp Validation of the ASTER Global Digital Elevation Model Version 2 over the Conterminous United States]'' | ||
=== ACE2 === | === ACE2 === | ||
Line 43: | Line 46: | ||
order="native" north=15 south=0 east=120 west=105 \ | order="native" north=15 south=0 east=120 west=105 \ | ||
rows=18000 cols=18000 | rows=18000 cols=18000 | ||
=== CleanTOPO2 (DEM) === | |||
* [http://www.shadedrelief.com/cleantopo2/ CleanTOPO2 download]: Edited SRTM30 Plus World Elevation Data | |||
Import in GRASS: | |||
r.in.gdal CleanTOPO2.tif out=cleanTOPO2.tmp -l -o | |||
g.region rast=cleanTOPO2 -p -g | |||
# rescale from odd integer values to true world values | |||
r.rescale cleanTOPO2.tmp out=cleanTOPO2 to=-10701,8248 | |||
r.colors cleanTOPO2_final col=terrain | |||
[[Image:CleanTOPO2_map.png|thumb|center|300px|Rescaled ClearTOPO2 map]] | |||
=== EGM2008 Geoid Data (Earth Gravitational Model) === | |||
Global 2.5 Minute Geoid Undulations: | |||
* download GIS Format at http://earth-info.nga.mil/GandG/wgs84/gravitymod/egm2008/egm08_gis.html | |||
[[Image:Trentino_egm2008_map_5m_resampled.jpg|thumb|center|300px|Geoid undulations in Trentino, Italy]] | |||
Verifications of points can be done with the http://geographiclib.sourceforge.net/cgi-bin/GeoidEval | |||
=== ETOPO (DEM) === | === ETOPO (DEM) === | ||
Line 52: | Line 77: | ||
* http://www.ngdc.noaa.gov/mgg/global/ | * http://www.ngdc.noaa.gov/mgg/global/ | ||
'''The ''cell registered'' version can be loaded directly into a lat/lon | * '''The ''cell registered'' version can be loaded directly into a lat/lon location'''. GRASS raster data is cell registered (see the [[GRASS raster semantics]] page) | ||
the [[GRASS raster semantics]] page) | |||
* Special care must be taken with the ''grid registered'' version. It can not be loaded directly into a lat/lon location as the parameters found in the .hdr file exceed the limits of polar coordinate space: they have N,S rows which go 1/2 a cell beyond 90 latitude, when considered in the ''cell registered'' convention. | |||
: So the data needs to have those 90deg N,S rows cropped away, and while we're at it we crop away a redundant overlapping column at 180 longitude. To do this we have to first tell the GIS a little fib during import to squeeze the data into lat/lon space, then crop away the spurious rows and column, then finally reset the resulting map's bounds to its true extent. | |||
<source lang="bash"> | |||
# Import grid registered binary float, fibbing about its true extent | |||
# Import grid registered binary float | r.in.bin -f in=etopo1_bed_g.flt out=etopo1_bed_g.raw \ | ||
r.in.bin -f in=etopo1_bed_g.flt out=etopo1_bed_g \ | n=90 s=-90 e=180 w=-180 rows=10801 cols=21601 anull=-9999 | ||
n=90 | |||
# reduce region by 1 cell | # reduce the working region by 1 cell | ||
g.region rast=etopo1_bed_g | g.region rast=etopo1_bed_g.raw | ||
eval `g.region -g` | eval `g.region -g` | ||
g.region n=n-$nsres s=s+$nsres e=e-$ewres -p | g.region n=n-$nsres s=s+$nsres e=e-$ewres -p | ||
# save smaller raster and remove original | # save smaller raster and remove original | ||
r.mapcalc "etopo1_bed_g.crop = etopo1_bed_g" | r.mapcalc "etopo1_bed_g.crop = etopo1_bed_g.raw" | ||
g.remove etopo1_bed_g | g.remove etopo1_bed_g.raw | ||
# | # re-establish the correct bounds, now that they'll fit | ||
# | r.region etopo1_bed_g.crop n=89:59:30N s=89:59:30S w=179:59:30E e=179:59:30E | ||
g.region rast=etopo1_bed_g.crop | |||
# check that N,S,E,W and Res are all nice and clean: | |||
r.info etopo1_bed_g.crop | |||
# looks good, so accept the results by resetting the map name | |||
g.rename etopo1_bed_g.crop,etopo1_bed_g | |||
# set to use appropriate color rules | |||
r.colors etopo1_bed_g color=etopo2 | |||
# set the 'units' metadata field (for elevation data contained within the map) | |||
r.support etopo1_bed_g units=meters | |||
</source> | |||
* For the problematic ''grid registered'' version, the resulting {{cmd|r.info}} report should look like: | |||
| Rows: 10799 | | |||
| Columns: 21600 | | |||
| Total Cells: 233258400 | | |||
| Projection: Latitude-Longitude | | |||
| N: 89:59:30N S: 89:59:30S Res: 0:01 | | |||
| E: 179:59:30E W: 179:59:30E Res: 0:01 | | |||
| Range of data: min = -10898 max = 8271 | | |||
(the east and west bounds of the map touch 1/2 a cell west of 180 longitude) | |||
* For the problematic ''grid registered'' version, since the data's grid is 1/2 a cell shifted from nicely rounded 1 arc-minutes (0:01), you'll need to ensure that the mapset's region preserves that alignment after zooming or panning: | |||
g.region align=etopo1_bed_g -p | |||
: (or oversample and set the region resolution to 1/2 arc-minutes (0:00:30), which will be four times as slow) | |||
==== ETOPO2 (DEM) ==== | ==== ETOPO2 (DEM) ==== | ||
Line 94: | Line 142: | ||
=== Global Multi-resolution Terrain Elevation Data 2010 (GMTED2010) === | === Global Multi-resolution Terrain Elevation Data 2010 (GMTED2010) === | ||
* Data [ | * Data download: [https://lta.cr.usgs.gov/GMTED2010 Web] and [http://topotools.cr.usgs.gov/GMTED_viewer/gmted2010_global_grids.php FTP] - Import with {{cmd|r.in.gdal}}. See also [https://erouault.blogspot.de/2011/12/seamless-access-to-remote-global-multi.html related GDAL blog post] | ||
Import of GMTED2010 tiles in GRASS GIS: | Tiles: Import of GMTED2010 tiles in GRASS GIS: | ||
r.in.gdal 30N000E_20101117_gmted_mea075.tif out=gmted2010_30N000E_20101117 | r.in.gdal 30N000E_20101117_gmted_mea075.tif out=gmted2010_30N000E_20101117 | ||
r.colors gmted2010_30N000E_20101117 color=elevation | r.colors gmted2010_30N000E_20101117 color=elevation | ||
g.region rast=gmted2010_30N000E_20101117 | g.region rast=gmted2010_30N000E_20101117 | ||
r. | r.relief input=gmted2010_30N000E_20101117 output=gmted2010_30N000E_20101117.shade | ||
d.mon | r.shade shade=gmted2010_30N000E_20101117.shade color=gmted2010_30N000E_20101117 \ | ||
d.rast | output=gmted2010_30N000E_20101117_shaded | ||
d.mon wx0 | |||
d.rast gmted2010_30N000E_20101117_shaded | |||
d.grid 1 color=red textcolor=red | d.grid 1 color=red textcolor=red | ||
[[Image:Gmted2010_30N000E_20101117_shaded.png|thumb|center|300px|GMTED2010 example: Trento - Garda Lake - Verona area (Northern Italy)]] | [[Image:Gmted2010_30N000E_20101117_shaded.png|thumb|center|300px|GMTED2010 example: Trento - Garda Lake - Verona area (Northern Italy)]] | ||
Full maps: | |||
[ | # mean elevation global GMTED2010 map, 30 arc-sec | ||
wget http://edcintl.cr.usgs.gov/downloads/sciweb1/shared/topo/downloads/GMTED/Grid_ZipFiles/mn30_grd.zip | |||
unzip mn30_grd.zip | |||
Important: the GMTED2010 map exceeds the -180°..+180° range due to the [https://pubs.usgs.gov/of/2011/1073/pdf/of2011-1073.pdf GMTED2010 pixel geometry] (PDF). Note that this cannot be handled in GRASS GIS < 7.4. Please update to GRASS GIS 7.4 or newer. | |||
=== GEBCO Bathymetric Chart === | === GEBCO Bathymetric Chart === | ||
* The General Bathymetric Chart of the Oceans (original 1' release 2003, new 1' and 30" releases 2008) | * The General Bathymetric Chart of the Oceans (original 1' release 2003, new 1' and 30" releases 2008, new 15" released 2020) | ||
: http://www.gebco.net/data_and_products/gridded_bathymetry_data/ | : http://www.gebco.net/data_and_products/gridded_bathymetry_data/ | ||
: http://www.bodc.ac.uk/data/online_delivery/gebco/ | : http://www.bodc.ac.uk/data/online_delivery/gebco/ | ||
The GEBCO_2020 is available in NetCDF or GeoTIFF format. | |||
{{cmd|r.in.gdal}} can be used to import the GMT netCDF files directly, or if that doesn't work you can use GMT tools to convert to an old-style native GMT format and import that with {{cmd|r.in.bin}}. | {{cmd|r.in.gdal}} can be used to import the GMT netCDF files directly, or if that doesn't work you can use GMT tools to convert to an old-style native GMT format and import that with {{cmd|r.in.bin}}. | ||
Line 159: | Line 206: | ||
=== Global Multi-Resolution Topography (GMRT DEM) === | === Global Multi-Resolution Topography (GMRT DEM) === | ||
: ''From Columbia University's Lamont-Doherty Earth Observatory'' | |||
(it is reported that this is what Google Maps uses for their global bathymetry) | |||
* Global ~1 arc-second (~90 m) topography using multi-beam and satellite data in the oceans combined with SRTM on land. | * Global ~1 arc-second (~90 m) topography using multi-beam and satellite data in the oceans combined with SRTM on land. | ||
Line 172: | Line 221: | ||
* Note: Downloaded file contains no projection information, but is EPSG:4326 (WGS84 Geographic). The file size is limited, but lower resolution (resolution=2,4,8) data can be downloaded for larger areas. | * Note: Downloaded file contains no projection information, but is EPSG:4326 (WGS84 Geographic). The file size is limited, but lower resolution (resolution=2,4,8) data can be downloaded for larger areas. | ||
=== NASADEM === | |||
1-arc second (~30 m @ equator) global only-land. | |||
https://lpdaac.usgs.gov/news/release-nasadem-data-products/ | |||
See also {{AddonCmd|r.in.nasadem|version=7}} addon | |||
=== Smith and Sandwell DEM === | === Smith and Sandwell DEM === | ||
Line 179: | Line 235: | ||
=== SRTM DEM === | === SRTM DEM === | ||
[http://www2.jpl.nasa.gov/srtm/ Space Shuttle Radar Topography Mission] | [http://www2.jpl.nasa.gov/srtm/ Space Shuttle Radar Topography Mission] - several SRTM Data Products are available: | ||
* see [[HOWTO import SRTM elevation data]] | * Original data - SRTM 3 V001 arc-seconds Non-Void Filled elevation data (US: 1 arc-second (approximately 30 meters); outside the US at 3 arc-seconds (approximately 90 meters)) | ||
* SRTM V003 3 Arc-Second Global Void Filled elevation data, with voids filled using interpolation algorithms in conjunction with other sources of elevation data (US: 1 arc-second (approximately 30 meters); outside the US at 3 arc-seconds (approximately 90 meters)) | |||
** SRTM V3 tiles at 3 arc seconds resolution from: http://e4ftl01.cr.usgs.gov/SRTM/SRTMGL3.003/2000.02.11/ - or simply use {{AddonCmd|r.in.srtm.region}} | |||
* '''SRTM V003 1 Arc-Second Global elevation data''' offer worldwide coverage of '''void filled''' data at a resolution of 1 arc-second (30 meters) and provide open distribution of this high-resolution global data set. | |||
** [http://earthexplorer.usgs.gov/ EarthExplorer] can be used to search, preview, and download Shuttle Radar Topography Mission (SRTM) 1 Arc-Second Global data. The collections are located under the Digital Elevation category. | |||
** FTP download: http://e4ftl01.cr.usgs.gov/SRTM/SRTMGL1.003/2000.02.11/ - or simply use {{AddonCmd|r.in.srtm.region}} | |||
** Web-based [http://dwtkns.com/srtm30m/ 30-Meter SRTM Tile Downloader] (select from map) | |||
Import: | |||
* Using {{cmd|r.in.gdal}} or {{cmd|r.import}} or {{cmd|r.in.srtm}} or {{AddonCmd|r.in.srtm.region}} | |||
* see [[HOWTO import SRTM elevation data]], focused on the SRTM 3 arc-seconds Non-Void Filled elevation data | |||
=== SRTM15+ DEM === | |||
SRTM15+ data consists of 33 files of global topography in the same format as the SRTM30plus products. The grid resolution is 15 seconds which is roughly 500 m at the equator. | |||
https://topex.ucsd.edu/WWW_html/srtm15_plus.html | |||
=== SRTM30plus data DEM === | === SRTM30plus data DEM === | ||
SRTM30plus data consists of 33 files of global topography in the same format as the SRTM30 products distributed by the USGS EROS data center. The grid resolution is 30 | SRTM30plus data consists of 33 files of global topography in the same format as the SRTM30 products distributed by the USGS EROS data center. The grid resolution is 30 seconds which is roughly one kilometer (1 km). | ||
Land data are based on the 1-km averages of topography derived from the USGS SRTM30 grided DEM data product created with data from the NASA Shuttle Radar Topography Mission. GTOPO30 data are used for high latitudes where SRTM data are not available. | Land data are based on the 1-km averages of topography derived from the USGS SRTM30 grided DEM data product created with data from the NASA Shuttle Radar Topography Mission. GTOPO30 data are used for high latitudes where SRTM data are not available. | ||
Line 192: | Line 264: | ||
All data are derived from public domain sources and these data are also in the public domain. | All data are derived from public domain sources and these data are also in the public domain. | ||
GRASS 6 script | GRASS 6 script {{{cmd|r.in.srtm}}} described in GRASSNews vol. 3 won't work with this dataset (as it was made for the original SRTM HGT files). But you can import SRTM30plus tiles into GRASS this way: | ||
r.in.bin -sb input=e020n40. | r.in.bin -sb input=e020n40.Bathymetry.srtm output=e020n40_topex bytes=2 \ | ||
north=40 south=-10 east=60 west=20 r=6000 c=4800 | |||
r.colors e020n40_topex rules=etopo2 | r.colors e020n40_topex rules=etopo2 | ||
Line 201: | Line 274: | ||
; Getting as SRTM30plus tiles: ftp://topex.ucsd.edu/pub/srtm30_plus/srtm30/data/ | ; Getting as SRTM30plus tiles: ftp://topex.ucsd.edu/pub/srtm30_plus/srtm30/data/ | ||
; Getting as SRTM30plus huge file: ftp://topex.ucsd.edu/pub/srtm30_plus/topo30/ | ; Getting as SRTM30plus huge file: ftp://topex.ucsd.edu/pub/srtm30_plus/topo30/ | ||
; SRTMPLUS WCS server: http://svn.osgeo.org/gdal/trunk/autotest/gdrivers/data/srtmplus.wcs (read with {{cmd|r.external}}) | |||
=== | === SRTM Water Body Database SRTMSWBD V003 === | ||
SRTM Water Body Database V003 | |||
* Format documentation: https://lpdaac.usgs.gov/dataset_discovery/measures/measures_products_table/srtmswbd_v003 | |||
* FTP raster data (30m res water bodies): http://e4ftl01.cr.usgs.gov/SRTM/SRTMSWBD.003/ | |||
Import into GRASS GIS 7 (lat-long location): | |||
r.in.bin -sb input=N00E108.raw output=N00E108_swbd bytes=1 north=0 south=-10 east=108 west=98 r=3601 c=3601 <<= DRAFT - TODO fix n,s,e,w - calculate from filename | |||
=== TanDEM-X DEM === | |||
This is a 90 m only-land DEM. | |||
Data from 2010-12-12 through 2015-01-16 | |||
https://geoservice.dlr.de/data-assets/ju28hc7pui09.html | |||
== Soil data == | |||
=== Harmonized World Soil Database (HWSD Database) === | |||
Download: http://webarchive.iiasa.ac.at/Research/LUC/External-World-soil-database/HTML/ | |||
[http://webarchive.iiasa.ac.at/Research/LUC/External-World-soil-database/HTML/DataDesc.html?sb=12 Spatial reference system:] [http://spatialreference.org/ref/epsg/4326/ EPSG:4326] (LatLong WGS84) | |||
Import: | |||
grass70 -c EPSG:4326 ~/grassdata/hwsd | |||
# -e: expand location to dataset; -o: override (missing) projection in input dataset: | |||
r.in.gdal input=hwsd.bil output=hwSoil -e -o | |||
g.region raster=hwSoil -p | |||
r.category hwSoil | |||
The data is distributed with an MSAccess .mdb which contains additional data for each of the categories in the raster file. Opening the file in access, the data is found in the query "HWSD_Q". Save this query in .csv format (with a name like "HWSD_Q.csv") so that it may then be imported into GRASS. After that, it is necessary to replace the commas with dots (find & replace) in the .csv file. Before you can import it, you also need a file "HWSD_Q.csvt", which contains a single line listing the type for each column in the database: | |||
"Integer","String","Integer","Integer","Integer","String","Integer","Integer","Real","Integer","String","Integer","String","Integer","String","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real","Integer","Integer","Integer","Integer","Integer","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real" | |||
With both the .csv and the .csvt file in the same directory, you can then import them into GRASS: | |||
db.in.ogr input=~/grassdata/hwsd/HWSD_Q.csv output=hwsdData | |||
The data cannot be connected directly to the raster, it must be converted to a vector first: | |||
g.region raster=hwSoil | |||
r.to.vect -v input=hwSoil output=hwSoil feature=area | |||
v.db.droptable hwSoil | |||
db.droptable -f hwSoil # delete the table completely | |||
Note that the table includes multiple rows for each polygon, corresponding | |||
to the dominant and various numbers of subdominant soils. To select only | |||
the dominant soil layer: | |||
db.select table=hwsdData sql='select * from hwsdData where SEQ = 1' \ | |||
output=domSoil.csv separator=, | |||
This saves a copy of the table that contains only the dominant soil type for each polygon as domSoil.csv. This needs to be reloaded into the GRASS database. Since it has the same columns as HWSD_Q.csv, we can use the labels for that file: | |||
cp HWSD_Q.csvt domSoil.csvt | |||
Then we can load domSoil.csv: | |||
db.in.ogr \ | |||
input=~/grassdata/downloads/harmonized_world_soil_database/domSoil.csv \ | |||
output=domSoil | |||
Now at last we can connect the database to the vector file: | |||
v.db.connect -o map=hwsd table=domSoil driver=sqlite key=MU_GLOBAL | |||
To create a new raster map taking the values from the table: | |||
g.region raster=hwSoil ## make sure we get the whole map | |||
v.to.rast in=hwSoil out=T_SAND col=T_SAND | |||
=== SoilGrids.org 250m soil taxonomy map === | |||
SoilGrids is a system for automated soil mapping based on global soil profile and environmental covariate data. SoilGrids represents a collection of updatable soil property and class maps of the world at 1 km and 250 m spatial resolution produced using automated soil mapping based on machine learning algorithms. It aims at becoming OpenStreetMap and/or OpenWeatherMap for soil data. SoilGrids predictions are updated on a regular basis (at least every few months). For more details about the SoilGrids system, please refer to the SoilGrids project site: https://www.soilgrids.org/#/?layer=geonode:taxnwrb_250m | |||
<source lang="bash"> | |||
URL=ftp://ftp.soilgrids.org/data/recent/TAXNWRB_250m_ll.tif | |||
# the Soilgrids GeoTIFF data suffer from a resolution precision problem since they were produced with SAGA: | |||
# resolution is stored as 0.002083333000000 while it should be 0.002083333333333, hence the geometry is not fully correct | |||
# this likely originates from Soilgrids being processed in SAGA which cuts decimals after the 10th decimal place, hence comes with a precision problem | |||
export NAME=`basename $URL .tif` | |||
wget $URL | |||
</source> | |||
OLD OLD OLD start -- | |||
<source> | |||
# see below for the better way how to fix SoilGrids data | |||
gdal_translate --config GDAL_CACHEMAX 2000 -a_ullr $COORDS -co "COMPRESS=DEFLATE" $NAME.tif ${NAME}_fixed.tif | |||
gdalinfo ${NAME}_fixed.tif | |||
grass72 -c ${NAME}_fixed.tif ~/grassdata/latlong --exec r.import input=${NAME}_fixed.tif output=${NAME} | |||
</source> | |||
-- OLD OLD OLD end | |||
New fix & import method: | |||
Starting with '''GRASS GIS 7.4.x''', there is new flag in {{cmd|r.in.gdal}} to auto-adjust such small resolution precision issues: '''-a''' ''- Auto-adjustment for lat/lon. Attempt to fix small precision errors in resolution and extents.'' | |||
<source lang="bash"> | |||
r.in.gdal -a input=TAXNWRB_250m_ll.tif output=TAXNWRB_250m_ll | |||
</source> | |||
== Landcover data == | |||
=== ESA Globcover dataset === | |||
Download: http://due.esrin.esa.int/page_globcover.php | |||
Or via command line: | |||
wget http://due.esrin.esa.int/files/Globcover2009_V2.3_Global_.zip | |||
unzip Globcover2009_V2.3_Global_.zip | |||
# rm -f Globcover2009_V2.3_Global_.zip | |||
Note, also a coloured version of the map in GeoTIFF format is available at: http://due.esrin.esa.int/files/GLOBCOVER_L4_200901_200912_V2.3.color.tif | |||
Unfortunately the Globcover map exceeds the -180°..+180° range etc, indicating a shift of the map (see also [http://www.cosmo-model.org/content/tasks/workGroups/wg3b/meetings/2012-soilveg/EXTPAR-GLOBCOVER.pdf this assessment by DWD]): | |||
<pre> | |||
gdalinfo GLOBCOVER_L4_200901_200912_V2.3.tif | |||
Driver: GTiff/GeoTIFF | |||
Files: GLOBCOVER_L4_200901_200912_V2.3.tif | |||
Size is 129600, 55800 | |||
Coordinate System is: | |||
GEOGCS["WGS 84", | |||
... | |||
Origin = (-180.001388888888897,90.001388888888883) | |||
... | |||
Corner Coordinates: | |||
Upper Left (-180.0013889, 90.0013889) (180d 0' 5.00"W, 90d 0' 5.00"N) | |||
Lower Left (-180.0013889, -64.9986111) (180d 0' 5.00"W, 64d59'55.00"S) | |||
Upper Right ( 179.9986111, 90.0013889) (179d59'55.00"E, 90d 0' 5.00"N) | |||
Lower Right ( 179.9986111, -64.9986111) (179d59'55.00"E, 64d59'55.00"S) | |||
Center ( -0.0013889, 12.5013889) ( 0d 0' 5.00"W, 12d30' 5.00"N) | |||
... | |||
</pre> | |||
How to fix this? | |||
'''Option 1:''' You can use the -l flag of {{cmd|r.in.gdal}} to constrain the map coordinates to legal values ([https://pvanb.wordpress.com/2011/05/10/importing-global-rasters-in-grass-gives-me-illegal-latitude-for-north-message/ ref]. But the resulting pixels will no longer have the original resolution. We will not do that. | |||
'''Option 2:''' Shift the Globcover map slightly into the right position using [http://www.gdal.org/gdal_translate.html gdal_translate]: | |||
<pre> | |||
# coords are shifted, fix raster map | |||
# -a_ullr Assign/override the georeferenced bounds of the output file | |||
# use larger cache and compress result | |||
gdal_translate --config GDAL_CACHEMAX 1200 -a_ullr -180 90 180 -65 \ | |||
-co "COMPRESS=LZW" GLOBCOVER_L4_200901_200912_V2.3.tif GLOBCOVER_L4_200901_200912_V2.3_fixed.tif | |||
# result: | |||
gdalinfo GLOBCOVER_L4_200901_200912_V2.3_fixed.tif | |||
... | |||
Origin = (-180.000000000000000,90.000000000000000) | |||
Pixel Size = (0.002777777777778,-0.002777777777778) | |||
... | |||
Corner Coordinates: | |||
Upper Left (-180.0000000, 90.0000000) (180d 0' 0.00"W, 90d 0' 0.00"N) | |||
Lower Left (-180.0000000, -65.0000000) (180d 0' 0.00"W, 65d 0' 0.00"S) | |||
Upper Right ( 180.0000000, 90.0000000) (180d 0' 0.00"E, 90d 0' 0.00"N) | |||
Lower Right ( 180.0000000, -65.0000000) (180d 0' 0.00"E, 65d 0' 0.00"S) | |||
Center ( 0.0000000, 12.5000000) ( 0d 0' 0.01"E, 12d30' 0.00"N) | |||
</pre> | |||
Voilà! Now we can import the map into GRASS GIS: | |||
r.in.gdal input=GLOBCOVER_L4_200901_200912_V2.3_fixed.tif output=esa_globcover2009 | |||
'''Legend conversion''': The ZIP file contains a XLS table describing the classes and the RGB colors. Using ogr2ogr can directly convert XLS --> CSV: | |||
ogr2ogr -f CSV Globcover2009_Legend.csv Globcover2009_Legend.xls | |||
'''Applying the legend:''' | |||
# suppress table header and only consider category value and label, apply on the fly: | |||
cat Globcover2009_Legend.csv | grep -v '^Value' | cut -d',' -f1-2 | r.category esa_globcover2009 separator=comma rules=- | |||
# verify (0E, 0N is the Atlantic Ocean) | |||
r.what esa_globcover2009 coor=0,0 -f | |||
0|0||210|Water bodies | |||
=== Global Forest Change === | |||
* http://earthenginepartners.appspot.com/science-2013-global-forest | |||
* Download info on: http://earthenginepartners.appspot.com/science-2013-global-forest/download_v1.3.html | |||
== Imagery == | == Imagery == | ||
Line 222: | Line 471: | ||
* see the [[Blue Marble]] wiki page | * see the [[Blue Marble]] wiki page | ||
=== EO-1 imagery === | === EO-1 imagery === | ||
Line 243: | Line 479: | ||
* On-board Atmospheric Corrections | * On-board Atmospheric Corrections | ||
=== | === Global Land Cover Characteristics === | ||
USGS ''et al.'' generated dataset at 1km resolution. Provides global landcover characteristics. | |||
* | * see the [[Global Land Cover Characteristics]] wiki page | ||
=== LANDSAT imagery === | === LANDSAT imagery === | ||
Line 265: | Line 496: | ||
* {{cmd|r.in.wms}} - Download data covering current map region via WMS server | * {{cmd|r.in.wms}} - Download data covering current map region via WMS server | ||
* [[GRASS_AddOns#r.in.onearth|r.in.onearth]] - WMS frontend for NASA's OnEarth Global Landsat Mosaic | * [[GRASS_AddOns#r.in.onearth|r.in.onearth]] - WMS frontend for NASA's OnEarth Global Landsat Mosaic | ||
* {{cmd|i.landsat.rgb}} - Color balancing/enhancement tool | |||
==== Color balancing modules ==== | |||
* {{cmd|i.landsat.rgb}} (GRASS 6.x) | {{cmd|i.colors.enhance|version=70}} (GRASS 7.x) - Color balancing/enhancement tool | |||
==== See also ==== | ==== See also ==== | ||
* Processing tips can be found on the [[LANDSAT]] wiki page | * Processing tips can be found on the [[LANDSAT]] wiki page | ||
=== ESA Sentinel imagery === | |||
The [https://grass.osgeo.org/grass-stable/manuals/addons/i.sentinel.html i.sentinel] toolbox of addons provides | |||
a complete suite for downloading, importing and preprocessing Sentinel imagery. | |||
For direct access, all Sentinel 1 and 2 data is available for download from the [https://scihub.copernicus.eu/ Open Access Hub] | |||
* via the [https://scihub.copernicus.eu/dhus/#/home online interactive interface] | |||
* via the [https://scihub.copernicus.eu/twiki/do/view/SciHubWebPortal/APIHubDescription API] | |||
Other pre-processing tools are available at: | |||
* http://step.esa.int/main/ Scientific Toolbox Exploitation Platform | |||
* https://github.com/Fernerkundung/awesome-sentinel ("Awesome Sentinel" - list of tools) | |||
=== Miscellaneous === | |||
==== Data sources ==== | |||
* Some datasource links: http://www.ruf.rice.edu/~ben/gmt.html | |||
* [http://www.geotorrent.org/browse.php Geotorrent.org] | |||
==== Import Modules ==== | |||
* The {{cmd|r.in.gdal}} modules may be used to import data of [http://www.gdal.org/formats_list.html many formats], including GMT netCDF | |||
* The {{cmd|r.in.bin}} module may be used to import raw binary files | |||
=== MODIS imagery === | === MODIS imagery === | ||
* see the [[MODIS]] wiki page | * see the [[MODIS]] wiki page | ||
=== Natural Earth imagery === | |||
* [http://www.naturalearthdata.com/ Natural Earth II]: World environment map in natural color. GeoTIFF (use the {{cmd|r.in.gdal}} module) | |||
* see also 1:10 million, 1:50 million and 1:110million scale maps from http://www.naturalearthdata.com/ | |||
=== Earth at Night: nightlight maps === | |||
* Earth at Night: Flat Maps https://earthobservatory.nasa.gov/features/NightLights/page3.php (GeoTIFFs) | |||
=== Orthoimagery === | |||
* [http://worldwindcentral.com/wiki/Sources_of_free_orthoimagery Sources of free orthoimagery] | |||
=== Pathfinder AVHRR SST imagery === | === Pathfinder AVHRR SST imagery === | ||
Line 294: | Line 566: | ||
* for import, see {{cmd|i.in.spotvgt}} | * for import, see {{cmd|i.in.spotvgt}} | ||
== | === True Marble imagery === | ||
* [http://www.unearthedoutdoors.net/global_data/true_marble/download True Marble]: 250m world wide visual image of the Earth from space, with the clouds removed. GeoTIFF (use the {{cmd|r.in.gdal}} module) | |||
== Climatic data == | |||
=== OGC WCS - Albedo example === | === OGC WCS - Albedo example === | ||
TODO: update this example e.g. to http://demo.mapserver.org/cgi-bin/wcs?SERVICE=wcs&VERSION=1.0.0&REQUEST=GetCapabilities | |||
GRASS imports OGC Web Coverage Service data. Example server (please suggest a better one!) | GRASS imports OGC Web Coverage Service data. Example server (please suggest a better one!) | ||
Line 333: | Line 603: | ||
anull=-9999 input=snowdas_input.dat output=snowdas | anull=-9999 input=snowdas_input.dat output=snowdas | ||
=== CHELSA climate maps === | |||
CHELSA – Climatologies at high resolution for the earth’s land surface areas is a high resolution (30 arc sec) climate data set for the earth land surface areas currently under development, see http://chelsa-climate.org/ | |||
Version 1.1 has some coordinate issues originating from SAGA being used (coordinate precision issue), see http://chelsa-climate.org/known-issues/ | |||
<source lang="shell"> | |||
# WARNING: dirty hack - Better wait for the new release V1.2 of CHELSA! | |||
for i in `ls /scratch/chelsa_climate/*.zip` ; do | |||
unzip $i | |||
NAME=`basename $i .zip` | |||
gdal_translate --config GDAL_CACHEMAX 2000 -a_ullr -180 84 180 -90 -co "COMPRESS=DEFLATE" $NAME.tif ${NAME}_fixed.tif | |||
rm -f $NAME.tif | |||
done | |||
</source> | |||
=== WorldClim maps === | |||
[http://www.worldclim.org/ WorldClim] is a set of global climate layers (climate grids) with a spatial resolution of a square kilometer. Besides long-term average climate layers (representing the period 1950 - 2000) it also includes projections for future conditions based on downscaled global climate model (GCM) data from CMIP5 (IPPC Fifth Assessment) and projections of past conditions (downscaled global climate model output). | |||
* Load into a Lat/Lon WGS84 location (EPSG:4326) | |||
* The data set is provided in two formats: BIL and ESRI Grd. Import with {{cmd|r.in.bin}} or {{cmd|r.in.gdal}}. Version 1.4 has some coordinate issues: | |||
a) BIL: binary format is 2 byte integer. Multiply by 10 using {{cmd|r.mapcalc}} to convert units. See http://www.worldclim.org/format.htm for more information and the [[MODIS]] help page for example of converting raw to data units. Note that the file header is missing a line. To fix: | |||
# fix WorldClim's BIL; tmean example | |||
for i in $(seq 1 12); do echo “PIXELTYPE SIGNEDINT” >>tmean$i.hdr; done | |||
b) ESRI grd files: Note that the WorldClim ESRI grd files suffer from a quality issue of coordinate precision. See [https://lists.osgeo.org/pipermail/grass-user/2011-January/059358.html here] for a solution. | |||
# fix WorldClim's ESRI Grd; tmean example | |||
export GDAL_CACHEMAX=2000 | |||
mkdir -p ~/tmp/ | |||
# fix broken WorldClim files, see https://lists.osgeo.org/pipermail/grass-user/2011-January/059358.html | |||
# note: 60S, not 90S | |||
for i in $(seq 1 12); do gdal_translate -a_ullr -180 90 180 -60 tmean_$i $HOME/tmp/tmean_${i}_fixed.tif; done | |||
# | |||
# import | |||
for i in $(seq 1 12) ; do r.in.gdal input=$HOME/tmp/tmean_${i}_fixed.tif out=tmp --o ; g.region raster=tmp -p ; r.mapcalc "tmean_${i} = 0.1 * tmp" --o ; r.colors tmean_${i} color=celsius ; done | |||
# | |||
# clean up | |||
g.remove raster name=tmp -f | |||
rm -f ~/tmp/tmean_?_fixed.tif ; rm -f ~/tmp/tmean_??_fixed.tif | |||
=== Africlim maps === | |||
[https://www.york.ac.uk/environment/research/kite/resources/ Africlim] provides four baseline data sets for current climate, including: | |||
* CRU CL 2.0 | |||
* WorldClim v1.4 | |||
* TAMSAT TARCAT v2.0 (rainfall only) | |||
* CHIRPS v1.8 (rainfall only). | |||
It furthermore provides data sets with projections of future climates based on combinations of ten general circulation models (GCMs), downscaled using five regional climate models (RCMs) and the four above mentioned contemporary baselines, under two representative concentration pathways of the IPCC-AR5 (RCP4.5 and RCP8.5). The data layers are available as GeoTIF files at spatial resolutions of 10', 5', 2.5', 1' and 30". | |||
=== PaleoClim maps === | |||
[http://www.paleoclim.org PaleoClim] provides free, high-resolution paleoclimate data for use in biological modeling and GIS. | |||
The data are available at 3 different spatial resolutions; from 2.5 arc-minutes (~5 km), 5 arc-minutes (~10 km), and 10 arc-minutes (~20 km). The CHELSA data are also available in 30 arc-seconds (~1 km). Each download is a “zip” file containing up to 19 GeoTiff (.tif) files, one for each of the bioclimatic variables. | |||
'''Bioclimatic parameters''' | |||
From the high-resolution monthly temperature and precipitation values, a set of derived parameters were calculated, broadly used in ecological applications. These bioclimatic variables are derived from the monthly mean temperature (or minimum and maximum temperature, depending on their availability) and precipitation values. They are specifically developed for species distribution modelling and related ecological applications . The procedure for generating bioclimatic variables followed WorldClim and used the ‘biovars’ function of the R package dismo. Output bioclimate layers were saved as individual GeoTiffs (*tif) and projected in the WGS 1984 projection. | |||
Bio_1=Annual Mean Temperature [°C*10] <br> | |||
Bio_2=Mean Diurnal Range [°C] <br> | |||
Bio_3=Isothermality [Bio_2/Bio_7] <br> | |||
Bio_4=Temperature Seasonality [standard deviation*100] <br> | |||
Bio_5=Max Temperature of Warmest Month [°C*10] <br> | |||
Bio_6=Min Temperature of Coldest Month [°C*10] <br> | |||
Bio_7=Temperature Annual Range [°C*10] <br> | |||
Bio_8=Mean Temperature of Wettest Quarter [°C*10] <br> | |||
Bio_9=Mean Temperature of Driest Quarter [°C*10] <br> | |||
Bio_10=Mean Temperature of Warmest Quarter [°C*10] <br> | |||
Bio_11=Mean Temperature of Coldest Quarter [°C*10] <br> | |||
Bio_12=Annual Precipitation [mm/year] <br> | |||
Bio_13=Precipitation of Wettest Month [mm/month] <br> | |||
Bio_14=Precipitation of Driest Month [mm/month] <br> | |||
Bio_15=Precipitation Seasonality [coefficient of variation]v | |||
Bio_16=Precipitation of Wettest Quarter [mm/quarter] <br> | |||
Bio_17=Precipitation of Driest Quarter [mm/quarter] <br> | |||
Bio_18=Precipitation of Warmest Quarter [mm/quarter] <br> | |||
Bio_19=Precipitation of Coldest Quarter [mm/quarter] <br> | |||
'''Time Periods Represented (bp)''' | |||
Pleistocene: late-Holocene, Meghalayan (4.2-0.3 ka) <br> | |||
Pleistocene: mid-Holocene, Northgrippian (8.326-4.2 ka) <br> | |||
Pleistocene: early-Holocene, Greenlandian (11.7-8.326 ka) <br> | |||
Pleistocene: Younger Dryas Stadial (12.9-11.7 ka) <br> | |||
Pleistocene: Bølling-Allerød ( 14.7-12.9 ka) <br> | |||
Pleistocene: Heinrich Stadial 1 (17.0-14.7 ka) <br> | |||
Pleistocene: Last Interglacial (ca. 130 ka) <br> | |||
Pleistocene: MIS19 (ca. 787 ka) <br> | |||
Pliocene: mid-Pliocene warm period (3.205 Ma) <br> | |||
Pliocene: M2 (ca. 3.3 Ma) | |||
== Population maps == | == Population maps == | ||
=== WorldPop === | |||
* http://www.worldpop.org.uk/ | |||
=== Gridded Population of the World === | === Gridded Population of the World === | ||
Line 347: | Line 716: | ||
* [http://en.poehali.org/maps Soviet topographic maps] as geocoded GeoTIFFs | * [http://en.poehali.org/maps Soviet topographic maps] as geocoded GeoTIFFs | ||
= Vector data = | |||
=== Natural Earth === | |||
* http://www.naturalearthdata.com/ data scaled for 1:10 million, 1:50 million and 1:110million | |||
=== CDC Geographic Boundary and Public Health Maps === | === CDC Geographic Boundary and Public Health Maps === | ||
Line 367: | Line 740: | ||
GSHHS is a high resolution shoreline dataset. It is derived from data in the public domain and licensed as GPL. The shorelines are constructed entirely from hierarchically arranged closed polygons. It is closely linked to the [[GMT]] project. | GSHHS is a high resolution shoreline dataset. It is derived from data in the public domain and licensed as GPL. The shorelines are constructed entirely from hierarchically arranged closed polygons. It is closely linked to the [[GMT]] project. | ||
==== Availability ==== | |||
* | * Download the original data set from http://www.soest.hawaii.edu/pwessel/gshhg/index.html. Also available at http://www.ngdc.noaa.gov/mgg/shorelines/data/gshhg/latest/. | ||
* | * The data set, or parts from it, can be extracted from [http://www.ngdc.noaa.gov/mgg/shorelines/shorelines.html NOAA's shoreline extractor]. | ||
: For GRASS 6 you can download 1:250,000 shoreline data from NOAA's site in Mapgen format, which can be imported with the {{cmd|v.in.mapgen}} module. | :For GRASS 6 you can download 1:250,000 shoreline data from NOAA's site in Mapgen format, which can be imported with the {{cmd|v.in.mapgen}} module. | ||
* '''Shapefiles''' | * '''ESRI Shapefiles''' of the latest version are available at http://www.ngdc.noaa.gov/mgg/shorelines/data/gshhg/latest/. The old 1.6 version is available at ftp://ftp.ihg.uni-duisburg.de/GIS/GISData/GSHHS/. | ||
==== Import ==== | |||
* Import with the GRASS6 add-on module {{AddonCmd|v.in.gshhs}} | |||
=== OpenStreetMap === | === OpenStreetMap === | ||
See the [[OpenStreetMap]] wiki page. | See the [[OpenStreetMap]] wiki page. | ||
==== Administrative boundaries from OpenStreetMap ==== | |||
For a convenient download in GeoJSON and SHAPE, see https://wambachers-osm.website/boundaries/ | |||
(using the amost invisible triangle, you can pop out details of a country down to admin level 8) | |||
=== SALB === | === SALB === | ||
Line 394: | Line 777: | ||
Check the [http://en.wikipedia.org/wiki/Vector_Map Wikipedia page] on VMAP, see the links at the bottom of that article to shapefile versions of VMAP0 and VMAP1. Those look like the versions that were, several years ago, on a NIMA (predecessor to NGA, and successor to the Defense Mapping Agency that managed the Digital Chart of the World and VMAP project) Website. Many GRASS users may prefer the shapefiles to the original Vector Product Format data. | Check the [http://en.wikipedia.org/wiki/Vector_Map Wikipedia page] on VMAP, see the links at the bottom of that article to shapefile versions of VMAP0 and VMAP1. Those look like the versions that were, several years ago, on a NIMA (predecessor to NGA, and successor to the Defense Mapping Agency that managed the Digital Chart of the World and VMAP project) Website. Many GRASS users may prefer the shapefiles to the original Vector Product Format data. | ||
* [http://gis-lab.info/qa/vmap0-eng.html VMap0 data in ESRI shape format] | |||
= See also = | |||
* [http://spatial-analyst.net/wiki/index.php?title=Global_datasets Global datasets] list by T. Hengl (with dataset download) | * [http://spatial-analyst.net/wiki/index.php?title=Global_datasets Global datasets] list by T. Hengl (with dataset download) | ||
* http://freegisdata.rtwilson.com/ | |||
* The FreeGIS.org database: http://www.freegis.org/database/ | * The FreeGIS.org database: http://www.freegis.org/database/ | ||
* http://finder.geocommons.com/ | * http://finder.geocommons.com/ | ||
Line 402: | Line 790: | ||
* http://www.geonames.org/data-sources.html | * http://www.geonames.org/data-sources.html | ||
* [http://ckan.net/tag/read/geo Open Knowledge Foundation link collection] | * [http://ckan.net/tag/read/geo Open Knowledge Foundation link collection] | ||
* [http://openweathermap.org/ Open Weather Map] free weather data and forecast API suitable for any cartographic services like web and smartphones applications. Ideology is inspired by OpenStreetMap and Wikipedia that make information free and available for everybody. | |||
=== Metadata Catalogues === | |||
Catalog Service for the Web (CSW) is an OGC standard for offering access to catalogues of geospatial information over the Internet (HTTP). CSW allow for discovering, browsing, and querying metadata about data, services, and similar resources. A list of Metadata Catalogues / CSW services from member states of the European Union can be found here:<br /> | |||
* [http://inspire-geoportal.ec.europa.eu/INSPIRERegistry/ http://inspire-geoportal.ec.europa.eu/INSPIRERegistry/]<br /> | |||
And here: [http://inspire-geoportal.ec.europa.eu/discovery/ http://inspire-geoportal.ec.europa.eu/discovery/] one can search European Metadata Catalogues online. | |||
=== European datasets === | |||
* [[European datasets]] | |||
* [http://preview.grid.unep.ch/index3.php?preview=data&lang=eng Global Risk Data Platform] | |||
* [http://open-data.europa.eu/open-data/data/ European Commission Opendata Portal]: 5800+ datasets | |||
* [http://eca.knmi.nl/download/ensembles/download.php E-OBS] This is the download page for the ENSEMBLES daily gridded observational dataset for precipitation, temperature and sea level pressure in Europe | |||
* [http://mars.jrc.ec.europa.eu/mars/About-us/AGRI4CAST/Data-distribution MARS @ JRC] Temperature, vapour pressure, rainfall, relative humidity, cloud cover, solar radiation, wind speed. | |||
* [http://www.efas.eu/ EFAS @ JRC] is a High resolution pan-European dataset for hydrologic modelling. | |||
* [http://data.jrc.ec.europa.eu/ JRC Data Portal] In this catalogue, you can find an inventory of data that produced by the JRC in accordance with the JRC data policy. The content is continuously updated and shall not be seen as a complete inventory of JRC data. Currently, the inventory describes only a small subset of JRC data. | |||
=== US datasets === | |||
* [[NLCD Land Cover|NLCD: National land cover database]] | |||
* [[CUSP Coastline|CUSP: NOAA Continually Updated Shoreline]] | |||
=== National datasets === | === National datasets === | ||
* [http://asdd.ga.gov.au/asdd/tech/zap/basic.html Australian Spatial Data Directory] | * [http://asdd.ga.gov.au/asdd/tech/zap/basic.html Australian Spatial Data Directory] | ||
* [http://aekos.org.au/home Australian Ecological Knowledge and Observation System] | |||
* [http://wiki.gfoss.it/index.php/GIS_Open_Data Italian Geodata collection] | * [http://wiki.gfoss.it/index.php/GIS_Open_Data Italian Geodata collection] | ||
* [http://koordinates.com/ New Zealand] data from Koordinates.com | * [http://koordinates.com/ New Zealand] data from Koordinates.com | ||
Line 411: | Line 821: | ||
* [http://geodata.gov.gr/geodata/ Greek Public Geodata] (in Greek) | * [http://geodata.gov.gr/geodata/ Greek Public Geodata] (in Greek) | ||
=== | === Various datasets worldwide === | ||
* [http:// | * [http://geospatial.edublogs.org/ GEOSPATIAL DATA REPORT]: Finding and Using GIS Data | ||
* [http://www.edenextdata.com/?q=data Edenext data portal]: Land Cover, Transport networks, Elevation, Orthoimagery, Human health and safety, Species Distribution, Atmospheric Conditions and Meteorological Geographical Features, Training Program Presentations and Data, Utility and governmental services, Hydrography, Soil, Bio geographical regions, Population distribution and Demographics | |||
* [http://gdex.cr.usgs.gov/gdex/ Global Data Explorer USGS]: ASTER, SRTM, GTOPO etc | |||
* [http://www.landcover.org/ landcover] | |||
* [http://www.gripweb.org/gripweb/?q=data-information GRIPWEB’s Data & Informational Portal]: hazard & risk | |||
* [http://sedac.ciesin.columbia.edu/data/sets/browse SEDAC]: Agriculture, Climate, Conservation, Framework Data, Governance, Hazards, Health, Infrastructure, Land Use, Marine and Coastal, Population, Poverty, Remote Sensing, Sustainability, Urban, Water | |||
* [http://www.preventionweb.net/english/professional/maps/?pid:6&pih:2 Prevention Web]: hazard & risk | |||
* [http://data.un.org/Default.aspx UNdata]: UN database | |||
* [http://www.undp.org/content/undp/en/home.html UNDP home page] | |||
* [http://www.cgiar-csi.org/data global climatic data] | |||
* [http://csi.cgiar.org/cgiargeospatialtools.asp cosortium for spatial information CGIAR-CSI GeoSpatial Toolkits] | |||
* [http://freegisdata.rtwilson.com/ Links to over 300 sites providing freely available geographic datasets] | |||
* [http://www.diva-gis.org/Data Free Spatial Data] | |||
* [http://edc2.usgs.gov/glcc/globe_int.php Global Land Cover Characteristics Data Base Version 2.0] | |||
* [http://opentopo.sdsc.edu/gridsphere/gridsphere?cid=datasets A Portal to High-Resolution Topography Data and Tools] | |||
* [http://www.metoffice.gov.uk/hadobs/hadghcnd/ HadGHCND] is a gridded daily temperature dataset based upon near-surface maximum (TX) and minimum (TN) temperature observations. | |||
=== | === WMS servers === | ||
* [ | * See [[WMS]] page | ||
=== River discharge data === | |||
* [http://www.bafg.de/GRDC/EN/Home/homepage_node.html Global Runoff Data Centre] | |||
* [http://www.sage.wisc.edu/riverdata/ Global River Discharge Database] | |||
* [http://csdms.colorado.edu/wiki/River_discharge_data CSDMS] | |||
[[Category: Geodata]] | |||
[ | [[Category: Import]] |
Latest revision as of 21:50, 10 July 2023
Raster data
Elevation data
ASTER topography (GDEM V1)
Improved ASTER GDEM 1 from 2009:
GDEM global 30m elevation calculated from stereo-pair images collected by the Terra satellite. "This is the most complete, consistent global digital elevation data yet made available to the world." This is a very new dataset, at version 1 (treat as experimental). Accuracy will be improved in forthcoming versions (validation with SRTM, etc.; see assessment here and here).
- pre-release announcement
- NASA press release
- Warehouse Inventory Search Tool or Easy search tool (Data download)
Tutorial: ASTER topography
See also: ASTER GDEM 30m quality assessment
ASTER topography (GDEM V2)
Improved ASTER GDEM 2 from 2011:
The ASTER GDEM covers land surfaces between 83°N and 83°S and is comprised of 22,702 tiles. Tiles that contain at least 0.01% land area are included. The ASTER GDEM is distributed as Geographic Tagged Image File Format (GeoTIFF) files with geographic coordinates (latitude, longitude). The data are posted on a 1 arc-second (approximately 30–m at the equator) grid and referenced to the 1984 World Geodetic System (WGS84)/ 1996 Earth Gravitational Model (EGM96) geoid.
Notes: this DEM can be rather well filtered and smoothed with the Sun's denoising algorithm (using GDAL and free / open source program <mdenoise> or simply GRASS add-on r.denoise.
Experiments showed that the best smoothing of ASTER GDEM 2 is reached with such parameters of <mdenoise>:
- threshold = 0.8
- iterations = 10-20
Also filtering with r.neighbors by "average" method and window size >=5 is quite useful to remove some noise from DEM.
See also: Validation of the ASTER Global Digital Elevation Model Version 2 over the Conterminous United States
ACE2
The ACE2 Global Digital Elevation Model is available at 3", 30" and 5' spatial resolutions.
Import example:
r.in.bin -f input="00N105E_3S.ACE2" output="ACE2_00N105E" bytes=4 \ order="native" north=15 south=0 east=120 west=105 \ rows=18000 cols=18000
CleanTOPO2 (DEM)
- CleanTOPO2 download: Edited SRTM30 Plus World Elevation Data
Import in GRASS:
r.in.gdal CleanTOPO2.tif out=cleanTOPO2.tmp -l -o g.region rast=cleanTOPO2 -p -g # rescale from odd integer values to true world values r.rescale cleanTOPO2.tmp out=cleanTOPO2 to=-10701,8248 r.colors cleanTOPO2_final col=terrain
EGM2008 Geoid Data (Earth Gravitational Model)
Global 2.5 Minute Geoid Undulations:
- download GIS Format at http://earth-info.nga.mil/GandG/wgs84/gravitymod/egm2008/egm08_gis.html
Verifications of points can be done with the http://geographiclib.sourceforge.net/cgi-bin/GeoidEval
ETOPO (DEM)
The ETOPO datasets provide global topography and bathymetry at 1', 2', and 5' per-cell resolutions.
ETOPO1 (DEM)
- The cell registered version can be loaded directly into a lat/lon location. GRASS raster data is cell registered (see the GRASS raster semantics page)
- Special care must be taken with the grid registered version. It can not be loaded directly into a lat/lon location as the parameters found in the .hdr file exceed the limits of polar coordinate space: they have N,S rows which go 1/2 a cell beyond 90 latitude, when considered in the cell registered convention.
- So the data needs to have those 90deg N,S rows cropped away, and while we're at it we crop away a redundant overlapping column at 180 longitude. To do this we have to first tell the GIS a little fib during import to squeeze the data into lat/lon space, then crop away the spurious rows and column, then finally reset the resulting map's bounds to its true extent.
# Import grid registered binary float, fibbing about its true extent
r.in.bin -f in=etopo1_bed_g.flt out=etopo1_bed_g.raw \
n=90 s=-90 e=180 w=-180 rows=10801 cols=21601 anull=-9999
# reduce the working region by 1 cell
g.region rast=etopo1_bed_g.raw
eval `g.region -g`
g.region n=n-$nsres s=s+$nsres e=e-$ewres -p
# save smaller raster and remove original
r.mapcalc "etopo1_bed_g.crop = etopo1_bed_g.raw"
g.remove etopo1_bed_g.raw
# re-establish the correct bounds, now that they'll fit
r.region etopo1_bed_g.crop n=89:59:30N s=89:59:30S w=179:59:30E e=179:59:30E
g.region rast=etopo1_bed_g.crop
# check that N,S,E,W and Res are all nice and clean:
r.info etopo1_bed_g.crop
# looks good, so accept the results by resetting the map name
g.rename etopo1_bed_g.crop,etopo1_bed_g
# set to use appropriate color rules
r.colors etopo1_bed_g color=etopo2
# set the 'units' metadata field (for elevation data contained within the map)
r.support etopo1_bed_g units=meters
- For the problematic grid registered version, the resulting r.info report should look like:
| Rows: 10799 | | Columns: 21600 | | Total Cells: 233258400 | | Projection: Latitude-Longitude | | N: 89:59:30N S: 89:59:30S Res: 0:01 | | E: 179:59:30E W: 179:59:30E Res: 0:01 | | Range of data: min = -10898 max = 8271 |
(the east and west bounds of the map touch 1/2 a cell west of 180 longitude)
- For the problematic grid registered version, since the data's grid is 1/2 a cell shifted from nicely rounded 1 arc-minutes (0:01), you'll need to ensure that the mapset's region preserves that alignment after zooming or panning:
g.region align=etopo1_bed_g -p
- (or oversample and set the region resolution to 1/2 arc-minutes (0:00:30), which will be four times as slow)
ETOPO2 (DEM)
- See the ETOPO2 (2' global) article by M.H. Bowman in the GRASS Newsletter, 1:8-11, August 2004.
- ETOPO2v2 data download (take for example the ETOPO2v2g_f4_LSB.flt file)
GTOPO30 (DEM)
Note: To avoid that the GTOPO30 data are read incorrectly, you can add a new line "PIXELTYPE SIGNEDINT" in the .HDR to force interpretation of the file as signed rather than unsigned integers. Then the .DEM file can be imported. Finally, e.g. the 'terrain' color table can be assigned to the imported map with r.colors.
Global Multi-resolution Terrain Elevation Data 2010 (GMTED2010)
- Data download: Web and FTP - Import with r.in.gdal. See also related GDAL blog post
Tiles: Import of GMTED2010 tiles in GRASS GIS:
r.in.gdal 30N000E_20101117_gmted_mea075.tif out=gmted2010_30N000E_20101117 r.colors gmted2010_30N000E_20101117 color=elevation g.region rast=gmted2010_30N000E_20101117 r.relief input=gmted2010_30N000E_20101117 output=gmted2010_30N000E_20101117.shade r.shade shade=gmted2010_30N000E_20101117.shade color=gmted2010_30N000E_20101117 \ output=gmted2010_30N000E_20101117_shaded d.mon wx0 d.rast gmted2010_30N000E_20101117_shaded d.grid 1 color=red textcolor=red
Full maps:
# mean elevation global GMTED2010 map, 30 arc-sec wget http://edcintl.cr.usgs.gov/downloads/sciweb1/shared/topo/downloads/GMTED/Grid_ZipFiles/mn30_grd.zip unzip mn30_grd.zip
Important: the GMTED2010 map exceeds the -180°..+180° range due to the GMTED2010 pixel geometry (PDF). Note that this cannot be handled in GRASS GIS < 7.4. Please update to GRASS GIS 7.4 or newer.
GEBCO Bathymetric Chart
- The General Bathymetric Chart of the Oceans (original 1' release 2003, new 1' and 30" releases 2008, new 15" released 2020)
- http://www.gebco.net/data_and_products/gridded_bathymetry_data/
- http://www.bodc.ac.uk/data/online_delivery/gebco/
The GEBCO_2020 is available in NetCDF or GeoTIFF format.
r.in.gdal can be used to import the GMT netCDF files directly, or if that doesn't work you can use GMT tools to convert to an old-style native GMT format and import that with r.in.bin.
- example: (GEBCO 2003 1' data)
# convert to an old style GMT binary .grd using grdreformat $ grdreformat 3n24s47w14w.grd 3n24s47w14w_Native.grd=bs # then import into GRASS, GRASS> r.in.bin -h -s bytes=2 in=3n24s47w14w_Native.grd out=3n24s47w14w # and set some nice colors GRASS> r.colors 3n24s47w14w rules=- << EOF nv magenta 0% black -7740 0:0:168 0 84:176:248 0 40:124:0 522 68:148:24 1407 148:228:108 1929 232:228:108 2028 232:228:92 2550 228:160:32 2724 216:116:8 2730 grey 2754 grey 2760 252:252:252 2874 252:252:252 2883 192:192:192 2913 192:192:192 100% 252:252:252 EOF
Global Multi-Resolution Topography (GMRT DEM)
- From Columbia University's Lamont-Doherty Earth Observatory
(it is reported that this is what Google Maps uses for their global bathymetry)
- Global ~1 arc-second (~90 m) topography using multi-beam and satellite data in the oceans combined with SRTM on land.
- Full information at: http://www.marine-geo.org/portals/gmrt/
- Accessible via GeoMapApp or Virtual Ocean software.
- Very convenient to download into GRASS via wget:
export `g.region -g` wget "http://www.marine-geo.org/cgi-bin/getgridB?west=${w}&east=${e}&south=${s}&north=${n}&resolution=1" -O /tmp/test.grd r.in.gdal /tmp/test.grd output=GMRT -o rm /tmp/test.grd
- Note: Downloaded file contains no projection information, but is EPSG:4326 (WGS84 Geographic). The file size is limited, but lower resolution (resolution=2,4,8) data can be downloaded for larger areas.
NASADEM
1-arc second (~30 m @ equator) global only-land.
https://lpdaac.usgs.gov/news/release-nasadem-data-products/
See also r.in.nasadem addon
Smith and Sandwell DEM
- Merge info here from the Marine Science wiki page
SRTM DEM
Space Shuttle Radar Topography Mission - several SRTM Data Products are available:
- Original data - SRTM 3 V001 arc-seconds Non-Void Filled elevation data (US: 1 arc-second (approximately 30 meters); outside the US at 3 arc-seconds (approximately 90 meters))
- SRTM V003 3 Arc-Second Global Void Filled elevation data, with voids filled using interpolation algorithms in conjunction with other sources of elevation data (US: 1 arc-second (approximately 30 meters); outside the US at 3 arc-seconds (approximately 90 meters))
- SRTM V3 tiles at 3 arc seconds resolution from: http://e4ftl01.cr.usgs.gov/SRTM/SRTMGL3.003/2000.02.11/ - or simply use r.in.srtm.region
- SRTM V003 1 Arc-Second Global elevation data offer worldwide coverage of void filled data at a resolution of 1 arc-second (30 meters) and provide open distribution of this high-resolution global data set.
- EarthExplorer can be used to search, preview, and download Shuttle Radar Topography Mission (SRTM) 1 Arc-Second Global data. The collections are located under the Digital Elevation category.
- FTP download: http://e4ftl01.cr.usgs.gov/SRTM/SRTMGL1.003/2000.02.11/ - or simply use r.in.srtm.region
- Web-based 30-Meter SRTM Tile Downloader (select from map)
Import:
- Using r.in.gdal or r.import or r.in.srtm or r.in.srtm.region
- see HOWTO import SRTM elevation data, focused on the SRTM 3 arc-seconds Non-Void Filled elevation data
SRTM15+ DEM
SRTM15+ data consists of 33 files of global topography in the same format as the SRTM30plus products. The grid resolution is 15 seconds which is roughly 500 m at the equator.
https://topex.ucsd.edu/WWW_html/srtm15_plus.html
SRTM30plus data DEM
SRTM30plus data consists of 33 files of global topography in the same format as the SRTM30 products distributed by the USGS EROS data center. The grid resolution is 30 seconds which is roughly one kilometer (1 km).
Land data are based on the 1-km averages of topography derived from the USGS SRTM30 grided DEM data product created with data from the NASA Shuttle Radar Topography Mission. GTOPO30 data are used for high latitudes where SRTM data are not available.
Ocean data are based on the Smith and Sandwell global 2-minute grid between latitudes +/- 72 degrees. Higher resolution grids have been added from the LDEO Ridge Multibeam Synthesis Project and the NGDC Coastal Relief Model. Arctic bathymetry is from the International Bathymetric Chart of the Oceans (IBCAO).
All data are derived from public domain sources and these data are also in the public domain.
GRASS 6 script r.in.srtm described in GRASSNews vol. 3 won't work with this dataset (as it was made for the original SRTM HGT files). But you can import SRTM30plus tiles into GRASS this way:
r.in.bin -sb input=e020n40.Bathymetry.srtm output=e020n40_topex bytes=2 \ north=40 south=-10 east=60 west=20 r=6000 c=4800 r.colors e020n40_topex rules=etopo2
- Source
- GRASS Users Mailing List http://lists.osgeo.org/pipermail/grass-user/2005-August/030063.html
- Getting as SRTM30plus tiles
- ftp://topex.ucsd.edu/pub/srtm30_plus/srtm30/data/
- Getting as SRTM30plus huge file
- ftp://topex.ucsd.edu/pub/srtm30_plus/topo30/
- SRTMPLUS WCS server
- http://svn.osgeo.org/gdal/trunk/autotest/gdrivers/data/srtmplus.wcs (read with r.external)
SRTM Water Body Database SRTMSWBD V003
SRTM Water Body Database V003
- Format documentation: https://lpdaac.usgs.gov/dataset_discovery/measures/measures_products_table/srtmswbd_v003
- FTP raster data (30m res water bodies): http://e4ftl01.cr.usgs.gov/SRTM/SRTMSWBD.003/
Import into GRASS GIS 7 (lat-long location):
r.in.bin -sb input=N00E108.raw output=N00E108_swbd bytes=1 north=0 south=-10 east=108 west=98 r=3601 c=3601 <<= DRAFT - TODO fix n,s,e,w - calculate from filename
TanDEM-X DEM
This is a 90 m only-land DEM. Data from 2010-12-12 through 2015-01-16
https://geoservice.dlr.de/data-assets/ju28hc7pui09.html
Soil data
Harmonized World Soil Database (HWSD Database)
Download: http://webarchive.iiasa.ac.at/Research/LUC/External-World-soil-database/HTML/
Spatial reference system: EPSG:4326 (LatLong WGS84)
Import:
grass70 -c EPSG:4326 ~/grassdata/hwsd # -e: expand location to dataset; -o: override (missing) projection in input dataset: r.in.gdal input=hwsd.bil output=hwSoil -e -o g.region raster=hwSoil -p r.category hwSoil
The data is distributed with an MSAccess .mdb which contains additional data for each of the categories in the raster file. Opening the file in access, the data is found in the query "HWSD_Q". Save this query in .csv format (with a name like "HWSD_Q.csv") so that it may then be imported into GRASS. After that, it is necessary to replace the commas with dots (find & replace) in the .csv file. Before you can import it, you also need a file "HWSD_Q.csvt", which contains a single line listing the type for each column in the database:
"Integer","String","Integer","Integer","Integer","String","Integer","Integer","Real","Integer","String","Integer","String","Integer","String","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Integer","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real","Integer","Integer","Integer","Integer","Integer","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real","Real"
With both the .csv and the .csvt file in the same directory, you can then import them into GRASS:
db.in.ogr input=~/grassdata/hwsd/HWSD_Q.csv output=hwsdData
The data cannot be connected directly to the raster, it must be converted to a vector first:
g.region raster=hwSoil r.to.vect -v input=hwSoil output=hwSoil feature=area v.db.droptable hwSoil db.droptable -f hwSoil # delete the table completely
Note that the table includes multiple rows for each polygon, corresponding to the dominant and various numbers of subdominant soils. To select only the dominant soil layer:
db.select table=hwsdData sql='select * from hwsdData where SEQ = 1' \ output=domSoil.csv separator=,
This saves a copy of the table that contains only the dominant soil type for each polygon as domSoil.csv. This needs to be reloaded into the GRASS database. Since it has the same columns as HWSD_Q.csv, we can use the labels for that file:
cp HWSD_Q.csvt domSoil.csvt
Then we can load domSoil.csv:
db.in.ogr \ input=~/grassdata/downloads/harmonized_world_soil_database/domSoil.csv \ output=domSoil
Now at last we can connect the database to the vector file:
v.db.connect -o map=hwsd table=domSoil driver=sqlite key=MU_GLOBAL
To create a new raster map taking the values from the table:
g.region raster=hwSoil ## make sure we get the whole map v.to.rast in=hwSoil out=T_SAND col=T_SAND
SoilGrids.org 250m soil taxonomy map
SoilGrids is a system for automated soil mapping based on global soil profile and environmental covariate data. SoilGrids represents a collection of updatable soil property and class maps of the world at 1 km and 250 m spatial resolution produced using automated soil mapping based on machine learning algorithms. It aims at becoming OpenStreetMap and/or OpenWeatherMap for soil data. SoilGrids predictions are updated on a regular basis (at least every few months). For more details about the SoilGrids system, please refer to the SoilGrids project site: https://www.soilgrids.org/#/?layer=geonode:taxnwrb_250m
URL=ftp://ftp.soilgrids.org/data/recent/TAXNWRB_250m_ll.tif
# the Soilgrids GeoTIFF data suffer from a resolution precision problem since they were produced with SAGA:
# resolution is stored as 0.002083333000000 while it should be 0.002083333333333, hence the geometry is not fully correct
# this likely originates from Soilgrids being processed in SAGA which cuts decimals after the 10th decimal place, hence comes with a precision problem
export NAME=`basename $URL .tif`
wget $URL
OLD OLD OLD start --
# see below for the better way how to fix SoilGrids data
gdal_translate --config GDAL_CACHEMAX 2000 -a_ullr $COORDS -co "COMPRESS=DEFLATE" $NAME.tif ${NAME}_fixed.tif
gdalinfo ${NAME}_fixed.tif
grass72 -c ${NAME}_fixed.tif ~/grassdata/latlong --exec r.import input=${NAME}_fixed.tif output=${NAME}
-- OLD OLD OLD end
New fix & import method:
Starting with GRASS GIS 7.4.x, there is new flag in r.in.gdal to auto-adjust such small resolution precision issues: -a - Auto-adjustment for lat/lon. Attempt to fix small precision errors in resolution and extents.
r.in.gdal -a input=TAXNWRB_250m_ll.tif output=TAXNWRB_250m_ll
Landcover data
ESA Globcover dataset
Download: http://due.esrin.esa.int/page_globcover.php
Or via command line:
wget http://due.esrin.esa.int/files/Globcover2009_V2.3_Global_.zip unzip Globcover2009_V2.3_Global_.zip # rm -f Globcover2009_V2.3_Global_.zip
Note, also a coloured version of the map in GeoTIFF format is available at: http://due.esrin.esa.int/files/GLOBCOVER_L4_200901_200912_V2.3.color.tif
Unfortunately the Globcover map exceeds the -180°..+180° range etc, indicating a shift of the map (see also this assessment by DWD):
gdalinfo GLOBCOVER_L4_200901_200912_V2.3.tif Driver: GTiff/GeoTIFF Files: GLOBCOVER_L4_200901_200912_V2.3.tif Size is 129600, 55800 Coordinate System is: GEOGCS["WGS 84", ... Origin = (-180.001388888888897,90.001388888888883) ... Corner Coordinates: Upper Left (-180.0013889, 90.0013889) (180d 0' 5.00"W, 90d 0' 5.00"N) Lower Left (-180.0013889, -64.9986111) (180d 0' 5.00"W, 64d59'55.00"S) Upper Right ( 179.9986111, 90.0013889) (179d59'55.00"E, 90d 0' 5.00"N) Lower Right ( 179.9986111, -64.9986111) (179d59'55.00"E, 64d59'55.00"S) Center ( -0.0013889, 12.5013889) ( 0d 0' 5.00"W, 12d30' 5.00"N) ...
How to fix this?
Option 1: You can use the -l flag of r.in.gdal to constrain the map coordinates to legal values (ref. But the resulting pixels will no longer have the original resolution. We will not do that.
Option 2: Shift the Globcover map slightly into the right position using gdal_translate:
# coords are shifted, fix raster map # -a_ullr Assign/override the georeferenced bounds of the output file # use larger cache and compress result gdal_translate --config GDAL_CACHEMAX 1200 -a_ullr -180 90 180 -65 \ -co "COMPRESS=LZW" GLOBCOVER_L4_200901_200912_V2.3.tif GLOBCOVER_L4_200901_200912_V2.3_fixed.tif # result: gdalinfo GLOBCOVER_L4_200901_200912_V2.3_fixed.tif ... Origin = (-180.000000000000000,90.000000000000000) Pixel Size = (0.002777777777778,-0.002777777777778) ... Corner Coordinates: Upper Left (-180.0000000, 90.0000000) (180d 0' 0.00"W, 90d 0' 0.00"N) Lower Left (-180.0000000, -65.0000000) (180d 0' 0.00"W, 65d 0' 0.00"S) Upper Right ( 180.0000000, 90.0000000) (180d 0' 0.00"E, 90d 0' 0.00"N) Lower Right ( 180.0000000, -65.0000000) (180d 0' 0.00"E, 65d 0' 0.00"S) Center ( 0.0000000, 12.5000000) ( 0d 0' 0.01"E, 12d30' 0.00"N)
Voilà! Now we can import the map into GRASS GIS:
r.in.gdal input=GLOBCOVER_L4_200901_200912_V2.3_fixed.tif output=esa_globcover2009
Legend conversion: The ZIP file contains a XLS table describing the classes and the RGB colors. Using ogr2ogr can directly convert XLS --> CSV:
ogr2ogr -f CSV Globcover2009_Legend.csv Globcover2009_Legend.xls
Applying the legend:
# suppress table header and only consider category value and label, apply on the fly: cat Globcover2009_Legend.csv | grep -v '^Value' | cut -d',' -f1-2 | r.category esa_globcover2009 separator=comma rules=- # verify (0E, 0N is the Atlantic Ocean) r.what esa_globcover2009 coor=0,0 -f 0|0||210|Water bodies
Global Forest Change
- http://earthenginepartners.appspot.com/science-2013-global-forest
- Download info on: http://earthenginepartners.appspot.com/science-2013-global-forest/download_v1.3.html
Imagery
AVHRR
- see the AVHRR wiki page
Blue Marble imagery
NASA's Blue Marble is a 500m-8 degree per-cell world wide visual image of the Earth from space, with the clouds removed.
- see the Blue Marble wiki page
EO-1 imagery
(Earth Observing-1)
- "Advanced Land Imager (ALI) provides image data from ten spectral bands (band designations). The instrument operates in a pushbroom fashion, with a spatial resolution of 30 meters for the multispectral bands and 10 meters for the panchromatic band."
- On-board Atmospheric Corrections
Global Land Cover Characteristics
USGS et al. generated dataset at 1km resolution. Provides global landcover characteristics.
- see the Global Land Cover Characteristics wiki page
LANDSAT imagery
Since October 1, 2008 all Landsat 7 ETM+ scenes held in the USGS EROS archive are available for download at no charge.
- Download via the Glovis online search tool (req. Java)
- Download via the USGS's EarthExplorer interface
Import Modules
- r.in.gdal - Main import tool for complete multiband scenes
- r.in.wms - Download data covering current map region via WMS server
- r.in.onearth - WMS frontend for NASA's OnEarth Global Landsat Mosaic
Color balancing modules
- i.landsat.rgb (GRASS 6.x) | i.colors.enhance (GRASS 7.x) - Color balancing/enhancement tool
See also
- Processing tips can be found on the LANDSAT wiki page
ESA Sentinel imagery
The i.sentinel toolbox of addons provides a complete suite for downloading, importing and preprocessing Sentinel imagery.
For direct access, all Sentinel 1 and 2 data is available for download from the Open Access Hub
- via the online interactive interface
- via the API
Other pre-processing tools are available at:
- http://step.esa.int/main/ Scientific Toolbox Exploitation Platform
- https://github.com/Fernerkundung/awesome-sentinel ("Awesome Sentinel" - list of tools)
Miscellaneous
Data sources
- Some datasource links: http://www.ruf.rice.edu/~ben/gmt.html
- Geotorrent.org
Import Modules
- The r.in.gdal modules may be used to import data of many formats, including GMT netCDF
- The r.in.bin module may be used to import raw binary files
MODIS imagery
- see the MODIS wiki page
Natural Earth imagery
- Natural Earth II: World environment map in natural color. GeoTIFF (use the r.in.gdal module)
- see also 1:10 million, 1:50 million and 1:110million scale maps from http://www.naturalearthdata.com/
Earth at Night: nightlight maps
- Earth at Night: Flat Maps https://earthobservatory.nasa.gov/features/NightLights/page3.php (GeoTIFFs)
Orthoimagery
Pathfinder AVHRR SST imagery
- see the Pathfinder AVHRR SST wiki page
QuickBird imagery
- See the QuickBird wiki page
SeaWiFS imagery
- see the SeaWiFS wiki page
SPOT Vegetation imagery
SPOT Vegetation (1km) global: NDVI data sets
- SPOT Vegetation (1km, global) NDVI data set server
- for import, see i.in.spotvgt
True Marble imagery
- True Marble: 250m world wide visual image of the Earth from space, with the clouds removed. GeoTIFF (use the r.in.gdal module)
Climatic data
OGC WCS - Albedo example
TODO: update this example e.g. to http://demo.mapserver.org/cgi-bin/wcs?SERVICE=wcs&VERSION=1.0.0&REQUEST=GetCapabilities
GRASS imports OGC Web Coverage Service data. Example server (please suggest a better one!)
<WCS_GDAL> <ServiceURL>http://laits.gmu.edu/cgi-bin/NWGISS/NWGISS?</ServiceURL> <CoverageName>AUTUMN.hdf</CoverageName> <Timeout>90</Timeout> <Resample>nearest</Resample> </WCS_GDAL>
Save this as albedo.xml. Import into a LatLong WGS84 location:
r.in.gdal albedo.xml out=albedo
Unfortunately this server sends out the map shifted by 0.5 pixel. This requires a fix to the map boundary coordinates:
r.region albedo n=90 s=-90 w=-180 e=180
Now apply color table and look at the map:
r.colors albedo color=byr d.mon x0 d.rast albedo
SNODAS maps
Snow Data Assimilation System data that support hydrological modeling and analysis. First download the data, and untar them (once for each month, and once for each day), and you should get pairs of “.dat” and “.Hdr” files. The data files are stored in flat 16-bit binary format, so assuming that “snowdas_in.dat” is the name of the input file, at the GRASS prompt:
r.in.bin -bs bytes=2 rows=3351 cols=6935 north=52.874583333332339 \ south=24.949583333333454 east=-66.942083333334011 west=-124.733749999998366 \ anull=-9999 input=snowdas_input.dat output=snowdas
CHELSA climate maps
CHELSA – Climatologies at high resolution for the earth’s land surface areas is a high resolution (30 arc sec) climate data set for the earth land surface areas currently under development, see http://chelsa-climate.org/
Version 1.1 has some coordinate issues originating from SAGA being used (coordinate precision issue), see http://chelsa-climate.org/known-issues/
# WARNING: dirty hack - Better wait for the new release V1.2 of CHELSA!
for i in `ls /scratch/chelsa_climate/*.zip` ; do
unzip $i
NAME=`basename $i .zip`
gdal_translate --config GDAL_CACHEMAX 2000 -a_ullr -180 84 180 -90 -co "COMPRESS=DEFLATE" $NAME.tif ${NAME}_fixed.tif
rm -f $NAME.tif
done
WorldClim maps
WorldClim is a set of global climate layers (climate grids) with a spatial resolution of a square kilometer. Besides long-term average climate layers (representing the period 1950 - 2000) it also includes projections for future conditions based on downscaled global climate model (GCM) data from CMIP5 (IPPC Fifth Assessment) and projections of past conditions (downscaled global climate model output).
- Load into a Lat/Lon WGS84 location (EPSG:4326)
- The data set is provided in two formats: BIL and ESRI Grd. Import with r.in.bin or r.in.gdal. Version 1.4 has some coordinate issues:
a) BIL: binary format is 2 byte integer. Multiply by 10 using r.mapcalc to convert units. See http://www.worldclim.org/format.htm for more information and the MODIS help page for example of converting raw to data units. Note that the file header is missing a line. To fix:
# fix WorldClim's BIL; tmean example for i in $(seq 1 12); do echo “PIXELTYPE SIGNEDINT” >>tmean$i.hdr; done
b) ESRI grd files: Note that the WorldClim ESRI grd files suffer from a quality issue of coordinate precision. See here for a solution.
# fix WorldClim's ESRI Grd; tmean example export GDAL_CACHEMAX=2000 mkdir -p ~/tmp/ # fix broken WorldClim files, see https://lists.osgeo.org/pipermail/grass-user/2011-January/059358.html # note: 60S, not 90S for i in $(seq 1 12); do gdal_translate -a_ullr -180 90 180 -60 tmean_$i $HOME/tmp/tmean_${i}_fixed.tif; done # # import for i in $(seq 1 12) ; do r.in.gdal input=$HOME/tmp/tmean_${i}_fixed.tif out=tmp --o ; g.region raster=tmp -p ; r.mapcalc "tmean_${i} = 0.1 * tmp" --o ; r.colors tmean_${i} color=celsius ; done # # clean up g.remove raster name=tmp -f rm -f ~/tmp/tmean_?_fixed.tif ; rm -f ~/tmp/tmean_??_fixed.tif
Africlim maps
Africlim provides four baseline data sets for current climate, including:
- CRU CL 2.0
- WorldClim v1.4
- TAMSAT TARCAT v2.0 (rainfall only)
- CHIRPS v1.8 (rainfall only).
It furthermore provides data sets with projections of future climates based on combinations of ten general circulation models (GCMs), downscaled using five regional climate models (RCMs) and the four above mentioned contemporary baselines, under two representative concentration pathways of the IPCC-AR5 (RCP4.5 and RCP8.5). The data layers are available as GeoTIF files at spatial resolutions of 10', 5', 2.5', 1' and 30".
PaleoClim maps
PaleoClim provides free, high-resolution paleoclimate data for use in biological modeling and GIS.
The data are available at 3 different spatial resolutions; from 2.5 arc-minutes (~5 km), 5 arc-minutes (~10 km), and 10 arc-minutes (~20 km). The CHELSA data are also available in 30 arc-seconds (~1 km). Each download is a “zip” file containing up to 19 GeoTiff (.tif) files, one for each of the bioclimatic variables.
Bioclimatic parameters
From the high-resolution monthly temperature and precipitation values, a set of derived parameters were calculated, broadly used in ecological applications. These bioclimatic variables are derived from the monthly mean temperature (or minimum and maximum temperature, depending on their availability) and precipitation values. They are specifically developed for species distribution modelling and related ecological applications . The procedure for generating bioclimatic variables followed WorldClim and used the ‘biovars’ function of the R package dismo. Output bioclimate layers were saved as individual GeoTiffs (*tif) and projected in the WGS 1984 projection.
Bio_1=Annual Mean Temperature [°C*10]
Bio_2=Mean Diurnal Range [°C]
Bio_3=Isothermality [Bio_2/Bio_7]
Bio_4=Temperature Seasonality [standard deviation*100]
Bio_5=Max Temperature of Warmest Month [°C*10]
Bio_6=Min Temperature of Coldest Month [°C*10]
Bio_7=Temperature Annual Range [°C*10]
Bio_8=Mean Temperature of Wettest Quarter [°C*10]
Bio_9=Mean Temperature of Driest Quarter [°C*10]
Bio_10=Mean Temperature of Warmest Quarter [°C*10]
Bio_11=Mean Temperature of Coldest Quarter [°C*10]
Bio_12=Annual Precipitation [mm/year]
Bio_13=Precipitation of Wettest Month [mm/month]
Bio_14=Precipitation of Driest Month [mm/month]
Bio_15=Precipitation Seasonality [coefficient of variation]v
Bio_16=Precipitation of Wettest Quarter [mm/quarter]
Bio_17=Precipitation of Driest Quarter [mm/quarter]
Bio_18=Precipitation of Warmest Quarter [mm/quarter]
Bio_19=Precipitation of Coldest Quarter [mm/quarter]
Time Periods Represented (bp)
Pleistocene: late-Holocene, Meghalayan (4.2-0.3 ka)
Pleistocene: mid-Holocene, Northgrippian (8.326-4.2 ka)
Pleistocene: early-Holocene, Greenlandian (11.7-8.326 ka)
Pleistocene: Younger Dryas Stadial (12.9-11.7 ka)
Pleistocene: Bølling-Allerød ( 14.7-12.9 ka)
Pleistocene: Heinrich Stadial 1 (17.0-14.7 ka)
Pleistocene: Last Interglacial (ca. 130 ka)
Pleistocene: MIS19 (ca. 787 ka)
Pliocene: mid-Pliocene warm period (3.205 Ma)
Pliocene: M2 (ca. 3.3 Ma)
Population maps
WorldPop
Gridded Population of the World
Import with r.in.gdal, assign population color table with r.colors
Topographic maps
Soviet topographic maps
- Soviet topographic maps as geocoded GeoTIFFs
Vector data
Natural Earth
- http://www.naturalearthdata.com/ data scaled for 1:10 million, 1:50 million and 1:110million
CDC Geographic Boundary and Public Health Maps
Global Administrative Areas
- GADM is a database of the location of the world's administrative areas (boundaries) available in shapefiles.
- http://gadm.org (extracted by country here)
- World Borders Dataset including ISO 3166-1 Country codes available in shapefiles.
- Free GIS data from Mapping Hacks
GSHHS World Coastline
GSHHS is a high resolution shoreline dataset. It is derived from data in the public domain and licensed as GPL. The shorelines are constructed entirely from hierarchically arranged closed polygons. It is closely linked to the GMT project.
Availability
- Download the original data set from http://www.soest.hawaii.edu/pwessel/gshhg/index.html. Also available at http://www.ngdc.noaa.gov/mgg/shorelines/data/gshhg/latest/.
- The data set, or parts from it, can be extracted from NOAA's shoreline extractor.
- For GRASS 6 you can download 1:250,000 shoreline data from NOAA's site in Mapgen format, which can be imported with the v.in.mapgen module.
- ESRI Shapefiles of the latest version are available at http://www.ngdc.noaa.gov/mgg/shorelines/data/gshhg/latest/. The old 1.6 version is available at ftp://ftp.ihg.uni-duisburg.de/GIS/GISData/GSHHS/.
Import
- Import with the GRASS6 add-on module v.in.gshhs
OpenStreetMap
See the OpenStreetMap wiki page.
Administrative boundaries from OpenStreetMap
For a convenient download in GeoJSON and SHAPE, see https://wambachers-osm.website/boundaries/
(using the amost invisible triangle, you can pop out details of a country down to admin level 8)
SALB
Second Administrative Level Boundaries: "The SALB dataset is a global digital dataset consisting of digital maps and codes that can be downloaded on a country by country basis."
VMap0
1:1 million vector data. Formerly known as Digital Chart of the World
- see the two articles in GRASS Newsletter vol. 3 (June 2005)
Check the Wikipedia page on VMAP, see the links at the bottom of that article to shapefile versions of VMAP0 and VMAP1. Those look like the versions that were, several years ago, on a NIMA (predecessor to NGA, and successor to the Defense Mapping Agency that managed the Digital Chart of the World and VMAP project) Website. Many GRASS users may prefer the shapefiles to the original Vector Product Format data.
See also
- Global datasets list by T. Hengl (with dataset download)
- http://freegisdata.rtwilson.com/
- The FreeGIS.org database: http://www.freegis.org/database/
- http://finder.geocommons.com/
- http://wiki.openstreetmap.org/wiki/Potential_Datasources
- http://www.geonames.org/data-sources.html
- Open Knowledge Foundation link collection
- Open Weather Map free weather data and forecast API suitable for any cartographic services like web and smartphones applications. Ideology is inspired by OpenStreetMap and Wikipedia that make information free and available for everybody.
Metadata Catalogues
Catalog Service for the Web (CSW) is an OGC standard for offering access to catalogues of geospatial information over the Internet (HTTP). CSW allow for discovering, browsing, and querying metadata about data, services, and similar resources. A list of Metadata Catalogues / CSW services from member states of the European Union can be found here:
And here: http://inspire-geoportal.ec.europa.eu/discovery/ one can search European Metadata Catalogues online.
European datasets
- European datasets
- Global Risk Data Platform
- European Commission Opendata Portal: 5800+ datasets
- E-OBS This is the download page for the ENSEMBLES daily gridded observational dataset for precipitation, temperature and sea level pressure in Europe
- MARS @ JRC Temperature, vapour pressure, rainfall, relative humidity, cloud cover, solar radiation, wind speed.
- EFAS @ JRC is a High resolution pan-European dataset for hydrologic modelling.
- JRC Data Portal In this catalogue, you can find an inventory of data that produced by the JRC in accordance with the JRC data policy. The content is continuously updated and shall not be seen as a complete inventory of JRC data. Currently, the inventory describes only a small subset of JRC data.
US datasets
National datasets
- Australian Spatial Data Directory
- Australian Ecological Knowledge and Observation System
- Italian Geodata collection
- New Zealand data from Koordinates.com
- United States from NOAA/USGSs data portal (FIXME: link?)
- Greek Public Geodata (in Greek)
Various datasets worldwide
- GEOSPATIAL DATA REPORT: Finding and Using GIS Data
- Edenext data portal: Land Cover, Transport networks, Elevation, Orthoimagery, Human health and safety, Species Distribution, Atmospheric Conditions and Meteorological Geographical Features, Training Program Presentations and Data, Utility and governmental services, Hydrography, Soil, Bio geographical regions, Population distribution and Demographics
- Global Data Explorer USGS: ASTER, SRTM, GTOPO etc
- landcover
- GRIPWEB’s Data & Informational Portal: hazard & risk
- SEDAC: Agriculture, Climate, Conservation, Framework Data, Governance, Hazards, Health, Infrastructure, Land Use, Marine and Coastal, Population, Poverty, Remote Sensing, Sustainability, Urban, Water
- Prevention Web: hazard & risk
- UNdata: UN database
- UNDP home page
- global climatic data
- cosortium for spatial information CGIAR-CSI GeoSpatial Toolkits
- Links to over 300 sites providing freely available geographic datasets
- Free Spatial Data
- Global Land Cover Characteristics Data Base Version 2.0
- A Portal to High-Resolution Topography Data and Tools
- HadGHCND is a gridded daily temperature dataset based upon near-surface maximum (TX) and minimum (TN) temperature observations.
WMS servers
- See WMS page