R.modis GSoC 2011: Difference between revisions
Jump to navigation
Jump to search
(final version of second report week 1) |
(grammar corrections) |
||
| Line 4: | Line 4: | ||
|Organization: || [http://www.osgeo.org OSGeo - Open Source Geospatial Foundation] | |Organization: || [http://www.osgeo.org OSGeo - Open Source Geospatial Foundation] | ||
|- | |- | ||
| Mentor Name: || [http://gis.cri.fmach.it | | Mentor Name: || [http://gis.cri.fmach.it/neteler/ Markus Neteler] | ||
|- | |- | ||
| Title: || [http://www.google-melange.com/gsoc/project/google/gsoc2011/lucadelu/13001 '''r.in.modis for GRASS GIS'''] | | Title: || [http://www.google-melange.com/gsoc/project/google/gsoc2011/lucadelu/13001 '''r.in.modis for GRASS GIS'''] | ||
| Line 13: | Line 13: | ||
'''Abstract''' | '''Abstract''' | ||
'''MODIS data''' are free geodata and they are crucial to derive ecological indicators. | '''MODIS data''' are free geodata and they are crucial to derive ecological indicators. MODIS is flown on two NASA satellite systems, Terra and Aqua, which significantly improve the current data availability for scientific purposes. | ||
I am facing the challenge to develop a module which will be able to: | I am facing the challenge to develop a module which will be able to: | ||
* import data from a downloaded file | * import data from a downloaded file | ||
| Line 20: | Line 20: | ||
== Application == | == Application == | ||
=== Idea === | === Idea === | ||
The idea was little changed from the initial idea that I wrote in the [http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/lucadelu/1 GSOC | The idea was a little bit changed from the initial idea that I wrote in the [http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/lucadelu/1 GSOC proposal]. I spoke to my mentor and we think that the best solution is to create three modules: | ||
* '''r.modis.download''': to download the MODIS products using [https://github.com/lucadelu/pyModis pyModis library]. It will be able to download more tiles and different range of times | * '''r.modis.download''': to download the MODIS products using [https://github.com/lucadelu/pyModis pyModis library]. It will be able to download more tiles and different range of times | ||
* '''r.modis.import''': to import Level 3 MODIS products, it will use [https://github.com/lucadelu/pyModis pyModis library] to parse the XML files and [https://lpdaac.usgs.gov/lpdaac/tools/modis_reprojection_tool MODIS Reprojection Tool]. It will be able to import single tile or creates a mosaic for more tiles of the same day | * '''r.modis.import''': to import Level 3 MODIS products, it will use [https://github.com/lucadelu/pyModis pyModis library] to parse the XML files and [https://lpdaac.usgs.gov/lpdaac/tools/modis_reprojection_tool MODIS Reprojection Tool]. It will be able to import single tile or creates a mosaic for more tiles of the same day | ||
| Line 27: | Line 27: | ||
=== Project Plan === | === Project Plan === | ||
{| {{table}} | {| {{table}} | ||
| May 23 - 29 || Wiki documentation, | | May 23 - 29 || Wiki documentation, implementing of new functions in the pyModis library, start '''r.modis.download''' | ||
|- | |- | ||
| May 30 - June 5 || | | May 30 - June 5 || finishing and testing '''r.modis.download''', start '''r.modis.import''' | ||
|- | |- | ||
| June 6 - July 3 || | | June 6 - July 3 || finishing and testing '''r.modis.import''', I hope also to start '''r.modis.process''' | ||
|- | |- | ||
| July 4 - July 31 || '''r.modis.process''' | | July 4 - July 31 || finishing and testing '''r.modis.process''' | ||
|- | |- | ||
| August 1 - 16 || documentation, testing and bug fixing | | August 1 - 16 || documentation, testing and bug fixing | ||
| Line 45: | Line 45: | ||
I spent nine wonderful days in Prague, I attended before the meeting [http://geoinformatics.fsv.cvut.cz/gwiki/Geoinformatics_FCE_CTU_2011 Geoinformatics FCE CTU 2011] and after the [[GRASS_Community_Sprint_Prague_2011|first Community spring]]. Nine days with a lot of main developers and power users of GRASS community | I spent nine wonderful days in Prague, I attended before the meeting [http://geoinformatics.fsv.cvut.cz/gwiki/Geoinformatics_FCE_CTU_2011 Geoinformatics FCE CTU 2011] and after the [[GRASS_Community_Sprint_Prague_2011|first Community spring]]. Nine days with a lot of main developers and power users of GRASS community | ||
I worked on pyModis, the library that I'll use in ''r.modis.download'' to download MODIS file: | I worked on pyModis, the library that I'll use in ''r.modis.download'' to download MODIS file: | ||
* | * fixed a bug with Stefano Cavallari [https://github.com/lucadelu/pyModis/commit/7369cf63140f611dc9b4a5e78820f6c333ecdcd6] | ||
* | * implemented a new class to parse XML files of MODIS products [https://github.com/lucadelu/pyModis/commit/c4565cc61bed4f1f160222feb170933ba03956ab] | ||
* | * fixed a bug about name of downloaded file, now using os.path.join() [https://github.com/lucadelu/pyModis/commit/47ebe3dfaa1a8e1e51131cde0ab03c1ae83fc483] | ||
* | * fixed a bug in the dayDownload function [https://github.com/lucadelu/pyModis/commit/d2e5b4174e78480298df49dab7a53faad0ced947] | ||
I also | I also started to implement r.modis.download. | ||
| Line 64: | Line 64: | ||
'''1) What do I have completed this week?''' | '''1) What do I have completed this week?''' | ||
During this week I could work well, without problems. I finished ''r.modis.download'', now I'm looking for more info about Makefile, after I'll solve this little blocking issue I'll commit in the svn repository the first version of ''r.modis.download''. I started to write documentation files for GRASS modules as HTML file like the other modules. I also | During this week I could work well, without problems. I finished ''r.modis.download'', now I'm looking for more info about Makefile, after I'll solve this little blocking issue I'll commit in the svn repository the first version of ''r.modis.download''. I started to write documentation files for GRASS modules as HTML file like the other modules. I also worked on pyModis, I added some functions and a new class to launch Modis Reprojection Tool (MRT) software to convert a HDF file into a GeoTIFF file. This class it will be used in ''r.modis.import'' that I started to do. Here some changes | ||
* an option to force the last day, this is useful with sixteen days data because delta could download more data that the user want [https://github.com/lucadelu/pyModis/commit/2c84de9ac42c03076c9ab4fb5f79a844691a3497] | * an option to force the last day, this is useful with sixteen days data because delta could download more data that the user want [https://github.com/lucadelu/pyModis/commit/2c84de9ac42c03076c9ab4fb5f79a844691a3497] | ||
* | * fixed a bug when pyModis writes the list of downloaded files [https://github.com/lucadelu/pyModis/commit/cf105f34261a85fe0cdf838f0aacb28fa1d7d5c3] | ||
* | * added new functions for reading every variables from xml file of MODIS data [https://github.com/lucadelu/pyModis/commit/cf105f34261a85fe0cdf838f0aacb28fa1d7d5c3] and one for creating a configuration file for MRT Tool software [https://github.com/lucadelu/pyModis/commit/4bc51dee0dfe282aaadc01fff4f9fa73413161c9] | ||
* | * started new class to convert HDF to GeoTITF file format [https://github.com/lucadelu/pyModis/commit/c519e4db3526486ffac6469694b8a67d7e29e09b] | ||
Revision as of 19:27, 3 June 2011
| Student Name: | Luca Delucchi, University of Genova |
| Organization: | OSGeo - Open Source Geospatial Foundation |
| Mentor Name: | Markus Neteler |
| Title: | r.in.modis for GRASS GIS |
| SVN: | r.modis |
Abstract
MODIS data are free geodata and they are crucial to derive ecological indicators. MODIS is flown on two NASA satellite systems, Terra and Aqua, which significantly improve the current data availability for scientific purposes. I am facing the challenge to develop a module which will be able to:
- import data from a downloaded file
- directly download MODIS data from a FTP server and then load the file(s) in a GRASS GIS location.
Application
Idea
The idea was a little bit changed from the initial idea that I wrote in the GSOC proposal. I spoke to my mentor and we think that the best solution is to create three modules:
- r.modis.download: to download the MODIS products using pyModis library. It will be able to download more tiles and different range of times
- r.modis.import: to import Level 3 MODIS products, it will use pyModis library to parse the XML files and MODIS Reprojection Tool. It will be able to import single tile or creates a mosaic for more tiles of the same day
- r.modis.process: to process and import MODIS raw data using MODIS Reprojection Tool Swath
Project Plan
| May 23 - 29 | Wiki documentation, implementing of new functions in the pyModis library, start r.modis.download |
| May 30 - June 5 | finishing and testing r.modis.download, start r.modis.import |
| June 6 - July 3 | finishing and testing r.modis.import, I hope also to start r.modis.process |
| July 4 - July 31 | finishing and testing r.modis.process |
| August 1 - 16 | documentation, testing and bug fixing |
| August 17 - 22 | final reviews |
Weekly reports
#0 2011-05-27
1) What do I have completed this week?
I spent nine wonderful days in Prague, I attended before the meeting Geoinformatics FCE CTU 2011 and after the first Community spring. Nine days with a lot of main developers and power users of GRASS community I worked on pyModis, the library that I'll use in r.modis.download to download MODIS file:
- fixed a bug with Stefano Cavallari [1]
- implemented a new class to parse XML files of MODIS products [2]
- fixed a bug about name of downloaded file, now using os.path.join() [3]
- fixed a bug in the dayDownload function [4]
I also started to implement r.modis.download.
2) What am I going to achieve for next week?
Finish r.modis.download, if I'll have time I'd like to develop a class in pyModis to write a XML file for the mosaik file, that I'll use in r.modis.import
3) Is there any blocking issue?
No, everything is under control
#1 2011-06-03
1) What do I have completed this week?
During this week I could work well, without problems. I finished r.modis.download, now I'm looking for more info about Makefile, after I'll solve this little blocking issue I'll commit in the svn repository the first version of r.modis.download. I started to write documentation files for GRASS modules as HTML file like the other modules. I also worked on pyModis, I added some functions and a new class to launch Modis Reprojection Tool (MRT) software to convert a HDF file into a GeoTIFF file. This class it will be used in r.modis.import that I started to do. Here some changes
- an option to force the last day, this is useful with sixteen days data because delta could download more data that the user want [5]
- fixed a bug when pyModis writes the list of downloaded files [6]
- added new functions for reading every variables from xml file of MODIS data [7] and one for creating a configuration file for MRT Tool software [8]
- started new class to convert HDF to GeoTITF file format [9]
2) What am I going to achieve for next week?
Release the first version of r.modis.download on the grass-addons svn repository. Working on r.modis.import
3) Is there any blocking issue?
I have to study Makefile system in GRASS GIS to compile pyModis like a library.