R.modis GSoC 2011: Difference between revisions

From GRASS-Wiki
Jump to navigation Jump to search
(final version of second report week 1)
(grammar corrections)
Line 4: Line 4:
|Organization: || [http://www.osgeo.org OSGeo - Open Source Geospatial Foundation]
|Organization: || [http://www.osgeo.org OSGeo - Open Source Geospatial Foundation]
|-
|-
| Mentor Name: || [http://gis.cri.fmach.it/people/neteler/ Markus Neteler]
| Mentor Name: || [http://gis.cri.fmach.it/neteler/ Markus Neteler]
|-
|-
| Title: || [http://www.google-melange.com/gsoc/project/google/gsoc2011/lucadelu/13001 '''r.in.modis for GRASS GIS''']
| Title: || [http://www.google-melange.com/gsoc/project/google/gsoc2011/lucadelu/13001 '''r.in.modis for GRASS GIS''']
Line 13: Line 13:
'''Abstract'''
'''Abstract'''


'''MODIS data''' are free geodata and they are crucial to derive ecological indicators. The two NASA satellite systems, Terra and Aqua, significantly improve the current data availability for scientific purposes.  
'''MODIS data''' are free geodata and they are crucial to derive ecological indicators. MODIS is flown on two NASA satellite systems, Terra and Aqua, which significantly improve the current data availability for scientific purposes.  
I am facing the challenge to develop a module  which will be able to:
I am facing the challenge to develop a module  which will be able to:
* import data from a downloaded file  
* import data from a downloaded file  
Line 20: Line 20:
== Application ==
== Application ==
=== Idea ===
=== Idea ===
The idea was little changed from the initial idea that I wrote in the [http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/lucadelu/1 GSOC propose]. I spoke with my mentor and we think that the best solution is create three modules:
The idea was a little bit changed from the initial idea that I wrote in the [http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/lucadelu/1 GSOC proposal]. I spoke to my mentor and we think that the best solution is to create three modules:
* '''r.modis.download''': to download the MODIS products using [https://github.com/lucadelu/pyModis pyModis library]. It will be able to download more tiles and different range of times
* '''r.modis.download''': to download the MODIS products using [https://github.com/lucadelu/pyModis pyModis library]. It will be able to download more tiles and different range of times
* '''r.modis.import''': to import Level 3 MODIS products, it will use [https://github.com/lucadelu/pyModis pyModis library] to parse the XML files and [https://lpdaac.usgs.gov/lpdaac/tools/modis_reprojection_tool MODIS Reprojection Tool]. It will be able to import single tile or creates a mosaic for more tiles of the same day
* '''r.modis.import''': to import Level 3 MODIS products, it will use [https://github.com/lucadelu/pyModis pyModis library] to parse the XML files and [https://lpdaac.usgs.gov/lpdaac/tools/modis_reprojection_tool MODIS Reprojection Tool]. It will be able to import single tile or creates a mosaic for more tiles of the same day
Line 27: Line 27:
=== Project Plan ===
=== Project Plan ===
{| {{table}}
{| {{table}}
| May 23 - 29 || Wiki documentation, implement new functions in pyModis library, start '''r.modis.download'''
| May 23 - 29 || Wiki documentation, implementing of new functions in the pyModis library, start '''r.modis.download'''
|-
|-
| May 30 - June 5 || finish and testing '''r.modis.download''', start '''r.modis.import'''
| May 30 - June 5 || finishing and testing '''r.modis.download''', start '''r.modis.import'''
|-
|-
| June 6 - July 3 || finish and testing  '''r.modis.import''', I hope also to start '''r.modis.process'''
| June 6 - July 3 || finishing and testing  '''r.modis.import''', I hope also to start '''r.modis.process'''
|-
|-
| July 4 - July 31 || '''r.modis.process'''
| July 4 - July 31 || finishing and testing '''r.modis.process'''
|-
|-
| August 1 - 16 || documentation, testing and bug fixing
| August 1 - 16 || documentation, testing and bug fixing
Line 45: Line 45:
I spent nine wonderful days in Prague, I attended before the meeting  [http://geoinformatics.fsv.cvut.cz/gwiki/Geoinformatics_FCE_CTU_2011 Geoinformatics FCE CTU 2011] and after the [[GRASS_Community_Sprint_Prague_2011|first Community spring]]. Nine days with a lot of main developers and power users of GRASS community
I spent nine wonderful days in Prague, I attended before the meeting  [http://geoinformatics.fsv.cvut.cz/gwiki/Geoinformatics_FCE_CTU_2011 Geoinformatics FCE CTU 2011] and after the [[GRASS_Community_Sprint_Prague_2011|first Community spring]]. Nine days with a lot of main developers and power users of GRASS community
I worked on pyModis, the library that I'll use in ''r.modis.download'' to download MODIS file:
I worked on pyModis, the library that I'll use in ''r.modis.download'' to download MODIS file:
* fix a bug with Stefano Cavallari [https://github.com/lucadelu/pyModis/commit/7369cf63140f611dc9b4a5e78820f6c333ecdcd6]
* fixed a bug with Stefano Cavallari [https://github.com/lucadelu/pyModis/commit/7369cf63140f611dc9b4a5e78820f6c333ecdcd6]
* implement a new class to parse XML files of MODIS products [https://github.com/lucadelu/pyModis/commit/c4565cc61bed4f1f160222feb170933ba03956ab]
* implemented a new class to parse XML files of MODIS products [https://github.com/lucadelu/pyModis/commit/c4565cc61bed4f1f160222feb170933ba03956ab]
* fix bug about name of downloaded file, now us os.path.join [https://github.com/lucadelu/pyModis/commit/47ebe3dfaa1a8e1e51131cde0ab03c1ae83fc483]
* fixed a bug about name of downloaded file, now using os.path.join() [https://github.com/lucadelu/pyModis/commit/47ebe3dfaa1a8e1e51131cde0ab03c1ae83fc483]
* fix bug in dayDownload function [https://github.com/lucadelu/pyModis/commit/d2e5b4174e78480298df49dab7a53faad0ced947]
* fixed a bug in the dayDownload function [https://github.com/lucadelu/pyModis/commit/d2e5b4174e78480298df49dab7a53faad0ced947]
I also start to implement r.modis.download
I also started to implement r.modis.download.




Line 64: Line 64:
'''1) What do I have completed this week?'''
'''1) What do I have completed this week?'''


During this week I could work well, without problems. I finished ''r.modis.download'', now I'm looking for more info about Makefile, after I'll solve this little blocking issue I'll commit in the svn repository the first version of ''r.modis.download''. I started to write documentation files for GRASS modules as HTML file like the other modules. I also work on pyModis, I added some functions and a new class to launch Modis Reprojection Tool (MRT) software to convert HDF file into TIF file. This class it will use in ''r.modis.import'' that I started to do. Here some changes
During this week I could work well, without problems. I finished ''r.modis.download'', now I'm looking for more info about Makefile, after I'll solve this little blocking issue I'll commit in the svn repository the first version of ''r.modis.download''. I started to write documentation files for GRASS modules as HTML file like the other modules. I also worked on pyModis, I added some functions and a new class to launch Modis Reprojection Tool (MRT) software to convert a HDF file into a GeoTIFF file. This class it will be used in ''r.modis.import'' that I started to do. Here some changes
* an option to force the last day, this is useful with sixteen days data because delta could download more data that the user want [https://github.com/lucadelu/pyModis/commit/2c84de9ac42c03076c9ab4fb5f79a844691a3497]
* an option to force the last day, this is useful with sixteen days data because delta could download more data that the user want [https://github.com/lucadelu/pyModis/commit/2c84de9ac42c03076c9ab4fb5f79a844691a3497]
* fix bug when pyModis write the list of downloaded files [https://github.com/lucadelu/pyModis/commit/cf105f34261a85fe0cdf838f0aacb28fa1d7d5c3]
* fixed a bug when pyModis writes the list of downloaded files [https://github.com/lucadelu/pyModis/commit/cf105f34261a85fe0cdf838f0aacb28fa1d7d5c3]
* add new functions for read every variables from xml file of MODIS data [https://github.com/lucadelu/pyModis/commit/cf105f34261a85fe0cdf838f0aacb28fa1d7d5c3] and one for create a configuration file for MRT Tool software [https://github.com/lucadelu/pyModis/commit/4bc51dee0dfe282aaadc01fff4f9fa73413161c9]
* added new functions for reading every variables from xml file of MODIS data [https://github.com/lucadelu/pyModis/commit/cf105f34261a85fe0cdf838f0aacb28fa1d7d5c3] and one for creating a configuration file for MRT Tool software [https://github.com/lucadelu/pyModis/commit/4bc51dee0dfe282aaadc01fff4f9fa73413161c9]
* start new class to convert HDF to TIF file [https://github.com/lucadelu/pyModis/commit/c519e4db3526486ffac6469694b8a67d7e29e09b]
* started new class to convert HDF to GeoTITF file format [https://github.com/lucadelu/pyModis/commit/c519e4db3526486ffac6469694b8a67d7e29e09b]





Revision as of 19:27, 3 June 2011

Student Name: Luca Delucchi, University of Genova
Organization: OSGeo - Open Source Geospatial Foundation
Mentor Name: Markus Neteler
Title: r.in.modis for GRASS GIS
SVN: r.modis

Abstract

MODIS data are free geodata and they are crucial to derive ecological indicators. MODIS is flown on two NASA satellite systems, Terra and Aqua, which significantly improve the current data availability for scientific purposes. I am facing the challenge to develop a module which will be able to:

  • import data from a downloaded file
  • directly download MODIS data from a FTP server and then load the file(s) in a GRASS GIS location.

Application

Idea

The idea was a little bit changed from the initial idea that I wrote in the GSOC proposal. I spoke to my mentor and we think that the best solution is to create three modules:

  • r.modis.download: to download the MODIS products using pyModis library. It will be able to download more tiles and different range of times
  • r.modis.import: to import Level 3 MODIS products, it will use pyModis library to parse the XML files and MODIS Reprojection Tool. It will be able to import single tile or creates a mosaic for more tiles of the same day
  • r.modis.process: to process and import MODIS raw data using MODIS Reprojection Tool Swath

Project Plan

May 23 - 29 Wiki documentation, implementing of new functions in the pyModis library, start r.modis.download
May 30 - June 5 finishing and testing r.modis.download, start r.modis.import
June 6 - July 3 finishing and testing r.modis.import, I hope also to start r.modis.process
July 4 - July 31 finishing and testing r.modis.process
August 1 - 16 documentation, testing and bug fixing
August 17 - 22 final reviews

Weekly reports

#0 2011-05-27

1) What do I have completed this week?

I spent nine wonderful days in Prague, I attended before the meeting Geoinformatics FCE CTU 2011 and after the first Community spring. Nine days with a lot of main developers and power users of GRASS community I worked on pyModis, the library that I'll use in r.modis.download to download MODIS file:

  • fixed a bug with Stefano Cavallari [1]
  • implemented a new class to parse XML files of MODIS products [2]
  • fixed a bug about name of downloaded file, now using os.path.join() [3]
  • fixed a bug in the dayDownload function [4]

I also started to implement r.modis.download.


2) What am I going to achieve for next week?

Finish r.modis.download, if I'll have time I'd like to develop a class in pyModis to write a XML file for the mosaik file, that I'll use in r.modis.import


3) Is there any blocking issue?

No, everything is under control

#1 2011-06-03

1) What do I have completed this week?

During this week I could work well, without problems. I finished r.modis.download, now I'm looking for more info about Makefile, after I'll solve this little blocking issue I'll commit in the svn repository the first version of r.modis.download. I started to write documentation files for GRASS modules as HTML file like the other modules. I also worked on pyModis, I added some functions and a new class to launch Modis Reprojection Tool (MRT) software to convert a HDF file into a GeoTIFF file. This class it will be used in r.modis.import that I started to do. Here some changes

  • an option to force the last day, this is useful with sixteen days data because delta could download more data that the user want [5]
  • fixed a bug when pyModis writes the list of downloaded files [6]
  • added new functions for reading every variables from xml file of MODIS data [7] and one for creating a configuration file for MRT Tool software [8]
  • started new class to convert HDF to GeoTITF file format [9]


2) What am I going to achieve for next week?

Release the first version of r.modis.download on the grass-addons svn repository. Working on r.modis.import


3) Is there any blocking issue?

I have to study Makefile system in GRASS GIS to compile pyModis like a library.

#2 2011-06-10

#3 2011-06-17

#4 2011-06-24

#5 2011-07-01

#6 2011-07-08

#7 2011-07-15 Mid-term evaluations

#8 2011-07-22

#9 2011-07-29

#10 2011-08-05

#11 2011-08-12

#12 2011-08-19

#13 2011-08-26 Final evaluation