GRASS Migration to OSGeo

Migration task list

The GRASS infrastructure is described in the infrastructure document.

To finish in 2007

Migration of GForge/RT bugtracker to OSGeo Trac

Task manager: Maciej Sieczka, Howard Butler, Martin Landa

• Description: SVN hosting
• Date: end of Nov 2007 (needs to be done in 2007)
• Task 1: migrate GForge bugs to trac (how?)
• Task 2: migrate old RT bugs to trac (how?)
• Status: open

Useful links

• Moving from GForge to Trac (Trac ML)
• Best Practical RT -> Trac importer

Cron job Migration

All cronjobs run weekly (Saturday).

Retire:

• cron_build_50tutor.sh -> outdated? keep? generates http://grass.fbk.eu/gdp/grass5tutor/index.html but needs docbook and such
• cron_cvs_DGLIBsnapshot.sh -> do we need it as separate package?

--HB: If it does no harm to offer it separate, it's a nice service to the community. Its existance needs to be better advertised otherwise it will not be used.

-MN it harms because it's extra work

• cron_cvs_rsync.sh: rsync Intevation CVS to grass.itc.it (no need to keep after migration)

-MN_ or implement as SVN rsync to somewhere else

Maybe:

• cron_grass60_src_snapshot.sh -> outdated? keep?

--HB: My vote is to stop, nothing is being backported to the 6.0.x release branch. Replace with instructions on how to extract 6.0.x from SVN.

-MN agreed

Todo:

(all to be changed to SVN server after migration) - generated on download.osgeo.org

• cron_grass63_generate_prog_manuals_PDF.sh PDFs: done
• cron_grass63_generate_prog_manuals_HTML.sh HTML: done
• Stable weekly snapshots:
  • cron_grass62_release_src_snapshot.sh
  • cron_grass62_release_build_bins.sh
• Unstable weekly snapshots:
  • cron_grass63_src_snapshot.sh
  • cron_grass63_build_bins.sh
• cron_grass_fetch_usermap.sh: User map for web site hosted at GDF Hannover
• cron_grassweb_update.sh: Web pages -> obsolete, once the Drupal migration is done

• Suggestion: Maintain all cronjob scripts in OSGeo SVN repository fo easy maintenance (but manually copy into cron space for security reasons). See http://trac.osgeo.org/osgeo/ticket/102
• Date: Dec 2007
• Status: open

Web Migration to grass.osgeo.org

Task manager: Markus Neteler, Wolf Bergenheim

• make grass.osgeo.org first site for Web-CVS update and rsync mirrors
• Date: Dec 2007
• Status: open

Search engine Migration

Task manager: Markus Neteler, Wolf Bergenheim, Tyler Mtchell

• Currently htdig based on grass.itc.it, due to Apache rewrite engine new lists.osgeo.org isn't picked up
• Google, Yahoo etc. need time to re-fetch the archive
• Mailman archives at lists.osgeo.org are slightly shifted in email reference number since the archives have been recreated
• TODO: verify with OSGeo how to search lists
• TODO: decides how to archive 'grass-commit'
• Date: Dec 2007
• Status: open

Web statistics Migration

Task manager: Markus Neteler, Wolf Bergenheim

• we have server statistics (apache logs) from 2002 onwards for grass.itc.it (the server delivered 6.73 Tb so far which is underestimated due to some lacking log data [Note specific to the grass.itc.it server, does not include downloads from mirrors, distros])
  • log files to be donated to OSGeo for Marketing analysis (backup): http://trac.osgeo.org/osgeo/ticket/170
  • webalizer results are static HTML pages. Can we just copy them over?

• grass.osgeo.org needs (has?) server statistics

• Date: Dec 2007
• Status: open

To do in 2008

Wiki Migration

Task manager: Markus Neteler, Martin Spott, Howard Butler, Martin Landa

• Description: Migration of GDF Mediawiki to OSGeo Mediawiki (incl. version update)
  • An upgrade of MediaWiki version would allow use of reCaptcha plugin, for better spamproofing

• Date: Jan 2008?
• Status: open

Plan

1. At least 24 hours notice will be provided in GRASS-dev mailing list before the transition starts.
2. When the transition starts, write access to the wiki will disabled (TODO: notification), and archived to avoid any confusion.
3. Wiki will be updated to the version 1.11 (from 1.6.10), probably on josef.
4. Tarball (wiki directory + database dumpstream) will be prepared for OSGeo.

Web Migration to Drupal

Task manager: Markus Neteler, Wolf Bergenheim

• Description: Migration of HTML Web pages to OSGeo Drupal (update to Drupal 5 ongoing there)
• Date: Jan 2008?
• Status: open
• Note: the site http://grass.osgeo.org has been set up already
• Note: the site http://www.grass-gis.org is a rewrite rule to that site
• Important: only 70% of the files are in CVS, all big files are a local copy on grass.itc.it and need to be transferred via rsync

--HB: Could someone provide details on what work is entailed in a migration to "Drupal 5"? Better, could someone provide a Drupal mock-up of what the GRASS front page and downloads page would be like? Will the page changes be saved in SVN for review and history? If not is there some revision history available in Drupal?

Wolf has implemented a test site: http://grass-dev.osgeo.net/

Done

Migration of Mailman lists

Task manager: Markus Neteler, Frank Warmerdam

• Description: move of all grass.itc.it Mailman lists to http://lists.osgeo.org
• Date: 15 Nov 2007
• Note 1: some lists have been renamed for consistency
• Note 2: the old list addresses still work and are auto-fwd'ed to the new list addresses
• Note 3: the archives are redirected to lists.osgeo.org through Apache Rewrite engine
• Status: done

Special Note for weblist: The list is open to submit Web site comments but spam prone. Due to the lack of spam filter on the OSGeo site, it is now configured as follows:

 User -> weblist at grass itc.it -> /etc/aliases -> 
         -> neteler.osgeo..gmail.com (for Spam filtering) -> FWD -> 
           -> grass-web at lists osgeo.org

Source code repository migration to OSGeo SVN

Migration from CVS to OSGeo SVN

Task manager: Martin Landa, Howard Butler

• Description: SVN hosting
• Implementation: Migration from CVS to SVN
• Date: end of Nov 2007 (needs to be done in 2007)
• Requirements: Developers need to get all of their commits in CVS done by 13:00 UTC Sunday 9 December 2007. Then we migrate during the weekend. The new SVN at osgeo.org will open 5-10 hours later.

see mailing list post [GRASS-dev] CVS write access shutdown on Sunday for migration to SVN by Markus Neteler

• Status: done

Migration from GRASS Addons SVN to OSGeo SVN

Task manager: Markus Neteler, Martin Landa, Howard Butler

• Description: Server change
• Date: end of Nov 2007 (needs to be done in 2007)
• Task: SVN dump at grass.itc.it (done via rsync), then import at svn.osgeo.org
• Implementation: Migration from CVS to SVN
• Status: done

Developer's TODO: get your "osgeo_id"

• Since OSGeo's SVN is managed via single sign-on authentication (LDAP), each developer with write access has to obtain an "osgeo_id" at http://www.osgeo.org/osgeo_userid . If you already have created the ID but forgot the details, check at http://www.osgeo.org/cgi-bin/ldap_web_search.py . This "osgeo_id" is then used to activate you for GRASS-SVN at OSGeo.

Detailed migration plan

1. At least 24 hours notice will be provided in GRASS-dev mailing list before the transition starts to allow committers to commit any outstanding work that is ready to into the repository. (DONE)
2. Before the conversion starts, the GRASS CVS SSH daemon will be stopped (at 13 UTC, 9 Dec 2007; notification DONE), and archived again (DONE: rsync on josef and grass.itc.it) to avoid any confusion.
3. also GRASS Addons SVN write access is removed (DONE)
4. The conversion will be done by Martin Landa using the cvs2svn tool, see Migration from CVS to SVN for details. DONE
5. SVN dump transfer to OSGeo.org (DONE)
   1. LDAP groups:
      1. grass/ - main source code repository (grass5, grass6, ...) | LDAP group: "grass"
      2. grass-addons/ - controlled sandbox | LDAP group: "grass-addons"
      3. grass-web/ - web stuff, to be migrated to Drupal in 2008 | LDAP group: "grass"
      4. extra LDAP group for translators: "grass-translators" (only needed in 2008, to path grass/trunk/locale/)
6. The source access information (contributors.csv) will be updated in the documentation; the web pages as well. (partially DONE)
7. Committers will need to get a login on osgeo.org (see above; all have been personally informed) and notify Markus Neteler to regain commit access to SVN (managed here). Committer access on the new repository will be enabled after the above changes are all complete and after email agreement of each committer to RFC2 (legal aspects) was sent to Markus. File 'contributors.csv' keeps track on that. Any enabled GRASS developer can activate new 'osgeo_id's following the PSC procedure. (partially DONE)