Differences between revisions 74 and 75
Revision 74 as of 2010-07-23 21:40:26
Size: 34012
Revision 75 as of 2011-03-05 13:56:32
Size: 26769
Editor: HenriLeFoll
Comment: older migration in other pages
Deletions are marked like this. Additions are marked like this.
Line 732: Line 732:
== migrating moinmoin 1.5 -> 1.7 ==

The system hosting the wiki has been migrated to Lenny, so Moinmoin was upgraded ([[DebianWiki/MigratedToMoinmoin17]]).

The purpose of this page was to prepare and track that migration of the wiki.

'''Wiki Configuration'''
 * --( I18n: sister sites ([[http://lists.debian.org/debian-www/2009/03/msg00041.html|prototype]])? => wont-fix)--
 * --( Provide a Favicon (DebianBug:520178, fixed by pabs). )--
 * --( Update pages to use the new [[DebianWiki/EditorGuide#official|Debian "official material" banner]] (i.e search pages containing "official-doc.png"). )--
 * --( Fix {{{ {{ #!/bin/sh }}} [[http://sourceforge.net/mailarchive/forum.php?thread_name=1237166633.24642.244.camel%40timo-desktop&forum_name=moin-user|bug]] (mostly fixed by PaulWise). )--
 * Enable [[http://moinmo.in/HelpOnConfiguration/SupplementationPage|SupplementationPage]] (see [[http://lists.debian.org/debian-www/2009/03/msg00144.html|mail]]) and migrate existing pages.
 * Authentication against ldap.d.o, alioth sql, or openid ( see [[http://moinmo.in/HelpOnAuthentication|doc]])? {{{#!wiki comment
This task is postponed until the license of the wiki is fixed.

'''Wiki Content'''
 * --( Drop AyudaSobreEdiccion/* ? )--
 * --( Use [[http://moinmo.in/HelpOnAdmonitions|HelpOnAdmonitions]], for [[http://wiki.debian.org/DebianWiki/EditorGuide#head-70e5ab2f9bbefb68886c25cf352eef6b7801efd0|Debian "official material" banner]]. )--
 * --( Review "EditedSystemPages" )--
 * --( Review/update InterWikiMap ([[http://lists.debian.org/debian-www/2009/03/msg00128.html|mail]]) )--
 * --( Update the DebianWiki/EditorGuide ''(done by FranklinPiat)'' )--
 * --( Send an announcement on [[http://lists.debian.org/debian-devel/2009/03/msg00884.html|debian-devel]] <<BR>> (./) and [[DeveloperNews]]. )--
 * --( Fix the [[https://wiki.debian.org/Games/TheBattleForWesnoth?action=fullsearch&context=180&value=re%3AFullSearchCached&fullsearch=Text|Games/de...]] pages, like for [[https://wiki.debian.org/de/Games/TheBattleForWesnoth?action=diff&rev2=4&rev1=2|TheBattleForWesnoth]] )--
 * Replace {{{<<PageList(re:^FooBar)>>}}} macro with {{{<<FullSearchCached(t:re:^FooBar.*)>>}}}, because the first one now lists attachments too :-(
 * Update the [[CategoryCategory|Category]] pages, based on moin 1.6's [[CategoryTemplate]]
 * Drop Category``!FrSomething : use !FullSearch(Category``Something + language:fr).. Looks even slower that Category searches.

== OLD wiki.debian.net migration ==

=== Status ===


=== Cleanup Project ===

I've been going through a bunch of the pages and reformatting them for [[KWiki]]. (I got half-way through OliverGeorge but got tired, and gave up.) Anyway, ''please'' join in and cleanup any pages that need cleaning. If you find a page that needs cleaning, but don't have time, just tag it CleanMe. If you're looking for something to do, search for CleanMe and go fix one of those. --MichaelIvey
''This text was formerly on NewsCleanup.. but i'am cleaning that too ;) ''

=== TODO ===

 * Deal with Licencing terms[[copyright.html]] by at least proposing a license for new content. -- FilipusKlutiero

=== Done ===

 * Kwiki had switched URL formats and supported through some hack (probably URL rewrite) old links in the form index.cgi?Foo (example : http``://wiki.debian.net/index.cgi?DebianInstallerFAQ). This was a switch recent enough so that we still find links with such a form in doc and should support them IMO. Currently these bring to a non-existing index.cgi page. -- FilipusKlutiero
   * I agree, it would be nice if http``://wiki.debian.net/'''index.cgi?'''foo and http``://wiki.debian.net/'''?'''foo were redirected to http``://wiki.debian.org/foo -- FranklinPiat

 * The new wiki supports links such as w.d.o/?Foo to bring to Foo. However there's no actual redirection. This seems to highlight a small Moin bug. If you access a page this way, and try deleting the page, you'll be asked for confirmation on the homepage for your language. I wasn't careful or thought that was just a bug and confirmed the deletion. The French PageD'Accueil was deleted (but still exists, since it was regenerated automatically). Hopefully that doesn't happen to the english homepage until it's locked. -- FilipusKlutiero

 * Remove old kwiki help pages, like [[TextFormattingRules]] and switch to [[HelpOnEditing]] (''done''), etc :
   Many old page have been expanded and translated, still some cleanup is needed. see
   * HelpPage* (HelpPage,HelpPageGerman,HelpPageFrench)
   * ReadmeFirst (+ ReadmeFirstFrench, ReadmeFirstDanish, ReadmeFirstSpanish, ReadmeFirstGerman, ReadmeFirstHebrew)
   * HowDoIEdit, EditarPagina + AyudaSobreEdiccion/*
   * DanishLanguage

 * The german equivalent of "FrontPage" is still the default page. Probably the same thing applies for other languages. We should get rid of such "bogus" translations! -- ErichSchubert
   * As I mentionned in [[FrontPage/Discussion]], I think we should use MoinMoin's official names for translated front pages. For example, FrontPageFrench duplicates much of [[PageD'Accueil]] (the equivalent of FrontPage in french). -- TheAnarcat <<DateTime(2006-05-15T02:18:10Z)>>

Sat Sep 8 11:24:53 UTC 2007
 * all links to wiki.debian.net are now converted to wiki.debian.org (within wiki.d.o !) -- FranklinPiat

Fri Sep 7 21:32:00 UTC 2007
 * converted all !DebianPackage:, !DebianPts:, !DebianPackages: i.e kwiki's [[http://zwiki.org/RemoteWikiURL|RemoteWikiURL]] to Moinmoin's [[http://moinmoin.wikiwikiweb.de/InterWiki|InterWiki]] links -- FranklinPiat
 * former help pages cleanup (see below)

Sun Aug 5 11:51:00 UTC 2007
 * converted all bts: and package: to InterWiki links -- FranklinPiat

Sat Oct 8 00:03:05 UTC 2005: wiki.debian.net content is converted over, wiki.debian.net is now permanently read-only, and will soon start to http-redirect people to here --[[Jeroen]]
 * Some pages were not converted perfectly, those should be manually fixed.
 * Some pages existed on both wiki.debian.org and wiki.debian.net, I ([[Jeroen]]) needed to do something with that. I documented it all, and you can double-check me, and correct where needed:
  * Some page's history got merged, the .org version becoming the last (current) version. You might want to check the last wiki.debian.net version to see if it has info that was dropped in the first wiki.debian.org version. List and raw data: http://spohr.debian.org/~jeroen/wiki/merged/
  * Some pages were seeming manually copied from wiki.debian.net, I deleted the wiki.debian.org version and put down the wiki.debian.net version with history. The .org version might have had markup fixes that are now gone again. You might want to check that. List and raw data: http://spohr.debian.org/~jeroen/wiki/replaced/
  * Some pages had seeming a much better version history in the .org version, and the .net version was a completely seperate branch, I deleted the wiki.debian.net version, but there still might be good info over there that should be merged into the .org version. List and raw data: http://spohr.debian.org/~jeroen/wiki/skipped-backmergemanually/
  * Quite a number of users had on both wiki's a user page, I dropped the .net version for all of them. List and raw data: http://spohr.debian.org/~jeroen/wiki/skipped-personal/

== older migration ==
 * [[/To1.7|migrating moinmoin 1.5 -> 1.7]] and [[DebianWiki/MigratedToMoinmoin17]]
 * [[/FromWikiDebianNet|OLD wiki.debian.net migration]]

migrating moinmoin 1.7 -> 1.9+

This is a list of action for the next migration (lenny -> squeeze!) (currently tested on http://wiki-debian-net.klabs.be/).

TODO / Ideas

  • ?? Allow Embedding objects (Ogg,PDF...), see EmbedObject

  • User-Agent language negotiation doesn't work :-(

  • Communicate on the fact that docbook will be gone :-(

  • Do we re-enable the GUI editor ?

Actual wiki Migration steps


  1. Get the list of EditedSystemPages (they may need to be updated after the upgrade)

  2. Update the links, to use <<Anchor(foo)>> instead of #head-1234567, anchors auto-generated by moinmoin's <TableOfContents> feature.

Update blockquote starting with { {{{ } followed by #!foo

Drop { {{{#!plain } Introduced during moinmoin 1.7 migration :-(


The pages folder is quite large... make sure it's in the cache...

  1. for x in 1 2 3 4 5 6 7 8 9 ; do ls /srv/wiki.debian.org/var/moin/data/pages > /dev/null ; done &

And Meanwhile...

Turn the wiki read-only

  1. edit /srv/wiki.debian.org/etc/moin/wikiconfig.py and append:

        page_header1 = """<table width='100%'><tr><td style="background:#ffd0d0; text-align: center;padding:15pt">wiki.debian.org is in read-only mode for a maintenance operation. We will be back in 60 minutes. </td></tr></table>"""
        acl_rights_default = 'Known:read All:read'

Upgrade moinmoin

  1. aptitude install --without-recommends python-flup python-tz python-xapian python-xappy poppler-utils
    aptitude remove python-4suite-xml

Migrate moinmoin data (i.e update existing pages, for new syntax) :

#Estimated time for migration: ~~10minutes (continue the steps below).
/srv/wiki.debian.org/bin/moin --config-dir=/srv/wiki.debian.org/etc/moin/ --wiki-url=wiki.debian.org migration data

Update WSGI application name:

  1. Edit /srv/wiki.debian.org/bin/moin.wsgi:

    import sys
    sys.path.insert(0, '/srv/wiki.debian.org/etc/moin')
    # moinmoin application name has changed between v1.7 and v1.9
    #from MoinMoin.server.server_wsgi import moinmoinApp
    #application = moinmoinApp
    from MoinMoin.web.serving import make_application
    application = make_application(shared=True)

Publish (the new) theme using apache. Enable client-side caching.

  1. Enable content expiration in apache (execute a2enmod expires)

  2. Edit /srv/wiki.debian.org/etc/moin/wikiconfig.py, replace url_prefix = '/htdocs', with:

    url_prefix_local = '/htdocs'
    # Moin (>=1.6) use a prefix like '/moin_static160' to ensure file versioning
    # (en therefore avoid client file caching issue). So we stop forcing the prefix.
    #url_prefix_static = '/htdocs'
  3. Edit /srv/wiki.debian.org/etc/apache2/apache2.conf, add this alias

    # This alias needs to be updated on wiki upgrade, according to "release_short" in
    # /usr/share/pyshared/MoinMoin/version.py
      Alias /moin_static191    /usr/share/moin/htdocs/
      ExpiresActive On
      <Directory /usr/share/moin/htdocs>
        Order allow,deny
        Allow from all
        # Moinmoin use file-versioning, so we can cache agressively.
        ExpiresDefault "access plus 1 week"
      <Directory /srv/wiki.debian.org/usr/htdocs>
        Order allow,deny
        Allow from all
        ExpiresDefault "access plus 1 day"
  4. We can get rid of the old symlinks in /srv/wiki.debian.org/usr/htdocs/:

    rm /srv/wiki.debian.org/usr/htdocs/common
    rm /srv/wiki.debian.org/usr/htdocs/classic
    rm /srv/wiki.debian.org/usr/htdocs/modern
    rm /srv/wiki.debian.org/usr/htdocs/rightsidebar

Fix account & password pre-validation stuffs /srv/wiki.debian.org/etc/moin/wikiconfig.py ( <!> Ideally, we should keep ?DefaultConfig.password_checker):

diff --git a/etc/moin/wikiconfig.py b/etc/moin/wikiconfig.py
index 5dea400..f53a88b 100644
--- a/etc/moin/wikiconfig.py
+++ b/etc/moin/wikiconfig.py
@@ -50,11 +50,11 @@ class Config(DefaultConfig):
     # Spammers
     hosts_deny = local_secrets.hosts_deny
-    def password_checker(username, passwd):
+    def password_checker(request, username, passwd):
         result = local_secrets.password_checker(username, passwd)
         if result != None:
             return result
-        return DefaultConfig.password_checker(username, passwd)
+        return None
     password_checker = staticmethod(password_checker)

Get rid of some obsolete configuration statements. Edit /srv/wiki.debian.org/etc/moin/wikiconfig.py

  • Remove acl_enabled = 1. The settings was removed (always enabled), see SettingsCleanup

  • Remove allowed_actions = .... The settings was removed in moin 1.5, see SettingsCleanup

Update wiki underlay:

  1. mv /srv/wiki.debian.org/var/moin/underlay/pages/ /srv/wiki.debian.org/var/moin/underlay/pages.pre-19

  2. cp -R /usr/share/moin/underlay/pages /srv/wiki.debian.org/var/moin/underlay/

  3. chown -R wiki:wikiadm /srv/wiki.debian.org/var/moin/underlay/pages

  4. chmod ug+wX /srv/wiki.debian.org/var/moin/underlay/pages

  5. find /srv/wiki.debian.org/var/moin/underlay/pages -type d | xargs chmod g+s

  6. A Wiki admin (with an account declared in wikiconfig.py's superuser=), And install the languages packs below (more on LanguageSetup):

Update Interwiki

  1. mv /srv/wiki.debian.org/var/moin/data/intermap.txt /srv/wiki.debian.org/var/moin/data/intermap.pre-19

  2. ln -s /usr/share/moin/data/intermap.txt  /srv/wiki.debian.org/var/moin/data/

Cleanup moinmoin's cache

  1. /srv/wiki.debian.org/bin/moin maint cleancache (Estimated time for migration: 5~10minutes)

Update (or Rebuild??) Xapian index:

  1. /srv/wiki.debian.org/bin/moin index build --mode=update

Post upgrade

older migration