Differences between revisions 74 and 88 (spanning 14 versions)
Revision 74 as of 2010-07-23 21:40:26
Size: 34012
Revision 88 as of 2016-03-16 21:55:42
Size: 27957
Editor: Ana
Comment: spam
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
== migrating moinmoin 1.7 -> 1.9+ ==
''This is a list of action for the [[DebianWiki/MigratedToMoinmoin19|next migration]] (lenny -> squeeze!)'' (currently tested on [[http://wiki-debian-net.klabs.be/]]).
== 2011 - migrating moinmoin 1.7 -> 1.9+ ==
''This is a list of action for the [[DebianWiki/MigratedToMoinmoin19|next migration]] (lenny -> squeeze!)'' (completed).
Line 37: Line 37:
[[BSP/ch/Marathon]], [[BSP/2006/10/ch/Zurich]],
Line 409: Line 409:
 * [[PolishL10N/PackageInstallers/skrypty]] : {{{{ {{{  * [[pl/L10n/Polish/PackageInstallers/skrypty]] : {{{{ {{{
Line 727: Line 727:
 * Update/remove/revert [[EditedSystemPages]]  * (./) --(Update/remove/revert [[EditedSystemPages]])--
Line 730: Line 730:
 * Make sure Default front-page for installed languages exists ([[PageD'Accueil]]...)

== migrating moinmoin 1.5 -> 1.7 ==

The system hosting the wiki has been migrated to Lenny, so Moinmoin was upgraded ([[DebianWiki/MigratedToMoinmoin17]]).

The purpose of this page was to prepare and track that migration of the wiki.

'''Wiki Configuration'''
 * --( I18n: sister sites ([[http://lists.debian.org/debian-www/2009/03/msg00041.html|prototype]])? => wont-fix)--
 * --( Provide a Favicon (DebianBug:520178, fixed by pabs). )--
 * --( Update pages to use the new [[DebianWiki/EditorGuide#official|Debian "official material" banner]] (i.e search pages containing "official-doc.png"). )--
 * --( Fix {{{ {{ #!/bin/sh }}} [[http://sourceforge.net/mailarchive/forum.php?thread_name=1237166633.24642.244.camel%40timo-desktop&forum_name=moin-user|bug]] (mostly fixed by PaulWise). )--
 * Make sure Default front-page for installed languages exists ([[fr/FrontPage]]...)

== 2009 - migrating moinmoin 1.5 -> 1.7 ==

The system hosting the wiki has been migrated to Lenny, so Moinmoin was upgraded ([[DebianWiki/MigratedToMoinmoin17]]), (see [[DebianWiki/History]]).

Remaining ideas/tasks to do:
Line 747: Line 741:

'''Wiki Content'''
 * --( Drop AyudaSobreEdiccion/* ? )--
 * --( Use [[http://moinmo.in/HelpOnAdmonitions|HelpOnAdmonitions]], for [[http://wiki.debian.org/DebianWiki/EditorGuide#head-70e5ab2f9bbefb68886c25cf352eef6b7801efd0|Debian "official material" banner]]. )--
 * --( Review "EditedSystemPages" )--
 * --( Review/update InterWikiMap ([[http://lists.debian.org/debian-www/2009/03/msg00128.html|mail]]) )--
 * --( Update the DebianWiki/EditorGuide ''(done by FranklinPiat)'' )--
 * --( Send an announcement on [[http://lists.debian.org/debian-devel/2009/03/msg00884.html|debian-devel]] <<BR>> (./) and [[DeveloperNews]]. )--
 * --( Fix the [[https://wiki.debian.org/Games/TheBattleForWesnoth?action=fullsearch&context=180&value=re%3AFullSearchCached&fullsearch=Text|Games/de...]] pages, like for [[https://wiki.debian.org/de/Games/TheBattleForWesnoth?action=diff&rev2=4&rev1=2|TheBattleForWesnoth]] )--
Line 761: Line 746:

== OLD wiki.debian.net migration ==

=== Status ===


=== Cleanup Project ===

I've been going through a bunch of the pages and reformatting them for [[KWiki]]. (I got half-way through OliverGeorge but got tired, and gave up.) Anyway, ''please'' join in and cleanup any pages that need cleaning. If you find a page that needs cleaning, but don't have time, just tag it CleanMe. If you're looking for something to do, search for CleanMe and go fix one of those. --MichaelIvey
''This text was formerly on NewsCleanup.. but i'am cleaning that too ;) ''

=== TODO ===
== 2005 - migrating from wiki.debian.net ==
When Debian wiki became an official service in 2005, it was migrated from wiki.debian.net to wiki.debian.org (see [[DebianWiki/History]]).

Remaining ideas/tasks to do:
Line 777: Line 752:
=== Done ===

 * Kwiki had switched URL formats and supported through some hack (probably URL rewrite) old links in the form index.cgi?Foo (example : http``://wiki.debian.net/index.cgi?DebianInstallerFAQ). This was a switch recent enough so that we still find links with such a form in doc and should support them IMO. Currently these bring to a non-existing index.cgi page. -- FilipusKlutiero
   * I agree, it would be nice if http``://wiki.debian.net/'''index.cgi?'''foo and http``://wiki.debian.net/'''?'''foo were redirected to http``://wiki.debian.org/foo -- FranklinPiat

 * The new wiki supports links such as w.d.o/?Foo to bring to Foo. However there's no actual redirection. This seems to highlight a small Moin bug. If you access a page this way, and try deleting the page, you'll be asked for confirmation on the homepage for your language. I wasn't careful or thought that was just a bug and confirmed the deletion. The French PageD'Accueil was deleted (but still exists, since it was regenerated automatically). Hopefully that doesn't happen to the english homepage until it's locked. -- FilipusKlutiero

 * Remove old kwiki help pages, like [[TextFormattingRules]] and switch to [[HelpOnEditing]] (''done''), etc :
   Many old page have been expanded and translated, still some cleanup is needed. see
   * HelpPage* (HelpPage,HelpPageGerman,HelpPageFrench)
   * ReadmeFirst (+ ReadmeFirstFrench, ReadmeFirstDanish, ReadmeFirstSpanish, ReadmeFirstGerman, ReadmeFirstHebrew)
   * HowDoIEdit, EditarPagina + AyudaSobreEdiccion/*
   * DanishLanguage

 * The german equivalent of "FrontPage" is still the default page. Probably the same thing applies for other languages. We should get rid of such "bogus" translations! -- ErichSchubert
   * As I mentionned in [[FrontPage/Discussion]], I think we should use MoinMoin's official names for translated front pages. For example, FrontPageFrench duplicates much of [[PageD'Accueil]] (the equivalent of FrontPage in french). -- TheAnarcat <<DateTime(2006-05-15T02:18:10Z)>>

Sat Sep 8 11:24:53 UTC 2007
 * all links to wiki.debian.net are now converted to wiki.debian.org (within wiki.d.o !) -- FranklinPiat

Fri Sep 7 21:32:00 UTC 2007
 * converted all !DebianPackage:, !DebianPts:, !DebianPackages: i.e kwiki's [[http://zwiki.org/RemoteWikiURL|RemoteWikiURL]] to Moinmoin's [[http://moinmoin.wikiwikiweb.de/InterWiki|InterWiki]] links -- FranklinPiat
 * former help pages cleanup (see below)

Sun Aug 5 11:51:00 UTC 2007
 * converted all bts: and package: to InterWiki links -- FranklinPiat

Sat Oct 8 00:03:05 UTC 2005: wiki.debian.net content is converted over, wiki.debian.net is now permanently read-only, and will soon start to http-redirect people to here --[[Jeroen]]
 * Some pages were not converted perfectly, those should be manually fixed.
 * Some pages existed on both wiki.debian.org and wiki.debian.net, I ([[Jeroen]]) needed to do something with that. I documented it all, and you can double-check me, and correct where needed:
  * Some page's history got merged, the .org version becoming the last (current) version. You might want to check the last wiki.debian.net version to see if it has info that was dropped in the first wiki.debian.org version. List and raw data: http://spohr.debian.org/~jeroen/wiki/merged/
  * Some pages were seeming manually copied from wiki.debian.net, I deleted the wiki.debian.org version and put down the wiki.debian.net version with history. The .org version might have had markup fixes that are now gone again. You might want to check that. List and raw data: http://spohr.debian.org/~jeroen/wiki/replaced/
  * Some pages had seeming a much better version history in the .org version, and the .net version was a completely seperate branch, I deleted the wiki.debian.net version, but there still might be good info over there that should be merged into the .org version. List and raw data: http://spohr.debian.org/~jeroen/wiki/skipped-backmergemanually/
  * Quite a number of users had on both wiki's a user page, I dropped the .net version for all of them. List and raw data: http://spohr.debian.org/~jeroen/wiki/skipped-personal/
== See also ==
 * [[DebianWiki/History]]

2011 - migrating moinmoin 1.7 -> 1.9+

This is a list of action for the next migration (lenny -> squeeze!) (completed).

TODO / Ideas

  • ?? Allow Embedding objects (Ogg,PDF...), see EmbedObject

  • User-Agent language negotiation doesn't work :-(

  • Communicate on the fact that docbook will be gone :-(

  • Do we re-enable the GUI editor ?

Actual wiki Migration steps


  1. Get the list of EditedSystemPages (they may need to be updated after the upgrade)

  2. Update the links, to use <<Anchor(foo)>> instead of #head-1234567, anchors auto-generated by moinmoin's <TableOfContents> feature.

Update blockquote starting with { {{{ } followed by #!foo

Drop { {{{#!plain } Introduced during moinmoin 1.7 migration :-(


The pages folder is quite large... make sure it's in the cache...

  1. for x in 1 2 3 4 5 6 7 8 9 ; do ls /srv/wiki.debian.org/var/moin/data/pages > /dev/null ; done &

And Meanwhile...

Turn the wiki read-only

  1. edit /srv/wiki.debian.org/etc/moin/wikiconfig.py and append:

        page_header1 = """<table width='100%'><tr><td style="background:#ffd0d0; text-align: center;padding:15pt">wiki.debian.org is in read-only mode for a maintenance operation. We will be back in 60 minutes. </td></tr></table>"""
        acl_rights_default = 'Known:read All:read'

Upgrade moinmoin

  1. aptitude install --without-recommends python-flup python-tz python-xapian python-xappy poppler-utils
    aptitude remove python-4suite-xml

Migrate moinmoin data (i.e update existing pages, for new syntax) :

#Estimated time for migration: ~~10minutes (continue the steps below).
/srv/wiki.debian.org/bin/moin --config-dir=/srv/wiki.debian.org/etc/moin/ --wiki-url=wiki.debian.org migration data

Update WSGI application name:

  1. Edit /srv/wiki.debian.org/bin/moin.wsgi:

    import sys
    sys.path.insert(0, '/srv/wiki.debian.org/etc/moin')
    # moinmoin application name has changed between v1.7 and v1.9
    #from MoinMoin.server.server_wsgi import moinmoinApp
    #application = moinmoinApp
    from MoinMoin.web.serving import make_application
    application = make_application(shared=True)

Publish (the new) theme using apache. Enable client-side caching.

  1. Enable content expiration in apache (execute a2enmod expires)

  2. Edit /srv/wiki.debian.org/etc/moin/wikiconfig.py, replace url_prefix = '/htdocs', with:

    url_prefix_local = '/htdocs'
    # Moin (>=1.6) use a prefix like '/moin_static160' to ensure file versioning
    # (en therefore avoid client file caching issue). So we stop forcing the prefix.
    #url_prefix_static = '/htdocs'
  3. Edit /srv/wiki.debian.org/etc/apache2/apache2.conf, add this alias

    # This alias needs to be updated on wiki upgrade, according to "release_short" in
    # /usr/share/pyshared/MoinMoin/version.py
      Alias /moin_static191    /usr/share/moin/htdocs/
      ExpiresActive On
      <Directory /usr/share/moin/htdocs>
        Order allow,deny
        Allow from all
        # Moinmoin use file-versioning, so we can cache agressively.
        ExpiresDefault "access plus 1 week"
      <Directory /srv/wiki.debian.org/usr/htdocs>
        Order allow,deny
        Allow from all
        ExpiresDefault "access plus 1 day"
  4. We can get rid of the old symlinks in /srv/wiki.debian.org/usr/htdocs/:

    rm /srv/wiki.debian.org/usr/htdocs/common
    rm /srv/wiki.debian.org/usr/htdocs/classic
    rm /srv/wiki.debian.org/usr/htdocs/modern
    rm /srv/wiki.debian.org/usr/htdocs/rightsidebar

Fix account & password pre-validation stuffs /srv/wiki.debian.org/etc/moin/wikiconfig.py ( <!> Ideally, we should keep ?DefaultConfig.password_checker):

diff --git a/etc/moin/wikiconfig.py b/etc/moin/wikiconfig.py
index 5dea400..f53a88b 100644
--- a/etc/moin/wikiconfig.py
+++ b/etc/moin/wikiconfig.py
@@ -50,11 +50,11 @@ class Config(DefaultConfig):
     # Spammers
     hosts_deny = local_secrets.hosts_deny
-    def password_checker(username, passwd):
+    def password_checker(request, username, passwd):
         result = local_secrets.password_checker(username, passwd)
         if result != None:
             return result
-        return DefaultConfig.password_checker(username, passwd)
+        return None
     password_checker = staticmethod(password_checker)

Get rid of some obsolete configuration statements. Edit /srv/wiki.debian.org/etc/moin/wikiconfig.py

  • Remove acl_enabled = 1. The settings was removed (always enabled), see SettingsCleanup

  • Remove allowed_actions = .... The settings was removed in moin 1.5, see SettingsCleanup

Update wiki underlay:

  1. mv /srv/wiki.debian.org/var/moin/underlay/pages/ /srv/wiki.debian.org/var/moin/underlay/pages.pre-19

  2. cp -R /usr/share/moin/underlay/pages /srv/wiki.debian.org/var/moin/underlay/

  3. chown -R wiki:wikiadm /srv/wiki.debian.org/var/moin/underlay/pages

  4. chmod ug+wX /srv/wiki.debian.org/var/moin/underlay/pages

  5. find /srv/wiki.debian.org/var/moin/underlay/pages -type d | xargs chmod g+s

  6. A Wiki admin (with an account declared in wikiconfig.py's superuser=), And install the languages packs below (more on LanguageSetup):

Update Interwiki

  1. mv /srv/wiki.debian.org/var/moin/data/intermap.txt /srv/wiki.debian.org/var/moin/data/intermap.pre-19

  2. ln -s /usr/share/moin/data/intermap.txt  /srv/wiki.debian.org/var/moin/data/

Cleanup moinmoin's cache

  1. /srv/wiki.debian.org/bin/moin maint cleancache (Estimated time for migration: 5~10minutes)

Update (or Rebuild??) Xapian index:

  1. /srv/wiki.debian.org/bin/moin index build --mode=update

Post upgrade

2009 - migrating moinmoin 1.5 -> 1.7

The system hosting the wiki has been migrated to Lenny, so Moinmoin was upgraded (DebianWiki/MigratedToMoinmoin17), (see DebianWiki/History).

Remaining ideas/tasks to do:

  • Enable SupplementationPage (see mail) and migrate existing pages.

  • Authentication against ldap.d.o, alioth sql, or openid ( see doc)?

  • Replace <<PageList(re:^FooBar)>> macro with <<FullSearchCached(t:re:^FooBar.*)>>, because the first one now lists attachments too :-(

  • Update the Category pages, based on moin 1.6's CategoryTemplate

  • Drop CategoryFrSomething : use FullSearch(CategorySomething + language:fr).. Looks even slower that Category searches.

2005 - migrating from wiki.debian.net

When Debian wiki became an official service in 2005, it was migrated from wiki.debian.net to wiki.debian.org (see DebianWiki/History).

Remaining ideas/tasks to do:

See also