Differences between revisions 1 and 27 (spanning 26 versions)
Revision 1 as of 2017-10-06 22:41:51
Size: 5600
Editor: LauraArjona
Comment: Add page about release point announcements
Revision 27 as of 2020-08-01 16:17:59
Size: 8156
Editor: LauraArjona
Comment:
Deletions are marked like this. Additions are marked like this.
Line 7: Line 7:
1. on $expected-release-date we need to publish the announcement in the website, and update most of the website to reflect the point releases we are going to offer from now on. To avoid presenting an updated info in some places while the CD images are not ready yet, or while other parts of the website still didn't get updated, we're going to stop the cron jobs that build the website automatically, and thus update and build ourselves, and push to mirrors, as it is needed. 1. On $expected-release-date we need to publish the announcement in the website, and update most of the website to reflect the point releases we are going to offer from now on. To avoid presenting an updated info in some places while the CD images are not ready yet, or while other parts of the website still didn't get updated,  we would need to stop the cron jobs that build the website automatically, and thus update and build ourselves, and push to mirrors, as it is needed.
Line 23: Line 23:
2. The release team will probably have written a draft (or two if there is release point for stable and oldstable) in the [[https://anonscm.debian.org/cgit/publicity/announcements.git|publicity announcements git repository]] under en/$year/YYYYMMDD.wml and have sent a mail to debian-publicity@lists.debian.org (adding in CC debian-l10n-english@lists.debian.org and debian-i18n@lists.debian.org) asking for reviews and translations, so check the folders of other languages (or commit log of the repository). 2. The release team will probably have written a draft (or two if there is release point for stable and oldstable) in the [[https://salsa.debian.org/publicity-team/announcements|publicity announcements git repository]] under en/$year/YYYYMMDD.wml and have sent a mail to debian-publicity@lists.debian.org (adding in CC debian-l10n-english@lists.debian.org and debian-i18n@lists.debian.org) asking for reviews and translations, so check the folders of other languages (or commit log of the repository).
Line 25: Line 25:
2.1. Publish the announcement in the website: you just need to add it to the webwml CVS repository at webwml/english/News/$year with the namescheme YYYYMMDD.wml). Take care also of all the available translations commiting also them on the appropriate dirs. Here is a hacky shell loop for moving the files. You will need to adjust the announcement name and also the path to webwml on your system. 2.1. Publish the announcement in the website: you just need to add it to the webwml git repository at webwml/english/News/$year with the namescheme YYYYMMDD.wml). Add and commit the English version first. Then, take note of the hash of the commit of the English file (you can do "git log english/News/$year/YYYYMMDD.wml" and copy the hash of the most recent commit). Then copy the translations to their corresponding folders (adding Makefiles if needed), and then edit them to add the hash in the "translation-check" header.

For example, let's say that the French translation file has a first line like this:
Line 28: Line 30:
#FIXME: read parameters
#FIXME: create missing Makefiles
ann=2015/20150606.wml ; year=2015 ; date=20150606 ; webwml=/home/user/path/to/webwml ; for code in $(ls */$ann | cut -d/ -f 2) ; do lang=$(grep -l LANG=$code $webwml/*/.wmlrc | sed 's/.*webwml.//;s_/.*__') ; mkdir -p $webwml/$lang/News/$year/ ; mv $code/$ann $webwml/$lang/News/$year/$date.wml ; done ; echo These announcements remain: $(ls */$ann)
#use wml::debian::translation-check translation=" " maintainer="Jean-Pierre Giraud"
Line 32: Line 32:

Then you have to paste the hash so it looks like something like this:

{{{
#use wml::debian::translation-check translation="0788aa9ab387393e2e9236d36df0630ae1c038c6" maintainer="Jean-Pierre Giraud"
}}}

Save the files, and then add and commit the translations (and makefiles if any) You can add and commit all the files at the same time.
Line 36: Line 44:
   ssh -tt wolkenstein.debian.org sudo -u debwww /srv/www.debian.org/update-part News    ssh -tt www-master.debian.org sudo -u debwww /srv/www.debian.org/update-part News
}}}

(this step usually takes more than 10 minutes).

If you want to update the homepage so the news is listed there too, run:

{{{
   ssh -tt www-master.debian.org sudo -u debwww NOSUBDIRS=1 /srv/www.debian.org/update-part index
Line 42: Line 58:
IMPORTANT: Please run the script in a Debian stretch box until [[https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=950972|#950972]] is fixed
Line 45: Line 63:
Line 50: Line 69:
3. For stable/oldstable point releases, almost the whole website needs to be rebuilt but the push to mirrors cannot be made until the installation images are ready (keep an eye on #debian-cd and #debian-release). We will update the website manually, without pushing to mirrors. 3. For stable/oldstable point releases, almost the whole website needs to be rebuilt but the push to mirrors cannot be made until the installation images are ready (keep an eye on #debian-cd and #debian-release). We will update the website manually, without pushing to mirrors. 
Line 52: Line 71:
3.1 {{{english/releases/}}}''codename''/{{{errata.wml}}} and {{{english/template/debian/release_info.wml}}} need to be updated with the version number of the point release.

In the release_info.wml files there are 3 tags to be updated: current_release_* , current_release_date_* and current-cd-release; the push to mirrors should wait until the the CD images are ready.
We will update the 3 tags, and commit the changes (in your local copy, no in www-master.debian.org)

3.2. In www-master.debian.org, cvs up /srv/www.debian.org/webwml to update the whole website

3.3. Build the relevant parts of the website, using the script:
3.1. We need to stop any job of website build that is running to avoid automatic push to mirrors. You can see the processes by typing (in www-master):
Line 62: Line 74:
sudo -u debwww NOMIRROR=1 /srv/www.debian.org/update-part-pabs CD    sudo -u debwww pstree -p debwww
Line 65: Line 77:
(then repeat the command with other folder, until all the relevant folders are updated. At least: releases, CD, distrib, ports. Don't build the "security" folder because that one takes too long). and stop it with

{{{
   sudo -u debwww kill PID
}}}


3.2 The files {{{english/releases/}}}''codename''/{{{errata.wml}}} and {{{english/template/debian/release_info.wml}}} need to be updated with the version number of the point release. In some cases, we also need to update {{{english/releases/}}}''codename''/{{{index.wml}}} and {{{english/releases/}}}''codename''/{{{release.data}}} (see below for the details).

 * Add a line in {{{english/releases/}}}''codename''/{{{errata.wml}}} to point to the URL of the announcement for the point release.
 
 * In the release_info.wml files there are several tags to be updated: current_release_''codename'' , current_release_date_''codename'' , current_release_newsurl_''codename'' and current-cd-release; you can commit and push the changes to the repo, but any push to mirrors of the built files should wait until the the CD images are ready (that's why we stopped the cron jobs and the running jobs in www-master).

 * In the case of stable releases or final point release for an oldstable release, {{{english/releases/}}}''codename''/{{{index.wml}}} needs to be updated too.

 * In the case of oldstable releases, or the first publication of a stable release (i.e., a release becoming oldstable), {{{english/releases/}}}''codename_oldstable''/{{{release.data}}} needs to be updated too, adding or updating these tags:
{{{
<define-tag jessie-images-url>https://cdimage.debian.org/cdimage/archive/8.11.0</define-tag>
<define-tag jessie-cd-release-filename>8.11.0</define-tag>
}}}

 * In the case of stable and oldstable point release, you have to update the tags and wml files corresponding to both releases.

Commit the changes (in your local copy, no in www-master.debian.org)

3.3. In www-master.debian.org, build the relevant parts of the website, using the script:

{{{
sudo -u debwww NOMIRROR=1 /srv/www.debian.org/update-part CD
}}}

(Repeat the command changing CD for each one of the folders that use the release_info tags. At least: CD, distrib, ports, releases).
This step usually takes more than 10 minutes. Each folder takes some minutes to update.
Line 70: Line 114:
sudo -u debwww NOSUBDIRS=1 NOMIRROR=1 /srv/www.debian.org/update-part-pabs index sudo -u debwww NOSUBDIRS=1 NOMIRROR=1 /srv/www.debian.org/update-part index
Line 73: Line 117:
3.5. You can review the output of all the website builds in /srv/www.d.o/www This step should take some minutes, not much.
Line 75: Line 119:
4. Once the installation images are ready, trigger to mirrors so the updated website gets published: 3.5 If the images are not ready yet, you can build the other folders of the website with the same command of step 3.3. Don't build the "security" folder because that one takes too long. "Bugs" and "events" are also folders that take a while to build).
Line 77: Line 121:
{{{
sudo -u debwww /srv/www.debian.org/cron/parts/999TriggerMirrors
}}}
3.6. You can review the output of all the website builds in /srv/www.debian.org/www (or via web in https://www-staging.debian.org ).

4. Once the installation images are ready, you can repeat step 2.2 (update-part News) so the last translations of the announcement get published, and the folders that we built in the step 3 are pushed to mirrors (and the website looks updated and with links to the updated images).

This step may take more than 30 minutes.
Line 91: Line 137:
7. Remove the announcement from the [[https://anonscm.debian.org/cgit/publicity/announcements.git|publicity announcements git repository]] once it has been published. 7. Remove the announcement from the [[https://salsa.debian.org/publicity-team/announcements|publicity announcements git repository]] once it has been published.

Workflow for the Release Point announcements

This page describe the current workflow and best practices for the creation and publication of announcements of release points.

This task has to be run by Publicity delegates and/or webmasters because you need permissions to stop cron jobs, build the website, and push to mirrors.

1. On $expected-release-date we need to publish the announcement in the website, and update most of the website to reflect the point releases we are going to offer from now on. To avoid presenting an updated info in some places while the CD images are not ready yet, or while other parts of the website still didn't get updated, we would need to stop the cron jobs that build the website automatically, and thus update and build ourselves, and push to mirrors, as it is needed.

1.1 Open an ssh session in www-master.debian.org

   ssh www-master.debian.org

1.2 Stop the cron jobs that build the website:

   sudo -u debwww crontab -e
  • and mark as comment the lines related to the website builds the ones that launch /srv/www.debian.org/cron/often and /srv/www.debian.org/cron/lessoften

2. The release team will probably have written a draft (or two if there is release point for stable and oldstable) in the publicity announcements git repository under en/$year/YYYYMMDD.wml and have sent a mail to debian-publicity@lists.debian.org (adding in CC debian-l10n-english@lists.debian.org and debian-i18n@lists.debian.org) asking for reviews and translations, so check the folders of other languages (or commit log of the repository).

2.1. Publish the announcement in the website: you just need to add it to the webwml git repository at webwml/english/News/$year with the namescheme YYYYMMDD.wml). Add and commit the English version first. Then, take note of the hash of the commit of the English file (you can do "git log english/News/$year/YYYYMMDD.wml" and copy the hash of the most recent commit). Then copy the translations to their corresponding folders (adding Makefiles if needed), and then edit them to add the hash in the "translation-check" header.

For example, let's say that the French translation file has a first line like this:

#use wml::debian::translation-check translation="      " maintainer="Jean-Pierre Giraud"

Then you have to paste the hash so it looks like something like this:

#use wml::debian::translation-check translation="0788aa9ab387393e2e9236d36df0630ae1c038c6" maintainer="Jean-Pierre Giraud"

Save the files, and then add and commit the translations (and makefiles if any) You can add and commit all the files at the same time.

2.2. Run a partial rebuild of the website:

   ssh -tt www-master.debian.org sudo -u debwww /srv/www.debian.org/update-part News

(this step usually takes more than 10 minutes).

If you want to update the homepage so the news is listed there too, run:

   ssh -tt www-master.debian.org sudo -u debwww NOSUBDIRS=1 /srv/www.debian.org/update-part index

2.3. Now you're ready for creating the mail: the script to create it is the publicity dpn repo under scripts/DPNhtml2mail.pl Please note that the script is not perfect: a check and a couple of adjustments by hand are usually required (and a patch to improve it, as well!)

IMPORTANT: Please run the script in a Debian stretch box until #950972 is fixed

./scripts/DPNhtml2mail.pl -t news -i $year/$date

2.4. Send the mail to debian-announce@lists.debian.org.

2.5. Follow the instructions in https://micronews.debian.org/pages/contribute.html to send a microblogging that will be mirrored in identi.ca/debian and other social networks.

3. For stable/oldstable point releases, almost the whole website needs to be rebuilt but the push to mirrors cannot be made until the installation images are ready (keep an eye on #debian-cd and #debian-release). We will update the website manually, without pushing to mirrors.

3.1. We need to stop any job of website build that is running to avoid automatic push to mirrors. You can see the processes by typing (in www-master):

   sudo -u debwww pstree -p debwww

and stop it with

   sudo -u debwww kill PID

3.2 The files english/releases/codename/errata.wml and english/template/debian/release_info.wml need to be updated with the version number of the point release. In some cases, we also need to update english/releases/codename/index.wml and english/releases/codename/release.data (see below for the details).

  • Add a line in english/releases/codename/errata.wml to point to the URL of the announcement for the point release.

  • In the release_info.wml files there are several tags to be updated: current_release_codename , current_release_date_codename , current_release_newsurl_codename and current-cd-release; you can commit and push the changes to the repo, but any push to mirrors of the built files should wait until the the CD images are ready (that's why we stopped the cron jobs and the running jobs in www-master).

  • In the case of stable releases or final point release for an oldstable release, english/releases/codename/index.wml needs to be updated too.

  • In the case of oldstable releases, or the first publication of a stable release (i.e., a release becoming oldstable), english/releases/codename_oldstable/release.data needs to be updated too, adding or updating these tags:

<define-tag jessie-images-url>https://cdimage.debian.org/cdimage/archive/8.11.0</define-tag>
<define-tag jessie-cd-release-filename>8.11.0</define-tag>
  • In the case of stable and oldstable point release, you have to update the tags and wml files corresponding to both releases.

Commit the changes (in your local copy, no in www-master.debian.org)

3.3. In www-master.debian.org, build the relevant parts of the website, using the script:

sudo -u debwww NOMIRROR=1 /srv/www.debian.org/update-part CD

(Repeat the command changing CD for each one of the folders that use the release_info tags. At least: CD, distrib, ports, releases). This step usually takes more than 10 minutes. Each folder takes some minutes to update.

3.4. Build the homepage and files in the main folder with:

sudo -u debwww NOSUBDIRS=1 NOMIRROR=1 /srv/www.debian.org/update-part index

This step should take some minutes, not much.

3.5 If the images are not ready yet, you can build the other folders of the website with the same command of step 3.3. Don't build the "security" folder because that one takes too long. "Bugs" and "events" are also folders that take a while to build).

3.6. You can review the output of all the website builds in /srv/www.debian.org/www (or via web in https://www-staging.debian.org ).

4. Once the installation images are ready, you can repeat step 2.2 (update-part News) so the last translations of the announcement get published, and the folders that we built in the step 3 are pushed to mirrors (and the website looks updated and with links to the updated images).

This step may take more than 30 minutes.

5. And finally, undo the changes in crontab so the next website build runs as usual:

sudo -u debwww crontab -e

(the next rebuild will automatically rebuild the /security and other folders, if needed)

6. You may want to follow again the instructions in https://micronews.debian.org/pages/contribute.html to send a microblogging about the installation images of the new point release(s) ready to download from the Debian website (not needed if not much time passed between the announcement itself and this moment).

7. Remove the announcement from the publicity announcements git repository once it has been published.

8. Finally, update the debian-timeline with this event.