Differences between revisions 16 and 17
⇤ ← Revision 16 as of 2012-04-19 06:02:57 →
Size: 3343
Editor: PaulWise
Comment: planet derivatives update process changed slightly
← Revision 17 as of 2012-05-01 13:01:35 → ⇥
Size: 5083
Editor: PaulWise
Comment: explain the planet derivs mechanisms better, add links
Deletions are marked like this. Additions are marked like this.
Line 34: Line 34:
 1. download the census pages
 1. look for items related to blogs
 1. find if there are RSS feeds on those pages
 1. download the derivatives logos
 1. generate a [[http://dex.alioth.debian.org/census/planet-config|new planet config file]]
 1. resize the logos and aggregate the [[http://dex.alioth.debian.org/census/planet-heads/|planet heads]]
 1. download the Planet Debian SVN repository
 1. compare the new planet config file and heads against SVN, mail the results		  1. download the census pages (scripts [[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/get-wiki-text|1]] [[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/get-url-eol-fix|2]])
 1. look for items related to blogs (scripts [[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/wiki-text-to-blogs-list|1]] [[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/wiki-text-to-dev-blogs-list|2]])
 1. look for a logo ([[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/wiki-text-to-logo|script]])
 1. find if there are RSS feeds on those pages ([[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/get-blogs-rss|script]])
 1. download the logo ([[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/get-logo-img|script]])
 1. generate a planet config snippet ([[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/derivative-to-planet-config|script]])
 1. resize the logo into a head ([[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/logo-to-planet-head|script]])
 1. aggregate the [[http://dex.alioth.debian.org/census/planet-config|planet config]] snippets and [[http://dex.alioth.debian.org/census/planet-heads/|planet heads]] (scripts [[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/aggregate-planet-config|1]] [[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/aggregate-planet-heads|2]])
 1. download the [[http://anonscm.debian.org/viewvc/planet-debian/trunk/|Planet Debian SVN repository]] ([[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/get-planet-svn|script]])
 1. compare the new planet config file and heads against the planet [[http://anonscm.debian.org/viewvc/planet-debian/trunk/config/config.ini.deriv?view=co|config]] and [[http://anonscm.debian.org/viewvc/planet-debian/trunk/heads/deriv/|heads]] in SVN, mail the results via cron output (scripts [[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/compare-planet-config|1]] [[http://anonscm.debian.org/gitweb/?p=dex/census.git;a=blob_plain;f=bin/compare-planet-heads|2]])
Line 43: Line 45:
A human should then review the feeds and any make changes needed to [[PlanetDebian|Planet Debian]] SVN. A human should then review the cron mails and any make changes needed to [[PlanetDebian|Planet Debian]] SVN.

We now have a list of derivatives and some information about them. A list of derivatives hiding away in a corner of the wiki is not that useful. Better would be to aggregate the available information about derivatives and present it in Debian infrastructure in a way that makes the derivatives visible to Debian contributors and useful to them. Got an idea about how we can do that? Add it below!

The code being written to help integrate the census into Debian infrastructure is available in git under the DEX project:

git clone git://git.debian.org/git/dex/census.git
http://anonscm.debian.org/gitweb/?p=dex/census.git

Contents

  1. Status
    1. Planet Debian derivatives
  2. Ideas
    1. Packages
    2. Bugs
    3. Screenshots

Status

Currently the census is only minimally used for integration of derivatives with Debian:

Some information about derivatives has been manually integrated:

  • PTS: contains information about Ubuntu bugs, version numbers and patches
  • DDPO: contains information about Ubuntu bugs, version numbers and patches
  • UDD: contains information about:
    • packages from aptosid, skolelinux, Ubuntu
    • bugs from Ubuntu
    • popcon from Ubuntu
  • website: contains information about some derivatives with a few links to the census
  • wiki: some javascript to detect the status of bugs linked to from the wiki. Currently supports the Debian bug tracker and the Launchpad bug tracker.
  • debtags: imports packages from Ubuntu and allows them to be tagged
  • screenshots: imports packages from Ubuntu and allows them to be screenshotted

Planet Debian derivatives

Aggregates all the developer and main blogs of all derivatives in one location on http://planet.debian.org/deriv/. The derivatives census scripts perform the following steps:

  1. download the census pages (scripts 1 2)

  2. look for items related to blogs (scripts 1 2)

  3. look for a logo (script)

  4. find if there are RSS feeds on those pages (script)

  5. download the logo (script)

  6. generate a planet config snippet (script)

  7. resize the logo into a head (script)

  8. aggregate the planet config snippets and planet heads (scripts 1 2)

  9. download the Planet Debian SVN repository (script)

  10. compare the new planet config file and heads against the planet config and heads in SVN, mail the results via cron output (scripts 1 2)

A human should then review the cron mails and any make changes needed to Planet Debian SVN.

Ideas

Packages

Aggregate all the derivative's sources.list snippets and integrate them into the following:

  • udd.debian.org
  • packages.debian.org
  • packages.qa.debian.org
  • patch-tracker.debian.org
  • qa.debian.org/developer.php
  • qa.debian.org/madison.php

Bugs

Link to the derivatives bug trackers from the PTS so that Debian folks can find potential problems in their packages. This might be hard since it can be rare for derivatives to provide mappings between a bug report and the source package it applies to.

Screenshots

Allow folks to upload screenshots for packages that are only in derivatives. This would rely on some way to differentiate between free and non-free sections in our derivatives, since screenshots.d.n does not accept screenshots for contrib/non-free.