Differences between revisions 8 and 9
Revision 8 as of 2012-12-27 20:42:42
Size: 9239
Comment: Wouter's got a WikiName and administers vivaldi, too
Revision 9 as of 2012-12-27 20:58:42
Size: 9272
Comment: add column about where the box is hosted
Deletions are marked like this. Additions are marked like this.
Line 7: Line 7:
||Buildd||DNS||Machine||Host Admin||Buildd Admin||
||akire||akire.buildd.net||Amiga 2000/060||IngoJuergensmann||JohnPaulAdrianGlaubitz||
||ara5||ara5.mirbsd.org||ARAnyM||ThorstenGlaser||ThorstenGlaser||
||arrakis||arrakis.buildd.net||Amiga 3000/060||IngoJuergensmann||WouterVerhelst||
||elgar||elgar.debian.net||Amiga 4000/060||IngoJuergensmann||JohnPaulAdrianGlaubitz||
||vivaldi||vivaldi.buildd.net||Amiga 4000/060||IngoJuergensmann||WouterVerhelst||
||Buildd||where?||DNS||Machine||Host Admin||Buildd Admin||
||akire||?||akire.buildd.net||Amiga 2000/060||IngoJuergensmann||JohnPaulAdrianGlaubitz||
||ara5||[[GPLHost]]||ara5.mirbsd.org||ARAnyM||ThorstenGlaser||ThorstenGlaser||
||arrakis||?||arrakis.buildd.net||Amiga 3000/060||IngoJuergensmann||WouterVerhelst||
||elgar||?||elgar.debian.net||Amiga 4000/060||IngoJuergensmann||JohnPaulAdrianGlaubitz||
||vivaldi||?||vivaldi.buildd.net||Amiga 4000/060||IngoJuergensmann||WouterVerhelst||

Information about M68k Autobuilder

Autobuilder (aka Buildds) are machines that automatically build packages from source packages. The M68k port is using several autobuilders for that purpose.

List of Buildds

Buildd

where?

DNS

Machine

Host Admin

Buildd Admin

akire

?

akire.buildd.net

Amiga 2000/060

?IngoJuergensmann

?JohnPaulAdrianGlaubitz

ara5

GPLHost

ara5.mirbsd.org

ARAnyM

ThorstenGlaser

ThorstenGlaser

arrakis

?

arrakis.buildd.net

Amiga 3000/060

?IngoJuergensmann

WouterVerhelst

elgar

?

elgar.debian.net

Amiga 4000/060

?IngoJuergensmann

?JohnPaulAdrianGlaubitz

vivaldi

?

vivaldi.buildd.net

Amiga 4000/060

?IngoJuergensmann

WouterVerhelst

HowTo Setup/Upgrade A Buildd from Etch-m68k to Unstable

There are these possible ways:

  • ?IngoJuergensmann wrote a blog entry about upgrading from etch-m68k to unstable: http://blog.windfluechter.net/content/blog/2011/07/26/1189-upgrading-m68k-etch-m68k-unstable The information there is a little bit outdated because of newer packages. You'll need to tweak every now and then with different dependencies and maybe force packages with dpkg --force-depends or --force-all to get installed. It may be necessary, too, that you'll need to download a certain package version from archive.debian.org and even unpack it with ar -x and copy the files to your filesystem. As this is really not recommended and only experienced users should do this: make a backup! It's best to use a second partition on your harddisk, copy over your system and work on that copy/second partition!

ThorstenGlaser still says that this is absolutely not supported by Debian and will most likely fail. Use debootstrap or copy an image instead! (More on this later…)

  • Use debootstrap on another partition to install a unstable system and boot into it.
  • Get the tarball from <needstobeadded> and untar it on one of your partitions. Make the necessary changes to the system like generating SSH keys, create a user and such.

HowTo Setup buildd chroot

needs to be written

HowTo configure schroot & sbuild

  • You'll need to install sbuild, schroot and (for later) buildd
  • create a chroot as described above, for this example we assume it's being located on a LVM under /dev/vg/buildd-sid

  • create a config entry for that chroot under /etc/schroot/chroot.d/sid-m68k-sbuild:

[sid-m68k-sbuild]
type=lvm-snapshot
description=Debian sid LVM snapshot
groups=sbuild,root,ij
root-users=ij,sbuild,buildd
root-groups=root,sbuild,ij,buildd
source-root-users=ij,sbuild,buildd
device=/dev/vg/buildd
mount-options=-o atime,sync,user_xattr
lvm-snapshot-options=--size 4G 
  • configure /etc/sbuild/sbuild.conf as needed, i.e. setting the arch to m68k

  • configure ˝/.sbuildrc as this (example):

#
# example for ~/.sbuildrc
# commented out stuff are defaults
#
# $Id: example.sbuildrc,v 1.2 2000/03/09 13:13:16 rnhodek Exp $

# Require chrooted building?
#$chroot_only=1;

$fakeroot = "fakeroot";

# Directory for writing build logs to
$log_dir = "$HOME/logs";

# Mail address where logs are sent to (mandatory, no default!)
# this moved to .builddrc...
$mailto = '%%buildd-admin%%@example.org,logs@buildd.debian-ports.org';

$mailfrom = "buildd\@%%yourhost%%.example.org";

# Maintainer name to use in .changes files (mandatory, no default!)
$maintainer_name='debian/m68k buildd <buildd@%%yourhost%%.example.org>';

# When to purge the build directory afterwards; possible values are "never",
# "successful", and "always"
$purge_build_directory="successful";

# After that time (in minutes) of inactivity a build is terminated. Activity
# is measured by output to the log file.
$stalled_pkg_timeout = 600;

# Some packages may exceed the general timeout (e.g. redirecting output to
# a file) and need a different timeout. Below are some examples.
require "/home/buildd/globals/sbuildrc-timeout";

$sbuild_mode = "buildd";

#%alternatives = (
#       svgalibg1-dev => svgalib-dummyg1,
#       libmotif-dev => lesstif2-dev
#);

$apt_update = 0;
$apt_distupgrade = 0;
$apt_upgrade = 0;

# don't remove this, Perl needs it:
1;
  • generate an sbuild key with sbuild-update --genkey. I did this as root as well as buildd user, because I didn't know which key is used and I wanted to be safe. But I guess you'll just generate the system sbuild key as root.

  • try to build by using sbuild -d unstable -c sid-m68k-sbuild <package_version> and keep an eye on the build logs.

  • if package built fine without problems, you may proceed to configure the buildd itself:

HowTo configure buildd

Wouter wrote in a mail to debian-68k list this:

Now, while it's still fresh in my memory, for those of you who want to
set things up, here's a (not so) short HOWTO:

- First, set up sbuild so it can build packages. This has changed fairly
 significantly since the old days, so you'll have to learn all over
 again. Since Ingo set that up on arrakis, I'm afraid I can't help
 here, but he said he'd mail his explanation some time soon.

 Important: make sure the 'schroot' chroot name follows the following
 pattern:

 <dist>-<arch>-sbuild

 e.g.,

 sid-m68k-sbuild

 otherwise buildd won't find the chroot and can't build.
- Install buildd. Note that 'buildd.conf' has been renamed, you should
 now use ~buildd/.builddrc instead. A template configuration file looks
 like this:

--->8--->8---
@distributions = (
       {
               dist_name => [ "sid" ],
               built_architecture => 'm68k',
               wanna_build_ssh_host => "buildd.debian-ports.org",
               wanna_build_ssh_user => "buildd_m68k",
               wanna_build_ssh_socket => "buildd.debian-ports.org.ssh",
               wanna_build_ssh_options => [],
               wanna_build_db_user => "buildd_m68k-arrakis",
               dupload_local_queue_dir => "upload",
               no_auto_build => [],
               weak_no_auto_build => [],
               logs_mailed_to => 'wouter@debian.org,logs@buildd.debian-ports.org',
               sign_with => "96DC703F",
       },
);

@upload_queues = (
       {
               dupload_local_queue_dir => "upload",
               dupload_archive_name => "dports",
       },
);

my $autoclean_interval = 86400;
my $secondary_daemon_threshold = undef;
$admin_mail = "wouter\@debian.org";
$statistics_mail = $admin_mail;

# How many days until archiving build logs
my $buildd_log_keep = 7;

# Log successful messages from upload queue daemon?
my $log_queued_messages = 1;

# Send rotated daemon.log files?
$daemon_log_send = 1;

# Arrakis is a dedicated daemon, it shouldn't need nice
$nice_level = 0;

my $max_build = 1;

# Ask whether packages should be built if they failed earlier?
$should_build_msgs = 0;

# Don't remove this, Perl needs it
1;
---8<---8<---

 Yes, that means we can specify more than one distributions with more
 than one target upload queue. On debian.org machines, this is used to
 build for unstable, experimental, backports, and security, all from
 the same host.

 Obviously you'll want to change the values of logs_mailed_to,
 wanna_build_db_user, and $admin_mail :-)
- Add a cronjob for 

 schroot -c source:sid-m68k-sbuild -- apt-get update

 and have it run every six hours, but *not* at 6-12-18-24, because
 that's just *before* the archive run. This is because 'apt-get update'
 takes about 25 minutes these days, and otherwise it'll try to do that
 for *every* build, which isn't always necessary. With this, it'll do
 it as often as debian-ports gets updated; much more useful.  Note the
 source: bit in the schroot command line, it means you don't want
 schroot to create a snapshot that it'll throw away after you log out
 (fairly crucial for what we want to do here)
- Patch /usr/bin/perl5/Buildd/Daemon.pm, find the line that says
 '--apt-update' and change it into '--no-apt-update'. I'll file a
 bugreport in a minute so that isn't hardcoded anymore, but for now
 you'll have to do that.
- Generate a GPG key with:
 - 4096 bits RSA
 - expiry set to 1 year
 - no password
 You do *not* want to do this on the m68k; generate it on a faster
 machine, and use 'gpg --export-secret-key' to copy it over to the
 m68k. Otherwise you'll be at it for hours. Note that
 --export-secret-key doesn't export the public key, you have to use
 --export-key for that. Use --import on the m68k machine to import both
 files there. Don't forget to gpg --delete-secret-key it from your
 other machine (don't want to needlessly increase the attack surface)
- Sign the GPG key with your own GPG key (the one that you can use to do
 debian.org uploads with)
- Change the value of 'sign_with' in .builddrc to the key ID of the GPG
 key that you just generated.
- Upload the GPG key to some keyserver somewhere.
- Generate an SSH key (if that has not already been done)
- Send a mail to aurelien with GPG fingerprint, SSH public, and mail
 forward address
- Install buildd-watcher and buildd-uploader in cron, as before.
- Profit!