Differences between revisions 39 and 92 (spanning 53 versions)
Revision 39 as of 2008-08-23 10:08:00
Size: 5990
Editor: HolgerLevsen
Comment:
Revision 92 as of 2014-05-20 11:34:21
Size: 1881
Editor: HolgerLevsen
Comment: shorten / make clearer / https / invite contributors
Deletions are marked like this. Additions are marked like this.
Line 3: Line 3:
[[TableOfContents(2)]]

= General info =
= What is piuparts? =
Line 8: Line 6:
Description: .deb package installation, upgrading, and removal testing tool Description: .deb package installation, upgrading, and removal testing tool 
Line 15: Line 13:
 .   .
Line 18: Line 16:
Homepage: https://piuparts.debian.org
Line 20: Line 19:
piuparts runs on piuparts.cs.helsinki.fi aka piatti.debian.org and just like lintian should be run on every developer machine before uploading :) === piuparts.debian.org ===
Line 22: Line 21:
piuparts logs (currently outdated) are available at [http://piatti.debian.org http://piatti.debian.org] piuparts is being run constantly on all suites of the main Debian archive, the results are made public on [[https://piuparts.debian.org|piuparts.debian.org]].
The [[piuparts/piuparts.debian.org|piuparts.debian.org setup]] is documented and maintained in GIT, plus there is also an [[piuparts/FAQ|FAQ]] available.
Line 24: Line 24:
#debian-qa is the irc-channel to coordinate work on irc, piuparts-devel is the project name on alioth. === Documentation ===
Line 26: Line 26:
== Machine info == piuparts itself has a [[https://piuparts.debian.org/doc/README_1st.html|README_1st]] and a [[http://piuparts.debian.org/doc/piuparts.1.html|manpage]] - read those before reading the [[piuparts/HowTos]].
Line 28: Line 28:
 * piuparts.cs.helsinki.fi aka piatti.debian.org
 * hosted at [http://cs.helsinki.fi/index.en.html Department of Computer Science, University of Helsinki]
 * donated by [http://hp.com/go/debian/ HP]
 * dual AMD Opteron(tm) Processor 275, 2.2 Ghz
 * 4GB RAM
 * 465 GB physical volume for data
  * 50 GB for /home for piatti
  * 90 GB for mirror
  * 10 GB for xenu1 (testdomain)
  * 4 GB and 128 MB swap for test.my.piuparts (testdomain2 :)
  * X GB piuparts slave
  * Y GB developer test environtments
  * planned: 50 GB for svn-buildstat
 * 2 IPs
=== Contributing ===
Line 43: Line 30:
== How to run piuparts on piatti == If you are interested in contributing, that's great! Here's a list to hopefully get you started:
 * join [[piuparts/Development|development]] efforts. Every little pull request helps. Check the BTS for plenty of wishlist bugs to tackle.
 * [[https://piuparts.debian.org/bug_howto.html|file bugs]] based on piuparts.d.o runs!
 * improve the documentation, both these wiki pages and what's in GIT has been growing over the years and it's showing.
Line 45: Line 35:
the piuparts stuff is partly in the piupartsm account (master end, including debmirroring), and partly in the piuartss account (the slave, which actually runs piuparts)

run piuparts-slave.py as piupartss and watch it run via screen. the slave starts the master when it needs it, you don't need to start it manually

also read http://liw.iki.fi/liw/debian/piuparts-logfile-processing-howto

If you want to help, please don't bother liw, h01ger has access too and you should bother him.

... to be continued! ...

== Troubleshouting / maintainance ==

Sometimes the chroot tarballs in /home/piupartss/ need to be removed, currently there are sid.tar.gz and sarge.tar.gz

see /etc/piuparts/piuparts-slave.conf

= Developing piuparts =

 * alioth project
 * http://wiki.debian.org/SummerOfCode2007/PiupartsImprovements

= Todo =

== service related ==

 * workaround apt problem
 * use local mirror

== Machine related ==

 * tell weasel which directories to backup
 * ignore python-apt warnings until DSA solves it
 * local uids or add goneri to ldap?
 * put all existing piuparts scripts and configs into svn
 * set up xenu domains with fai
 * root access for XENU domains for DDs and non-DDs (like goneri if needed, or other qa members), via local console
   * no users (from ldap) in XENU domains
 * XENU domain for svn-buildstat (min 30gb hd space, he'll get 50)
  * actualy no extra XENU is needed for this.
  * [http://wiki.debian.org/svnbuildstat#head-9e8eb0f99ba9ff07787c9168839f52553909b6bd setup howto for svnbuildstat]
  * goneri (non-DD) needs an account and a postgresdb
  * external IP not strictly neccessary, a http-port should be enough for the new code, the current uses http+ftp
   * this dns name would be nice: qabuildstat.cs.helsinki.fi
 * mirror proposed updates and security updates too
 * run two piuparts slaves to make use of the two cpus
 * finish aide configuration - http://wiki.debian.org/Teams/DSA/MachineSetup
 (but: <buxy> h01ger: AFAIK, aide is not consistently used (and is known to break on merkel currently), so you can probably skip that part for now)
  * deinstall aide?
 * root@piuparts.cs.helsinki.fi bounces
 * drop Joey a note so that all users are replicated via ldap
 * backup /etc and /org via http://wiki.debian.org/Teams/DSA/DaBackup
 * also use the machine to run svnbuildstat.debian.net
 * also use the machine to run vlosuts

done:
 * apt-get install debian.org aide nagios-nrpe-server lvm2
 * apt-get install -t etch-backports xen-shell xen-tools

== Codebase related ==

 * split /fails/ into more directories
 * <liw> (at some point) you may want to run the bin/mirror-debian script as user piupartsm
 * look at the irssi_away script to see how to monitor screen sessions, to notify when piuparts is hanging


== Piuparts and pts integration suggestion ==

In order for the PTS to be able to display piuparts testing status for a package, and link to its log file,
Piuparts could generate a set of static files that will be visible via http:

{{{
%s = source package name
%v = source package version
%p = piuparts version

/source/%s -> index page
/source/%s/%v -> a particular log
/source/%s/latest -> log for latest version
/source/%s/piuparts-%p/%v -> a particular log from a version of piuparts

similar for /binary-$ARCH/

/%s -> /source/%s

For PTS integration: one file with results for all source packages:
/results-per-source.txt
    %s pass $MATCHINGLOG
    %s fail $MATCHINGLOG

For Ubuntu development weather report (similar to PTS): a file with the following:
    Pass: %d
    Fail: %d

}}}

(See https://blueprints.launchpad.net/ubuntu/+spec/developer-weather-report for the Ubuntu developer weather report.)

== Documentation ==

split this wiki page into subpages, so that the piuparts documentation can be mainained in the wiki, by exporting as docbook.

suggested structure:

 * /piuparts - index page, just a table of contents
 * /piuparts/about - what is piuparts
 * /piuparts/devel - information how to participate in piuparts development
 * /piuparts/doc/software - piuparts documentation
 * /piuparts/doc/piatti - documenation about piuparts.cs.helsinki.fi
 * /piuparts/todo - todo list
----
## This page is referenced from http://piuparts.debian.org
CategoryPermalink

What is piuparts?

Description: .deb package installation, upgrading, and removal testing tool 
 piuparts tests that .deb packages (as used by Debian) handle
 installation, upgrading, and removal correctly. It does this by
 creating a minimal Debian installation in a chroot, and installing,
 upgrading, and removing packages in that environment, and comparing the
 state of the directory tree before and after. piuparts reports any
 files that have been added, removed, or modified during this process.
 .
 piuparts is meant as a quality assurance tool for people who create .deb
 packages to test them before they upload them to the Debian package archive.
Homepage: https://piuparts.debian.org

piuparts.debian.org

piuparts is being run constantly on all suites of the main Debian archive, the results are made public on piuparts.debian.org. The piuparts.debian.org setup is documented and maintained in GIT, plus there is also an FAQ available.

Documentation

piuparts itself has a README_1st and a manpage - read those before reading the piuparts/HowTos.

Contributing

If you are interested in contributing, that's great! Here's a list to hopefully get you started:

  • join development efforts. Every little pull request helps. Check the BTS for plenty of wishlist bugs to tackle.

  • file bugs based on piuparts.d.o runs!

  • improve the documentation, both these wiki pages and what's in GIT has been growing over the years and it's showing.


CategoryPermalink