Differences between revisions 62 and 114 (spanning 52 versions)
Revision 62 as of 2015-10-12 14:09:46
Size: 5281
Editor: PaulWise
Comment: reproducible builds :D
Revision 114 as of 2022-05-07 03:35:02
Size: 11576
Editor: PaulWise
Comment: link additions and updates
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
<<TableOfContents>>
Line 11: Line 13:
 * [[https://www.debian.org/doc/manuals/developers-reference/pkgs.en.html#nmus-vs-qa-uploads|Howto do qa uploads]]
Line 12: Line 15:
 * Package Tracking System: [[qa.debian.org/pts]]  * Code repository: [[https://salsa.debian.org/qa/qa]]
 * Debian Package Tracker: [[qa.debian.org/distro-tracker]] ([[https://tracker.debian.org/|website]])
 * Package Tracking System: [[qa.debian.org/pts]] ([[https://packages.qa.debian.org/|website]])
Line 25: Line 30:
 * [[https://qa.debian.org/dose|Dose Tools]] (archive wide tests, e.g.: non-installable packages, Debian weather, missing conflicts, ... Formerly known as EDOS)  * [[https://qa.debian.org/dose|Dose Tools]] (archive wide tests, e.g.: non-installable packages, Debian weather, missing conflicts, ... Formerly known as EDOS) ([[https://d-i.debian.org/dose/|debian-installer dose checks]])
Line 27: Line 32:
 * [[http://portfolio.debian.net/]] (Portfolio Service, inspired by [[DDPortfolio]])  * [[https://portfolio.debian.net/]] (Portfolio Service, inspired by [[DDPortfolio]])
Line 29: Line 34:
 * [[qa.debian.org/RC-usertagging]] (RC bugs usertagging)  * [[https://bugs.debian.org/release-critical/|RC bugs]] (release critical bug reports)
 * [[/usertagging|QA/RC usertags]] (QA/RC bugs usertagging)
 * [[DebianPackage:how-can-i-help]]: (find bugs to work on)
Line 31: Line 38:
   * [[https://salsa.debian.org/jelmer/lintian-brush|lintian-brush]] (package auto-fixing tool)
   * [[https://janitor.debian.net/|Debian Janitor]]'s [[https://janitor.debian.net/lintian-fixes/|lintian-fixes]] (package VCS auto-fixing service)
 * [[https://metacpan.org/release/App-Cme|Config::Model editor]]: can update debian/ directory files, to fix issues etc
 * [[https://salsa.debian.org/science-team/routine-update|routine-update]]: perform common packaging cleanups
Line 32: Line 43:
 * [[http://git.debian.org/?p=pkg-debile/debile.git|Debile]] (DACA, but slightly less professional, and can do slightly more in a more stupid way.
  * [[https://github.com/fedora-static-analysis/firehose|Firehose]] (Store static testing data in XML, used by Debile)
 * [[https://alioth-archive.debian.org/git/pkg-debile/|Debile]] (DACA, but slightly less professional, and can do slightly more in a more stupid way.
  * [[https://github.com/fedora-static-analysis/firehose|Firehose]] (Store static testing data in XML, used by Debile)
  * [[https://www.oasis-open.org/standards#sarifv2.1-os|SARIF]]: (OASIS Standard: Static Analysis Results Interchange Format, obsoletes Firehose)
 * [[https://cppcheck.sourceforge.io/devinfo/daca2-report/daca2.html|DACA2]] (cppcheck results) ([[http://cppcheck1.osuosl.org:8000/|newer report]])
 * [[https://phd-sid.ethz.ch/debian/report/|tarzeau's static analysis report]] (cmetrics codespell cppcheck cqmetrics flawfinder graudit shellcheck splint)
Line 35: Line 49:
 * [[http://clang.debian.net|clang]] (rebuilding the archive using the clang compiler)  * [[https://clang.debian.net/|clang]] (rebuilding the archive using the clang compiler)
Line 37: Line 51:
 * [[https://crossqa.debian.net/|crossqa.d.n]] (rebuilding the archive using the cross compilers)
 * [[https://ditto.debian.net/|ditto]] ([[https://wiki.debian.org/Teams/DebianCd/ditto|TODO list]]): tool in development for registration of manual procedures/testing results
 * [[https://wiki.debian.org/Teams/DebianCD/ReleaseTesting|CD release testing]] (manual testing of CD image releases)
 * [[https://wiki.debian.org/U-boot/Status|u-boot status]]: (manual testing of u-boot releases on various boards)
 * [[https://wiki.debian.org/SecureBoot/Testing|Secure Boot testing]] (manual testing of Secure Boot)
 * [[https://wiki.debian.org/LTS/TestSuites|LTS testing]] (manual/automatic testing that LTS updates don't break packages)
 * Other manual testing: [[Diaspora/testing|diaspora]] [[EmacspeakTestingGuide|emacspeak]] [[Teams/DebianSambaGroup/Testing|samba]] [[DebianEdu/Contribute/Testing|DebianEdu]] [[DebianIndia/Testing|Indian support]] [[Debian_GNU/kFreeBSD/Testing|kFreeBSD]] [[GuruPlugTesting|GuruPlug]]
 * [[DebianMan:dh_auto_test]] (runs upstream test suites during build)
Line 38: Line 60:
 * [[http://jenkins.debian.net/|Jenkins]] (continuous integration)
 * [[http://ci.debian.net/|debci]] (continuous integration)
   * [[DebianPackage:autopkgtest|autopkgtest]] [[https://wiki.ubuntu.com/AutomatedTesting|docs]]
 * [[DebianPackage:adequate|adequate]] (checking installed systems for issues)
 * [[https://jenkins.debian.net/|Jenkins]] (continuous integration) - also see [[Services/jenkins.debian.net]]
 * [[https://ci.debian.net/|debci]] (continuous integration)
   * [[DebianPackage:autopkgtest|autopkgtest]] [[https://wiki.ubuntu.com/AutomatedTesting|docs]] wiki pages: [[debci]] ContinuousIntegration
 * [[https://openqa.debian.net/|openQA]] (continuous integration)
 * [[Teams/SalsaCI|SalsaCI]] (runs [[https://docs.gitlab.com/ee/ci/|GitLab CI]] in each repo)
 * [[https://lava.debian.net/|LAVA]] [[LAVA|docs]] (automated hardware and whole-system testing)
 * [[https://www.irif.fr/~treinen/colis/|Colis]] (formal verification of maintainer scripts)
 * [[https://github.com/lvc/pkg-abidiff|pkg-abidiff]] and [[DebianMan:abipkgdiff]] (from DebianPackage:abigail-tools) (compare ABIs between package versions)
Line 43: Line 71:
 * [[https://repology.org/repository/debian_unstable/problems|Repology problems]] (another URL checker)
Line 46: Line 75:
 * [[http://dedup.debian.net/|dedup]] (Debian duplication detector)
 * [[http://clonewise.debian.net/|Clonewise]] (checks for embedded code copies, not yet setup)
 * [[https://dedup.debian.net/|dedup]] (Debian duplication detector)
 * [[MultiArch/Hints|multiarch hints]] (hints for correcting multi-arch data)
   * [[https
://janitor.debian.net/|Debian Janitor]]'s [[https://janitor.debian.net/multiarch-fixes/|multiarch-fixes]] (package VCS auto-fixing service)
 * [[https://github.com/silviocesare/C
lonewise|Clonewise]] (checks for embedded code copies, service not yet setup)
Line 52: Line 83:
== QA Meetings == <<Anchor(wishlist)>>
== Missing services ==
Line 54: Line 86:
 * 2005/09/09-11, Darmstadt: [[http://meetings-archive.debian.net/pub/debian-meetings/2005/qa-meeting-darmstadt/|Videos and slides]], [[http://wiki.ftbfs.de/ftbfs/DebianQaMeeting|wiki page of the meeting (does not work since 2007-01-24)]]
 * 2006/12/13-17, Badajoz (Extremadura): [[http://meetings-archive.debian.net/pub/debian-meetings/2006/qa-meeting-badajoz/|Videos]], [[DebianQAExtremadura2006|wiki page of the meeting]]
 * 2007/11/28-12/02, Extremadura: [[DebianQAExtremadura2007|wiki page of the meeting]]
 * 2008/11/26-30, Extremadura: [[DebianQAExtremadura2008|wiki page of the meeting]]
 * --(Upcoming: February 2011, Paris: [[DebianQAParis2011|wiki page of the meeting]])-- (cancelled)
Some QA related services that Debian lacks:

 * Library API/ABI tracking (using [[https://github.com/lvc/pkg-abidiff|pkg-abidiff]] or DebianMan:abipkgdiff from DebianPkg:abigail-tools)
 * Continuous testing for unused build-depends (cf DebianBug:890195)

== QA events ==

 * DebConf18: [[https://debconf18.debconf.org/talks/31-learn-how-to-triage-bugs/|31]] [[https://debconf18.debconf.org/talks/90-mining-debian-maintainer-scripts/|90]] [[https://debconf18.debconf.org/talks/149-lets-start-salvaging-packages/|149]] [[https://debconf18.debconf.org/talks/87-debian-ciautopkgtest-bof/|87]] [[https://debconf18.debconf.org/talks/171-cross-building-debian-packages-and-rebootstrap/|171]] [[https://debconf18.debconf.org/talks/95-rethinking-of-debianwatch-rule/|95]]
 * DebConf17: [[https://debconf17.debconf.org/talks/2/|2]] [[https://debconf17.debconf.org/talks/35/|35]] [[https://debconf17.debconf.org/talks/14/|14]] [[https://debconf17.debconf.org/talks/103/|103]] [[https://debconf17.debconf.org/talks/88/|88]] [[https://debconf17.debconf.org/talks/91/|91]] [[https://debconf17.debconf.org/talks/34/|34]] [[https://debconf17.debconf.org/talks/69/|69]] [[https://debconf17.debconf.org/talks/120/|120]] [[https://debconf17.debconf.org/talks/31/|31]]
 * DebConf16: [[https://debconf16.debconf.org/talks/65/|65]] [[https://debconf16.debconf.org/talks/24/|24]] [[https://debconf16.debconf.org/talks/10/|10]] [[https://debconf16.debconf.org/talks/19/|19]] [[https://debconf16.debconf.org/talks/66/|66]] [[https://debconf16.debconf.org/talks/100/|100]] [[https://debconf16.debconf.org/talks/17/|17]] [[https://debconf16.debconf.org/talks/135/|135]] [[https://debconf16.debconf.org/talks/7/|7]] [[https://debconf16.debconf.org/talks/63/|63]] [[https://debconf16.debconf.org/talks/55/|55]]
 * DebConf15: [[https://summit.debconf.org/debconf15/meeting/272/maintaining-8000-packages-large-scale-package-qa-in-the-postgresql-ecosystem/|272]] [[https://summit.debconf.org/debconf15/meeting/377/quality-assurance-bof/|377]] [[https://summit.debconf.org/debconf15/meeting/271/contributing-to-distro-tracker/|271]] [[https://summit.debconf.org/debconf15/meeting/282/check-all-the-things/|282]]
 * DebConf14: [[https://summit.debconf.org/debconf14/track/debian-qa/|debian-qa track]]
 * --(2011-02-??, Paris: [[DebianQAParis2011|wiki page of the meeting]])-- (cancelled)
 * 2008-11-26 to 2008-11-30, Extremadura: [[DebianQAExtremadura2008|wiki page of the meeting]]
 * 2007-11-28 to 2007-12-02, Extremadura: [[DebianQAExtremadura2007|wiki page of the meeting]]
 * 2006-12-13 to 2006-12-17, Badajoz (Extremadura): [[https://meetings-archive.debian.net/pub/debian-meetings/2006/qa-meeting-badajoz/|Videos]], [[DebianQAExtremadura2006|wiki page of the meeting]]
 * 2005-09-09 to 2005-09-11, Darmstadt: [[https://meetings-archive.debian.net/pub/debian-meetings/2005/qa-meeting-darmstadt/|Videos and slides]], [[DebianQAExtremadura2005|wiki page of the meeting]]
Line 62: Line 106:
 * Work-Needing and Prospective Packages: [[http://wnpp.debian.net]]
 * - by tags: http://wnpp-by-tags.debian.net/
 * Work-Needing and Prospective Packages: [[https://wnpp.debian.net/]]
 * - by tags: https://wnpp-by-tags.debian.net/
Line 67: Line 111:
 * [[https://abi-laboratory.pro/?view=upstream-tracker|Upstream C/C++/Java ABI tracking]]
Line 70: Line 115:
 * [[http://www.gentoo.org/proj/en/qa/|Gentoo]]
 * [[http://en.opensuse.org/openSUSE:Build_Service_Concept_QA|openSUSE]] ([[https://en.opensuse.org/openSUSE:OpenQA|OpenQA]])
 * [[http://wiki.maemo.org/OpenSuse_Build_Service/Application_QA_Process|Maemo]]
 * [[http://community.linuxmint.com/iso|Linux Mint]]
   * [[https://fedoraproject.org/wiki/QA/Test_Days|manual test days]]
 * [[https://
wiki.gentoo.org/wiki/Project:Quality_Assurance|Gentoo]]
 * [[https://en.opensuse.org/openSUSE:Build_Service_Concept_QA|openSUSE]] ([[https://en.opensuse.org/openSUSE:OpenQA|OpenQA]])
 * [[https://wiki.maemo.org/OpenSuse_Build_Service/Application_QA_Process|Maemo]]
 * [[https://community.linuxmint.com/iso|Linux Mint]]
Line 75: Line 121:
 * [[https://www.happyassassin.net/2014/10/23/being-a-sporadic-overview-of-linux-distribution-release-validation-processes/|Review of Linux distros validation]]  * [[https://web.archive.org/web/20160409080835/https://www.happyassassin.net/2014/10/23/being-a-sporadic-overview-of-linux-distribution-release-validation-processes/|Review of Linux distros validation]]
 * QubesOS:
   * [[https://www.qubes-os.org/news/2022/05/05/automated-os-testing-on-physical-laptops/|automated testing on physical laptops]]

Wiki Page of the Debian QA Group

This is the main wiki page of the Debian Quality Assurance (QA) Team.

Missing services

Some QA related services that Debian lacks:

QA events

Other distributions