Differences between revisions 34 and 114 (spanning 80 versions)
Revision 34 as of 2011-09-26 18:23:15
Size: 2780
Editor: DidierRaboud
Comment: Add link to ArchiveTeting
Revision 114 as of 2022-05-07 03:35:02
Size: 11576
Editor: PaulWise
Comment: link additions and updates
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
<<TableOfContents>>
Line 4: Line 6:
 * '''Website''': http://qa.debian.org/
 * '''Mailing Lists''': http://lists.debian.org/debian-qa/
 * '''Website''': https://qa.debian.org/
 * '''Mailing Lists''': https://lists.debian.org/debian-qa/
Line 9: Line 11:
== News from the QA Team ==

The QA team needs to communicate regularly about its activities. The next report is always in preparation in [[/Reports/Draft]].
You can find the older reports in [[/Reports]].
Line 16: Line 13:
 * [[https://www.debian.org/doc/manuals/developers-reference/pkgs.en.html#nmus-vs-qa-uploads|Howto do qa uploads]]
Line 17: Line 15:
 * Package Tracking System: [[qa.debian.org/pts]]
 * [[http://qa.debian.org/developer.php|DDPO]] (Debian Developer's Package Overview)
 * Code repository: [[https://salsa.debian.org/qa/qa]]
 * Debian Package Tracker: [[qa.debian.org/distro-tracker]] ([[https://tracker.debian.org/|website]])
 * Package Tracking System: [[qa.debian.org/pts]] ([[https://packages.qa.debian.org/|website]])
 * Package Popularity Contest: [[https://qa.debian.org/popcon.php]]
 * Package Popularity Graphs: [[https://qa.debian.org/popcon-graph.php]] (shows more results)
 * Package Removals: [[qa.debian.org/removals]]
Line 20: Line 22:
 * Removals: [[qa.debian.org/removals]]
Line 22: Line 23:
 * [[https://qa.debian.org/developer.php|DDPO]] (Debian Developer's Package Overview)
 * [[https://udd.debian.org/dmd.cgi|DMD]] (Debian Maintainer Dashboard)
Line 25: Line 28:
 * [[http://qa.debian.org/debcheck.php|Debcheck]] (missing Depends, PreDepends, Recommends, Suggests, etc.)
 * [[http://edos.debian.net/|EDOS tools]] (archive wide tests by EDOS, e.g.: non-installable packages, Debian weather, missing conflicts, ...)
 * [[https://qa.debian.org/debcheck.php|Debcheck]] (missing Depends, PreDepends, Recommends, Suggests, etc.)
 * [[http://debian.semistable.com/debgraph.out.html|debgraph]] (cyclic dependencies)
 * [[https://qa.debian.org/dose|Dose Tools]] (archive wide tests, e.g.: non-installable packages, Debian weather, missing conflicts, ... Formerly known as EDOS) ([[https://d-i.debian.org/dose/|debian-installer dose checks]])
Line 28: Line 32:
 * [[http://ddportfolio.debian.net/]] (Debian Developer Portfolio Service, inspired by [[DDPortfolio]])  * [[https://portfolio.debian.net/]] (Portfolio Service, inspired by [[DDPortfolio]])
Line 30: Line 34:
 * [[https://bugs.debian.org/release-critical/|RC bugs]] (release critical bug reports)
 * [[/usertagging|QA/RC usertags]] (QA/RC bugs usertagging)
 * [[DebianPackage:how-can-i-help]]: (find bugs to work on)
 * [[https://lintian.debian.org/|lintian]] (package static analysis)
   * [[https://salsa.debian.org/jelmer/lintian-brush|lintian-brush]] (package auto-fixing tool)
   * [[https://janitor.debian.net/|Debian Janitor]]'s [[https://janitor.debian.net/lintian-fixes/|lintian-fixes]] (package VCS auto-fixing service)
 * [[https://metacpan.org/release/App-Cme|Config::Model editor]]: can update debian/ directory files, to fix issues etc
 * [[https://salsa.debian.org/science-team/routine-update|routine-update]]: perform common packaging cleanups
 * [[https://qa.debian.org/daca/|DACA]] (code static analysis, LoC counting etc)
 * [[https://alioth-archive.debian.org/git/pkg-debile/|Debile]] (DACA, but slightly less professional, and can do slightly more in a more stupid way.
  * [[https://github.com/fedora-static-analysis/firehose|Firehose]] (Store static testing data in XML, used by Debile)
  * [[https://www.oasis-open.org/standards#sarifv2.1-os|SARIF]]: (OASIS Standard: Static Analysis Results Interchange Format, obsoletes Firehose)
 * [[https://cppcheck.sourceforge.io/devinfo/daca2-report/daca2.html|DACA2]] (cppcheck results) ([[http://cppcheck1.osuosl.org:8000/|newer report]])
 * [[https://phd-sid.ethz.ch/debian/report/|tarzeau's static analysis report]] (cmetrics codespell cppcheck cqmetrics flawfinder graudit shellcheck splint)
 * [[https://qa.debian.org/bls/|bls]] (checks buildd logs for unstable for irregularities and warnings)
 * [[https://clang.debian.net/|clang]] (rebuilding the archive using the clang compiler)
 * [[https://reproducible.debian.net|reproducible.d.n]] ([[ReproducibleBuilds|reproducibly building]] the archive)
 * [[https://crossqa.debian.net/|crossqa.d.n]] (rebuilding the archive using the cross compilers)
 * [[https://ditto.debian.net/|ditto]] ([[https://wiki.debian.org/Teams/DebianCd/ditto|TODO list]]): tool in development for registration of manual procedures/testing results
 * [[https://wiki.debian.org/Teams/DebianCD/ReleaseTesting|CD release testing]] (manual testing of CD image releases)
 * [[https://wiki.debian.org/U-boot/Status|u-boot status]]: (manual testing of u-boot releases on various boards)
 * [[https://wiki.debian.org/SecureBoot/Testing|Secure Boot testing]] (manual testing of Secure Boot)
 * [[https://wiki.debian.org/LTS/TestSuites|LTS testing]] (manual/automatic testing that LTS updates don't break packages)
 * Other manual testing: [[Diaspora/testing|diaspora]] [[EmacspeakTestingGuide|emacspeak]] [[Teams/DebianSambaGroup/Testing|samba]] [[DebianEdu/Contribute/Testing|DebianEdu]] [[DebianIndia/Testing|Indian support]] [[Debian_GNU/kFreeBSD/Testing|kFreeBSD]] [[GuruPlugTesting|GuruPlug]]
 * [[DebianMan:dh_auto_test]] (runs upstream test suites during build)
 * [[https://piuparts.debian.org/|piuparts]] (package installation, upgrading and removal testing suite)
 * [[DebianPackage:adequate|adequate]] (checking installed systems for issues)
 * [[https://jenkins.debian.net/|Jenkins]] (continuous integration) - also see [[Services/jenkins.debian.net]]
 * [[https://ci.debian.net/|debci]] (continuous integration)
   * [[DebianPackage:autopkgtest|autopkgtest]] [[https://wiki.ubuntu.com/AutomatedTesting|docs]] wiki pages: [[debci]] ContinuousIntegration
 * [[https://openqa.debian.net/|openQA]] (continuous integration)
 * [[Teams/SalsaCI|SalsaCI]] (runs [[https://docs.gitlab.com/ee/ci/|GitLab CI]] in each repo)
 * [[https://lava.debian.net/|LAVA]] [[LAVA|docs]] (automated hardware and whole-system testing)
 * [[https://www.irif.fr/~treinen/colis/|Colis]] (formal verification of maintainer scripts)
 * [[https://github.com/lvc/pkg-abidiff|pkg-abidiff]] and [[DebianMan:abipkgdiff]] (from DebianPackage:abigail-tools) (compare ABIs between package versions)
 * [[https://qa.debian.org/watch/|watch files]] (watch file checker)
 * [[http://duck.debian.net/|DUCK]] (the Debian Url ChecKer)
 * [[https://repology.org/repository/debian_unstable/problems|Repology problems]] (another URL checker)
 * [[DebianPackage:ratt|rebuild-all-the-things]] (check reverse build depends still work)
 * [[DebianPackage:check-all-the-things|check-all-the-things]] (check packages and upstream code using various tools)
 * [[https://qa.debian.org/cgi-bin/vcswatch|vcswatch]] (version control system checker)
 * [[https://dedup.debian.net/|dedup]] (Debian duplication detector)
 * [[MultiArch/Hints|multiarch hints]] (hints for correcting multi-arch data)
   * [[https://janitor.debian.net/|Debian Janitor]]'s [[https://janitor.debian.net/multiarch-fixes/|multiarch-fixes]] (package VCS auto-fixing service)
 * [[https://github.com/silviocesare/Clonewise|Clonewise]] (checks for embedded code copies, service not yet setup)
 * [[https://security-tracker.debian.org/tracker/|security tracker]] (tracks CVE issues)
 * [[https://pkg-fonts.alioth.debian.org/review/|Debian font review]] (font metadata extraction and static analysis)
 * [[Derivatives/Census|Debian derivatives census]] ([[Derivatives/CensusQA|QA]] and [[Derivatives/Integration|info gathering]] on Debian derivatives)
Line 31: Line 83:
== QA Meetings == <<Anchor(wishlist)>>
== Missing services ==
Line 33: Line 86:
 * 2005/09/09-11, Darmstadt: [[http://meetings-archive.debian.net/pub/debian-meetings/2005/qa-meeting-darmstadt/|Videos and slides]], [[http://wiki.ftbfs.de/ftbfs/DebianQaMeeting|wiki page of the meeting (does not work since 2007-01-24)]]
 * 2006/12/13-17, Badajoz (Extremadura): [[http://meetings-archive.debian.net/pub/debian-meetings/2006/qa-meeting-badajoz/|Videos]], [[DebianQAExtremadura2006|wiki page of the meeting]]
 * 2007/11/28-12/02, Extremadura: [[DebianQAExtremadura2007|wiki page of the meeting]]
 * 2008/11/26-30, Extremadura: [[DebianQAExtremadura2008|wiki page of the meeting]]
 * --(Upcoming: February 2011, Paris: [[DebianQAParis2011|wiki page of the meeting]])-- (cancelled)
Some QA related services that Debian lacks:

 * Library API/ABI tracking (using [[https://github.com/lvc/pkg-abidiff|pkg-abidiff]] or DebianMan:abipkgdiff from DebianPkg:abigail-tools)
 * Continuous testing for unused build-depends (cf DebianBug:890195)

== QA events ==

 * DebConf18: [[https://debconf18.debconf.org/talks/31-learn-how-to-triage-bugs/|31]] [[https://debconf18.debconf.org/talks/90-mining-debian-maintainer-scripts/|90]] [[https://debconf18.debconf.org/talks/149-lets-start-salvaging-packages/|149]] [[https://debconf18.debconf.org/talks/87-debian-ciautopkgtest-bof/|87]] [[https://debconf18.debconf.org/talks/171-cross-building-debian-packages-and-rebootstrap/|171]] [[https://debconf18.debconf.org/talks/95-rethinking-of-debianwatch-rule/|95]]
 * DebConf17: [[https://debconf17.debconf.org/talks/2/|2]] [[https://debconf17.debconf.org/talks/35/|35]] [[https://debconf17.debconf.org/talks/14/|14]] [[https://debconf17.debconf.org/talks/103/|103]] [[https://debconf17.debconf.org/talks/88/|88]] [[https://debconf17.debconf.org/talks/91/|91]] [[https://debconf17.debconf.org/talks/34/|34]] [[https://debconf17.debconf.org/talks/69/|69]] [[https://debconf17.debconf.org/talks/120/|120]] [[https://debconf17.debconf.org/talks/31/|31]]
 * DebConf16: [[https://debconf16.debconf.org/talks/65/|65]] [[https://debconf16.debconf.org/talks/24/|24]] [[https://debconf16.debconf.org/talks/10/|10]] [[https://debconf16.debconf.org/talks/19/|19]] [[https://debconf16.debconf.org/talks/66/|66]] [[https://debconf16.debconf.org/talks/100/|100]] [[https://debconf16.debconf.org/talks/17/|17]] [[https://debconf16.debconf.org/talks/135/|135]] [[https://debconf16.debconf.org/talks/7/|7]] [[https://debconf16.debconf.org/talks/63/|63]] [[https://debconf16.debconf.org/talks/55/|55]]
 * DebConf15: [[https://summit.debconf.org/debconf15/meeting/272/maintaining-8000-packages-large-scale-package-qa-in-the-postgresql-ecosystem/|272]] [[https://summit.debconf.org/debconf15/meeting/377/quality-assurance-bof/|377]] [[https://summit.debconf.org/debconf15/meeting/271/contributing-to-distro-tracker/|271]] [[https://summit.debconf.org/debconf15/meeting/282/check-all-the-things/|282]]
 * DebConf14: [[https://summit.debconf.org/debconf14/track/debian-qa/|debian-qa track]]
 * --(2011-02-??, Paris: [[DebianQAParis2011|wiki page of the meeting]])-- (cancelled)
 * 2008-11-26 to 2008-11-30, Extremadura: [[DebianQAExtremadura2008|wiki page of the meeting]]
 * 2007-11-28 to 2007-12-02, Extremadura: [[DebianQAExtremadura2007|wiki page of the meeting]]
 * 2006-12-13 to 2006-12-17, Badajoz (Extremadura): [[https://meetings-archive.debian.net/pub/debian-meetings/2006/qa-meeting-badajoz/|Videos]], [[DebianQAExtremadura2006|wiki page of the meeting]]
 * 2005-09-09 to 2005-09-11, Darmstadt: [[https://meetings-archive.debian.net/pub/debian-meetings/2005/qa-meeting-darmstadt/|Videos and slides]], [[DebianQAExtremadura2005|wiki page of the meeting]]
Line 41: Line 106:
 * [[http://wnpp.debian.net]]  * Work-Needing and Prospective Packages: [[https://wnpp.debian.net/]]
 * - by tags: https://wnpp-by-tags.debian.net/
Line 45: Line 111:
 * [[https://abi-laboratory.pro/?view=upstream-tracker|Upstream C/C++/Java ABI tracking]]
Line 48: Line 115:
 * [[http://www.gentoo.org/proj/en/qa/|Gentoo]]
 * [[http://en.opensuse.org/openSUSE:Build_Service_Concept_QA|openSUSE]]
 * [[http://wiki.maemo.org/OpenSuse_Build_Service/Application_QA_Process|Maemo]]
 * [[http://community.linuxmint.com/iso|Linux Mint]]
   * [[https://fedoraproject.org/wiki/QA/Test_Days|manual test days]]
 * [[https://
wiki.gentoo.org/wiki/Project:Quality_Assurance|Gentoo]]
 * [[https://en.opensuse.org/openSUSE:Build_Service_Concept_QA|openSUSE]] ([[https://en.opensuse.org/openSUSE:OpenQA|OpenQA]])
 * [[https://wiki.maemo.org/OpenSuse_Build_Service/Application_QA_Process|Maemo]]
 * [[https://community.linuxmint.com/iso|Linux Mint]]
Line 53: Line 121:
 * [[https://web.archive.org/web/20160409080835/https://www.happyassassin.net/2014/10/23/being-a-sporadic-overview-of-linux-distribution-release-validation-processes/|Review of Linux distros validation]]
 * QubesOS:
   * [[https://www.qubes-os.org/news/2022/05/05/automated-os-testing-on-physical-laptops/|automated testing on physical laptops]]

Wiki Page of the Debian QA Group

This is the main wiki page of the Debian Quality Assurance (QA) Team.

Missing services

Some QA related services that Debian lacks:

QA events

Other distributions