Size: 4477
Comment: drop deprecated link to edos.debian.net
|
Size: 11633
Comment: adjust ditto link
|
Deletions are marked like this. | Additions are marked like this. |
Line 1: | Line 1: |
<<TableOfContents>> |
|
Line 4: | Line 6: |
* '''Website''': http://qa.debian.org/ * '''Mailing Lists''': http://lists.debian.org/debian-qa/ |
* '''Website''': https://qa.debian.org/ * '''Mailing Lists''': https://lists.debian.org/debian-qa/ |
Line 11: | Line 13: |
* [[https://www.debian.org/doc/manuals/developers-reference/pkgs.en.html#nmus-vs-qa-uploads|Howto do qa uploads]] | |
Line 12: | Line 15: |
* Package Tracking System: [[qa.debian.org/pts]] * Package Popularity Contest: [[http://qa.debian.org/popcon.php]] * Package Popularity Graphs: [[http://qa.debian.org/popcon-graph.php]] (shows more results) |
* Code repository: [[https://salsa.debian.org/qa/qa]] * Debian Package Tracker: [[qa.debian.org/distro-tracker]] ([[https://tracker.debian.org/|website]]) * Package Tracking System: [[qa.debian.org/pts]] ([[https://packages.qa.debian.org/|website]]) * Package Popularity Contest: [[https://qa.debian.org/popcon.php]] * Package Popularity Graphs: [[https://qa.debian.org/popcon-graph.php]] (shows more results) |
Line 18: | Line 23: |
* [[http://qa.debian.org/developer.php|DDPO]] (Debian Developer's Package Overview) * [[http://udd.debian.org/dmd.cgi|DMD]] (Debian Maintainer Dashboard) |
* [[https://qa.debian.org/developer.php|DDPO]] (Debian Developer's Package Overview) * [[https://udd.debian.org/dmd.cgi|DMD]] (Debian Maintainer Dashboard) |
Line 23: | Line 28: |
* [[http://qa.debian.org/debcheck.php|Debcheck]] (missing Depends, PreDepends, Recommends, Suggests, etc.) | * [[https://qa.debian.org/debcheck.php|Debcheck]] (missing Depends, PreDepends, Recommends, Suggests, etc.) |
Line 25: | Line 30: |
* [[http://qa.debian.org/dose|Dose Tools]] (archive wide tests, e.g.: non-installable packages, Debian weather, missing conflicts, ... Formerly known as EDOS) | * [[https://qa.debian.org/dose|Dose Tools]] (archive wide tests, e.g.: non-installable packages, Debian weather, missing conflicts, ... Formerly known as EDOS) ([[https://d-i.debian.org/dose/|debian-installer dose checks]]) |
Line 27: | Line 32: |
* [[http://portfolio.debian.net/]] (Portfolio Service, inspired by [[DDPortfolio]]) | * [[https://portfolio.debian.net/]] (Portfolio Service, inspired by [[DDPortfolio]]) |
Line 29: | Line 34: |
* [[qa.debian.org/RC-usertagging]] (RC bugs usertagging) * [[http://lintian.debian.org/|lintian]] (package static analysis) * [[http://qa.debian.org/daca/|DACA]] (code static analysis, LoC counting etc) * [[http://git.debian.org/?p=pkg-debile/debile.git|Debile]] (DACA, but slightly less professional, and can do slightly more in a more stupid way. * [[https://github.com/fedora-static-analysis/firehose|Firehose]] (Store static testing data in XML, used by Debile) * [[http://qa.debian.org/bls/|bls]] (checks buildd logs for unstable for irregularities and warnings) * [[http://clang.debian.net|clang]] (rebuilding the archive using the clang compiler) * [[http://piuparts.debian.org/|piuparts]] (package installation, upgrading and removal testing suite) * [[http://jenkins.debian.net/|Jenkins]] (continuous integration) * [[http://qa.debian.org/watch/|watch files]] (watch file checker) |
* [[https://bugs.debian.org/release-critical/|RC bugs]] (release critical bug reports) * [[/usertagging|QA/RC usertags]] (QA/RC bugs usertagging) * [[DebianPackage:how-can-i-help]]: (find bugs to work on) * [[https://lintian.debian.org/|lintian]] (package static analysis) * [[https://salsa.debian.org/jelmer/lintian-brush|lintian-brush]] (package auto-fixing tool) * [[https://janitor.debian.net/|Debian Janitor]]'s [[https://janitor.debian.net/lintian-fixes/|lintian-fixes]] (package VCS auto-fixing service) * [[https://metacpan.org/release/App-Cme|Config::Model editor]]: can update debian/ directory files, to fix issues etc * [[https://salsa.debian.org/science-team/routine-update|routine-update]]: perform common packaging cleanups * [[https://qa.debian.org/daca/|DACA]] (code static analysis, LoC counting etc) * [[https://alioth-archive.debian.org/git/pkg-debile/|Debile]] (DACA, but slightly less professional, and can do slightly more in a more stupid way. * [[https://github.com/fedora-static-analysis/firehose|Firehose]] (Store static testing data in XML, used by Debile) * [[https://www.oasis-open.org/standards#sarifv2.1-os|SARIF]]: (OASIS Standard: Static Analysis Results Interchange Format, obsoletes Firehose) * [[https://cppcheck.sourceforge.io/devinfo/daca2-report/daca2.html|DACA2]] (cppcheck results) ([[http://cppcheck1.osuosl.org:8000/|newer report]]) * [[https://phd-sid.ethz.ch/debian/report/|tarzeau's static analysis report]] (cmetrics codespell cppcheck cqmetrics flawfinder graudit shellcheck splint) * [[https://qa.debian.org/bls/|bls]] (checks buildd logs for unstable for irregularities and warnings) * [[https://clang.debian.net/|clang]] (rebuilding the archive using the clang compiler) * [[https://reproducible.debian.net|reproducible.d.n]] ([[ReproducibleBuilds|reproducibly building]] the archive) * [[https://crossqa.debian.net/|crossqa.d.n]] (rebuilding the archive using the cross compilers) * [[https://salsa.debian.org/images-team/ditto|ditto]] ([[https://wiki.debian.org/Teams/DebianCd/ditto|TODO list]]) ([[https://ditto.debian.net/|service]]): tool in development for registration of manual procedures/testing results * [[https://wiki.debian.org/Teams/DebianCD/ReleaseTesting|CD release testing]] (manual testing of CD image releases) * [[https://wiki.debian.org/U-boot/Status|u-boot status]]: (manual testing of u-boot releases on various boards) * [[https://wiki.debian.org/SecureBoot/Testing|Secure Boot testing]] (manual testing of Secure Boot) * [[https://wiki.debian.org/LTS/TestSuites|LTS testing]] (manual/automatic testing that LTS updates don't break packages) * Other manual testing: [[Diaspora/testing|diaspora]] [[EmacspeakTestingGuide|emacspeak]] [[Teams/DebianSambaGroup/Testing|samba]] [[DebianEdu/Contribute/Testing|DebianEdu]] [[DebianIndia/Testing|Indian support]] [[Debian_GNU/kFreeBSD/Testing|kFreeBSD]] [[GuruPlugTesting|GuruPlug]] * [[DebianMan:dh_auto_test]] (runs upstream test suites during build) * [[https://piuparts.debian.org/|piuparts]] (package installation, upgrading and removal testing suite) * [[DebianPackage:adequate|adequate]] (checking installed systems for issues) * [[https://jenkins.debian.net/|Jenkins]] (continuous integration) - also see [[Services/jenkins.debian.net]] * [[https://ci.debian.net/|debci]] (continuous integration) * [[DebianPackage:autopkgtest|autopkgtest]] [[https://wiki.ubuntu.com/AutomatedTesting|docs]] wiki pages: [[debci]] ContinuousIntegration * [[https://openqa.debian.net/|openQA]] (continuous integration) * [[Teams/SalsaCI|SalsaCI]] (runs [[https://docs.gitlab.com/ee/ci/|GitLab CI]] in each repo) * [[https://lava.debian.net/|LAVA]] [[LAVA|docs]] (automated hardware and whole-system testing) * [[https://www.irif.fr/~treinen/colis/|Colis]] (formal verification of maintainer scripts) * [[https://github.com/lvc/pkg-abidiff|pkg-abidiff]] and [[DebianMan:abipkgdiff]] (from DebianPackage:abigail-tools) (compare ABIs between package versions) * [[https://qa.debian.org/watch/|watch files]] (watch file checker) |
Line 40: | Line 71: |
* [[http://dedup.debian.net/|dedup]] (Debian duplication detector) * [[http://clonewise.debian.net/|Clonewise]] (checks for embedded code copies, not yet setup) * [[http://security-tracker.debian.org/tracker/|security tracker]] (tracks CVE issues) * [[http://pkg-fonts.alioth.debian.org/review/|Debian font review]] (font metadata extraction and static analysis) |
* [[https://repology.org/repository/debian_unstable/problems|Repology problems]] (another URL checker) * [[DebianPackage:ratt|rebuild-all-the-things]] (check reverse build depends still work) * [[DebianPackage:check-all-the-things|check-all-the-things]] (check packages and upstream code using various tools) * [[https://qa.debian.org/cgi-bin/vcswatch|vcswatch]] (version control system checker) * [[https://dedup.debian.net/|dedup]] (Debian duplication detector) * [[MultiArch/Hints|multiarch hints]] (hints for correcting multi-arch data) * [[https://janitor.debian.net/|Debian Janitor]]'s [[https://janitor.debian.net/multiarch-fixes/|multiarch-fixes]] (package VCS auto-fixing service) * [[https://github.com/silviocesare/Clonewise|Clonewise]] (checks for embedded code copies, service not yet setup) * [[https://security-tracker.debian.org/tracker/|security tracker]] (tracks CVE issues) * [[https://pkg-fonts.alioth.debian.org/review/|Debian font review]] (font metadata extraction and static analysis) |
Line 46: | Line 83: |
== QA Meetings == | <<Anchor(wishlist)>> == Missing services == |
Line 48: | Line 86: |
* 2005/09/09-11, Darmstadt: [[http://meetings-archive.debian.net/pub/debian-meetings/2005/qa-meeting-darmstadt/|Videos and slides]], [[http://wiki.ftbfs.de/ftbfs/DebianQaMeeting|wiki page of the meeting (does not work since 2007-01-24)]] * 2006/12/13-17, Badajoz (Extremadura): [[http://meetings-archive.debian.net/pub/debian-meetings/2006/qa-meeting-badajoz/|Videos]], [[DebianQAExtremadura2006|wiki page of the meeting]] * 2007/11/28-12/02, Extremadura: [[DebianQAExtremadura2007|wiki page of the meeting]] * 2008/11/26-30, Extremadura: [[DebianQAExtremadura2008|wiki page of the meeting]] * --(Upcoming: February 2011, Paris: [[DebianQAParis2011|wiki page of the meeting]])-- (cancelled) |
Some QA related services that Debian lacks: * Library API/ABI tracking (using [[https://github.com/lvc/pkg-abidiff|pkg-abidiff]] or DebianMan:abipkgdiff from DebianPkg:abigail-tools) * Continuous testing for unused build-depends (cf DebianBug:890195) == QA events == * DebConf18: [[https://debconf18.debconf.org/talks/31-learn-how-to-triage-bugs/|31]] [[https://debconf18.debconf.org/talks/90-mining-debian-maintainer-scripts/|90]] [[https://debconf18.debconf.org/talks/149-lets-start-salvaging-packages/|149]] [[https://debconf18.debconf.org/talks/87-debian-ciautopkgtest-bof/|87]] [[https://debconf18.debconf.org/talks/171-cross-building-debian-packages-and-rebootstrap/|171]] [[https://debconf18.debconf.org/talks/95-rethinking-of-debianwatch-rule/|95]] * DebConf17: [[https://debconf17.debconf.org/talks/2/|2]] [[https://debconf17.debconf.org/talks/35/|35]] [[https://debconf17.debconf.org/talks/14/|14]] [[https://debconf17.debconf.org/talks/103/|103]] [[https://debconf17.debconf.org/talks/88/|88]] [[https://debconf17.debconf.org/talks/91/|91]] [[https://debconf17.debconf.org/talks/34/|34]] [[https://debconf17.debconf.org/talks/69/|69]] [[https://debconf17.debconf.org/talks/120/|120]] [[https://debconf17.debconf.org/talks/31/|31]] * DebConf16: [[https://debconf16.debconf.org/talks/65/|65]] [[https://debconf16.debconf.org/talks/24/|24]] [[https://debconf16.debconf.org/talks/10/|10]] [[https://debconf16.debconf.org/talks/19/|19]] [[https://debconf16.debconf.org/talks/66/|66]] [[https://debconf16.debconf.org/talks/100/|100]] [[https://debconf16.debconf.org/talks/17/|17]] [[https://debconf16.debconf.org/talks/135/|135]] [[https://debconf16.debconf.org/talks/7/|7]] [[https://debconf16.debconf.org/talks/63/|63]] [[https://debconf16.debconf.org/talks/55/|55]] * DebConf15: [[https://summit.debconf.org/debconf15/meeting/272/maintaining-8000-packages-large-scale-package-qa-in-the-postgresql-ecosystem/|272]] [[https://summit.debconf.org/debconf15/meeting/377/quality-assurance-bof/|377]] [[https://summit.debconf.org/debconf15/meeting/271/contributing-to-distro-tracker/|271]] [[https://summit.debconf.org/debconf15/meeting/282/check-all-the-things/|282]] * DebConf14: [[https://summit.debconf.org/debconf14/track/debian-qa/|debian-qa track]] * --(2011-02-??, Paris: [[DebianQAParis2011|wiki page of the meeting]])-- (cancelled) * 2008-11-26 to 2008-11-30, Extremadura: [[DebianQAExtremadura2008|wiki page of the meeting]] * 2007-11-28 to 2007-12-02, Extremadura: [[DebianQAExtremadura2007|wiki page of the meeting]] * 2006-12-13 to 2006-12-17, Badajoz (Extremadura): [[https://meetings-archive.debian.net/pub/debian-meetings/2006/qa-meeting-badajoz/|Videos]], [[DebianQAExtremadura2006|wiki page of the meeting]] * 2005-09-09 to 2005-09-11, Darmstadt: [[https://meetings-archive.debian.net/pub/debian-meetings/2005/qa-meeting-darmstadt/|Videos and slides]], [[DebianQAExtremadura2005|wiki page of the meeting]] |
Line 56: | Line 106: |
* Work-Needing and Prospective Packages: [[http://wnpp.debian.net]] * - by tags: http://wnpp-by-tags.debian.net/ |
* Work-Needing and Prospective Packages: [[https://wnpp.debian.net/]] * - by tags: https://wnpp-by-tags.debian.net/ |
Line 61: | Line 111: |
* [[https://abi-laboratory.pro/?view=upstream-tracker|Upstream C/C++/Java ABI tracking]] | |
Line 64: | Line 115: |
* [[http://www.gentoo.org/proj/en/qa/|Gentoo]] * [[http://en.opensuse.org/openSUSE:Build_Service_Concept_QA|openSUSE]] * [[http://wiki.maemo.org/OpenSuse_Build_Service/Application_QA_Process|Maemo]] * [[http://community.linuxmint.com/iso|Linux Mint]] |
* [[https://fedoraproject.org/wiki/QA/Test_Days|manual test days]] * [[https://wiki.gentoo.org/wiki/Project:Quality_Assurance|Gentoo]] * [[https://en.opensuse.org/openSUSE:Build_Service_Concept_QA|openSUSE]] ([[https://en.opensuse.org/openSUSE:OpenQA|OpenQA]]) * [[https://wiki.maemo.org/OpenSuse_Build_Service/Application_QA_Process|Maemo]] * [[https://community.linuxmint.com/iso|Linux Mint]] |
Line 69: | Line 121: |
* [[https://web.archive.org/web/20160409080835/https://www.happyassassin.net/2014/10/23/being-a-sporadic-overview-of-linux-distribution-release-validation-processes/|Review of Linux distros validation]] * QubesOS: * [[https://www.qubes-os.org/news/2022/05/05/automated-os-testing-on-physical-laptops/|automated testing on physical laptops]] |
Contents
Wiki Page of the Debian QA Group
This is the main wiki page of the Debian Quality Assurance (QA) Team.
Website: https://qa.debian.org/
Mailing Lists: https://lists.debian.org/debian-qa/
Public IRC channel: #debian-qa
Some QA related links
Bugs: qa.debian.org/bugs
Code repository: https://salsa.debian.org/qa/qa
Debian Package Tracker: qa.debian.org/distro-tracker (website)
Package Tracking System: qa.debian.org/pts (website)
Package Popularity Contest: https://qa.debian.org/popcon.php
Package Popularity Graphs: https://qa.debian.org/popcon-graph.php (shows more results)
Package Removals: qa.debian.org/removals
Full archive rebuilds coordination: ?qa.debian.org/ArchiveTesting
Current activities: qa.debian.org/activities
DDPO (Debian Developer's Package Overview)
DMD (Debian Maintainer Dashboard)
"Collaborative QA" pages: qa.debian.org/collab-qa
MIA Team qa.debian.org/MIATeam
qa.debian.org/bapase (BAd PAckages SEarch)
Debcheck (missing Depends, ?PreDepends, Recommends, Suggests, etc.)
debgraph (cyclic dependencies)
Dose Tools (archive wide tests, e.g.: non-installable packages, Debian weather, missing conflicts, ... Formerly known as EDOS) (debian-installer dose checks)
https://portfolio.debian.net/ (Portfolio Service, inspired by DDPortfolio)
Teams/unknown-package (Unknown-Package Task Force)
RC bugs (release critical bug reports)
QA/RC usertags (QA/RC bugs usertagging)
how-can-i-help: (find bugs to work on)
lintian (package static analysis)
lintian-brush (package auto-fixing tool)
Debian Janitor's lintian-fixes (package VCS auto-fixing service)
Config::Model editor: can update debian/ directory files, to fix issues etc
routine-update: perform common packaging cleanups
DACA (code static analysis, LoC counting etc)
Debile (DACA, but slightly less professional, and can do slightly more in a more stupid way.
DACA2 (cppcheck results) (newer report)
tarzeau's static analysis report (cmetrics codespell cppcheck cqmetrics flawfinder graudit shellcheck splint)
bls (checks buildd logs for unstable for irregularities and warnings)
clang (rebuilding the archive using the clang compiler)
reproducible.d.n (reproducibly building the archive)
crossqa.d.n (rebuilding the archive using the cross compilers)
ditto (TODO list) (service): tool in development for registration of manual procedures/testing results
CD release testing (manual testing of CD image releases)
u-boot status: (manual testing of u-boot releases on various boards)
Secure Boot testing (manual testing of Secure Boot)
LTS testing (manual/automatic testing that LTS updates don't break packages)
Other manual testing: diaspora emacspeak samba DebianEdu Indian support kFreeBSD GuruPlug
dh_auto_test (runs upstream test suites during build)
piuparts (package installation, upgrading and removal testing suite)
adequate (checking installed systems for issues)
Jenkins (continuous integration) - also see Services/jenkins.debian.net
debci (continuous integration)
autopkgtest docs wiki pages: debci ContinuousIntegration
openQA (continuous integration)
Colis (formal verification of maintainer scripts)
pkg-abidiff and abipkgdiff (from abigail-tools) (compare ABIs between package versions)
watch files (watch file checker)
Repology problems (another URL checker)
rebuild-all-the-things (check reverse build depends still work)
check-all-the-things (check packages and upstream code using various tools)
vcswatch (version control system checker)
dedup (Debian duplication detector)
multiarch hints (hints for correcting multi-arch data)
Debian Janitor's multiarch-fixes (package VCS auto-fixing service)
Clonewise (checks for embedded code copies, service not yet setup)
security tracker (tracks CVE issues)
Debian font review (font metadata extraction and static analysis)
Debian derivatives census (QA and info gathering on Debian derivatives)
Missing services
Some QA related services that Debian lacks:
Library API/ABI tracking (using pkg-abidiff or abipkgdiff from abigail-tools)
Continuous testing for unused build-depends (cf 890195)
QA events
2011-02-??, Paris: wiki page of the meeting (cancelled)
2008-11-26 to 2008-11-30, Extremadura: wiki page of the meeting
2007-11-28 to 2007-12-02, Extremadura: wiki page of the meeting
2006-12-13 to 2006-12-17, Badajoz (Extremadura): Videos, wiki page of the meeting
2005-09-09 to 2005-09-11, Darmstadt: Videos and slides, wiki page of the meeting
Other links
Work-Needing and Prospective Packages: https://wnpp.debian.net/
- by tags: https://wnpp-by-tags.debian.net/