Size: 5361
Comment:
|
Size: 11576
Comment: link additions and updates
|
Deletions are marked like this. | Additions are marked like this. |
Line 1: | Line 1: |
<<TableOfContents>> |
|
Line 11: | Line 13: |
* [[https://www.debian.org/doc/manuals/developers-reference/pkgs.en.html#nmus-vs-qa-uploads|Howto do qa uploads]] | |
Line 12: | Line 15: |
* Package Tracking System: [[qa.debian.org/pts]] | * Code repository: [[https://salsa.debian.org/qa/qa]] * Debian Package Tracker: [[qa.debian.org/distro-tracker]] ([[https://tracker.debian.org/|website]]) * Package Tracking System: [[qa.debian.org/pts]] ([[https://packages.qa.debian.org/|website]]) |
Line 25: | Line 30: |
* [[https://qa.debian.org/dose|Dose Tools]] (archive wide tests, e.g.: non-installable packages, Debian weather, missing conflicts, ... Formerly known as EDOS) | * [[https://qa.debian.org/dose|Dose Tools]] (archive wide tests, e.g.: non-installable packages, Debian weather, missing conflicts, ... Formerly known as EDOS) ([[https://d-i.debian.org/dose/|debian-installer dose checks]]) |
Line 27: | Line 32: |
* [[http://portfolio.debian.net/]] (Portfolio Service, inspired by [[DDPortfolio]]) | * [[https://portfolio.debian.net/]] (Portfolio Service, inspired by [[DDPortfolio]]) |
Line 29: | Line 34: |
* [[qa.debian.org/RC-usertagging]] (RC bugs usertagging) | * [[https://bugs.debian.org/release-critical/|RC bugs]] (release critical bug reports) * [[/usertagging|QA/RC usertags]] (QA/RC bugs usertagging) * [[DebianPackage:how-can-i-help]]: (find bugs to work on) |
Line 31: | Line 38: |
* [[https://salsa.debian.org/jelmer/lintian-brush|lintian-brush]] (package auto-fixing tool) * [[https://janitor.debian.net/|Debian Janitor]]'s [[https://janitor.debian.net/lintian-fixes/|lintian-fixes]] (package VCS auto-fixing service) * [[https://metacpan.org/release/App-Cme|Config::Model editor]]: can update debian/ directory files, to fix issues etc * [[https://salsa.debian.org/science-team/routine-update|routine-update]]: perform common packaging cleanups |
|
Line 32: | Line 43: |
* [[http://git.debian.org/?p=pkg-debile/debile.git|Debile]] (DACA, but slightly less professional, and can do slightly more in a more stupid way. * [[https://github.com/fedora-static-analysis/firehose|Firehose]] (Store static testing data in XML, used by Debile) |
* [[https://alioth-archive.debian.org/git/pkg-debile/|Debile]] (DACA, but slightly less professional, and can do slightly more in a more stupid way. * [[https://github.com/fedora-static-analysis/firehose|Firehose]] (Store static testing data in XML, used by Debile) * [[https://www.oasis-open.org/standards#sarifv2.1-os|SARIF]]: (OASIS Standard: Static Analysis Results Interchange Format, obsoletes Firehose) * [[https://cppcheck.sourceforge.io/devinfo/daca2-report/daca2.html|DACA2]] (cppcheck results) ([[http://cppcheck1.osuosl.org:8000/|newer report]]) * [[https://phd-sid.ethz.ch/debian/report/|tarzeau's static analysis report]] (cmetrics codespell cppcheck cqmetrics flawfinder graudit shellcheck splint) |
Line 35: | Line 49: |
* [[http://clang.debian.net|clang]] (rebuilding the archive using the clang compiler) | * [[https://clang.debian.net/|clang]] (rebuilding the archive using the clang compiler) |
Line 37: | Line 51: |
* [[https://crossqa.debian.net/|crossqa.d.n]] (rebuilding the archive using the cross compilers) * [[https://ditto.debian.net/|ditto]] ([[https://wiki.debian.org/Teams/DebianCd/ditto|TODO list]]): tool in development for registration of manual procedures/testing results * [[https://wiki.debian.org/Teams/DebianCD/ReleaseTesting|CD release testing]] (manual testing of CD image releases) * [[https://wiki.debian.org/U-boot/Status|u-boot status]]: (manual testing of u-boot releases on various boards) * [[https://wiki.debian.org/SecureBoot/Testing|Secure Boot testing]] (manual testing of Secure Boot) * [[https://wiki.debian.org/LTS/TestSuites|LTS testing]] (manual/automatic testing that LTS updates don't break packages) * Other manual testing: [[Diaspora/testing|diaspora]] [[EmacspeakTestingGuide|emacspeak]] [[Teams/DebianSambaGroup/Testing|samba]] [[DebianEdu/Contribute/Testing|DebianEdu]] [[DebianIndia/Testing|Indian support]] [[Debian_GNU/kFreeBSD/Testing|kFreeBSD]] [[GuruPlugTesting|GuruPlug]] * [[DebianMan:dh_auto_test]] (runs upstream test suites during build) |
|
Line 39: | Line 61: |
* [[http://jenkins.debian.net/|Jenkins]] (continuous integration) * [[http://ci.debian.net/|debci]] (continuous integration) * [[DebianPackage:autopkgtest|autopkgtest]] [[https://wiki.ubuntu.com/AutomatedTesting|docs]] |
* [[https://jenkins.debian.net/|Jenkins]] (continuous integration) - also see [[Services/jenkins.debian.net]] * [[https://ci.debian.net/|debci]] (continuous integration) * [[DebianPackage:autopkgtest|autopkgtest]] [[https://wiki.ubuntu.com/AutomatedTesting|docs]] wiki pages: [[debci]] ContinuousIntegration * [[https://openqa.debian.net/|openQA]] (continuous integration) * [[Teams/SalsaCI|SalsaCI]] (runs [[https://docs.gitlab.com/ee/ci/|GitLab CI]] in each repo) * [[https://lava.debian.net/|LAVA]] [[LAVA|docs]] (automated hardware and whole-system testing) * [[https://www.irif.fr/~treinen/colis/|Colis]] (formal verification of maintainer scripts) * [[https://github.com/lvc/pkg-abidiff|pkg-abidiff]] and [[DebianMan:abipkgdiff]] (from DebianPackage:abigail-tools) (compare ABIs between package versions) |
Line 44: | Line 71: |
* [[https://repology.org/repository/debian_unstable/problems|Repology problems]] (another URL checker) | |
Line 47: | Line 75: |
* [[http://dedup.debian.net/|dedup]] (Debian duplication detector) * [[http://clonewise.debian.net/|Clonewise]] (checks for embedded code copies, not yet setup) |
* [[https://dedup.debian.net/|dedup]] (Debian duplication detector) * [[MultiArch/Hints|multiarch hints]] (hints for correcting multi-arch data) * [[https://janitor.debian.net/|Debian Janitor]]'s [[https://janitor.debian.net/multiarch-fixes/|multiarch-fixes]] (package VCS auto-fixing service) * [[https://github.com/silviocesare/Clonewise|Clonewise]] (checks for embedded code copies, service not yet setup) |
Line 53: | Line 83: |
== QA Meetings == | <<Anchor(wishlist)>> == Missing services == |
Line 55: | Line 86: |
* 2005/09/09-11, Darmstadt: [[http://meetings-archive.debian.net/pub/debian-meetings/2005/qa-meeting-darmstadt/|Videos and slides]], [[http://wiki.ftbfs.de/ftbfs/DebianQaMeeting|wiki page of the meeting (does not work since 2007-01-24)]] * 2006/12/13-17, Badajoz (Extremadura): [[http://meetings-archive.debian.net/pub/debian-meetings/2006/qa-meeting-badajoz/|Videos]], [[DebianQAExtremadura2006|wiki page of the meeting]] * 2007/11/28-12/02, Extremadura: [[DebianQAExtremadura2007|wiki page of the meeting]] * 2008/11/26-30, Extremadura: [[DebianQAExtremadura2008|wiki page of the meeting]] * --(Upcoming: February 2011, Paris: [[DebianQAParis2011|wiki page of the meeting]])-- (cancelled) |
Some QA related services that Debian lacks: * Library API/ABI tracking (using [[https://github.com/lvc/pkg-abidiff|pkg-abidiff]] or DebianMan:abipkgdiff from DebianPkg:abigail-tools) * Continuous testing for unused build-depends (cf DebianBug:890195) == QA events == * DebConf18: [[https://debconf18.debconf.org/talks/31-learn-how-to-triage-bugs/|31]] [[https://debconf18.debconf.org/talks/90-mining-debian-maintainer-scripts/|90]] [[https://debconf18.debconf.org/talks/149-lets-start-salvaging-packages/|149]] [[https://debconf18.debconf.org/talks/87-debian-ciautopkgtest-bof/|87]] [[https://debconf18.debconf.org/talks/171-cross-building-debian-packages-and-rebootstrap/|171]] [[https://debconf18.debconf.org/talks/95-rethinking-of-debianwatch-rule/|95]] * DebConf17: [[https://debconf17.debconf.org/talks/2/|2]] [[https://debconf17.debconf.org/talks/35/|35]] [[https://debconf17.debconf.org/talks/14/|14]] [[https://debconf17.debconf.org/talks/103/|103]] [[https://debconf17.debconf.org/talks/88/|88]] [[https://debconf17.debconf.org/talks/91/|91]] [[https://debconf17.debconf.org/talks/34/|34]] [[https://debconf17.debconf.org/talks/69/|69]] [[https://debconf17.debconf.org/talks/120/|120]] [[https://debconf17.debconf.org/talks/31/|31]] * DebConf16: [[https://debconf16.debconf.org/talks/65/|65]] [[https://debconf16.debconf.org/talks/24/|24]] [[https://debconf16.debconf.org/talks/10/|10]] [[https://debconf16.debconf.org/talks/19/|19]] [[https://debconf16.debconf.org/talks/66/|66]] [[https://debconf16.debconf.org/talks/100/|100]] [[https://debconf16.debconf.org/talks/17/|17]] [[https://debconf16.debconf.org/talks/135/|135]] [[https://debconf16.debconf.org/talks/7/|7]] [[https://debconf16.debconf.org/talks/63/|63]] [[https://debconf16.debconf.org/talks/55/|55]] * DebConf15: [[https://summit.debconf.org/debconf15/meeting/272/maintaining-8000-packages-large-scale-package-qa-in-the-postgresql-ecosystem/|272]] [[https://summit.debconf.org/debconf15/meeting/377/quality-assurance-bof/|377]] [[https://summit.debconf.org/debconf15/meeting/271/contributing-to-distro-tracker/|271]] [[https://summit.debconf.org/debconf15/meeting/282/check-all-the-things/|282]] * DebConf14: [[https://summit.debconf.org/debconf14/track/debian-qa/|debian-qa track]] * --(2011-02-??, Paris: [[DebianQAParis2011|wiki page of the meeting]])-- (cancelled) * 2008-11-26 to 2008-11-30, Extremadura: [[DebianQAExtremadura2008|wiki page of the meeting]] * 2007-11-28 to 2007-12-02, Extremadura: [[DebianQAExtremadura2007|wiki page of the meeting]] * 2006-12-13 to 2006-12-17, Badajoz (Extremadura): [[https://meetings-archive.debian.net/pub/debian-meetings/2006/qa-meeting-badajoz/|Videos]], [[DebianQAExtremadura2006|wiki page of the meeting]] * 2005-09-09 to 2005-09-11, Darmstadt: [[https://meetings-archive.debian.net/pub/debian-meetings/2005/qa-meeting-darmstadt/|Videos and slides]], [[DebianQAExtremadura2005|wiki page of the meeting]] |
Line 63: | Line 106: |
* Work-Needing and Prospective Packages: [[http://wnpp.debian.net]] * - by tags: http://wnpp-by-tags.debian.net/ |
* Work-Needing and Prospective Packages: [[https://wnpp.debian.net/]] * - by tags: https://wnpp-by-tags.debian.net/ |
Line 68: | Line 111: |
* [[https://abi-laboratory.pro/?view=upstream-tracker|Upstream C/C++/Java ABI tracking]] | |
Line 71: | Line 115: |
* [[http://www.gentoo.org/proj/en/qa/|Gentoo]] * [[http://en.opensuse.org/openSUSE:Build_Service_Concept_QA|openSUSE]] ([[https://en.opensuse.org/openSUSE:OpenQA|OpenQA]]) * [[http://wiki.maemo.org/OpenSuse_Build_Service/Application_QA_Process|Maemo]] * [[http://community.linuxmint.com/iso|Linux Mint]] |
* [[https://fedoraproject.org/wiki/QA/Test_Days|manual test days]] * [[https://wiki.gentoo.org/wiki/Project:Quality_Assurance|Gentoo]] * [[https://en.opensuse.org/openSUSE:Build_Service_Concept_QA|openSUSE]] ([[https://en.opensuse.org/openSUSE:OpenQA|OpenQA]]) * [[https://wiki.maemo.org/OpenSuse_Build_Service/Application_QA_Process|Maemo]] * [[https://community.linuxmint.com/iso|Linux Mint]] |
Line 76: | Line 121: |
* [[https://www.happyassassin.net/2014/10/23/being-a-sporadic-overview-of-linux-distribution-release-validation-processes/|Review of Linux distros validation]] | * [[https://web.archive.org/web/20160409080835/https://www.happyassassin.net/2014/10/23/being-a-sporadic-overview-of-linux-distribution-release-validation-processes/|Review of Linux distros validation]] * QubesOS: * [[https://www.qubes-os.org/news/2022/05/05/automated-os-testing-on-physical-laptops/|automated testing on physical laptops]] |
Contents
Wiki Page of the Debian QA Group
This is the main wiki page of the Debian Quality Assurance (QA) Team.
Website: https://qa.debian.org/
Mailing Lists: https://lists.debian.org/debian-qa/
Public IRC channel: #debian-qa
Some QA related links
Bugs: qa.debian.org/bugs
Code repository: https://salsa.debian.org/qa/qa
Debian Package Tracker: qa.debian.org/distro-tracker (website)
Package Tracking System: qa.debian.org/pts (website)
Package Popularity Contest: https://qa.debian.org/popcon.php
Package Popularity Graphs: https://qa.debian.org/popcon-graph.php (shows more results)
Package Removals: qa.debian.org/removals
Full archive rebuilds coordination: ?qa.debian.org/ArchiveTesting
Current activities: qa.debian.org/activities
DDPO (Debian Developer's Package Overview)
DMD (Debian Maintainer Dashboard)
"Collaborative QA" pages: qa.debian.org/collab-qa
MIA Team qa.debian.org/MIATeam
qa.debian.org/bapase (BAd PAckages SEarch)
Debcheck (missing Depends, ?PreDepends, Recommends, Suggests, etc.)
debgraph (cyclic dependencies)
Dose Tools (archive wide tests, e.g.: non-installable packages, Debian weather, missing conflicts, ... Formerly known as EDOS) (debian-installer dose checks)
https://portfolio.debian.net/ (Portfolio Service, inspired by DDPortfolio)
Teams/unknown-package (Unknown-Package Task Force)
RC bugs (release critical bug reports)
QA/RC usertags (QA/RC bugs usertagging)
how-can-i-help: (find bugs to work on)
lintian (package static analysis)
lintian-brush (package auto-fixing tool)
Debian Janitor's lintian-fixes (package VCS auto-fixing service)
Config::Model editor: can update debian/ directory files, to fix issues etc
routine-update: perform common packaging cleanups
DACA (code static analysis, LoC counting etc)
Debile (DACA, but slightly less professional, and can do slightly more in a more stupid way.
DACA2 (cppcheck results) (newer report)
tarzeau's static analysis report (cmetrics codespell cppcheck cqmetrics flawfinder graudit shellcheck splint)
bls (checks buildd logs for unstable for irregularities and warnings)
clang (rebuilding the archive using the clang compiler)
reproducible.d.n (reproducibly building the archive)
crossqa.d.n (rebuilding the archive using the cross compilers)
ditto (TODO list): tool in development for registration of manual procedures/testing results
CD release testing (manual testing of CD image releases)
u-boot status: (manual testing of u-boot releases on various boards)
Secure Boot testing (manual testing of Secure Boot)
LTS testing (manual/automatic testing that LTS updates don't break packages)
Other manual testing: diaspora emacspeak samba DebianEdu Indian support kFreeBSD GuruPlug
dh_auto_test (runs upstream test suites during build)
piuparts (package installation, upgrading and removal testing suite)
adequate (checking installed systems for issues)
Jenkins (continuous integration) - also see Services/jenkins.debian.net
debci (continuous integration)
autopkgtest docs wiki pages: debci ContinuousIntegration
openQA (continuous integration)
Colis (formal verification of maintainer scripts)
pkg-abidiff and abipkgdiff (from abigail-tools) (compare ABIs between package versions)
watch files (watch file checker)
Repology problems (another URL checker)
rebuild-all-the-things (check reverse build depends still work)
check-all-the-things (check packages and upstream code using various tools)
vcswatch (version control system checker)
dedup (Debian duplication detector)
multiarch hints (hints for correcting multi-arch data)
Debian Janitor's multiarch-fixes (package VCS auto-fixing service)
Clonewise (checks for embedded code copies, service not yet setup)
security tracker (tracks CVE issues)
Debian font review (font metadata extraction and static analysis)
Debian derivatives census (QA and info gathering on Debian derivatives)
Missing services
Some QA related services that Debian lacks:
Library API/ABI tracking (using pkg-abidiff or abipkgdiff from abigail-tools)
Continuous testing for unused build-depends (cf 890195)
QA events
2011-02-??, Paris: wiki page of the meeting (cancelled)
2008-11-26 to 2008-11-30, Extremadura: wiki page of the meeting
2007-11-28 to 2007-12-02, Extremadura: wiki page of the meeting
2006-12-13 to 2006-12-17, Badajoz (Extremadura): Videos, wiki page of the meeting
2005-09-09 to 2005-09-11, Darmstadt: Videos and slides, wiki page of the meeting
Other links
Work-Needing and Prospective Packages: https://wnpp.debian.net/
- by tags: https://wnpp-by-tags.debian.net/