Differences between revisions 98 and 99
Revision 98 as of 2021-03-25 01:37:44
Size: 7071
Editor: PaulWise
Comment: linkify the form
Revision 99 as of 2021-03-25 01:39:44
Size: 6737
Editor: PaulWise
Comment: drop secton about obsolete spam flagging script
Deletions are marked like this. Additions are marked like this.
Line 47: Line 47:
=== discontinued script based effort to flag spam. ===

Description: [[ListMaster/ListArchiveSpam/newspamclassify.py]]

If you have used this one to flag spam, then your work isn't lost. Please send it in, your reports can be converted into the new internal format, so the new method knows which posts have been rated by you.

Spam in the Debian List Archive

Problem

The Debian mailing lists block a lot of spam, but occasionally small numbers of messages get through and so the Debian list archives contain some spam email messages.

Solution

Mailing list subscribers and visitors to the web archive nominate messages that they consider to be spam. Then Debian members review the nominated messages and classify them according to the policy. Then the mailing list archives remove the messages from indexes and prevent access to the messages themselves.

Nominating a message as spam

There are several options for nominating messages as spam:

Spam removal policy

Policy corner stones

  • Messages that are (beyond doubt) spam should be removed from the web archives. They should remain in the mailbox archives (and thus be accessible to developers on master.d.o).
  • Spam removals should be very conservative, with any doubt meaning no removal. For systematic removal, candidates need to be checked multiple times in order to minimize the risk of unmerited removal.
  • The information which messages have been flagged junk and how that came to be (review logs) should be accessible along with the mailbox archives, so any developer can inspect the changes to the archive and complain to listmaster about removals. This information is currently in https://lists.debian.org/archive-spam-removals/spam-removals/ .

  • On the technical side, when removing messages from the list archives URIs of messages must not change. To this end, lists.debian.org uses a version of the mhonarc mailbox converter that has been enhanced to allow skipping spam.

Ad hoc policy

Review standards should be set after seeing how things pan out.

For the start we accept three undisputed reviewers-ratings. If one reviewer has a different rating, there has to be a stronger majority. As formula:

  • it is Spam if $num{spam} > (3+2*$num{ham}+2*$num{inappropriate})

same applies for Ham and Inappropriate.

I hope this would minimize the risk of unwarranted removal. A rigorous standard seems to be necessary to obtain consensus with the project. As such, the three reviewers is only a guideline, not a rule. Of course, more reviewers doing shorter reviews would help tremendously. Ultimately, guaranteeing the integrety of the list archives currently falls in the realm of the Debian listmaster. If the numbers above don't work out, the levels can be changed easily without a hassle, previous blocked content will become available again.

Practical matters

Spam nomination review

  • Only tag as spam what really is absolutely surely spam. For example some people take offense to some comments on the lists, but that is not spam.
  • Inappropriate is the (misguided) term presently used for misguided ((un)subscribe to list, test messages, replies to Spam messages, vac messages, spam backscatter, probably NOT votes sent to debian-devel instead of devotee) messages, is is not entirely clear what to do with those, but please tag them accordingly.
  • Multiple people need to classify messages and if three more people flag a message as (Spam|Ham|Inappropriate), we can act accordingly. Note that this will be made public (at least to DDs) for verification of removals later.
  • There are four states spam, non-spam, inappropriate, unsure to use.

  • The Webinterface can be found at https://lists.debian.org/archive-spam-removals/review/. To proceed from that page you need to authorize. For now you need to be a DD, and you need to contact me for a login, Maybe the Authorisation will be later through LDAP.

  • Don't be overwhelmed by the number of articles that are nominated to review. The webinterface shows you 10 randomly chosen of it. And you should never see a rated post again.

Any suggestions on the above and/or the program are of course welcome.

Suggested Improvements and Todos

  • Because of the many false positives in the Nominations we need to make sure that
    • Webbots don't press the Spam-Button
      • this needs an analysis of the spam-button-presses.
    • Known good mails (at least the ones tagged 'Not Spam' in the Reviewer Process) should be flagged in the archive so they can not be nominated again.
  • Reworking the 'Report as Spam'-Button, so Nomination Status may be seen.
  • Analyze Logfiles to identify bots pressing the 'Report as Spam'-Button.
  • Check if some Meta-Tags are helpful to steer bots to the right pages.

People doing this

Your help is appreciated.

Debian members need a working @debian.org-address and can start here: https://lists.debian.org/archive-spam-removals/review/.

Everyone else can help us by nominating spam email messages.

Some coordinated efforts for specific lists are currently being run:


CategoryTeams | CategoryPermalink | CategoryListArchiveSpam