= Mirrors = == Infrastructure == * '''Website''': ''http://www.debian.org/mirrors'' * '''Unix group''': `mirroradm` * Services handled by the team: * providing `/srv/mirrors/*` on `.debian.org` hosts. * `ftp.NN.d.o` entry's points. * Maintaining the [[https://salsa.debian.org/mirror-team/masterlist/-/blob/master/Mirrors.masterlist|Mirrors masterlist]]. * Maintaining sync hierarchy, rsync credentials and mirror triggers for downstream mirrors * Maintaining/developing ``archvsync``, the software to mirror Debian archives. * Assessing the [[https://mirror-master.debian.org/status/mirror-status.html|status of the mirror network]] == Interacting with the team == * '''Read the FAQ first''': [[/FAQ|FAQ]] ''replace that link if you already have a FAQ somewhere else'' * '''Email contact''': * debian-mirrors@lists.debian.org - public mailing list * mirrors@debian.org - reach mirroradm only * '''Request tracker''': * http://bugs.debian.org/mirrors * [[https://rt.debian.org/Search/Results.html?Query=Queue%20%3D%20%27Mirror%27%20AND%20(Status%20%3D%20%27open%27%20OR%20Status%20%3D%20%27new%27%20OR%20Status%20%3D%20%27stalled%27)|Current mirrors ticket on RT]] * '''Public IRC channel''': [[irc://irc.debian.org/debian-mirrors|#debian-mirrors]] on irc.debian.org (OFTC) * Source repos: * ftpsync set of scripts used: https://ftp-master.debian.org/git/archvsync.git * Data: https://salsa.debian.org/mirror-team/masterlist/-/blob/master/Mirrors.masterlist * Pages on the webwml repo: https://salsa.debian.org/webmaster-team/webwml/-/tree/master/english/mirror == BTS tags == The mirrors team uses [[bugs.debian.org/usertags|BTS Usertags]] to categorize [[https://bugs.debian.org/mirrors|the various issues]]. The tags user is `mirrors@packages.debian.org`. The following tags are recognized: archvsync:: For bugs concerning the archvsync (ftpsync) scripts mirror-list:: Updates to the [[https://salsa.debian.org/mirror-team/masterlist/-/blob/master/Mirrors.masterlist|Mirrors masterlist]] and related issues mirror-submission:: new entries to the list. Those tagged with `moreinfo` are considered work-in-progress, the others new. mirroradm:: Debian-operated mirrors (such as ftp.debian.org) and syncproxies. In particular, this is for rsync access and push setup. httpredir:: Issues around httpredir.debian.org. misc:: everything else that didn't fix another category. == Usual roles == * Simon Paillard - (symoon) * Joerg Jaspert - (Ganneff) * Felipe Augusto van de Wiel * Raphael Geissert - (raphael) * Donald Norwood - (IRC nick cnote) * Peter Palfrader - (weasel) * Bastian Blank - (waldi) == Task description == The team is in charge of mirrors : * for the own Debian infrastructure: archive, webpages, services * for users: mirrors of the packages archive, including non debian.org hosts == Get involved == * <> Report issues you encounter while using some Debian mirror http://bugs.debian.org/mirrors * <> Process bugs from http://bugs.debian.org/mirrors * <> Convince admins of mirrors to use recommended ftpsync and setup push * <> (Graphical) statistics in time (munin, rrdtool, R) about archive size per architecture / section * <><> Implement all useful tests against mirrors as nagios plugins, see [[/Tests|Tests]] * <><> Figure out and implement [[/PushRedundancy|push redundancy]] in ftpsync * <><> YAML'ise all mirroradm config * <><> Generate Nagios config from YAML * <><> Generate ftpsync/runmirror/rsync config from YAML * <><><> Figure out generic redirector based on Geographic/Network distance and implement some Content Directory Network == More stuff == * Data from Simon not moved to the correct place yet: http://teubr.eu.org/~spaillar/debian/qamirrors/ * Useful inputs and tools: * [[DebianGeoMirror|automatic geographic mirror selection]] * a previous (not implemented) GSoC [[RedirectProposal|proposal]] * http://mirrorbrain.org/ * RFC about content delivery network: http://tools.ietf.org/html/rfc3568 * http://www.closestnode.com/ * http://en.opensuse.org/Libzypp/Failover * http://tools.ietf.org/html/rfc3568 * maybe anycast one : http://tools.ietf.org/html/rfc1546 * http://fedoraproject.org/wiki/Infrastructure/MirrorManagement * http://wiki.osuosl.org/display/Bouncer/Home * http://www.paris-traceroute.net/index.html * http://openlab.ring.gr.jp/dns_balance/ * Hook jigdo built with ftpsync: http://debian.nautile.nc/~mirror/jigdo/ * http://www.nedworks.org/~mark/presentations/hd2006/ * http://www.supersparrow.org/ss_paper/ * http://nagios.sourceforge.net/docs/3_0/macros.html * nagios specific parameters (useful to check architectures): http://nagios.sourceforge.net/docs/3_0/customobjectvars.html * http://idmaps.eecs.umich.edu/related.php * http://www.internetweathermap.com/index.php * http://www.caida.org/research/performance/measinfra/ * http://robescriva.com/2010/06/07/hello-fedora-planet/