Differences between revisions 1 and 35 (spanning 34 versions)
Revision 1 as of 2009-04-11 03:45:38
Size: 2015
Editor: ?YasuhiroAraki
Comment:
Revision 35 as of 2017-02-13 10:02:33
Size: 5773
Editor: PaulWise
Comment: CloudFront too now
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:
||<tablestyle="width: 100%;" style="border: 0px hidden">~-[[DebianWiki/EditorGuide#translation|Translation(s)]]: none-~||<style="text-align: right;border: 0px hidden"> (!) [[/Discussion|Discussion]]|| ~-[[DebianWiki/EditorGuide#translation|Translation(s)]]: none-~
Line 4: Line 4:
DebianGeoMirror is discussion wiki to manage Debian global mirror servers. DebianGeoMirror is discussion wiki to manage Debian global mirror servers by DNS.
Line 7: Line 8:
= Runnning Apt lines = = New URLs for Apt lines =
Line 9: Line 10:
 * http://cdn.debian.net/
 * geomirror
 * http://security.geo.debian.org/
There is one type of Debian Mirror archive URL with the new Debian !GeoMirror capability.

 * http://deb.debian.org/
 * --(http://httpredir.debian.org/ (formerly http://http.debian.net/) )-- '''discontinued'''
 * --(http://cdn.debian.net/ )-- '''deprecated'''
 * --(http://<country>.<arch>.mirror.debian.net/ )-- '''deprecated'''
 * --(http://<arch>-geomirror.debian.net/ )-- '''deprecated'''

== httpredir.debian.org / http.debian.net ==

It is a service based on http redirections. It is still under development. More details at the following address and the pages linked from there:
http://lists.debian.org/debian-mirrors/2012/01/msg00025.html and [[https://github.com/rgeissert/http-redirector|source code]].

Mirror administrators don't need to do anything special to receive users from the redirector.

Only APT version 0.7.21 or greater (i.e. squeeze or greater) support HTTP redirections.

http.debian.net is the old name from the testing phase, httpredir.debian.org is the current and official name.

[[https://lists.debian.org/debian-mirrors/2017/02/msg00000.html|httpredir.debian.org has been discontinued]] because of lack of maintenance and now redirects to http://deb.debian.org .

== deb.debian.org ==

This service is based on a CDN network provided by Fastly and CloudFront ([[https://debconf16.debconf.org/talks/97/|deb.debian.org Debconf16 talk]]).
Line 15: Line 37:
Contact: YasuhiroAraki ar@debian.org /!\ This service is [[https://lists.debian.org/CAG2RKXMdBLL-vSFW6dEu4P0NwT7qqor3PxVQDu-mwrM1J-6opw@mail.gmail.com|deprecated, please do not use it]]. It is currently being used as an alias for http.debian.net to allow existing sources.list entries to continue to work in light of the original service having been shut down.

You can see what is CDN at:
 * http://lists.debian.org/debian-devel/2008/02/msg00700.html
 * http://tokyodebian.alioth.debian.org/html/debianmeetingresume200708se6.html (Japanese page)

=== requests for mirror administrators ===

First of all, please set mirror directory structure.
You have to set your mirror by

curl -H "HOST: cdn.debian.net" http://YOUR.MIRROR.IP.ADDRESS/debian/

cdn.debian.net can handle IP-based Virtual Host (http://httpd.apache.org/docs/2.0/vhosts/ip-based.html ) without any modification at server-side.

If mirror server use Name-based Virtual Host (http://httpd.apache.org/docs/2.0/en/vhosts/name-based.html ), please fill "!ServerAlias cdn.debian.net".
After that, please send mail to debian-mirrors@lists.debian.org and ar@debian.org.

=== Technical information on cdn.debian.net ===

Contact: Yasuhiro Araki ar@debian.org

||fact || summary ||
||Health check|| by HTTP (1) every 10 mins. ||
||Geo Routing || GeoIP(2) for 42 countries (4) and 6 continents||
||Server list || autogenerated + http://cdncheck1.araki.net/hosts/ (password required) ||
||Source code || Available ||
||Source IP Routing || Available ||

 1. cdn.d.n checks rsync tracefile by HTTP(/debian/project/trace/#{tracefile}) for each server every three minutes. If server is down, this server is removed.
 1. Use GeoIP to check DNS server which client uses.
 1. Auto making from Mirrors.masterlist. But for Japan, hand-optimized. ( I round up volunteers for your country!)
 1. At 2009 Apr. 13.
 1. Apply at 2010, Aug, 7.
Line 19: Line 74:
At first, CDN find requester IP's location by Max-mind DB. At first, CDN find requester's IP in CIDR entry of the mirrors.

At 2nd
, CDN find requester IP's location by Max-mind DB.
Line 22: Line 79:
At 2nd, CDN checks nation/continent rsync footprint on each mirrors. At 3rd, CDN checks nation/continent rsync footprint on each mirrors.
Line 29: Line 86:
https://osdn.debian.or.jp/repos/cdn/trunk/  * https://osdn.debian.or.jp/repos/cdn/trunk/ (DNS)
 * http://github.com/armaniacs/debian-cdn-center2 (Health checker)
Line 32: Line 91:
== arch-geomirror.debian.net ==

Contact: PaulWise

<arch>-geomirror.debian.net

And slightly related is <country>.<arch>.mirror.debian.net
It is watching servers: 154 (alive: 113) at June.4 2010.
Line 41: Line 94:
== security.geo.debian.org ==
Contact: Martin Zobel-Helas <zobel@debian.org>
All of these are
 * generated from data in http://www.debian.org/mirror/submit.
 * all architectures
 * mirrored by rsync
 * routed by GeoIP or CIDR
 * HTTP health checked every 10 minutes. If a server is failed, it will be removed next DNS caching (please wait 20minutes or less).
 * same directory structure.
 * weighted DNS round-robin based on band-width related comment on
http://www.debian.org/mirror/submit.
Line 44: Line 104:
Currently we have only two "zones", EU and NA. Depending on where you
are located, you should be pointed to either security.na.debian.org or
security.eu.debian.org, which itself has a number of hosts in round
robin. If you are not located in either of those zones, you should get
"security.debian.org" as answer.
 deb http://cdn.debian.net/debian/ {unstable,stable} main contrib non-free
Line 50: Line 106:
geo.debian.org zone has it's own DNS servers running
(geo[1-3].debian.org) using powerdns package with GeoIP backend.
You can see list of servers in
 * http://cdncheck1.araki.net/status/alive (JSON)
Line 53: Line 109:
= To be merge? = = Other =
Line 55: Line 111:
== How to get server list? == There are experimental mirrorbrain-based redirectors for [[http://debian-cd.debian.net/|debian-cd]] and [[http://debian-meetings.poempelfox.de/debian-meetings/|debian-video]].
Line 57: Line 113:
Submit information about a mirror of Debian at http://www.debian.org/mirror/submit = Mailing List =
Line 59: Line 115:
 * For general questions on the debian-mirrors: <<MailTo(debian-mirrors@lists.debian.org)>>
 * [[http://lists.debian.org/debian-mirrors/|debian-mirrors Mailinglist archive]].
Line 60: Line 118:
= How to get server list data merged? =

 1. Submit information about a mirror of Debian at http://www.debian.org/mirror/submit.
 1. As a result, "Mirrors.masterlist" is generated.
 1. You can see latest data at
  * http://anonscm.debian.org/viewvc/webwml/webwml/english/mirror/Mirrors.masterlist?view=co
  * http://www.debian.org/mirror/list

Translation(s): none


DebianGeoMirror is discussion wiki to manage Debian global mirror servers by DNS.

New URLs for Apt lines

There is one type of Debian Mirror archive URL with the new Debian GeoMirror capability.

httpredir.debian.org / http.debian.net

It is a service based on http redirections. It is still under development. More details at the following address and the pages linked from there: http://lists.debian.org/debian-mirrors/2012/01/msg00025.html and source code.

Mirror administrators don't need to do anything special to receive users from the redirector.

Only APT version 0.7.21 or greater (i.e. squeeze or greater) support HTTP redirections.

http.debian.net is the old name from the testing phase, httpredir.debian.org is the current and official name.

httpredir.debian.org has been discontinued because of lack of maintenance and now redirects to http://deb.debian.org .

deb.debian.org

This service is based on a CDN network provided by Fastly and ?CloudFront (deb.debian.org Debconf16 talk).

cdn.debian.net

/!\ This service is deprecated, please do not use it. It is currently being used as an alias for http.debian.net to allow existing sources.list entries to continue to work in light of the original service having been shut down.

You can see what is CDN at:

requests for mirror administrators

First of all, please set mirror directory structure. You have to set your mirror by

curl -H "HOST: cdn.debian.net" http://YOUR.MIRROR.IP.ADDRESS/debian/

cdn.debian.net can handle IP-based Virtual Host (http://httpd.apache.org/docs/2.0/vhosts/ip-based.html ) without any modification at server-side.

If mirror server use Name-based Virtual Host (http://httpd.apache.org/docs/2.0/en/vhosts/name-based.html ), please fill "ServerAlias cdn.debian.net". After that, please send mail to debian-mirrors@lists.debian.org and ar@debian.org.

Technical information on cdn.debian.net

Contact: Yasuhiro Araki ar@debian.org

fact

summary

Health check

by HTTP (1) every 10 mins.

Geo Routing

GeoIP(2) for 42 countries (4) and 6 continents

Server list

autogenerated + http://cdncheck1.araki.net/hosts/ (password required)

Source code

Available

Source IP Routing

Available

  1. cdn.d.n checks rsync tracefile by HTTP(/debian/project/trace/#{tracefile}) for each server every three minutes. If server is down, this server is removed.
  2. Use GeoIP to check DNS server which client uses.
  3. Auto making from Mirrors.masterlist. But for Japan, hand-optimized. ( I round up volunteers for your country!)
  4. At 2009 Apr. 13.
  5. Apply at 2010, Aug, 7.

Technology and Codes:

At first, CDN find requester's IP in CIDR entry of the mirrors.

At 2nd, CDN find requester IP's location by Max-mind DB. Max-mind DB is same DB file for geoip-bin.deb package.

At 3rd, CDN checks nation/continent rsync footprint on each mirrors. In order to avoid dead/old/partial mirror.

At last, CDN return nation/continent IP address by DNS-balance (http://openlab.jp/dns_balance/dns_balance.html)

Do you want source? All codes are available in SVN at

Now these codes are maintained by three of DD in Japan.

It is watching servers: 154 (alive: 113) at June.4 2010.

All of these are

  • generated from data in http://www.debian.org/mirror/submit.

  • all architectures
  • mirrored by rsync
  • routed by GeoIP or CIDR
  • HTTP health checked every 10 minutes. If a server is failed, it will be removed next DNS caching (please wait 20minutes or less).
  • same directory structure.
  • weighted DNS round-robin based on band-width related comment on

http://www.debian.org/mirror/submit.

You can see list of servers in

Other

There are experimental mirrorbrain-based redirectors for debian-cd and debian-video.

Mailing List

How to get server list data merged?

  1. Submit information about a mirror of Debian at http://www.debian.org/mirror/submit.

  2. As a result, "Mirrors.masterlist" is generated.
  3. You can see latest data at