Statistics of source URLS

Greedy with how many packages each hoster has in Debian, I hacked this little script to find out:

the hackish shell scripts

 curl http://qa.debian.org/cgi-bin/udd-dehs?pkg= > paketliste
 grep upstream-url paketliste > upstream-url
 cat upstream-url |sed -e "s;.*http://;;" -e "s;.*ftp://;;" -e "s;.*https://;;"  |grep -v upstream-url |sed -e "s;/.*;;"  |sort > urls_alle
 for i in ` cat urls` ; do echo -n "$i " ; grep $i urls_alle |wc -l ; done  > urls_count.csv

The solution doesn't dereference i.e. all the sourceforge aliases

the results

(Please note that some projects consist of many packages, judge yourself.)

Heres the top-list: (and the winner is: cpan.(hands down..) )

downloads.xiph.org

10

invisible-island.net

10

repo1.maven.org

10

rostlab.org

10

ftp.gnustep.org

11

gforge.inria.fr

11

gstreamer.freedesktop.org

11

ftp.ggzgamingzone.org

12

java.freehep.org

12

linux.thai.net

12

release.cipux.org

12

sunsite.unc.edu

12

www.coin-or.org

12

code.google.com

13

download.tuxfamily.org

13

ftp.novell.com

13

icculus.org

13

mirrors.kernel.org

13

pecl.php.net

13

repository.maemo.org

13

space.mit.edu

13

fcitx.googlecode.com

14

ftp.horde.org

14

prdownloads.sourceforge.net

15

www.enthought.com

15

gcc.gnu.org

16

archive.apache.org

17

0pointer.de

18

anonsvn.jboss.org

18

cheeseshop.python.org

18

pgfoundry.org

18

www.kernel.org

18

download.savannah.nongnu.org

19

ftp.kde.org

19

telepathy.freedesktop.org

19

java.net

21

ftp.debian.org

22

ftp.drupal.org

22

samba.org

22

ibiblio.org

24

iij.dl.sourceforge.jp

24

kokkinizita.linuxaudio.org

25

mgltools.scripps.edu

25

files.b9.com

26

forge.ocamlcore.org

29

fedorahosted.org

31

svn.codehaus.org

40

bitbucket.org

41

download.sugarlabs.org

41

kernel.org

41

sourceforge.jp

42

ftp.mozilla.org

44

download.berlios.de

46

registry.npmjs.org

47

savannah.nongnu.org

47

gpe.linuxtogo.org

50

download.savannah.gnu.org

55

savannah.gnu.org

57

download.pear.php.net

60

download.gnome.org

62

downloads.sourceforge.net

65

archive.xfce.org

67

download.gna.org

68

www.apache.org

73

svn.apache.org

85

www.cpan.org

90

launchpad.net

119

rubyforge.org

127

github.com

129

xorg.freedesktop.org

129

sourceforge.net

146

cran.r-project.org

152

ftp.gnu.org

164

freedesktop.org

227

pkg-ruby-extras.alioth.debian.org

233

ftp.gnome.org

242

githubredir.debian.net

260

alioth.debian.org

268

pypi.python.org

336

hackage.haskell.org

498

haskell.org

502

qa.debian.org

2265

search.cpan.org

2438

cpan.org

2536