[pacman-mirrors] 4.12.5 Mirror ranking enhancement

pacman-mirrors

#1

Pacman-Mirrors 4.12

ATTENTION - build for Python 3.7

A small enhancement to the mirror response check has been made.

Instead of checking a sync file which is very small - the check now downloads another file which has a more reasonable size. The file which is used for the purpose is

mirror_url/branch/core/architecture/core.db.tar.gz

It has a size of 147KiB

Also the User-Agent string has been set to Pacman-Mirrors/{version} so mirror owners better can distinguish the Manjaro traffic.

August 2, 2018 1:01 PM (Europe: Paris), August 2, 2018 4:01 AM (America: Los Angeles)
This new enhancement revealed that the way of sorting the response time has been inherently bad since dawn of pacman-mirrors.

It has been sorting lexicographically - which works if they all begin with single digits - but when dual digits come into play it does not.

Fixed with 4.12.2-4

EDIT: August 5, 2018 11:41 AM (Europe: Paris), August 5, 2018 2:41 AM (America: Los Angeles)
As pointed out in the thread - some has very slow internet connections - and probing mirrors using a 1.6MiB file takes hours to complete.

So for now a compromise has been made - it will be the core.db.tar.gz file which will be used.

Changed with 4.12.2-5

August 6, 2018 10:53 AM (Europe: Paris), August 6, 2018 1:53 AM (America: Los Angeles)

Version 4.12.3-4

Added option to pacman-mirrors.conf for setting a preferred file from core repo.

The config defaults to core.db.tar.gz but can be any file present in the core repo.

August 6, 2018 5:35 PM (Europe: Paris), August 6, 2018 8:35 AM (America: Los Angeles)

Rebuild package - cosmetics (forgot a debug print line)

v4.12.4

August 6, 2018 7:12 PM (Europe: Paris), August 6, 2018 10:12 AM (America: Los Angeles)

Fix issue with console ui
Rebuild python-npyscreen for Python 3.7

v4.12.5


Pacman-mirrors -f0 too slow after last udate
Mirror servers down?
#2

Does that mean that the check will take longer time but will be more reliable?


#4

I’m getting some strange results (but not every time). Mirrors that have the highest response time are at the top of my list.

$ pacman-mirrors -v
Version 4.12.1
$ sudo pacman-mirrors -f0 -t10
.: INFO Downloading mirrors from repo.manjaro.org
.: INFO Using default mirror file
.: INFO Querying mirrors - This may take some time
   3.659 Australia      : http://manjaro.melbourneitmirror.net/
   ..... Austria        : http://mirror.inode.at/manjaro/
   2.608 Bangladesh     : http://mirror.xeonbd.com/manjaro/
   3.167 Belarus        : http://mirror.datacenter.by/pub/mirrors/manjaro/
   5.651 Belgium        : https://mirror.futureweb.be/manjaro/
   5.277 Belgium        : http://mirror.futureweb.be/manjaro/
   3.663 Brazil         : https://manjaro.c3sl.ufpr.br/
   3.061 Brazil         : http://pet.inf.ufsc.br/mirrors/manjarolinux/
   2.999 Brazil         : http://linorg.usp.br/manjaro/
   5.226 Bulgaria       : https://manjaro.ipacct.com/manjaro/
   4.302 Bulgaria       : http://manjaro.telecoms.bg/
   4.776 Canada         : https://osmirror.org/manjaro/
   3.211 Chile          : http://manjaro.dcc.uchile.cl/
   4.938 China          : https://mirrors.shu.edu.cn/manjaro/
   5.106 China          : http://mirrors.shu.edu.cn/manjaro/
   ..... China          : ftp://mirrors.shu.edu.cn/manjaro/
.: ERROR ftp error: timeout('timed out',) 'ftp://mirrors.shu.edu.cn/manjaro/'

   2.218 China          : https://mirrors.ustc.edu.cn/manjaro/
   2.890 China          : http://mirrors.tuna.tsinghua.edu.cn/manjaro/
   12.022 hina          : https://mirrors.zju.edu.cn/manjaro/
   4.376 China          : https://mirrors.shuosc.org/manjaro/
   ..... China          : ftp://mirrors.shuosc.org/manjaro/
.: ERROR ftp error: timeout('timed out',) 'ftp://mirrors.shuosc.org/manjaro/'

   4.038 China          : https://mirrors.sjtug.sjtu.edu.cn/manjaro/
   4.609 Colombia       : http://mirror.upb.edu.co/manjaro/
   3.668 Costa_Rica     : https://mirrors.ucr.ac.cr/manjaro/
   2.752 Czech          : https://mirror.dkm.cz/manjaro/
   3.931 Denmark        : https://mirrors.dotsrc.org/manjaro/
   5.443 Denmark        : https://www.uex.dk/public/manjaro/
   13.646 cuador        : https://mirror.cedia.org.ec/manjaro/
   5.111 Ecuador        : https://mirror.espoch.edu.ec/manjaro/
   4.960 France         : http://ftp.free.org/mirrors/repo.manjaro.org/repos/
   9.851 France         : ftp://ftp.free.org/mirrors/repo.manjaro.org/repos/
   3.187 France         : http://kibo.remi.lu/
   2.541 Germany        : https://mirror.alpix.eu/manjaro/
   2.812 Germany        : http://mirror.ragenetwork.de/manjaro/
   3.204 Germany        : https://ftp.halifax.rwth-aachen.de/manjaro/
   4.591 Germany        : ftp://ftp.halifax.rwth-aachen.de/manjaro/
   4.895 Germany        : http://ftp.tu-chemnitz.de/pub/linux/manjaro/
   8.091 Germany        : ftp://ftp.tu-chemnitz.de/pub/linux/manjaro/
   3.258 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
   2.947 Germany        : https://mirror.netcologne.de/manjaro/
   2.879 Germany        : https://repo.rhindon.net/manjaro/
   3.380 Germany        : http://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/
   5.332 Germany        : ftp://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/
   2.859 Germany        : https://mirror.philpot.de/manjaro/
   2.301 Germany        : http://mirror.philpot.de/manjaro/
   5.984 Germany        : https://manjaro.moson.eu/
   4.181 Germany        : http://manjaro.moson.eu/
   4.144 Hungary        : https://quantum-mirror.hu/mirrors/pub/manjaro/
   3.299 Hungary        : http://quantum-mirror.hu/mirrors/pub/manjaro/
   4.385 Indonesia      : http://kartolo.sby.datautama.net.id/manjaro/
   5.240 Iran           : https://repo.sadjad.ac.ir/manjaro/
   4.915 Iran           : http://repo.sadjad.ac.ir/manjaro/
   3.593 Italy          : https://manjaro.mirror.garr.it/mirrors/manjaro/
   3.657 Italy          : https://ba.mirror.garr.it/mirrors/manjaro/
   3.534 Italy          : https://ct.mirror.garr.it/mirrors/manjaro/
   4.549 Netherlands    : https://ftp.nluug.nl/pub/os/Linux/distr/manjaro/
   5.708 Netherlands    : ftp://ftp.nluug.nl/pub/os/Linux/distr/manjaro/
   4.738 Netherlands    : http://ftp.snt.utwente.nl/pub/linux/manjaro/
   8.571 Netherlands    : ftp://ftp.snt.utwente.nl/pub/linux/manjaro/
   2.894 Netherlands    : https://mirror.koddos.net/manjaro/
   2.802 Poland         : https://mirror.tuchola-dc.pl/manjaro/
   2.596 Poland         : http://mirror.tuchola-dc.pl/manjaro/
   2.816 Romania        : http://mirrors.serverhost.ro/manjaro/packages/
   3.101 Russia         : https://mirror.yandex.ru/mirrors/manjaro/
   2.302 Russia         : http://mirror.truenetwork.ru/manjaro/
   4.219 South_Africa   : http://mirror.is.co.za/mirrors/manjaro.org/
   3.188 Spain          : http://ftp.caliu.cat/manjaro/
   4.980 Sweden         : https://ftp.lysator.liu.se/pub/manjaro/
   6.554 Sweden         : ftp://ftp.lysator.liu.se/pub/manjaro/
   3.750 Sweden         : https://mirror.zetup.net/manjaro/
   ..... Turkey         : http://ftp.linux.org.tr/manjaro/
.: ERROR Forbidden 'http://ftp.linux.org.tr/manjaro/'

   8.344 Turkey         : ftp://ftp.linux.org.tr/manjaro/
   2.583 United_Kingdom : http://mirror.catn.com/pub/manjaro/
   4.244 United_Kingdom : http://repo.manjaro.org.uk/
   2.968 United_Kingdom : https://www.mirrorservice.org/sites/repo.manjaro.org/repos/
   4.520 United_Kingdom : http://manjaro.mirrors.uk2.net/
   3.803 United_States  : https://mirrors.ocf.berkeley.edu/manjaro/
   3.431 United_States  : https://mirror.math.princeton.edu/pub/manjaro/
.: INFO Writing mirror list
   China           : https://mirrors.zju.edu.cn/manjaro/unstable
   Ecuador         : https://mirror.cedia.org.ec/manjaro/unstable
   Austria         : http://mirror.inode.at/manjaro/unstable
   China           : https://mirrors.ustc.edu.cn/manjaro/unstable
   Germany         : https://mirror.philpot.de/manjaro/unstable
   Russia          : http://mirror.truenetwork.ru/manjaro/unstable
   Germany         : https://mirror.alpix.eu/manjaro/unstable
   United_Kingdom  : http://mirror.catn.com/pub/manjaro/unstable
   Poland          : https://mirror.tuchola-dc.pl/manjaro/unstable
   Bangladesh      : http://mirror.xeonbd.com/manjaro/unstable
   Czech           : https://mirror.dkm.cz/manjaro/unstable
   Germany         : http://mirror.ragenetwork.de/manjaro/unstable
   Romania         : http://mirrors.serverhost.ro/manjaro/packages/unstable
   Germany         : https://repo.rhindon.net/manjaro/unstable
   China           : http://mirrors.tuna.tsinghua.edu.cn/manjaro/unstable
   Netherlands     : https://mirror.koddos.net/manjaro/unstable
   Germany         : https://mirror.netcologne.de/manjaro/unstable
   United_Kingdom  : https://www.mirrorservice.org/sites/repo.manjaro.org/repos/unstable
   Brazil          : http://linorg.usp.br/manjaro/unstable
   Brazil          : http://pet.inf.ufsc.br/mirrors/manjarolinux/unstable
   Russia          : https://mirror.yandex.ru/mirrors/manjaro/unstable
   Belarus         : http://mirror.datacenter.by/pub/mirrors/manjaro/unstable
   France          : http://kibo.remi.lu/unstable
   Spain           : http://ftp.caliu.cat/manjaro/unstable
   Chile           : http://manjaro.dcc.uchile.cl/unstable
   Germany         : https://mirror.netzspielplatz.de/manjaro/packages/unstable
   Hungary         : https://quantum-mirror.hu/mirrors/pub/manjaro/unstable
   United_States   : https://mirror.math.princeton.edu/pub/manjaro/unstable
   Italy           : https://ct.mirror.garr.it/mirrors/manjaro/unstable
   Italy           : https://manjaro.mirror.garr.it/mirrors/manjaro/unstable
   Italy           : https://ba.mirror.garr.it/mirrors/manjaro/unstable
   Australia       : http://manjaro.melbourneitmirror.net/unstable
   Brazil          : https://manjaro.c3sl.ufpr.br/unstable
   Costa_Rica      : https://mirrors.ucr.ac.cr/manjaro/unstable
   Sweden          : https://mirror.zetup.net/manjaro/unstable
   United_States   : https://mirrors.ocf.berkeley.edu/manjaro/unstable
   Denmark         : https://mirrors.dotsrc.org/manjaro/unstable
   China           : https://mirrors.sjtug.sjtu.edu.cn/manjaro/unstable
   Germany         : https://manjaro.moson.eu/unstable
   South_Africa    : http://mirror.is.co.za/mirrors/manjaro.org/unstable
   United_Kingdom  : http://repo.manjaro.org.uk/unstable
   Bulgaria        : http://manjaro.telecoms.bg/unstable
   Indonesia       : http://kartolo.sby.datautama.net.id/manjaro/unstable
   United_Kingdom  : http://manjaro.mirrors.uk2.net/unstable
   Germany         : https://ftp.halifax.rwth-aachen.de/manjaro/unstable
   Colombia        : http://mirror.upb.edu.co/manjaro/unstable
   Canada          : https://osmirror.org/manjaro/unstable
   Iran            : https://repo.sadjad.ac.ir/manjaro/unstable
   Ecuador         : https://mirror.espoch.edu.ec/manjaro/unstable
   Bulgaria        : https://manjaro.ipacct.com/manjaro/unstable
   Belgium         : https://mirror.futureweb.be/manjaro/unstable
   Germany         : http://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/unstable
   Denmark         : https://www.uex.dk/public/manjaro/unstable
   Netherlands     : https://ftp.nluug.nl/pub/os/Linux/distr/manjaro/unstable
   Sweden          : https://ftp.lysator.liu.se/pub/manjaro/unstable
   Germany         : http://ftp.tu-chemnitz.de/pub/linux/manjaro/unstable
   Turkey          : http://ftp.linux.org.tr/manjaro/unstable
   Netherlands     : http://ftp.snt.utwente.nl/pub/linux/manjaro/unstable
   France          : http://ftp.free.org/mirrors/repo.manjaro.org/repos/unstable
.: INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist

The top server on this run was China https://mirrors.zju.edu.cn which had a response time of 12 seconds.

Here is another run using a timeout of 5 seconds. The top 3 servers have no response time.

Summary
$ sudo pacman-mirrors -c all -t5
.: INFO Downloading mirrors from repo.manjaro.org
.: INFO Using default mirror file
.: INFO Querying mirrors - This may take some time
   3.582 Australia      : http://manjaro.melbourneitmirror.net/
   ..... Austria        : http://mirror.inode.at/manjaro/
   2.440 Bangladesh     : http://mirror.xeonbd.com/manjaro/
   2.544 Belarus        : http://mirror.datacenter.by/pub/mirrors/manjaro/
   5.928 Belgium        : https://mirror.futureweb.be/manjaro/
   ..... Belgium        : http://mirror.futureweb.be/manjaro/
   3.588 Brazil         : https://manjaro.c3sl.ufpr.br/
   2.906 Brazil         : http://pet.inf.ufsc.br/mirrors/manjarolinux/
   2.804 Brazil         : http://linorg.usp.br/manjaro/
   3.876 Bulgaria       : https://manjaro.ipacct.com/manjaro/
   4.688 Bulgaria       : http://manjaro.telecoms.bg/
   4.618 Canada         : https://osmirror.org/manjaro/
   2.885 Chile          : http://manjaro.dcc.uchile.cl/
   5.251 China          : https://mirrors.shu.edu.cn/manjaro/
   4.024 China          : http://mirrors.shu.edu.cn/manjaro/
   ..... China          : ftp://mirrors.shu.edu.cn/manjaro/
.: ERROR ftp error: timeout('timed out',) 'ftp://mirrors.shu.edu.cn/manjaro/'

   3.219 China          : http://mirrors.tuna.tsinghua.edu.cn/manjaro/
   7.693 China          : https://mirrors.zju.edu.cn/manjaro/
   6.041 China          : https://mirrors.shuosc.org/manjaro/
   ..... China          : ftp://mirrors.shuosc.org/manjaro/
.: ERROR ftp error: timeout('timed out',) 'ftp://mirrors.shuosc.org/manjaro/'

   4.047 China          : https://mirrors.sjtug.sjtu.edu.cn/manjaro/
   4.951 Colombia       : http://mirror.upb.edu.co/manjaro/
   3.318 Costa_Rica     : https://mirrors.ucr.ac.cr/manjaro/
   2.888 Czech          : https://mirror.dkm.cz/manjaro/
   4.114 Denmark        : https://mirrors.dotsrc.org/manjaro/
   4.982 Denmark        : https://www.uex.dk/public/manjaro/
   ..... Ecuador        : https://mirror.cedia.org.ec/manjaro/
   5.483 Ecuador        : https://mirror.espoch.edu.ec/manjaro/
   ..... France         : http://ftp.free.org/mirrors/repo.manjaro.org/repos/
   ..... France         : ftp://ftp.free.org/mirrors/repo.manjaro.org/repos/
   3.015 France         : http://kibo.remi.lu/
   2.733 Germany        : https://mirror.alpix.eu/manjaro/
   2.961 Germany        : http://mirror.ragenetwork.de/manjaro/
   3.292 Germany        : https://ftp.halifax.rwth-aachen.de/manjaro/
   4.689 Germany        : ftp://ftp.halifax.rwth-aachen.de/manjaro/
   4.924 Germany        : http://ftp.tu-chemnitz.de/pub/linux/manjaro/
   ..... Germany        : ftp://ftp.tu-chemnitz.de/pub/linux/manjaro/
   3.181 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
   2.975 Germany        : https://mirror.netcologne.de/manjaro/
   3.041 Germany        : https://repo.rhindon.net/manjaro/
   2.997 Germany        : http://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/
   ..... Germany        : ftp://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/
   3.165 Germany        : https://mirror.philpot.de/manjaro/
   2.639 Germany        : http://mirror.philpot.de/manjaro/
   6.104 Germany        : https://manjaro.moson.eu/
   4.471 Germany        : http://manjaro.moson.eu/
   4.295 Hungary        : https://quantum-mirror.hu/mirrors/pub/manjaro/
   3.757 Hungary        : http://quantum-mirror.hu/mirrors/pub/manjaro/
   3.940 Indonesia      : http://kartolo.sby.datautama.net.id/manjaro/
   5.613 Iran           : https://repo.sadjad.ac.ir/manjaro/
   ..... Iran           : http://repo.sadjad.ac.ir/manjaro/
   3.482 Italy          : https://manjaro.mirror.garr.it/mirrors/manjaro/
   3.474 Italy          : https://ba.mirror.garr.it/mirrors/manjaro/
   3.599 Italy          : https://ct.mirror.garr.it/mirrors/manjaro/
   4.548 Netherlands    : https://ftp.nluug.nl/pub/os/Linux/distr/manjaro/
   ..... Netherlands    : ftp://ftp.nluug.nl/pub/os/Linux/distr/manjaro/
   3.881 Netherlands    : http://ftp.snt.utwente.nl/pub/linux/manjaro/
   ..... Netherlands    : ftp://ftp.snt.utwente.nl/pub/linux/manjaro/
   2.888 Netherlands    : https://mirror.koddos.net/manjaro/
   3.497 Poland         : https://mirror.tuchola-dc.pl/manjaro/
   2.290 Poland         : http://mirror.tuchola-dc.pl/manjaro/
   2.912 Romania        : http://mirrors.serverhost.ro/manjaro/packages/
   3.617 Russia         : https://mirror.yandex.ru/mirrors/manjaro/
   2.023 Russia         : http://mirror.truenetwork.ru/manjaro/
   3.824 South_Africa   : http://mirror.is.co.za/mirrors/manjaro.org/
   3.189 Spain          : http://ftp.caliu.cat/manjaro/
   4.522 Sweden         : https://ftp.lysator.liu.se/pub/manjaro/
   ..... Sweden         : ftp://ftp.lysator.liu.se/pub/manjaro/
   3.828 Sweden         : https://mirror.zetup.net/manjaro/
   ..... Turkey         : http://ftp.linux.org.tr/manjaro/
.: ERROR Forbidden 'http://ftp.linux.org.tr/manjaro/'

   ..... Turkey         : ftp://ftp.linux.org.tr/manjaro/
   2.775 United_Kingdom : http://mirror.catn.com/pub/manjaro/
   4.364 United_Kingdom : http://repo.manjaro.org.uk/
   3.707 United_Kingdom : https://www.mirrorservice.org/sites/repo.manjaro.org/repos/
   4.273 United_Kingdom : http://manjaro.mirrors.uk2.net/
   2.282 United_States  : https://mirrors.ocf.berkeley.edu/manjaro/
   2.406 United_States  : https://mirror.math.princeton.edu/pub/manjaro/
   4.583 Vietnam        : https://manjaro.chocomint.co/manjaro/
.: INFO Writing mirror list
   France          : http://ftp.free.org/mirrors/repo.manjaro.org/repos/unstable
   Austria         : http://mirror.inode.at/manjaro/unstable
   Ecuador         : https://mirror.cedia.org.ec/manjaro/unstable
   Russia          : http://mirror.truenetwork.ru/manjaro/unstable
   United_States   : https://mirrors.ocf.berkeley.edu/manjaro/unstable
   Poland          : https://mirror.tuchola-dc.pl/manjaro/unstable
   United_States   : https://mirror.math.princeton.edu/pub/manjaro/unstable
   Bangladesh      : http://mirror.xeonbd.com/manjaro/unstable
   Belarus         : http://mirror.datacenter.by/pub/mirrors/manjaro/unstable
   Germany         : https://mirror.philpot.de/manjaro/unstable
   Germany         : https://mirror.alpix.eu/manjaro/unstable
   United_Kingdom  : http://mirror.catn.com/pub/manjaro/unstable
   Brazil          : http://linorg.usp.br/manjaro/unstable
   Chile           : http://manjaro.dcc.uchile.cl/unstable
   Czech           : https://mirror.dkm.cz/manjaro/unstable
   Netherlands     : https://mirror.koddos.net/manjaro/unstable
   Brazil          : http://pet.inf.ufsc.br/mirrors/manjarolinux/unstable
   Romania         : http://mirrors.serverhost.ro/manjaro/packages/unstable
   Germany         : http://mirror.ragenetwork.de/manjaro/unstable
   Germany         : https://mirror.netcologne.de/manjaro/unstable
   France          : http://kibo.remi.lu/unstable
   Germany         : https://repo.rhindon.net/manjaro/unstable
   Germany         : https://mirror.netzspielplatz.de/manjaro/packages/unstable
   Spain           : http://ftp.caliu.cat/manjaro/unstable
   China           : http://mirrors.tuna.tsinghua.edu.cn/manjaro/unstable
   Costa_Rica      : https://mirrors.ucr.ac.cr/manjaro/unstable
   Italy           : https://ba.mirror.garr.it/mirrors/manjaro/unstable
   Italy           : https://manjaro.mirror.garr.it/mirrors/manjaro/unstable
   Australia       : http://manjaro.melbourneitmirror.net/unstable
   Brazil          : https://manjaro.c3sl.ufpr.br/unstable
   Italy           : https://ct.mirror.garr.it/mirrors/manjaro/unstable
   Russia          : https://mirror.yandex.ru/mirrors/manjaro/unstable
   United_Kingdom  : https://www.mirrorservice.org/sites/repo.manjaro.org/repos/unstable
   Hungary         : https://quantum-mirror.hu/mirrors/pub/manjaro/unstable
   South_Africa    : http://mirror.is.co.za/mirrors/manjaro.org/unstable
   Sweden          : https://mirror.zetup.net/manjaro/unstable
   Bulgaria        : https://manjaro.ipacct.com/manjaro/unstable
   Indonesia       : http://kartolo.sby.datautama.net.id/manjaro/unstable
   China           : https://mirrors.sjtug.sjtu.edu.cn/manjaro/unstable
   Denmark         : https://mirrors.dotsrc.org/manjaro/unstable
   United_Kingdom  : http://manjaro.mirrors.uk2.net/unstable
   United_Kingdom  : http://repo.manjaro.org.uk/unstable
   Germany         : https://manjaro.moson.eu/unstable
   Vietnam         : https://manjaro.chocomint.co/manjaro/unstable
   Canada          : https://osmirror.org/manjaro/unstable
   Bulgaria        : http://manjaro.telecoms.bg/unstable
   Germany         : https://ftp.halifax.rwth-aachen.de/manjaro/unstable
   Colombia        : http://mirror.upb.edu.co/manjaro/unstable
   Denmark         : https://www.uex.dk/public/manjaro/unstable
   Germany         : http://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/unstable
   Belgium         : https://mirror.futureweb.be/manjaro/unstable
   Ecuador         : https://mirror.espoch.edu.ec/manjaro/unstable
   Iran            : https://repo.sadjad.ac.ir/manjaro/unstable
   Sweden          : https://ftp.lysator.liu.se/pub/manjaro/unstable
   Netherlands     : https://ftp.nluug.nl/pub/os/Linux/distr/manjaro/unstable
   Netherlands     : http://ftp.snt.utwente.nl/pub/linux/manjaro/unstable
   China           : https://mirrors.zju.edu.cn/manjaro/unstable
   Germany         : http://ftp.tu-chemnitz.de/pub/linux/manjaro/unstable
   Turkey          : http://ftp.linux.org.tr/manjaro/unstable
.: INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist

#5

Indeed it does.

I have chosen to use the database from the core repo because it has a decent size - not too big - but enough to get a more accurate measuring on how fast the mirror can serve the files you request.

The database will vary in size but it should not grow too big as the core repo is the repo with the least number of files :slight_smile:

It has a size of 1661929B ~ 1.6MiB


#6

That is weird - they should be sorted with the mirror with the least response time first ?

Boing - I know why!

Doh! :slamming-forehead:

It looks like it is a string sort - not a number sort.

That I will look at immediately!

August 2, 2018 12:46 PM (Europe: Paris), August 2, 2018 3:46 AM (America: Los Angeles)
Edit: 4.12.2-4 in unstable


#7

Will there be an option to work with a less sized file, like before? In 2018 some people still have a slow or limited connection.


#8

The file used before was 276B - and it was too small to get a reasonable measure of a given mirrors response and download time.

But I am open to suggestions. What do you consider a reasonable size?

It could be the core.db.tar.gz file which has a size of 151029B ~ 147KiB which is less than 10% of the core.files.tar.gz file.

It could also be the multilib.files.tar.gz which has a size of 294650B ~ 287KiB.


#9

core.files.tar.gz is 1.6MB. There are 78 mirrors right now. At worst that’s 124.8 MB of traffic.

Considering a stable update is hundreds of MB or more (a kernel update is 60-70 MB by itself), and that you don’t need to run pacman-mirrors every time you do an update, I don’t think 124 MB is too much traffic.

But if you really think that’s too much, you can test less mirrors every time with -f <choose any number you want>. Or use interactive mode to create a custom mirrorlist.


#10

Personally I use -f3. The reasoning is that on rare occasions there will be a problem with the download of a package causing it to retry that download from the next mirror on the list. Although I have never seen it fail consecutively from two mirrors having a double fallback gives me reassurance. :smile:


#11

I just suggest to leave an option to use old file (or maybe core.db.tar.gz). For example, pacman-mirrors --ping or something like this. As grinner noticed, it can take too long even with a small file because of re-connections.


#12

The only purpose of ping is to validate if something is alive on the IP. A ping reveals absolutely nothing but a live connection.


#13

I don’t think 124 MB is too much traffic.

But I think so. It takes me more than 1 hour to download this amount. I can get updates from any other Manjaro machine by copying /var/cache/pacman/pkg and /var/lib/pacman/sync directories. Even from machine with other linux distribution using script, so it is not so big problem. But tracking mirrors should be made on a target machine, of course.


#14

I did not find it in man, but we can call this option any other way. --small-file, --slow-connection etc.


#15

I see. Then it makes even more sense to - initially - find the right mirror for your connection and stick to it accepting that updates is available when the mirror has synced.

For your specific situation - take a look at repo.manjaro.org and find the mirrors which appear closest to your location.

Then run pacman-mirrors using the --interactive --default which lets you select your custom mirror pool before the actual probing is done.

This way you can minimze how many mirrors are probed and you get a good indication of which mirror is best for your connection.

I will however change the file download to be one of a lesser size - as I can understand your issue.


#16

Thank you! I hope less file size will be handy not only for me. I’ll be waiting for a new version to re-check mirrors. It is hard to find countries next to me from repo.manjaro.org so it will be better to check a full list.


#18

Even the slowest mirrors can do 30-35 KB/s easily as they’re usually located at universities or data centers. I would think any mirror would work for you. Only people with very fast connections really benefit from testing every possible mirror.

If I was in your situation, I would run -f3 option and not think twice.

Have you actually found mirrors that will not use your full bandwidth?


#19

If you don’t want to download 124 MiB, then use the -c switch to test mirrors only from a specific country.


#20

Or maybe we can have both options? Default would be the biggest one, but those with slow connection could use parameter to use old, small ones, which served us well so long time (despite the drawbacks)? You could call it for example a legacy probing with disclaimer that it’s way less accurate but uses less bandwidth and is quicker.

Yeah, that one is also a great solution.


#21

That is right what I tried to explain.


#25

Your wishes come true. As of version 4.12.3 - in unstable now - the configuration file now holds an item for the file used when ranking mirrors download time.

Depending on the status of your pacman-mirrors configuration - you will get a new pacman-mirrors.conf or a pacman-mirrors.conf.new

The config defaults to core.db.tar.gz but can be any file present in the core repo.

If you use a filename which is not present you will get a bunch of errors and nothing changes.