[pacman-mirrors] 4.11.4 bugfix release

pacman-mirrors

#1

Pacman-mirrors 4.11.4 in unstable

Fixed
The mirrorlist created after interactive - used https where it should use http.

Our user @korealinux reported this issue.

As pacman-mirrors probes the mirrors it loops the available protocols which has been sorted in decending order so it probes https first and secondly http etc.

If the mirror has an expired certificate the following happens:

The first probe assign the mirror a response time of 99.99 to the https protocol but as the subsequent probe on the http protocol returns a valid response within the alotted time the mirror now gets the new response time of s.mss.

When the mirrors is written to the mirrorlist - again https is proritized over http and since the mirror now has a valid reponse time the https protocol is written to the mirror list.

The behavior is expected - what is not expected is a mirror to have an expired certificate, which in this case results in undesired behavior.

Please test it against German mirrors (philpot.de has an expired certificate).

The console output will show the expired certificate and the fix should ensure that the final mirrorlist does not contain the philpot.de server with the https protocol - only with http.

Watch out for the final mirrorlist if philpot.de mirror should be with http and not https.

~ >>> sudo pacman-mirrors -c Germany                                                                                 
[sudo] password for fh: 
.: INFO Downloading mirrors from repo.manjaro.org

.: INFO User generated mirror list
--------------------------
.: INFO Custom mirror file saved: /var/lib/pacman-mirrors/custom-mirrors.json
.: INFO Using custom mirror file
.: INFO Querying mirrors - This may take some time
   0.121 Germany        : http://mirror.ragenetwork.de/manjaro/
   0.223 Germany        : https://ftp.halifax.rwth-aachen.de/manjaro/
   0.673 Germany        : ftp://ftp.halifax.rwth-aachen.de/manjaro/
   0.220 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
   ..... Germany        : https://mirror.philpot.de/manjaro/
.: ERROR [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:841) 'https://mirror.philpot.de/manjaro/'

   0.072 Germany        : http://mirror.philpot.de/manjaro/
   0.190 Germany        : https://manjaro.moson.eu/
   0.062 Germany        : http://manjaro.moson.eu/
.: INFO Writing mirror list
   Germany         : https://manjaro.moson.eu/unstable/$repo/$arch
   Germany         : http://mirror.philpot.de/manjaro/unstable/$repo/$arch
   Germany         : http://mirror.ragenetwork.de/manjaro/unstable/$repo/$arch
   Germany         : https://mirror.netzspielplatz.de/manjaro/packages/unstable/$repo/$arch
   Germany         : https://ftp.halifax.rwth-aachen.de/manjaro/unstable/$repo/$arch
.: INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
.: INFO To remove custom config run  'sudo pacman-mirrors -c all'

Or

sudo pacman-mirrors -c Germany -i


Mirrors
[Stable Update] 2018-07-22 - Kernels, KDE, Gnome, Deepin, Mesa, Browsers, PHP
#2
$ sudo pacman-mirrors -f

: INFO Downloading mirrors from repo.manjaro.org
.: INFO: Querying mirrors - This may take some time
   0.284 Denmark        : 00:02: https://www.uex.dk/public/manjaro/
   ..... South_Africa   : 00:04: http://manjaro.mirror.ac.za/
   0.837 Ecuador        : 00:50: https://mirror.espoch.edu.ec/manjaro/
   0.417 United_States  : 00:52: https://mirror.math.princeton.edu/pub/manjaro/
   1.358 Brazil         : 00:21: http://mirror.ufam.edu.br/manjaro/
   ..... Germany        : 00:03: https://mirror.philpot.de/manjaro/
.: ERROR [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:841) 'https://mirror.philpot.de/manjaro/'


#3

That is expected - it is the final mirrorlist which should not contain the https when the mirror has an expired certificate.


#4

Results are consistent with your explanation:


sudo pacman-mirrors -c Germany,United_Kingdom,Canada                           
.: INFO Downloading mirrors from repo.manjaro.org

.: INFO User generated mirror list
--------------------------
.: INFO Custom mirror file saved: /var/lib/pacman-mirrors/custom-mirrors.json
.: INFO Using custom mirror file
.: INFO Querying mirrors - This may take some time
   0.121 Canada         : https://osmirror.org/manjaro/
   0.768 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
   ..... Germany        : https://mirror.philpot.de/manjaro/
.: ERROR [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:841) 'https://mirror.philpot.de/manjaro/'

   0.616 Germany        : https://manjaro.moson.eu/
.: INFO Writing mirror list
   Canada          : https://osmirror.org/manjaro/unstable/$repo/$arch
   Germany         : https://manjaro.moson.eu/unstable/$repo/$arch
   Germany         : https://mirror.netzspielplatz.de/manjaro/packages/unstable/$repo/
.: INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist

If I do in Interactive mode philpot.de appears in the list of available mirrors, though at the bottom.


#5

Can you post link to older version because with this version it gives 404 error?


#6
~ >>> ls /var/cache/pacman/pkg/pacman-mirrors*                                                                       
/var/cache/pacman/pkg/pacman-mirrors-4.11.2-1-any.pkg.tar.xz

#7

I don’t understand - What is giving 404?


#8

pacman says 404 with pacman-mirrors 4.11.3-1, but works normally with pacman-mirrors 4.11.2-1.


#9

What is the command exhibiting this behavior?


#10

sudo pacman -Syyu


#11

That is not pacman-mirrors.

Getting errors like that - is due to an invalid url in your mirrorlist.

Try doing

sudo pacman-mirrors -c all

Then

sudo pacman-mirrrors -f 10

Then

sudo pacman -Syyu

#12

On Manjaro pacman-mirrors generate mirrorlist and if there any error on mirrorlist, pacman not working normally. I can’t generate any working mirrorlist with pacman-mirrors 4.11.3, but mirrorlist which generated by pacman-mirrors 4.11.2 works normally.


#13

You can get an invalid url in your mirrorlist if you have a custom mirror pool which contains a nonfunctional mirror.

Which is why I recommend a pool reset by doing pacman-mirrors -c all

Please don’t mix pacman and pacman-mirrors.

Have you tried my suggestion ^^^ above?

Could you please copy paste the terminal output of your pacman-mirrors command for verification?

Also the first 15 lines or so from /etc/pacman.d/mirrorlist

What you say happen - did not happen if you cannot document it - so please paste terminal output of pacman-mirrors command and response.

Please remember to mark/select all pasted output and then click the </> in the post toolbar.

Let me provide an example

~ >>> pacman-mirrors -v
Version 4.11.3
~ >>> sudo pacman-mirrors -c Germany
.: INFO Downloading mirrors from repo.manjaro.org

.: INFO User generated mirror list
--------------------------
.: INFO Custom mirror file saved: /var/lib/pacman-mirrors/custom-mirrors.json
.: INFO Using custom mirror file
.: INFO Querying mirrors - This may take some time
   0.208 Germany        : http://mirror.ragenetwork.de/manjaro/
   0.508 Germany        : https://ftp.halifax.rwth-aachen.de/manjaro/
   0.611 Germany        : ftp://ftp.halifax.rwth-aachen.de/manjaro/
   0.195 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
   ..... Germany        : https://mirror.philpot.de/manjaro/
.: ERROR [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:841) 'https://mirror.philpot.de/manjaro/'

   0.076 Germany        : http://mirror.philpot.de/manjaro/
   0.183 Germany        : https://manjaro.moson.eu/
   0.065 Germany        : http://manjaro.moson.eu/
.: INFO Writing mirror list
   Germany         : https://manjaro.moson.eu/unstable/$repo/$arch
   Germany         : http://mirror.philpot.de/manjaro/unstable/$repo/$arch
   Germany         : https://mirror.netzspielplatz.de/manjaro/packages/unstable/$repo/$arch
   Germany         : http://mirror.ragenetwork.de/manjaro/unstable/$repo/$arch
   Germany         : https://ftp.halifax.rwth-aachen.de/manjaro/unstable/$repo/$arch
.: INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
.: INFO To remove custom config run  'sudo pacman-mirrors -c all'
~ >>> sudo pacman -Syyu
:: Synchronizing package databases...
 core                                         147,5 KiB  1756K/s 00:00 [########################################] 100%
 extra                                       1796,3 KiB  5,48M/s 00:00 [########################################] 100%
 community                                      4,8 MiB  15,9M/s 00:00 [########################################] 100%
 multilib                                     180,0 KiB  0,00B/s 00:00 [########################################] 100%
:: Starting full system upgrade...
 there is nothing to do

#14
[tux@Y2P ~]$ sudo pacman -U /var/cache/pacman/pkg/pacman-mirrors-4.11.3-1-any.pkg.tar.xz
loading packages...
warning: pacman-mirrors-4.11.3-1 is up to date -- reinstalling
resolving dependencies...
looking for conflicting packages...

Packages (1) pacman-mirrors-4.11.3-1

Total Installed Size:  0,96 MiB
Net Upgrade Size:      0,00 MiB

:: Proceed with installation? [Y/n] y
(1/1) checking keys in keyring                                                                                                                                [##################################################################################################] 100%
(1/1) checking package integrity                                                                                                                              [##################################################################################################] 100%
(1/1) loading package files                                                                                                                                   [##################################################################################################] 100%
(1/1) checking for file conflicts                                                                                                                             [##################################################################################################] 100%
(1/1) checking available disk space                                                                                                                           [##################################################################################################] 100%
:: Processing package changes...
(1/1) reinstalling pacman-mirrors                                                                                                                             [##################################################################################################] 100%
:: Running post-transaction hooks...
(1/2) Configuring pacman-mirrors ...
.: INFO Downloading mirrors from repo.manjaro.org
hint: use `pacman-mirrors` to generate and update your pacman mirrorlist.
(2/2) Arming ConditionNeedsUpdate...
[tux@Y2P ~]$ sudo pacman-mirrors -c all 
.: INFO Downloading mirrors from repo.manjaro.org
.: INFO Using default mirror file
.: INFO Querying mirrors - This may take some time
   0.683 Australia      : http://manjaro.melbourneitmirror.net/
   0.245 Belgium        : https://mirror.futureweb.be/manjaro/
   0.132 Belgium        : http://mirror.futureweb.be/manjaro/
   1.714 Brazil         : https://manjaro.c3sl.ufpr.br/
   0.651 Brazil         : http://mirror.ufam.edu.br/manjaro/
   0.361 Bulgaria       : https://manjaro.ipacct.com/manjaro/
   0.314 Bulgaria       : http://manjaro.telecoms.bg/
   0.541 Canada         : https://osmirror.org/manjaro/
   0.552 Chile          : http://manjaro.dcc.uchile.cl/
   1.322 Costa_Rica     : https://mirrors.ucr.ac.cr/manjaro/
   0.248 Denmark        : https://mirrors.dotsrc.org/manjaro/
   0.342 Denmark        : https://www.uex.dk/public/manjaro/
   1.029 Ecuador        : https://mirror.cedia.org.ec/manjaro/
   1.041 Ecuador        : https://mirror.espoch.edu.ec/manjaro/
   0.118 France         : http://kibo.remi.lu/
   0.126 Germany        : http://mirror.ragenetwork.de/manjaro/
   0.346 Germany        : https://ftp.halifax.rwth-aachen.de/manjaro/
   0.954 Germany        : ftp://ftp.halifax.rwth-aachen.de/manjaro/
   0.381 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
   ..... Germany        : https://mirror.philpot.de/manjaro/
.: ERROR [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:841) 'https://mirror.philpot.de/manjaro/'

   0.139 Germany        : http://mirror.philpot.de/manjaro/
   0.340 Germany        : https://manjaro.moson.eu/
   1.129 Germany        : http://manjaro.moson.eu/
   0.433 Hungary        : https://quantum-mirror.hu/mirrors/pub/manjaro/
   0.277 Hungary        : http://quantum-mirror.hu/mirrors/pub/manjaro/
   0.656 Indonesia      : http://kambing.ui.ac.id/manjaro/
   0.482 Indonesia      : http://kartolo.sby.datautama.net.id/manjaro/
   0.227 Poland         : https://mirror.tuchola-dc.pl/manjaro/
   0.114 Poland         : http://mirror.tuchola-dc.pl/manjaro/
   0.269 Portugal       : http://manjaro.barata.pt/
   0.168 Russia         : https://mirror.yandex.ru/mirrors/manjaro/
   0.276 Russia         : http://mirror.truenetwork.ru/manjaro/
   0.504 South_Africa   : http://mirror.is.co.za/mirrors/manjaro.org/
   1.083 South_Africa   : http://manjaro.mirror.ac.za/
   ..... South_Africa   : ftp://manjaro.mirror.ac.za/
.: ERROR ftp error: URLError('ftp error: error_perm("550 Can\'t change directory to state: No such file or directory",)',) 'ftp://manjaro.mirror.ac.za/'

   0.234 Sweden         : https://ftp.lysator.liu.se/pub/manjaro/
   0.406 Sweden         : ftp://ftp.lysator.liu.se/pub/manjaro/
   0.246 Sweden         : https://mirror.zetup.net/manjaro/
   0.139 United_Kingdom : http://mirror.catn.com/pub/manjaro/
   ..... United_Kingdom : http://repo.manjaro.org.uk/
.: ERROR timed out 'http://repo.manjaro.org.uk/'

   0.160 United_Kingdom : http://manjaro.mirrors.uk2.net/
   1.181 United_States  : https://mirrors.ocf.berkeley.edu/manjaro/
   0.568 United_States  : https://mirror.math.princeton.edu/pub/manjaro/
.: INFO Writing mirror list
   Poland          : https://mirror.tuchola-dc.pl/manjaro/unstable
   France          : http://kibo.remi.lu/unstable
   Germany         : http://mirror.ragenetwork.de/manjaro/unstable
   Belgium         : https://mirror.futureweb.be/manjaro/unstable
   Germany         : http://mirror.philpot.de/manjaro/unstable
   United_Kingdom  : http://mirror.catn.com/pub/manjaro/unstable
   United_Kingdom  : http://manjaro.mirrors.uk2.net/unstable
   Russia          : https://mirror.yandex.ru/mirrors/manjaro/unstable
   Sweden          : https://mirror.zetup.net/manjaro/unstable
   Denmark         : https://mirrors.dotsrc.org/manjaro/unstable
   Portugal        : http://manjaro.barata.pt/unstable
   Russia          : http://mirror.truenetwork.ru/manjaro/unstable
   Hungary         : https://quantum-mirror.hu/mirrors/pub/manjaro/unstable
   Bulgaria        : http://manjaro.telecoms.bg/unstable
   Denmark         : https://www.uex.dk/public/manjaro/unstable
   Bulgaria        : https://manjaro.ipacct.com/manjaro/unstable
   Germany         : https://mirror.netzspielplatz.de/manjaro/packages/unstable
   Sweden          : https://ftp.lysator.liu.se/pub/manjaro/unstable
   Indonesia       : http://kartolo.sby.datautama.net.id/manjaro/unstable
   South_Africa    : http://mirror.is.co.za/mirrors/manjaro.org/unstable
   Canada          : https://osmirror.org/manjaro/unstable
   Chile           : http://manjaro.dcc.uchile.cl/unstable
   United_States   : https://mirror.math.princeton.edu/pub/manjaro/unstable
   Brazil          : http://mirror.ufam.edu.br/manjaro/unstable
   Indonesia       : http://kambing.ui.ac.id/manjaro/unstable
   Australia       : http://manjaro.melbourneitmirror.net/unstable
   Germany         : https://ftp.halifax.rwth-aachen.de/manjaro/unstable
   Ecuador         : https://mirror.cedia.org.ec/manjaro/unstable
   Ecuador         : https://mirror.espoch.edu.ec/manjaro/unstable
   Germany         : https://manjaro.moson.eu/unstable
   United_States   : https://mirrors.ocf.berkeley.edu/manjaro/unstable
   Costa_Rica      : https://mirrors.ucr.ac.cr/manjaro/unstable
   Brazil          : https://manjaro.c3sl.ufpr.br/unstable
.: INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
[tux@Y2P ~]$ sudo pacman-mirrors -f 10 
.: INFO Downloading mirrors from repo.manjaro.org
.: INFO: Querying mirrors - This may take some time
.: INFO Using default mirror file
.: INFO Querying mirrors - This may take some time
   0.245 Belgium        : https://mirror.futureweb.be/manjaro/
   0.124 Belgium        : http://mirror.futureweb.be/manjaro/
   0.363 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
   0.944 Costa_Rica     : https://mirrors.ucr.ac.cr/manjaro/
   0.384 Bulgaria       : https://manjaro.ipacct.com/manjaro/
   0.229 Sweden         : https://mirror.zetup.net/manjaro/
   0.697 Indonesia      : http://kambing.ui.ac.id/manjaro/
   0.443 Hungary        : https://quantum-mirror.hu/mirrors/pub/manjaro/
   0.312 Hungary        : http://quantum-mirror.hu/mirrors/pub/manjaro/
   0.198 Bulgaria       : http://manjaro.telecoms.bg/
   0.272 Russia         : http://mirror.truenetwork.ru/manjaro/
   0.686 Australia      : http://manjaro.melbourneitmirror.net/
.: INFO Writing mirror list
   Belgium         : https://mirror.futureweb.be/manjaro/unstable
   Bulgaria        : http://manjaro.telecoms.bg/unstable
   Sweden          : https://mirror.zetup.net/manjaro/unstable
   Russia          : http://mirror.truenetwork.ru/manjaro/unstable
   Hungary         : https://quantum-mirror.hu/mirrors/pub/manjaro/unstable
   Germany         : https://mirror.netzspielplatz.de/manjaro/packages/unstable
   Bulgaria        : https://manjaro.ipacct.com/manjaro/unstable
   Australia       : http://manjaro.melbourneitmirror.net/unstable
   Indonesia       : http://kambing.ui.ac.id/manjaro/unstable
   Costa_Rica      : https://mirrors.ucr.ac.cr/manjaro/unstable
.: INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
[tux@Y2P ~]$ sudo pacman -Syyu
:: Synchronizing package databases...
error: failed retrieving file 'core.db' from mirror.futureweb.be : The requested URL returned error: 404
error: failed retrieving file 'core.db' from manjaro.telecoms.bg : The requested URL returned error: 404
error: failed retrieving file 'core.db' from mirror.zetup.net : The requested URL returned error: 404
error: failed retrieving file 'core.db' from mirror.truenetwork.ru : The requested URL returned error: 404
error: failed retrieving file 'core.db' from quantum-mirror.hu : The requested URL returned error: 404
error: failed retrieving file 'core.db' from mirror.netzspielplatz.de : The requested URL returned error: 404
error: failed retrieving file 'core.db' from manjaro.ipacct.com : The requested URL returned error: 404
error: failed retrieving file 'core.db' from manjaro.melbourneitmirror.net : The requested URL returned error: 404
error: failed retrieving file 'core.db' from kambing.ui.ac.id : The requested URL returned error: 404
error: failed retrieving file 'core.db' from mirrors.ucr.ac.cr : The requested URL returned error: 404
error: failed to update core (unexpected error)
error: failed retrieving file 'extra.db' from mirror.futureweb.be : The requested URL returned error: 404
error: failed retrieving file 'extra.db' from manjaro.telecoms.bg : The requested URL returned error: 404
error: failed retrieving file 'extra.db' from mirror.zetup.net : The requested URL returned error: 404
error: failed retrieving file 'extra.db' from mirror.truenetwork.ru : The requested URL returned error: 404
error: failed retrieving file 'extra.db' from quantum-mirror.hu : The requested URL returned error: 404
error: failed retrieving file 'extra.db' from mirror.netzspielplatz.de : The requested URL returned error: 404
error: failed retrieving file 'extra.db' from manjaro.ipacct.com : The requested URL returned error: 404
error: failed retrieving file 'extra.db' from manjaro.melbourneitmirror.net : The requested URL returned error: 404
error: failed retrieving file 'extra.db' from kambing.ui.ac.id : The requested URL returned error: 404
error: failed retrieving file 'extra.db' from mirrors.ucr.ac.cr : The requested URL returned error: 404
error: failed to update extra (unexpected error)
error: failed retrieving file 'community.db' from mirror.futureweb.be : The requested URL returned error: 404
error: failed retrieving file 'community.db' from manjaro.telecoms.bg : The requested URL returned error: 404
error: failed retrieving file 'community.db' from mirror.zetup.net : The requested URL returned error: 404
error: failed retrieving file 'community.db' from mirror.truenetwork.ru : The requested URL returned error: 404
error: failed retrieving file 'community.db' from quantum-mirror.hu : The requested URL returned error: 404
error: failed retrieving file 'community.db' from mirror.netzspielplatz.de : The requested URL returned error: 404
error: failed retrieving file 'community.db' from manjaro.ipacct.com : The requested URL returned error: 404
error: failed retrieving file 'community.db' from manjaro.melbourneitmirror.net : The requested URL returned error: 404
error: failed retrieving file 'community.db' from kambing.ui.ac.id : The requested URL returned error: 404
error: failed retrieving file 'community.db' from mirrors.ucr.ac.cr : The requested URL returned error: 404
error: failed to update community (unexpected error)
error: failed retrieving file 'multilib.db' from mirror.futureweb.be : The requested URL returned error: 404
error: failed retrieving file 'multilib.db' from manjaro.telecoms.bg : The requested URL returned error: 404
error: failed retrieving file 'multilib.db' from mirror.zetup.net : The requested URL returned error: 404
error: failed retrieving file 'multilib.db' from mirror.truenetwork.ru : The requested URL returned error: 404
error: failed retrieving file 'multilib.db' from quantum-mirror.hu : The requested URL returned error: 404
error: failed retrieving file 'multilib.db' from mirror.netzspielplatz.de : The requested URL returned error: 404
error: failed retrieving file 'multilib.db' from manjaro.ipacct.com : The requested URL returned error: 404
error: failed retrieving file 'multilib.db' from manjaro.melbourneitmirror.net : The requested URL returned error: 404
error: failed retrieving file 'multilib.db' from kambing.ui.ac.id : The requested URL returned error: 404
error: failed retrieving file 'multilib.db' from mirrors.ucr.ac.cr : The requested URL returned error: 404
error: failed to update multilib (unexpected error)
error: failed to synchronize all databases
[tux@Y2P ~]$ cat /etc/pacman.d/mirrorlist | head -16
##
## Manjaro Linux default mirrorlist
## Generated on 2018-07-22 17:50
##
## Please use 'pacman-mirrors -f [NUMBER] NUMBER' to modify mirrorlist
## (Use 0 for all mirrors)
##

## Country : Belgium
Server = https://mirror.futureweb.be/manjaro/unstable

## Country : Bulgaria
Server = http://manjaro.telecoms.bg/unstable

## Country : Sweden
Server = https://mirror.zetup.net/manjaro/unstable


#15

Mirrorlist which generated by pacman-mirrors 4.11.2 looks like this

##
## Manjaro Linux default mirrorlist
## Generated on 2018-07-22 18:00
##
## Please use 'pacman-mirrors -f [NUMBER] NUMBER' to modify mirrorlist
## (Use 0 for all mirrors)
##

## Country : France
Server = http://kibo.remi.lu/unstable/$repo/$arch

## Country : Sweden
Server = https://ftp.lysator.liu.se/pub/manjaro/unstable/$repo/$arch

## Country : Portugal
Server = http://manjaro.barata.pt/unstable/$repo/$arch

## Country : Canada
Server = https://osmirror.org/manjaro/unstable/$repo/$arch

## Country : Brazil
Server = http://mirror.ufam.edu.br/manjaro/unstable/$repo/$arch

## Country : Indonesia
Server = http://kambing.ui.ac.id/manjaro/unstable/$repo/$arch

## Country : Australia
Server = http://manjaro.melbourneitmirror.net/unstable/$repo/$arch

## Country : South_Africa
Server = http://manjaro.mirror.ac.za/unstable/$repo/$arch

## Country : United_States
Server = https://mirrors.ocf.berkeley.edu/manjaro/unstable/$repo/$arch

## Country : Costa_Rica
Server = https://mirrors.ucr.ac.cr/manjaro/unstable/$repo/$arch


#16
  • The pacman-mirrors reset behave as expected.
  • The pacman-mirrors fasttrack behave as expected.
  • The mirrorlist is not as expected.

Edit: I totally missed the missing $repo/$arch at the url

The error you see is not related to pacman-mirrors but is a network related error of which I can point to no specific cause.

First
What is your country of origin?

Second
Edit your /etc/pacman.d/mirrorlist
Change the first mirror server line to

https://www.uex.dk/public/manjaro/unstable/$repo/$arch

Save and then

sudo pacman -Syyu


#17

There is something on your system

~ >>> pacman-mirrors -v                                                                                              
Version 4.11.3
~ >>> sudo pacman-mirrors -c Germany                                                                                 
[sudo] password for fh: 
.: INFO Downloading mirrors from repo.manjaro.org

.: INFO User generated mirror list
--------------------------
.: INFO Custom mirror file saved: /var/lib/pacman-mirrors/custom-mirrors.json
.: INFO Using custom mirror file
.: INFO Querying mirrors - This may take some time
   0.111 Germany        : http://mirror.ragenetwork.de/manjaro/
   0.214 Germany        : https://ftp.halifax.rwth-aachen.de/manjaro/
   0.686 Germany        : ftp://ftp.halifax.rwth-aachen.de/manjaro/
   0.187 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
   ..... Germany        : https://mirror.philpot.de/manjaro/
.: ERROR [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:841) 'https://mirror.philpot.de/manjaro/'

   0.075 Germany        : http://mirror.philpot.de/manjaro/
   0.142 Germany        : https://manjaro.moson.eu/
   0.062 Germany        : http://manjaro.moson.eu/
.: INFO Writing mirror list
   Germany         : https://manjaro.moson.eu/unstable/$repo/$arch
   Germany         : http://mirror.philpot.de/manjaro/unstable/$repo/$arch
   Germany         : http://mirror.ragenetwork.de/manjaro/unstable/$repo/$arch
   Germany         : https://mirror.netzspielplatz.de/manjaro/packages/unstable/$repo/$arch
   Germany         : https://ftp.halifax.rwth-aachen.de/manjaro/unstable/$repo/$arch
.: INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
.: INFO To remove custom config run  'sudo pacman-mirrors -c all'
~ >>> cat /etc/pacman.d/mirrorlist                                                                                   
##
## Manjaro Linux custom mirrorlist
## Generated on 2018-07-22 17:08
##
## Please use 'pacman-mirrors -id' to reset custom mirrorlist
## Please use 'pacman-mirrors -c all' to reset custom mirrorlist
## To remove custom config run  'pacman-mirrors -c all'
##

## Country : Germany
Server = https://manjaro.moson.eu/unstable/$repo/$arch

## Country : Germany
Server = http://mirror.philpot.de/manjaro/unstable/$repo/$arch

## Country : Germany
Server = http://mirror.ragenetwork.de/manjaro/unstable/$repo/$arch

## Country : Germany
Server = https://mirror.netzspielplatz.de/manjaro/packages/unstable/$repo/$arch

## Country : Germany
Server = https://ftp.halifax.rwth-aachen.de/manjaro/unstable/$repo/$arch

And a second run with -f

~ >>> sudo pacman-mirrors -f                                                                                         
.: INFO Downloading mirrors from repo.manjaro.org
.: INFO: Querying mirrors - This may take some time
.: INFO Using custom mirror file
.: INFO Querying mirrors - This may take some time
   0.167 Germany        : https://ftp.halifax.rwth-aachen.de/manjaro/
   0.611 Germany        : ftp://ftp.halifax.rwth-aachen.de/manjaro/
   0.095 Germany        : https://manjaro.moson.eu/
   0.066 Germany        : http://manjaro.moson.eu/
   0.076 Germany        : http://mirror.ragenetwork.de/manjaro/
   0.190 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
   ..... Germany        : https://mirror.philpot.de/manjaro/
.: ERROR [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:841) 'https://mirror.philpot.de/manjaro/'

   0.079 Germany        : http://mirror.philpot.de/manjaro/
.: INFO Writing mirror list
   Germany         : https://manjaro.moson.eu/unstable/$repo/$arch
   Germany         : http://mirror.ragenetwork.de/manjaro/unstable/$repo/$arch
   Germany         : http://mirror.philpot.de/manjaro/unstable/$repo/$arch
   Germany         : https://mirror.netzspielplatz.de/manjaro/packages/unstable/$repo/$arch
   Germany         : https://ftp.halifax.rwth-aachen.de/manjaro/unstable/$repo/$arch
.: INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
~ >>> cat /etc/pacman.d/mirrorlist                                                                                   
##
## Manjaro Linux custom mirrorlist
## Generated on 2018-07-22 17:09
##
## Please use 'pacman-mirrors -id' to reset custom mirrorlist
## Please use 'pacman-mirrors -c all' to reset custom mirrorlist
## To remove custom config run  'pacman-mirrors -c all'
##

## Country : Germany
Server = https://manjaro.moson.eu/unstable/$repo/$arch

## Country : Germany
Server = http://mirror.ragenetwork.de/manjaro/unstable/$repo/$arch

## Country : Germany
Server = http://mirror.philpot.de/manjaro/unstable/$repo/$arch

## Country : Germany
Server = https://mirror.netzspielplatz.de/manjaro/packages/unstable/$repo/$arch

## Country : Germany
Server = https://ftp.halifax.rwth-aachen.de/manjaro/unstable/$repo/$arch

Please note the timestamp in the mirrorlist

## Generated on 2018-07-22 17:u6709:

I am not pulling your leg - I cannot figure why your mirrorlist looks like that - but it does explain why you are getting 404’s.


#18

I am now able to reproduce your issue - thank you for providing the terminal outputs.

Still mystified though

(pacman-mirrors) ~/.../manjaro-project/pacman-mirrors >>> sudo pacman-mirrors -c all                                                                                                                                                                             ±[master]
[sudo] password for fh: 
.: INFO Downloading mirrors from repo.manjaro.org
.: INFO Using default mirror file
.: INFO Querying mirrors - This may take some time
   0.646 Australia      : http://manjaro.melbourneitmirror.net/
   0.113 Belgium        : https://mirror.futureweb.be/manjaro/
   0.064 Belgium        : http://mirror.futureweb.be/manjaro/
   1.045 Brazil         : https://manjaro.c3sl.ufpr.br/
   0.642 Brazil         : http://mirror.ufam.edu.br/manjaro/
   0.245 Bulgaria       : https://manjaro.ipacct.com/manjaro/
   0.221 Bulgaria       : http://manjaro.telecoms.bg/
   0.424 Canada         : https://osmirror.org/manjaro/
   0.493 Chile          : http://manjaro.dcc.uchile.cl/
   0.758 Costa_Rica     : https://mirrors.ucr.ac.cr/manjaro/
   0.098 Denmark        : https://mirrors.dotsrc.org/manjaro/
   0.086 Denmark        : https://www.uex.dk/public/manjaro/
   0.893 Ecuador        : https://mirror.cedia.org.ec/manjaro/
   0.915 Ecuador        : https://mirror.espoch.edu.ec/manjaro/
   0.085 France         : http://kibo.remi.lu/
   0.073 Germany        : http://mirror.ragenetwork.de/manjaro/
   0.177 Germany        : https://ftp.halifax.rwth-aachen.de/manjaro/
   0.683 Germany        : ftp://ftp.halifax.rwth-aachen.de/manjaro/
   0.199 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
   ..... Germany        : https://mirror.philpot.de/manjaro/
.: ERROR [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:841) 'https://mirror.philpot.de/manjaro/'

   0.073 Germany        : http://mirror.philpot.de/manjaro/
   0.163 Germany        : https://manjaro.moson.eu/
   0.059 Germany        : http://manjaro.moson.eu/
   0.315 Hungary        : https://quantum-mirror.hu/mirrors/pub/manjaro/
   0.135 Hungary        : http://quantum-mirror.hu/mirrors/pub/manjaro/
   0.429 Indonesia      : http://kambing.ui.ac.id/manjaro/
   0.426 Indonesia      : http://kartolo.sby.datautama.net.id/manjaro/
   0.197 Poland         : https://mirror.tuchola-dc.pl/manjaro/
   0.111 Poland         : http://mirror.tuchola-dc.pl/manjaro/
   0.158 Portugal       : http://manjaro.barata.pt/
   0.162 Russia         : https://mirror.yandex.ru/mirrors/manjaro/
   0.230 Russia         : http://mirror.truenetwork.ru/manjaro/
   0.430 South_Africa   : http://mirror.is.co.za/mirrors/manjaro.org/
   0.589 South_Africa   : http://manjaro.mirror.ac.za/
   ..... South_Africa   : ftp://manjaro.mirror.ac.za/
.: ERROR ftp error: URLError('ftp error: error_perm("550 Can\'t change directory to state: No such file or directory",)',) 'ftp://manjaro.mirror.ac.za/'

   0.239 Spain          : http://ftp.caliu.cat/manjaro/
   0.094 Sweden         : https://ftp.lysator.liu.se/pub/manjaro/
   0.222 Sweden         : ftp://ftp.lysator.liu.se/pub/manjaro/
   0.114 Sweden         : https://mirror.zetup.net/manjaro/
   0.095 United_Kingdom : http://mirror.catn.com/pub/manjaro/
   ..... United_Kingdom : http://repo.manjaro.org.uk/
.: ERROR timed out 'http://repo.manjaro.org.uk/'

   0.076 United_Kingdom : http://manjaro.mirrors.uk2.net/
   0.722 United_States  : https://mirrors.ocf.berkeley.edu/manjaro/
   0.417 United_States  : https://mirror.math.princeton.edu/pub/manjaro/
.: INFO Writing mirror list
https://manjaro.moson.eu/unstable/$repo/$arch
https://mirror.futureweb.be/manjaro/unstable/$repo/$arch
http://mirror.ragenetwork.de/manjaro/unstable/$repo/$arch
http://mirror.philpot.de/manjaro/unstable/$repo/$arch
http://manjaro.mirrors.uk2.net/unstable/$repo/$arch
http://kibo.remi.lu/unstable/$repo/$arch
https://www.uex.dk/public/manjaro/unstable/$repo/$arch
http://mirror.catn.com/pub/manjaro/unstable/$repo/$arch
https://mirrors.dotsrc.org/manjaro/unstable/$repo/$arch
https://mirror.tuchola-dc.pl/manjaro/unstable/$repo/$arch
https://mirror.zetup.net/manjaro/unstable/$repo/$arch
https://quantum-mirror.hu/mirrors/pub/manjaro/unstable/$repo/$arch
http://manjaro.barata.pt/unstable/$repo/$arch
https://mirror.yandex.ru/mirrors/manjaro/unstable/$repo/$arch
https://mirror.netzspielplatz.de/manjaro/packages/unstable/$repo/$arch
http://manjaro.telecoms.bg/unstable/$repo/$arch
https://ftp.lysator.liu.se/pub/manjaro/unstable/$repo/$arch
http://mirror.truenetwork.ru/manjaro/unstable/$repo/$arch
http://ftp.caliu.cat/manjaro/unstable/$repo/$arch
https://manjaro.ipacct.com/manjaro/unstable/$repo/$arch
https://mirror.math.princeton.edu/pub/manjaro/unstable/$repo/$arch
https://osmirror.org/manjaro/unstable/$repo/$arch
http://kartolo.sby.datautama.net.id/manjaro/unstable/$repo/$arch
http://kambing.ui.ac.id/manjaro/unstable/$repo/$arch
http://mirror.is.co.za/mirrors/manjaro.org/unstable/$repo/$arch
http://manjaro.dcc.uchile.cl/unstable/$repo/$arch
http://mirror.ufam.edu.br/manjaro/unstable/$repo/$arch
http://manjaro.melbourneitmirror.net/unstable/$repo/$arch
https://ftp.halifax.rwth-aachen.de/manjaro/unstable/$repo/$arch
https://mirrors.ocf.berkeley.edu/manjaro/unstable/$repo/$arch
https://mirrors.ucr.ac.cr/manjaro/unstable/$repo/$arch
https://mirror.cedia.org.ec/manjaro/unstable/$repo/$arch
https://mirror.espoch.edu.ec/manjaro/unstable/$repo/$arch
https://manjaro.c3sl.ufpr.br/unstable/$repo/$arch
http://manjaro.mirror.ac.za/unstable/$repo/$arch
http://repo.manjaro.org.uk/unstable/$repo/$arch

The culprit was this
Found a mysterious line - which actually alter the server[“url”] before the server is written to file.

msg_url = server["url"] = "{}{}{}".format(protocol,
                                          url[pos:],
                                          config["branch"])

Quite sure it should be

msg_url = "{}{}{}".format(protocol,
                          url[pos:],
                          config["branch"])

#19

I am not having that “/$repo/$arch” at the end of each URL of the mirrors in my “/etc/pacman.d/mirrorlist”


#20

thank you for confirming the bug