Pacman-mirrors message during ipv6 failure

GaVenga · 6 March 2021 14:48

Since the latest AVM Fritz!Box 7590 Update (7.25)
ipv6 falls back to ipv4 by accident.
. -----------------------------------------------------------------------
EDIT:

Mystirious log while doing “sudo pacman-mirrors -i”:

Mär 06 17:52:25 ***** systemd-resolved[676]: DNSSEC validation failed for question ping.archlinux.org IN AAAA: incompatible-server
Mär 06 17:52:25 ***** systemd-resolved[676]: DNSSEC validation failed for question ping.archlinux.org IN A: incompatible-server
Mär 06 17:52:25 ***** systemd-resolved[676]: DNSSEC validation failed for question ping.archlinux.org IN A: incompatible-server
Mär 06 17:52:25 ***** systemd-resolved[676]: DNSSEC validation failed for question ping.archlinux.org IN AAAA: incompatible-server
Mär 06 17:52:25 ***** systemd-resolved[676]: DNSSEC validation failed for question ping.archlinux.org IN AAAA: incompatible-server

linux-aarhus · 7 March 2021 16:06

this is not a pacman-mirrors error/failure it is low-level IP message

GaVenga · 8 March 2021 10:01

Thank you for enlightment!
.
next Theme: “What is the difference between following results”
(and why does “repo.manjaro.org” not have ipv6):

$ dig repo.manjaro.org AAAA

; <<>> DiG 9.16.12 <<>> repo.manjaro.org AAAA
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 38698
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 65494
;; QUESTION SECTION:
;repo.manjaro.org.		IN	AAAA

;; Query time: 309 msec
;; SERVER: 127.0.0.yy#yy(127.0.0.yy)
;; WHEN: Mo Mär 08 10:52:13 CET 2021
;; MSG SIZE  rcvd: 45

$ dig ipv6.google.com AAAA

; <<>> DiG 9.16.12 <<>> ipv6.google.com AAAA
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 11577
;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 65494
;; QUESTION SECTION:
;ipv6.google.com. IN AAAA

;; ANSWER SECTION:
ipv6.google.com. 86400 IN CNAME ipv6.l.google.com.
ipv6.l.google.com. 299 IN AAAA 2a00:1450:4001:829::200e

;; Query time: 253 msec
;; SERVER: 127.0.0.yy#yy(127.0.0.yy)
;; WHEN: Mo Mär 08 10:52:25 CET 2021
;; MSG SIZE rcvd: 93

The Server “repo…manjaro.org” recently needs some MINUTES to answer "sudo pacman-mirrors -i ";
maybe its hosted on a RasPi??

linux-aarhus · 8 March 2021 15:45

The master repo server does not have a IPv6 address as the addition of an AAAA record has proved to negatively affect almost the entire mirror pool - but you already know that.

My network DNS resolver runs on an early raspberry pi but the master repo server does not.

If you experience long response to a simple json text file - then you have serious network issues - whether that is local or ISP related I cannot possibly know.

timed pacman-mirrors -c de

➜  ~ sudo time pacman-mirrors -c de
::INFO Downloading mirrors from repo.manjaro.org
::INFO User generated mirror list
::------------------------------------------------------------
::INFO Custom mirror file saved: /var/lib/pacman-mirrors/custom-mirrors.json
::INFO Using custom mirror file
::INFO Querying mirrors - This may take some time
  ..... Germany        : https://manjaro.re/
  1.899 Germany        : http://manjaro.re/
  0.335 Germany        : https://manjaro.moson.eu/
  0.134 Germany        : http://manjaro.moson.eu/
::INFO Writing mirror list
::Germany         : https://manjaro.moson.eu/unstable/$repo/$arch
::Germany         : https://manjaro.re/unstable/$repo/$arch
::INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
::INFO To reset custom mirrorlist 'sudo pacman-mirrors -id'
::INFO To remove custom config run  'sudo pacman-mirrors -c all'
0.32user 0.03system 0:08.05elapsed 4%CPU (0avgtext+0avgdata 32380maxresident)k
0inputs+96outputs (0major+5143minor)pagefaults 0swaps

GaVenga · 8 March 2021 17:10

Yes.

case A: "timed pacman-mirrors -c de"

time pacman-mirrors -c de
::INFO Downloading mirrors from repo.manjaro.org
::INFO User generated mirror list
::------------------------------------------------------------
::INFO Custom mirror file saved: /var/lib/pacman-mirrors/custom-mirrors.json
::INFO Using custom mirror file
::INFO Querying mirrors - This may take some time
2.746 Germany : https://manjaro.re/
… Germany : http://manjaro.re/
… Germany : https://mirror.atysleaks.org/manjaro/
… Germany : http://mirror.atysleaks.org/manjaro/
… Germany : Index of /manjaro/
… Germany : Index of /manjaro/
… Germany : https://manjaro.moson.eu/
… Germany : http://manjaro.moson.eu/
… Germany : https://manjaro.moson.org/
… Germany : http://manjaro.moson.org/
::INFO Writing mirror list
::Germany : https://mirror.23media.com/manjaro/testing/$repo/$arch
::Germany : https://manjaro.moson.org/testing/$repo/$arch
::Germany : https://manjaro.moson.eu/testing/$repo/$arch
::Germany : https://mirror.atysleaks.org/manjaro/testing/$repo/$arch
::Germany : https://manjaro.re/testing/$repo/$arch
::INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
::INFO To reset custom mirrorlist ‘sudo pacman-mirrors -id’
::INFO To remove custom config run ‘sudo pacman-mirrors -c all’

real 5m4,084s
user 0m0,277s
sys 0m0,047s

case B: "timed pacman-mirrors -c de"

time pacman-mirrors -c de
::INFO Downloading mirrors from repo.manjaro.org
::INFO User generated mirror list
::------------------------------------------------------------
::INFO Custom mirror file saved: /var/lib/pacman-mirrors/custom-mirrors.json
::INFO Using custom mirror file
::INFO Querying mirrors - This may take some time
… Germany : https://manjaro.re/
1.809 Germany : http://manjaro.re/
0.490 Germany : https://mirror.atysleaks.org/manjaro/
0.114 Germany : http://mirror.atysleaks.org/manjaro/
0.087 Germany : Index of /manjaro/
0.043 Germany : Index of /manjaro/
0.103 Germany : https://manjaro.moson.eu/
0.067 Germany : http://manjaro.moson.eu/
0.083 Germany : https://manjaro.moson.org/
0.058 Germany : http://manjaro.moson.org/
::INFO Writing mirror list
::Germany : https://mirror.23media.com/manjaro/testing/$repo/$arch
::Germany : https://manjaro.moson.org/testing/$repo/$arch
::Germany : https://manjaro.moson.eu/testing/$repo/$arch
::Germany : https://mirror.atysleaks.org/manjaro/testing/$repo/$arch
::Germany : https://manjaro.re/testing/$repo/$arch
::INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
::INFO To reset custom mirrorlist ‘sudo pacman-mirrors -id’
::INFO To remove custom config run ‘sudo pacman-mirrors -c all’

real 0m10,059s
user 0m0,222s
sys 0m0,037s

Case A: Settings → Network → … IPv6 to “automatic” (=default after installation)
Case B: Settings → Network → … IPv6 to “automatic, DHCP only”

Case A1 = A with “time 1.9-3”
Case B1 = B with “time 1.9-3”

Case A1

sudo time pacman-mirrors -c de
::INFO Downloading mirrors from repo.manjaro.org
::INFO User generated mirror list
::------------------------------------------------------------
::INFO Custom mirror file saved: /var/lib/pacman-mirrors/custom-mirrors.json
::INFO Using custom mirror file
::INFO Querying mirrors - This may take some time
… Germany : https://manjaro.re/
… Germany : http://manjaro.re/
… Germany : https://mirror.atysleaks.org/manjaro/
… Germany : http://mirror.atysleaks.org/manjaro/
… Germany : Index of /manjaro/
… Germany : Index of /manjaro/
… Germany : https://manjaro.moson.eu/
… Germany : http://manjaro.moson.eu/
… Germany : https://manjaro.moson.org/
… Germany : http://manjaro.moson.org/
::INFO Writing mirror list
::Germany : https://mirror.23media.com/manjaro/testing/$repo/$arch
::Germany : https://manjaro.moson.org/testing/$repo/$arch
::Germany : https://manjaro.moson.eu/testing/$repo/$arch
::Germany : https://manjaro.re/testing/$repo/$arch
::Germany : https://mirror.atysleaks.org/manjaro/testing/$repo/$arch
::INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
::INFO To reset custom mirrorlist ‘sudo pacman-mirrors -id’
::INFO To remove custom config run ‘sudo pacman-mirrors -c all’
0.23user 0.02system 5:03.10 elapsed 0%CPU (0avgtext+0avgdata 34532maxresident)k
0inputs+96outputs (0major+5675minor)pagefaults 0swaps

Case B1

sudo time pacman-mirrors -c de [1]
::INFO Downloading mirrors from repo.manjaro.org
::INFO User generated mirror list
::------------------------------------------------------------
::INFO Custom mirror file saved: /var/lib/pacman-mirrors/custom-mirrors.json
::INFO Using custom mirror file
::INFO Querying mirrors - This may take some time
2.524 Germany : https://manjaro.re/
… Germany : http://manjaro.re/
0.090 Germany : https://mirror.atysleaks.org/manjaro/
0.118 Germany : http://mirror.atysleaks.org/manjaro/
0.431 Germany : Index of /manjaro/
0.042 Germany : Index of /manjaro/
0.093 Germany : https://manjaro.moson.eu/
0.069 Germany : http://manjaro.moson.eu/
0.080 Germany : https://manjaro.moson.org/
0.059 Germany : http://manjaro.moson.org/
::INFO Writing mirror list
::Germany : https://mirror.23media.com/manjaro/testing/$repo/$arch
::Germany : https://manjaro.moson.org/testing/$repo/$arch
::Germany : https://manjaro.moson.eu/testing/$repo/$arch
::Germany : https://mirror.atysleaks.org/manjaro/testing/$repo/$arch
::Germany : https://manjaro.re/testing/$repo/$arch
::INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
::INFO To reset custom mirrorlist ‘sudo pacman-mirrors -id’
::INFO To remove custom config run ‘sudo pacman-mirrors -c all’
0.19user 0.03system 0:07.76 elapsed 3%CPU (0avgtext+0avgdata 34624maxresident)k
0inputs+96outputs (0major+5675minor)pagefaults 0swaps

linux-aarhus · 9 March 2021 12:54

You have a local configuration issue.

I suggest you begin with disabling IPv6 at the critical points - your router, dns and dhcp. If you have no IPv6 enabled at these points any device using a private IPv6 broadcast - what-ever - will have to use IPv4.

If it is your router - disabling IPv6 at that point will force all your clients to use IPv4 - of course if you run a campus with 500.000 devices including smart-light, refrigerators, fridges, smartphones, mouses, rats and students - everyone with a minimum of 4 devices (laptop, workstation, phone, tablet) - then you will probably be forced to use IPv6 - until that happens - hasta-la-vista IPv6.

My network services are configured for IPv4 only and I have no intention of learning how IPv6 works. I deliberately disable IPv6 when it is insisting on interfering with my network setup.

GaVenga · 9 March 2021 13:52

The same issue on a second PC with Ubuntu 20.4?!
My router says - ipv6 is availabel - the Firefox loads ipv6 sites, but after same time if i reload, its ipv4.
May be an ISP problem since End of October 2020 (logs say so).
Or the Fritz!Box update to 7.25 firmware. Before this - no networkproblems. Or accident?
I need some IPv6 only sites, so disabling IPv6 is not the right way, old man. (o.K.I am aged 69).
But finally:
10 print “Thank You”
20 goto 10

xxxxxxxxxxxxxxxxxxx(Tante) Edit:xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
Habe gerade eine mögliche Lösung gefunden:
Einstellungen → Netzwerk IPv4 “DNS Automatisch” deaktiviert und IPv6 “DNS"Automatisch” aktiviert.
.
danach lief das Updaten der Pamac Datenbank so etwas von schnell, das mir schwindlig wurde…

linux-aarhus · 9 March 2021 14:35

Well - then you outrank me ol’man - I am only reaching 61 this year been on sick leave - then retired since 2008 - sold off - more like - gave away my business - to some ungrateful sob.

linux-aarhus · 14 March 2021 14:09

I have an idea - actually it was not mine but an issue created on gitlab for pacman-mirrors.

function `urlopen` without timeout argument timed out in certain situations (#154) · Issues · Applications / pacman-mirrors · GitLab

TL:DR
the request fetching the json data files containing mirrors and current status lacked a timeout.

This has been added and a new version is in unstable 4.19.3 - I wonder if your IPv6 issue is somehow connected to these specific calls lacking a timeout?

Could you please test this?

GaVenga · 15 March 2021 10:34

Testing.
pacman-mirrors -v
Version 4.19.3
.
sudo pacman-mirrors -i [1]
::WARNING https://gitlab.manjaro.org ‘HTTP Error 500: Internal Server Error’
::WARNING https://gitlab.manjaro.org ‘HTTP Error 500: Internal Server Error’
::INFO Downloading mirrors from repo.manjaro.org
Traceback (most recent call last):
File “/usr/bin/pacman-mirrors”, line 28, in
pm.run()
File “/usr/lib/python3.9/site-packages/pacman_mirrors/pacman_mirrors.py”, line 101, in run
httpFn.download_mirror_pool(config=self.config, tty=self.tty, quiet=self.quiet)
File “/usr/lib/python3.9/site-packages/pacman_mirrors/functions/httpFn.py”, line 196, in download_mirror_pool
result = download_mirrors(config)
File “/usr/lib/python3.9/site-packages/pacman_mirrors/functions/httpFn.py”, line 59, in download_mirrors
with urllib.request.urlopen(req, timeout=config[“timeout”]) as response:
KeyError: ‘timeout’

linux-aarhus · 15 March 2021 11:32

At least it didn’t hang

I just fixed this - pushed v.4.19.5 to unstable

GaVenga · 15 March 2021 11:56

This Fix fixed it - hurra victoria!!!

GaVenga · 15 March 2021 13:11

pushed v.4.19.5 to unstable ==> pacman-mirrors -v
Version 4.19.4
in pamac it is called 4.19.5 ==> update version-string?

linux-aarhus · 15 March 2021 13:42

dang - forgot to bump the version string in source

GaVenga · 15 March 2021 15:48

happened to me too - while programming AMIGA in last Century.
.
Btw.: I decided to reset my Fritz!Box to factory settings and let the Telekomiker configure the FB automagic.
Now it works even better than before - digital daemons at work???
Old swedish - no, but denmarkish I presume.

system · 30 March 2021 15:48

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.