[pacman-mirrors] testing of development version


#1

In relation to the development of Pamac @guinux asked for a modification of pacman-mirrors.

The modification will ensure the Pamac logs is nicely presented without the escape sequences used for colorizing pacman-mirrors output.

This modification required a lot of work and though the tests I have done shows it works as expected - I would very much like your assistance to catch any regressions I might have caused.

The changes should not interfere with normal use - not at all - it should only remove colors from the output.

So I hereby call for some testers to install the development version available from unstable.

  • Test the normal use.
  • Test the normal use with --no-color argument

October 27, 2018 12:57 PM

The package is pacman-mirrors-dev. Please install from a mirror up-to-date on unstable branch.

Check the mirror service


#2

'LLo,

Tested with pacman-mirrors -c Germany,France,Belgium, works fine & effectivly there is no colors (if I have understood the request correctly… :thinking:).


#3

Hi :slight_smile:
It looks like its working, only error output is red and info white :slight_smile:


#4

Downloaded and tested on/against testing branch (okay probably shouldn’t… :stuck_out_tongue_winking_eye:) and didn’t find any problems.

Did notice that the timeout I was used to was being exceeded; in fact it seems now that there is a default of greater than four seconds where I believe the older default to have been 2 seconds. Fine by me since I had taken to specifying -t3 or more anyway. Btw if the timeout change is unintended or to be reverted would it be possible to allow custom (over)write of the timeout (-t) value in the conf file?


#5

To my knowledge - the package 4.12.9xx should only live in unstable. (unless phil made another testing update - I might not have noticed)

For the timeouts - if you have e.g. 3sec - it will be doubled if/when mirror protocol is ssl.


#6

Oh, I installed the package (4.12.905-1) directly from the unstable repository of the uek mirror. Which is why I was a bit cheeky. (Although I did note an earlier version 4.12.903 was reported on the testing branch.)

The timeout was not previously being doubled for me, using Protocol = https and SSLVerify = True on the non-dev version, when setting -t3 it would timeout at 3 seconds, if not specified it would timeout at 2 seconds (which was not enough). The -dev version is timing out after more than 4 seconds without a -t specified so what you say seems correct now. :woman_shrugging:


#7

Indeed - 2 sec is not enough for some https mirrors - I will revisit and check the code - but I am very sure I made it double if the procotol contains ´tps` which would accomodate for both http and ftp - if the latter becomes a standard :slight_smile:

just checked

snippet

    http_wait = self.max_wait_time
    ssl_wait = self.max_wait_time * 2

and

            if proto.endswith("tps"):  # https or ftps
                self.max_wait_time = ssl_wait
            else:
                self.max_wait_time = http_wait

#8

I am not questioning your code, indeed I like it very much. :grinning:

It is possible that something was strange in my pacman-mirrors.conf since I had to redo that after installing the dev version (did not think to copy ahead) but my experience was as above and over some time (months rather than days).

Some terminal output below. Note the repetition in the second and fourth lines.

::Downloading mirrors from repo.manjaro.org
::Querying mirrors - This may take some time
::Using default mirror file
::Querying mirrors - This may take some time
::  4.368 Denmark        : https://www.uex.dk/public/manjaro/
::  3.453 Germany        : https://manjaro.moson.eu/
::  3.761 Hungary        : https://quantum-mirror.hu/mirrors/pub/manjaro/
::  1.776 United_States  : https://mirrors.ocf.berkeley.edu/manjaro/
::  3.734 Bulgaria       : https://manjaro.ipacct.com/manjaro/
::  3.708 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
::  5.973 Brazil         : https://www.caco.ic.unicamp.br/manjaro/
::  3.375 Germany        : https://mirror.alpix.eu/manjaro/
::  2.849 Russia         : https://mirror.yandex.ru/mirrors/manjaro/
::  2.716 United_States  : https://mirror.math.princeton.edu/pub/manjaro/
::  2.300 Canada         : https://osmirror.org/manjaro/
::  6.105 Poland         : https://mirror.tuchola-dc.pl/manjaro/
::  2.988 Germany        : https://mirror.philpot.de/manjaro/
::  4.319 Brazil         : https://manjaro.c3sl.ufpr.br/

#9

That is indeed a developer error - I will fix that.

I have never spotted that. I think it has fixed itself (and that does never happen) - a test run on the latest 4.12.912

~/.../packages/core >>> sudo pacman-mirrors -c all                                                                   
[sudo] adgangskode for fh: 
::INFO Downloading mirrors from repo.manjaro.org
::INFO Using default mirror file
::INFO Querying mirrors - This may take some time
  1.690 Brazil         : https://www.caco.ic.unicamp.br/manjaro/
  0.365 Bulgaria       : https://manjaro.ipacct.com/manjaro/
  0.435 Denmark        : https://www.uex.dk/public/manjaro/
  0.268 Germany        : https://mirror.alpix.eu/manjaro/
  0.259 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
  0.219 Germany        : https://mirror.philpot.de/manjaro/
  0.218 Germany        : https://manjaro.moson.eu/
  0.351 Poland         : https://mirror.tuchola-dc.pl/manjaro/
  0.246 Russia         : https://mirror.yandex.ru/mirrors/manjaro/
::INFO Writing mirror list
::Germany         : https://manjaro.moson.eu/unstable
::Germany         : https://mirror.philpot.de/manjaro/unstable
::Russia          : https://mirror.yandex.ru/mirrors/manjaro/unstable
::Germany         : https://mirror.netzspielplatz.de/manjaro/packages/unstable
::Germany         : https://mirror.alpix.eu/manjaro/unstable
::Poland          : https://mirror.tuchola-dc.pl/manjaro/unstable
::Bulgaria        : https://manjaro.ipacct.com/manjaro/unstable
::Denmark         : https://www.uex.dk/public/manjaro/unstable
::Brazil          : https://www.caco.ic.unicamp.br/manjaro/unstable
::INFO Mirror list generated and saved to: /etc/pacman.d/mirrorlist
~/.../packages/core >>> sudo pacman-mirrors -c all --no-color                                                        
::Downloading mirrors from repo.manjaro.org
::Using default mirror file
::Querying mirrors - This may take some time
::  1.692 Brazil         : https://www.caco.ic.unicamp.br/manjaro/
::  0.359 Bulgaria       : https://manjaro.ipacct.com/manjaro/
::  0.421 Denmark        : https://www.uex.dk/public/manjaro/
::  0.263 Germany        : https://mirror.alpix.eu/manjaro/
::  0.261 Germany        : https://mirror.netzspielplatz.de/manjaro/packages/
::  0.205 Germany        : https://mirror.philpot.de/manjaro/
::  0.180 Germany        : https://manjaro.moson.eu/
::  0.339 Poland         : https://mirror.tuchola-dc.pl/manjaro/
::  0.163 Russia         : https://mirror.yandex.ru/mirrors/manjaro/
::Writing mirror list
::Russia          : https://mirror.yandex.ru/mirrors/manjaro/unstable
::Germany         : https://manjaro.moson.eu/unstable
::Germany         : https://mirror.philpot.de/manjaro/unstable
::Germany         : https://mirror.netzspielplatz.de/manjaro/packages/unstable
::Germany         : https://mirror.alpix.eu/manjaro/unstable
::Poland          : https://mirror.tuchola-dc.pl/manjaro/unstable
::Bulgaria        : https://manjaro.ipacct.com/manjaro/unstable
::Denmark         : https://www.uex.dk/public/manjaro/unstable
::Brazil          : https://www.caco.ic.unicamp.br/manjaro/unstable
::Mirror list generated and saved to: /etc/pacman.d/mirrorlist

#10

/etc/pacman-mirrors

installing this has changed the conf file from testing branch to stable branch (by commenting Branch= config)

is this whats its suppose to do? or is there another config file used when switching branch.

~ >>> sudo pacman -S pacman-mirrors-dev                                                        
resolving dependencies...
looking for conflicting packages...
:: pacman-mirrors-dev and pacman-mirrors are in conflict (pacman-mirrorlist). Remove pacman-mirrors? [y/N] y

Packages (2) pacman-mirrors-4.12.6-1 [removal]  pacman-mirrors-dev-4.12.912-1

Total Download Size:   0.11 MiB
Total Installed Size:  1.04 MiB
Net Upgrade Size:      0.07 MiB

:: Proceed with installation? [Y/n] 
:: Retrieving packages...
 pacman-mirrors-dev-4.12.91...   107.8 KiB   276K/s 00:00 [###############################] 100%
(1/1) checking keys in keyring                            [###############################] 100%
(1/1) checking package integrity                          [###############################] 100%
(1/1) loading package files                               [###############################] 100%
(1/1) checking for file conflicts                         [###############################] 100%
(2/2) checking available disk space                       [###############################] 100%
:: Processing package changes...
(1/1) removing pacman-mirrors                             [###############################] 100%
warning: /etc/pacman-mirrors.conf saved as /etc/pacman-mirrors.conf.pacsave
(1/1) installing pacman-mirrors-dev                       [###############################] 100%
Optional dependencies for pacman-mirrors-dev
    gtk3: for interactive mode (GUI) [installed]
    python-gobject: for interactive mode (GUI) [installed]
:: Running post-transaction hooks...
(1/1) Arming ConditionNeedsUpdate...


~ >>> pacman-mirrors -G                                                                        
stable

#11

It happens for me when I use the -f commandline option but not otherwise (as far as I can tell) this on 4.12.912-1.

@retrowertz The new .conf has everything commented out. Try redoing your choosen configuration. (I’m guessing that it defaults to stable branch when no branch is specified.)


#12

Thanks - I had a doubled message there.

Yes - I forgot to change the branch in the conf file when doing this dev version.


closed #13