Spidering software that checks Web sites for broken links - XENU clone?

Hey there,
I have a list of several thousand links in a txt file.
From time to time, a need arises to validate them.
On Windows - we have the champ: XENU
Is there anything similar to Xenu for linux?

appreciate your input, guys :slight_smile:

You could use urlwatch, however it might not scale for thousands of pages

1 Like

Hi @korben,

Maybe linkchecker works for you:

And it’s in the AUR:

$ pamac searchlinkchecker
linkchecker-git  latest-4                                                                                                                                                                                                                                 AUR
Check websites for broken links (development version)
linkchecker  10.3.0-1                                                                                                                                                                                                                                     AUR
check links in web documents or full websites

So can be installed with:

pamac build linkchecker

Go ahead and give it a go. I can only be or not be what you’re looking for and if it is

Hope it helps!

1 Like

Theres also a handful of different packages in the AUR:
https://aur.archlinux.org/packages?O=0&SeB=nd&K=link+check&outdated=&SB=v&SO=d&PP=50&submit=Go
https://aur.archlinux.org/packages?K=broken%20link

IDK … maybe muffet looks the most interesting?

2 Likes

Please don’t use abbreviations in posts. See


Tried. Failed. Couldn’t help myself.

:stuck_out_tongue_winking_eye:

There is also Site Checker Pro, if you prefer to work online; and Broken Link Checker which looks interesting – similar to Link Checker.

Screaming Frog SEO Spider appears to be the closest to Xenu, in functionality; however, it isn’t open-source.

Cheers.

1 Like