Most browsers are GTK apps (Firefox, Chromium etc) which use the GTK file picker dialog. QT file picker (normally used by KDE and QT applications) has thumbnail preview feature but GTK file picker does not.
You can manually make Firefox use the QT file picker instead by following this Arch wiki page. Not sure how to do this on Chromium based browsers though. Also see this similar thread: