Grsync - very slow, not sure of options

Hello, I am backing up a music collection from an external usb2 2TB HD to a Synology NAS.

Last night I had added 4 new albums to the USB and (using Grsync) synced them to the NAS. It took over 2 hours. I had run the ‘dummy’ run which was very quick (probably less than 10 mins) and everything looked fine. The command line in Grsync looks like this:

rsync -r -v --progress -i -s

In my Windows days I would have used SyncToy and had this done in 10 mins or less - what am I doing wrong!

Watching the output of Grsync it seems to be over-writing 100’s of files which makes me nervous but checking the finished operation all seems well. I was trying to read to output and the ‘T’ option seemed to appear a lot. I understand this to be adding a timestamp - is this correct? Is this causing the problem and if so can I turn it off?

I apologise for asking what I assume is a very basic question but all advice will be gratefully received!

Regards, Martin

  Kernel: 5.16.2-1-MANJARO x86_64 bits: 64 compiler: gcc v: 11.1.0
    parameters: BOOT_IMAGE=/boot/vmlinuz-5.16-x86_64
    root=UUID=24831e2c-db3a-430a-9d27-6f176c38314a rw quiet apparmor=1
    security=apparmor udev.log_priority=3
  Desktop: Xfce 4.16.0 tk: Gtk 3.24.29 info: xfce4-panel wm: xfwm 4.16.1
    vt: 7 dm: LightDM 1.30.0 Distro: Manjaro Linux base: Arch Linux
Machine:
  Type: Desktop System: ASUS product: N/A v: N/A serial: <superuser required>
  Mobo: ASUSTeK model: TUF GAMING B550-PLUS v: Rev X.0x
    serial: <superuser required> UEFI: American Megatrends v: 2423
    date: 08/10/2021
Battery:
  Message: No system battery data found. Is one present?
Memory:
  RAM: total: 31.32 GiB used: 2.13 GiB (6.8%)
  RAM Report:
    permissions: Unable to run dmidecode. Root privileges required.
CPU:
  Info: model: AMD Ryzen 9 3900X bits: 64 type: MT MCP arch: Zen 2
    family: 0x17 (23) model-id: 0x71 (113) stepping: 0 microcode: 0x8701021
  Topology: cpus: 1x cores: 12 tpc: 2 threads: 24 smt: enabled cache:
    L1: 768 KiB desc: d-12x32 KiB; i-12x32 KiB L2: 6 MiB desc: 12x512 KiB
    L3: 64 MiB desc: 4x16 MiB
  Speed (MHz): avg: 2333 high: 3593 min/max: 2200/4672 boost: enabled
    scaling: driver: acpi-cpufreq governor: schedutil cores: 1: 3593 2: 2052
    3: 2053 4: 2052 5: 3593 6: 2051 7: 2193 8: 2191 9: 2193 10: 2196 11: 2195
    12: 2196 13: 3587 14: 2052 15: 2052 16: 2194 17: 2194 18: 2198 19: 2195
    20: 2193 21: 2196 22: 2193 23: 2196 24: 2194 bogomips: 182125
  Flags: 3dnowprefetch abm adx aes aperfmperf apic arat avic avx avx2 bmi1
    bmi2 bpext cat_l3 cdp_l3 clflush clflushopt clwb clzero cmov cmp_legacy
    constant_tsc cpb cpuid cqm cqm_llc cqm_mbm_local cqm_mbm_total
    cqm_occup_llc cr8_legacy cx16 cx8 de decodeassists extapic extd_apicid
    f16c flushbyasid fma fpu fsgsbase fxsr fxsr_opt ht hw_pstate ibpb ibs
    irperf lahf_lm lbrv lm mba mca mce misalignsse mmx mmxext monitor movbe
    msr mtrr mwaitx nonstop_tsc nopl npt nrip_save nx osvw overflow_recov pae
    pat pausefilter pclmulqdq pdpe1gb perfctr_core perfctr_llc perfctr_nb
    pfthreshold pge pni popcnt pse pse36 rapl rdpid rdpru rdrand rdseed rdt_a
    rdtscp rep_good sep sev sev_es sha_ni skinit smap smca sme smep ssbd sse
    sse2 sse4_1 sse4_2 sse4a ssse3 stibp succor svm svm_lock syscall tce
    topoext tsc tsc_scale umip v_spec_ctrl v_vmsave_vmload vgif vmcb_clean vme
    vmmcall wbnoinvd wdt xgetbv1 xsave xsavec xsaveerptr xsaveopt xsaves
  Vulnerabilities:
  Type: itlb_multihit status: Not affected
  Type: l1tf status: Not affected
  Type: mds status: Not affected
  Type: meltdown status: Not affected
  Type: spec_store_bypass
    mitigation: Speculative Store Bypass disabled via prctl
  Type: spectre_v1
    mitigation: usercopy/swapgs barriers and __user pointer sanitization
  Type: spectre_v2 mitigation: Full AMD retpoline, IBPB: conditional, STIBP:
    conditional, RSB filling
  Type: srbds status: Not affected
  Type: tsx_async_abort status: Not affected
Graphics:
  Device-1: NVIDIA GP107 [GeForce GTX 1050 Ti] driver: nvidia v: 495.46
    alternate: nouveau,nvidia_drm bus-ID: 0a:00.0 chip-ID: 10de:1c82
    class-ID: 0300
  Display: x11 server: X.Org 1.21.1.3 compositor: xfwm4 v: 4.16.1 driver:
    loaded: nvidia display-ID: :0.0 screens: 1
  Screen-1: 0 s-res: 1680x1050 s-dpi: 96 s-size: 445x278mm (17.5x10.9")
    s-diag: 525mm (20.7")
  Monitor-1: DVI-D-0 res: 1680x1050 hz: 60 dpi: 90
    size: 474x296mm (18.7x11.7") diag: 559mm (22")
  Message: Unable to show advanced data. Required tool glxinfo missing.
Audio:
  Device-1: NVIDIA GP107GL High Definition Audio driver: snd_hda_intel
    v: kernel bus-ID: 0a:00.1 chip-ID: 10de:0fb9 class-ID: 0403
  Device-2: AMD Starship/Matisse HD Audio vendor: ASUSTeK
    driver: snd_hda_intel v: kernel bus-ID: 0c:00.4 chip-ID: 1022:1487
    class-ID: 0403
  Device-3: Creative USB Sound Blaster HD type: USB
    driver: hid-generic,snd-usb-audio,usbhid bus-ID: 5-2.4:3 chip-ID: 041e:30d7
    class-ID: 0300 serial: <filter>
  Sound Server-1: ALSA v: k5.16.2-1-MANJARO running: yes
  Sound Server-2: JACK v: 1.9.20 running: no
  Sound Server-3: PulseAudio v: 15.0 running: yes
  Sound Server-4: PipeWire v: 0.3.43 running: no
Network:
  Device-1: Realtek RTL8125 2.5GbE vendor: ASUSTeK driver: r8169 v: kernel
    port: f000 bus-ID: 09:00.0 chip-ID: 10ec:8125 class-ID: 0200
  IF: enp9s0 state: up speed: 1000 Mbps duplex: full mac: <filter>
  IP v4: <filter> type: dynamic noprefixroute scope: global
    broadcast: <filter>
  IP v6: <filter> type: dynamic noprefixroute scope: global
  IP v6: <filter> type: noprefixroute scope: link
  WAN IP: <filter>
Bluetooth:
  Message: No bluetooth data found.
Logical:
  Message: No logical block device data found.
RAID:
  Message: No RAID data found.
Drives:
  Local Storage: total: 5 TiB used: 2.09 TiB (41.8%)
  SMART Message: Unable to run smartctl. Root privileges required.
  ID-1: /dev/nvme0n1 maj-min: 259:0 vendor: Seagate
    model: FireCuda 520 SSD ZP1000GM30002 size: 931.51 GiB block-size:
    physical: 512 B logical: 512 B speed: 63.2 Gb/s lanes: 4 type: SSD
    serial: <filter> rev: STNSC014 temp: 36.9 C scheme: GPT
  ID-2: /dev/sda maj-min: 8:0 vendor: Western Digital
    model: WD20EZRX-22D8PB0 size: 1.82 TiB block-size: physical: 4096 B
    logical: 512 B speed: 6.0 Gb/s type: HDD rpm: 5400 serial: <filter>
    rev: 0A80 scheme: MBR
  ID-3: /dev/sdb maj-min: 8:16 vendor: Western Digital
    model: WD5000AAKS-00V1A0 size: 465.76 GiB block-size: physical: 512 B
    logical: 512 B speed: 3.0 Gb/s type: N/A serial: <filter> rev: 1D05
    scheme: MBR
  ID-4: /dev/sdc maj-min: 8:32 type: USB vendor: Western Digital
    model: WD20EARX-00PASB0 size: 1.82 TiB block-size: physical: 512 B
    logical: 512 B type: N/A serial: <filter> rev: 2021 scheme: MBR
  Optical-1: /dev/sr0 vendor: ATAPI model: iHAS324 F rev: CL8M
    dev-links: cdrom
  Features: speed: 48 multisession: yes audio: yes dvd: yes
    rw: cd-r,cd-rw,dvd-r state: running
Partition:
  ID-1: / raw-size: 217.42 GiB size: 212.95 GiB (97.94%) used: 37 GiB (17.4%)
    fs: ext4 dev: /dev/nvme0n1p2 maj-min: 259:2 label: N/A
    uuid: 24831e2c-db3a-430a-9d27-6f176c38314a
  ID-2: /boot/efi raw-size: 300 MiB size: 299.4 MiB (99.80%)
    used: 288 KiB (0.1%) fs: vfat dev: /dev/nvme0n1p1 maj-min: 259:1 label: N/A
    uuid: 744D-4741
  ID-3: /home raw-size: 711.84 GiB size: 699.6 GiB (98.28%)
    used: 61.83 GiB (8.8%) fs: ext4 dev: /dev/nvme0n1p4 maj-min: 259:4
    label: N/A uuid: 776583a5-6267-4392-be50-7a28533e179d
  ID-4: /run/media/martin/Data raw-size: 1.82 TiB size: 1.82 TiB (100.00%)
    used: 524.42 GiB (28.1%) fs: ntfs dev: /dev/sda1 maj-min: 8:1 label: Data
    uuid: E21A34941A3467A5
  ID-5: /run/media/martin/Music Store raw-size: 1.82 TiB
    size: 1.82 TiB (100.00%) used: 1.38 TiB (75.7%) fs: ntfs dev: /dev/sdc1
    maj-min: 8:33 label: Music Store uuid: 643E5EAC3E5E76D0
  ID-6: /run/timeshift/backup raw-size: 465.76 GiB size: 457.38 GiB (98.20%)
    used: 108.71 GiB (23.8%) fs: ext4 dev: /dev/sdb1 maj-min: 8:17 label: Crypt
    uuid: 3c0e08cd-6241-4c09-a846-adc6770141a9
Swap:
  Kernel: swappiness: 60 (default) cache-pressure: 100 (default)
  ID-1: swap-1 type: partition size: 1.95 GiB used: 0 KiB (0.0%)
    priority: -2 dev: /dev/nvme0n1p3 maj-min: 259:3 label: N/A
    uuid: 9180326d-c9a3-4e59-ab97-5fffad85ee93
Unmounted:
  Message: No unmounted partitions found.
USB:
  Hub-1: 1-0:1 info: Hi-speed hub with single TT ports: 10 rev: 2.0
    speed: 480 Mb/s chip-ID: 1d6b:0002 class-ID: 0900
  Device-1: 1-2:2 info: Cherry type: Keyboard,HID driver: hid-generic,usbhid
    interfaces: 2 rev: 2.0 speed: 1.5 Mb/s power: 100mA chip-ID: 046a:0076
    class-ID: 0300
  Device-2: 1-6:3 info: ASUSTek AURA LED Controller type: HID
    driver: hid-generic,usbhid interfaces: 2 rev: 2.0 speed: 12 Mb/s power: 16mA
    chip-ID: 0b05:1939 class-ID: 0300 serial: <filter>
  Hub-2: 1-7:4 info: Genesys Logic Hub ports: 4 rev: 2.0 speed: 480 Mb/s
    power: 100mA chip-ID: 05e3:0610 class-ID: 0900
  Device-1: 1-7.2:5 info: Alcor Micro Flash Card Reader/Writer
    type: Mass Storage driver: usb-storage interfaces: 1 rev: 2.0
    speed: 480 Mb/s power: 250mA chip-ID: 058f:6362 class-ID: 0806
    serial: <filter>
  Hub-3: 2-0:1 info: Super-speed hub ports: 4 rev: 3.1 speed: 10 Gb/s
    chip-ID: 1d6b:0003 class-ID: 0900
  Hub-4: 3-0:1 info: Hi-speed hub with single TT ports: 1 rev: 2.0
    speed: 480 Mb/s chip-ID: 1d6b:0002 class-ID: 0900
  Hub-5: 3-1:2 info: VIA Labs Hub ports: 4 rev: 2.1 speed: 480 Mb/s
    power: 100mA chip-ID: 2109:3431 class-ID: 0900
  Hub-6: 4-0:1 info: Super-speed hub ports: 4 rev: 3.0 speed: 5 Gb/s
    chip-ID: 1d6b:0003 class-ID: 0900
  Hub-7: 5-0:1 info: Hi-speed hub with single TT ports: 2 rev: 2.0
    speed: 480 Mb/s chip-ID: 1d6b:0002 class-ID: 0900
  Hub-8: 5-2:2 info: Hitachi ports: 4 rev: 2.1 speed: 480 Mb/s
    chip-ID: 045b:0209 class-ID: 0900
  Device-1: 5-2.4:3 info: Creative USB Sound Blaster HD type: Audio,HID
    driver: hid-generic,snd-usb-audio,usbhid interfaces: 6 rev: 1.1
    speed: 12 Mb/s power: 500mA chip-ID: 041e:30d7 class-ID: 0300
    serial: <filter>
  Hub-9: 6-0:1 info: Super-speed hub ports: 2 rev: 3.0 speed: 5 Gb/s
    chip-ID: 1d6b:0003 class-ID: 0900
  Hub-10: 6-2:2 info: Hitachi ports: 4 rev: 3.0 speed: 5 Gb/s
    chip-ID: 045b:0210 class-ID: 0900
  Hub-11: 7-0:1 info: Hi-speed hub with single TT ports: 4 rev: 2.0
    speed: 480 Mb/s chip-ID: 1d6b:0002 class-ID: 0900
  Device-1: 7-1:2 info: Logitech M105 Optical Mouse type: Mouse
    driver: hid-generic,usbhid interfaces: 1 rev: 2.0 speed: 1.5 Mb/s
    power: 100mA chip-ID: 046d:c077 class-ID: 0301
  Device-2: 7-2:3 info: Western Digital Elements Desktop (WDBAAU)
    type: Mass Storage driver: usb-storage interfaces: 1 rev: 2.0
    speed: 480 Mb/s power: 2mA chip-ID: 1058:1021 class-ID: 0806
    serial: <filter>
  Hub-12: 8-0:1 info: Super-speed hub ports: 4 rev: 3.1 speed: 10 Gb/s
    chip-ID: 1d6b:0003 class-ID: 0900
Sensors:
  System Temperatures: cpu: N/A mobo: N/A gpu: nvidia temp: 29 C
  Fan Speeds (RPM): N/A gpu: nvidia fan: 30%
Info:
  Processes: 408 Uptime: 25m wakeups: 0 Init: systemd v: 250 tool: systemctl
  Compilers: gcc: 11.1.0 clang: 13.0.0 Packages: 1415 pacman: 1393 lib: 370
  flatpak: 16 snap: 6 Shell: Bash v: 5.1.16 running-in: xfce4-terminal
  inxi: 3.3.12```

Hello, after trying some other options I have settled on Freefilesync for the moment which seems to fulfil my needs. I’m not entirely happy (it takes 10 mins every time to read to drives again) but it is certainly faster than using Grsync!

Thanks to all who took the time to read my post.

rsync bases its sync on:

  • checksum

  • timestamp

  • If you base on checksum, it has to read every file completely (on source and destination), create a checksum, and then decide to transfer something or not. This is slow, but won´t miss any changed files.

  • If you base on timestamps, rsync will consider files with the same name, length, and timestamp as unchanged. This is fast. But this will only work good if both filesystems do use the same sort of timestamps. (otherwise it will fall back to checksum)

If one filesystem does have an other representation of timestamps this can´t work. (for example timestamps between fat32 and ext2 have different resolution)

There is an option to ignore differences in timestamps smaller than … sec. This is what you need.

Please provide Information:

Providing the filesystems used would have helped to suggest a good solution

:man_shrugging:

This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.