Hi,
Server: Linksys WRT32X OpenWrt 19.07.3 with USB HDD
Client: Opensuse 15.1
Wired connection
In a previous thread about nfs here, I had some difficulties to run nfs without outage. Very often when I was writing my HDD through nfs, it stopped and freeze the client file manager Caja/Nautilus. I had to kill the process and had error in the HDD (fsck, superblock).
For the last 3 days, it was a lot better, no issue.
Today, I started to fill my HDD with data. I made 7 transfers with command line
time rsync -r /path/to/dir /mnt/HD5/media/to/dir; sync
Total around 280GB+144GB+25GB+130GB+250GB+26GB+5GB without any issue.
I was running again the command to transfer 240GB more and it stopped:
HDD LED stopped
Server network LED steady
Client command line waiting, I can't enter command
Client GUI file manager Caja with hourglass
Client dmesg
[19277.145775] nfs: server 192.168.1.1 not responding, still trying
[19278.170210] nfs: server 192.168.1.1 not responding, still trying
Server dmesg with ssh
[16776.980582] ieee80211 phy1: staid 1 deleted
[18044.331121] ieee80211 phy1: staid 1 deleted
[19052.914970] sd 2:0:0:0: [sda] tag#0 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[19052.923195] sd 2:0:0:0: [sda] tag#0 Sense Key : 0x5 [current]
[19052.929054] sd 2:0:0:0: [sda] tag#0 ASC=0x21 ASCQ=0x0
[19052.934223] sd 2:0:0:0: [sda] tag#0 CDB: opcode=0x2a 2a 00 00 29 ad 60 00 01 00 00
[19052.941828] print_req_error: critical target error, dev sda, sector 21850880
[19052.948916] EXT4-fs warning (device sda1): ext4_end_bio:323: I/O error 5 writing to inode 3609 (offset 43384832 size 6946816 starting block 2731616)
[19052.962279] Buffer I/O error on device sda1, logical block 2731104
[19052.968492] Buffer I/O error on device sda1, logical block 2731105
[19052.974700] Buffer I/O error on device sda1, logical block 2731106
[19052.980906] Buffer I/O error on device sda1, logical block 2731107
[19052.987116] Buffer I/O error on device sda1, logical block 2731108
[19052.993326] Buffer I/O error on device sda1, logical block 2731109
[19052.999533] Buffer I/O error on device sda1, logical block 2731110
[19053.005743] Buffer I/O error on device sda1, logical block 2731111
[19053.011949] Buffer I/O error on device sda1, logical block 2731112
[19053.018158] Buffer I/O error on device sda1, logical block 2731113
[19057.656691] JBD2: Detected IO errors while flushing file data on sda1-8
[19417.811721] sd 2:0:0:0: timing out command, waited 360s
[19417.816978] sd 2:0:0:0: [sda] tag#0 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[19417.825211] sd 2:0:0:0: [sda] tag#0 Sense Key : 0x4 [current]
[19417.831073] sd 2:0:0:0: [sda] tag#0 ASC=0x44 ASCQ=0x0
[19417.836247] sd 2:0:0:0: [sda] tag#0 CDB: opcode=0x35 35 00 00 00 00 00 00 00 00 00
[19417.843862] print_req_error: I/O error, dev sda, sector 3905672064
[19417.850092] Aborting journal on device sda1-8.
[19778.000254] sd 2:0:0:0: timing out command, waited 360s
[19778.005513] sd 2:0:0:0: [sda] tag#0 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[19778.013739] sd 2:0:0:0: [sda] tag#0 Sense Key : 0x4 [current]
[19778.019598] sd 2:0:0:0: [sda] tag#0 ASC=0x44 ASCQ=0x0
[19778.024767] sd 2:0:0:0: [sda] tag#0 CDB: opcode=0x35 35 00 00 00 00 00 00 00 00 00
[19778.032385] print_req_error: I/O error, dev sda, sector 3905161216
[19778.038593] Buffer I/O error on dev sda1, logical block 488144896, lost sync page write
[19778.046687] JBD2: Error -5 detected when updating journal superblock for sda1-8.
[19778.255214] EXT4-fs (sda1): Delayed block allocation failed for inode 3610 at logical offset 10240 with max blocks 2048 with error 30
[19778.267277] EXT4-fs (sda1): This should not happen!! Data will be lost
[19778.267277]
[19778.275347] EXT4-fs error (device sda1) in ext4_writepages:2925: Journal has aborted
[20138.358912] sd 2:0:0:0: timing out command, waited 360s
[20138.364171] sd 2:0:0:0: [sda] tag#0 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[20138.372395] sd 2:0:0:0: [sda] tag#0 Sense Key : 0x4 [current]
[20138.378255] sd 2:0:0:0: [sda] tag#0 ASC=0x44 ASCQ=0x0
[20138.383426] sd 2:0:0:0: [sda] tag#0 CDB: opcode=0x35 35 00 00 00 00 00 00 00 00 00
[20138.391042] print_req_error: I/O error, dev sda, sector 2048
[20138.396727] Buffer I/O error on dev sda1, logical block 0, lost sync page write
[20138.404076] EXT4-fs error (device sda1): ext4_journal_check_start:61: Detected aborted journal
[20138.412781] EXT4-fs (sda1): Remounting filesystem read-only
[20138.418389] EXT4-fs (sda1): previous I/O error to superblock detected
[20498.574796] sd 2:0:0:0: timing out command, waited 360s
[20498.580056] sd 2:0:0:0: [sda] tag#0 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[20498.588290] sd 2:0:0:0: [sda] tag#0 Sense Key : 0x4 [current]
[20498.594151] sd 2:0:0:0: [sda] tag#0 ASC=0x44 ASCQ=0x0
[20498.599322] sd 2:0:0:0: [sda] tag#0 CDB: opcode=0x35 35 00 00 00 00 00 00 00 00 00
[20498.606941] print_req_error: I/O error, dev sda, sector 2048
[20498.612627] Buffer I/O error on dev sda1, logical block 0, lost sync page write
[20498.620021] nfsd: peername failed (err 107)!
[20498.624493] EXT4-fs (sda1): previous I/O error to superblock detected
[20498.631045] nfsd: peername failed (err 107)!
[20498.635722] nfsd: peername failed (err 107)!
[20498.640125] nfsd: peername failed (err 107)!
[20498.644479] nfsd: peername failed (err 107)!
After about 10 more mn waiting I have a return in the client command
rsync: [sender] write error: Broken pipe (32)
rsync: close failed on "/mnt/HD5/media/path/to/file QzrK2s": Read-only file system (30)
rsync error: error in file IO (code 11) at receiver.c(853) [receiver=3.1.3]
It looks like an HDD issue, could you confirm?
Any idea why it happen? Due to nfs?
And how to fix permanently?
Edit:
With file manager (Caja) HDD is read-only but dir and files have nobody: create and delete, nogroup .
I can't delete the last directory
Last info in server dmesg
[20498.640125] nfsd: peername failed (err 107)!
[20498.644479] nfsd: peername failed (err 107)!
[20858.788268] sd 2:0:0:0: timing out command, waited 360s
[20858.793527] sd 2:0:0:0: [sda] tag#0 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[20858.801752] sd 2:0:0:0: [sda] tag#0 Sense Key : 0x4 [current]
[20858.807612] sd 2:0:0:0: [sda] tag#0 ASC=0x44 ASCQ=0x0
[20858.812778] sd 2:0:0:0: [sda] tag#0 CDB: opcode=0x35 35 00 00 00 00 00 00 00 00 00
[20858.820393] print_req_error: I/O error, dev sda, sector 2048
[20858.826079] Buffer I/O error on dev sda1, logical block 0, lost sync page write
[20859.123492] JBD2: Detected IO errors while flushing file data on sda1-8