[mdlug] Hard drive issue I/O error

[Mathew Enders]

I have been having an issue with one of the dard drives in the PDC for
Gaudior the school where MDLUG meets.  Here is basically what happens:

Everything will be fine for several days (number is random and varies
has been as many as 8 days or as few as 1) however sometimes when I come
in there are ton of I/O errors for the backup drive generated when the
nightly rsync runs.  I can not even ls into where I assume the error is
coming from it is one specific directory # /staffbak/share I get the
following error when I attempt this:

ARDVARC:~# ls /staffbak/share
ls: reading directory /staffbak/share: Input/output error
ARDVARC:~#    

The directory right above reads fine

ARDVARC:~# ls /staffbak
0006ah  0007yb  0304mr  0403jb  0405sb  0506ml  0606mk  9607rg  9806js
9901tt  9907jm
0007cg  0104ms  0307je  0403ss  0502cl  0602jp  0606sm  9702cg  9807eg
9904fp  lost+found
0007cj  0207el  0401db  0405dp  0505jm  0606kj  0703ll  9803sw  9807ml
9905gs  share
ARDVARC:~#  

Any help with this would be appreciated.  What could be causinf this?
Is it a bad drive?  Would a reformat of that drive fix the issue?

Here is a copy of dmesg from last nights run:

EXT3-fs error (device hdg1): ext3_find_entry: reading directory #1409025
offset 0
end_request: I/O error, dev hdg, sector 22626367
EXT3-fs error (device hdg1): ext3_find_entry: reading directory #1409025
offset 0
end_request: I/O error, dev hdg, sector 22626367
EXT3-fs error (device hdg1): ext3_find_entry: reading directory #1409025
offset 0
end_request: I/O error, dev hdg, sector 22626367
EXT3-fs error (device hdg1): ext3_find_entry: reading directory #1409025
offset 0
end_request: I/O error, dev hdg, sector 22626367
EXT3-fs error (device hdg1): ext3_find_entry: reading directory #1409025
offset 0
end_request: I/O error, dev hdg, sector 22626367
EXT3-fs error (device hdg1): ext3_find_entry: reading directory #1409025
offset 0
end_request: I/O error, dev hdg, sector 22626367
EXT3-fs error (device hdg1): ext3_find_entry: reading directory #1409025
offset 0
end_request: I/O error, dev hdg, sector 22626367
EXT3-fs error (device hdg1): ext3_find_entry: reading directory #1409025
offset 0
end_request: I/O error, dev hdg, sector 244318287
EXT3-fs error (device hdg1): ext3_get_inode_loc: unable to read inode
block - inode=15269889, block=30539778
end_request: I/O error, dev hdg, sector 288456767
end_request: I/O error, dev hdg, sector 902744382
end_request: I/O error, dev hdg, sector 697485630
end_request: I/O error, dev hdg, sector 683067710
end_request: I/O error, dev hdg, sector 844286270
end_request: I/O error, dev hdg, sector 599705918
end_request: I/O error, dev hdg, sector 879151422
end_request: I/O error, dev hdg, sector 697747774
end_request: I/O error, dev hdg, sector 950454590
end_request: I/O error, dev hdg, sector 867617086
end_request: I/O error, dev hdg, sector 855296318
end_request: I/O error, dev hdg, sector 679135550
end_request: I/O error, dev hdg, sector 926337342
end_request: I/O error, dev hdg, sector 888588606
end_request: I/O error, dev hdg, sector 728156478
end_request: I/O error, dev hdg, sector 970639678
end_request: I/O error, dev hdg, sector 874694974
end_request: I/O error, dev hdg, sector 638765374
end_request: I/O error, dev hdg, sector 759613758
end_request: I/O error, dev hdg, sector 881772862
end_request: I/O error, dev hdg, sector 860277054
end_request: I/O error, dev hdg, sector 605210942
end_request: I/O error, dev hdg, sector 658426174
end_request: I/O error, dev hdg, sector 892258622
end_request: I/O error, dev hdg, sector 814717262
end_request: I/O error, dev hdg, sector 758827326
end_request: I/O error, dev hdg, sector 908249406
end_request: I/O error, dev hdg, sector 709282110
end_request: I/O error, dev hdg, sector 721078590
end_request: I/O error, dev hdg, sector 931055934
end_request: I/O error, dev hdg, sector 521587006
end_request: I/O error, dev hdg, sector 692504894
end_request: I/O error, dev hdg, sector 965658942
end_request: I/O error, dev hdg, sector 496945470
end_request: I/O error, dev hdg, sector 907200830
end_request: I/O error, dev hdg, sector 717146430
end_request: I/O error, dev hdg, sector 584239422
end_request: I/O error, dev hdg, sector 926861630
end_request: I/O error, dev hdg, sector 648988990
end_request: I/O error, dev hdg, sector 672319806
end_request: I/O error, dev hdg, sector 598395198
end_request: I/O error, dev hdg, sector 753584446
end_request: I/O error, dev hdg, sector 553306430
end_request: I/O error, dev hdg, sector 923191614
end_request: I/O error, dev hdg, sector 747030846
end_request: I/O error, dev hdg, sector 681232702
end_request: I/O error, dev hdg, sector 536004926
end_request: I/O error, dev hdg, sector 790546750
end_request: I/O error, dev hdg, sector 920570174
end_request: I/O error, dev hdg, sector 894355774
end_request: I/O error, dev hdg, sector 826460478
end_request: I/O error, dev hdg, sector 851888446
end_request: I/O error, dev hdg, sector 859490622
end_request: I/O error, dev hdg, sector 545442110
end_request: I/O error, dev hdg, sector 658688318
end_request: I/O error, dev hdg, sector 669698366
end_request: I/O error, dev hdg, sector 905890110
end_request: I/O error, dev hdg, sector 590006590
end_request: I/O error, dev hdg, sector 898812222
end_request: I/O error, dev hdg, sector 678349118
end_request: I/O error, dev hdg, sector 845596990
end_request: I/O error, dev hdg, sector 927385918
end_request: I/O error, dev hdg, sector 864471358
end_request: I/O error, dev hdg, sector 570345790
end_request: I/O error, dev hdg, sector 766953790
end_request: I/O error, dev hdg, sector 898287934
end_request: I/O error, dev hdg, sector 764594494
end_request: I/O error, dev hdg, sector 764381518
EXT3-fs error (device hdg2): ext3_get_inode_loc: unable to read inode
block - inode=17252353, block=34504706
Aborting journal on device hdg2.
end_request: I/O error, dev hdg, sector 488356230
printk: 122 messages suppressed.
Buffer I/O error on device hdg2, logical block 1545
lost page write due to I/O error on hdg2
end_request: I/O error, dev hdg, sector 488343870
Buffer I/O error on device hdg2, logical block 0
lost page write due to I/O error on hdg2
EXT3-fs error (device hdg2) in ext3_reserve_inode_write: IO failure
end_request: I/O error, dev hdg, sector 488343870
Buffer I/O error on device hdg2, logical block 0
lost page write due to I/O error on hdg2
EXT3-fs error (device hdg2) in ext3_dirty_inode: IO failure
end_request: I/O error, dev hdg, sector 488343870
Buffer I/O error on device hdg2, logical block 0
lost page write due to I/O error on hdg2
end_request: I/O error, dev hdg, sector 944163134
ext3_abort called.
EXT3-fs error (device hdg2): ext3_journal_start_sb: Detected aborted
journal
Remounting filesystem read-only
end_request: I/O error, dev hdg, sector 729467198
end_request: I/O error, dev hdg, sector 732875070
end_request: I/O error, dev hdg, sector 536791358
end_request: I/O error, dev hdg, sector 731564350
end_request: I/O error, dev hdg, sector 510839102
end_request: I/O error, dev hdg, sector 521374030
Buffer I/O error on device hdg2, logical block 4128770
lost page write due to I/O error on hdg2
end_request: I/O error, dev hdg, sector 532384078
Buffer I/O error on device hdg2, logical block 5505026
lost page write due to I/O error on hdg2
end_request: I/O error, dev hdg, sector 534481230
Buffer I/O error on device hdg2, logical block 5767170
lost page write due to I/O error on hdg2
end_request: I/O error, dev hdg, sector 535791950
Buffer I/O error on device hdg2, logical block 5931010
lost page write due to I/O error on hdg2
end_request: I/O error, dev hdg, sector 536054094
Buffer I/O error on device hdg2, logical block 5963778
lost page write due to I/O error on hdg2
end_request: I/O error, dev hdg, sector 541034830
Buffer I/O error on device hdg2, logical block 6586370
lost page write due to I/O error on hdg2
end_request: I/O error, dev hdg, sector 545229134
end_request: I/O error, dev hdg, sector 551520590
end_request: I/O error, dev hdg, sector 553093454
end_request: I/O error, dev hdg, sector 555714894
end_request: I/O error, dev hdg, sector 570132814
end_request: I/O error, dev hdg, sector 584026446
end_request: I/O error, dev hdg, sector 589793614
end_request: I/O error, dev hdg, sector 598182222
end_request: I/O error, dev hdg, sector 599492942
end_request: I/O error, dev hdg, sector 604997966
end_request: I/O error, dev hdg, sector 606046542
end_request: I/O error, dev hdg, sector 630688078
end_request: I/O error, dev hdg, sector 636717390
end_request: I/O error, dev hdg, sector 638552398
end_request: I/O error, dev hdg, sector 639600974
end_request: I/O error, dev hdg, sector 648776014
end_request: I/O error, dev hdg, sector 658213198
end_request: I/O error, dev hdg, sector 658475342
end_request: I/O error, dev hdg, sector 669485390
end_request: I/O error, dev hdg, sector 672106830
end_request: I/O error, dev hdg, sector 678136142
end_request: I/O error, dev hdg, sector 678922574
end_request: I/O error, dev hdg, sector 681019726
end_request: I/O error, dev hdg, sector 682854734
end_request: I/O error, dev hdg, sector 690981198
end_request: I/O error, dev hdg, sector 692291918
end_request: I/O error, dev hdg, sector 697272654
end_request: I/O error, dev hdg, sector 697534798
end_request: I/O error, dev hdg, sector 698845518
end_request: I/O error, dev hdg, sector 709069134
end_request: I/O error, dev hdg, sector 713263438
end_request: I/O error, dev hdg, sector 716933454
end_request: I/O error, dev hdg, sector 720865614
end_request: I/O error, dev hdg, sector 727943502
end_request: I/O error, dev hdg, sector 731613518
end_request: I/O error, dev hdg, sector 737380686
end_request: I/O error, dev hdg, sector 746817870
end_request: I/O error, dev hdg, sector 753371470
end_request: I/O error, dev hdg, sector 753895758
end_request: I/O error, dev hdg, sector 758614350
end_request: I/O error, dev hdg, sector 759400782
end_request: I/O error, dev hdg, sector 766740814
end_request: I/O error, dev hdg, sector 774342990
end_request: I/O error, dev hdg, sector 790333774
end_request: I/O error, dev hdg, sector 808159566
end_request: I/O error, dev hdg, sector 814713166
end_request: I/O error, dev hdg, sector 818383182
end_request: I/O error, dev hdg, sector 818907470
end_request: I/O error, dev hdg, sector 823363918
end_request: I/O error, dev hdg, sector 826247502
end_request: I/O error, dev hdg, sector 836733262
end_request: I/O error, dev hdg, sector 844073294
end_request: I/O error, dev hdg, sector 845384014
end_request: I/O error, dev hdg, sector 851675470
end_request: I/O error, dev hdg, sector 855083342
end_request: I/O error, dev hdg, sector 855607630
end_request: I/O error, dev hdg, sector 859277646
end_request: I/O error, dev hdg, sector 860064078
end_request: I/O error, dev hdg, sector 863209806
end_request: I/O error, dev hdg, sector 863734094
end_request: I/O error, dev hdg, sector 864258382
end_request: I/O error, dev hdg, sector 867404110
end_request: I/O error, dev hdg, sector 874481998
end_request: I/O error, dev hdg, sector 878938446
end_request: I/O error, dev hdg, sector 881559886
end_request: I/O error, dev hdg, sector 888375630
end_request: I/O error, dev hdg, sector 892045646
end_request: I/O error, dev hdg, sector 894142798
end_request: I/O error, dev hdg, sector 898074958
end_request: I/O error, dev hdg, sector 898599246
end_request: I/O error, dev hdg, sector 902531406
end_request: I/O error, dev hdg, sector 904628558
end_request: I/O error, dev hdg, sector 905677134
end_request: I/O error, dev hdg, sector 906987854
end_request: I/O error, dev hdg, sector 908036430
end_request: I/O error, dev hdg, sector 920357198
end_request: I/O error, dev hdg, sector 922978638
end_request: I/O error, dev hdg, sector 923765070
end_request: I/O error, dev hdg, sector 926124366
end_request: I/O error, dev hdg, sector 926648654
end_request: I/O error, dev hdg, sector 927172942
end_request: I/O error, dev hdg, sector 930842958
end_request: I/O error, dev hdg, sector 942115150
end_request: I/O error, dev hdg, sector 949455182
end_request: I/O error, dev hdg, sector 950241614
end_request: I/O error, dev hdg, sector 958892366
end_request: I/O error, dev hdg, sector 963610958
end_request: I/O error, dev hdg, sector 965445966
end_request: I/O error, dev hdg, sector 970426702
end_request: I/O error, dev hdg, sector 488352086
end_request: I/O error, dev hdg, sector 490965326
end_request: I/O error, dev hdg, sector 495683918
end_request: I/O error, dev hdg, sector 496732494
end_request: I/O error, dev hdg, sector 498829646
end_request: I/O error, dev hdg, sector 508266830
end_request: I/O error, dev hdg, sector 635095358
end_request: I/O error, dev hdg, sector 512411966
end_request: I/O error, dev hdg, sector 869976382
end_request: I/O error, dev hdg, sector 937085246
end_request: I/O error, dev hdg, sector 970377534
end_request: I/O error, dev hdg, sector 961464638
end_request: I/O error, dev hdg, sector 681494846
end_request: I/O error, dev hdg, sector 723700030
end_request: I/O error, dev hdg, sector 680184126
end_request: I/O error, dev hdg, sector 678086974
end_request: I/O error, dev hdg, sector 639289662
hde: dma_timer_expiry: dma status == 0x21
hde: DMA timeout error
hde: dma timeout error: status=0x58 { DriveReady SeekComplete
DataRequest }
ide: failed opcode was: unknown
hde: dma_timer_expiry: dma status == 0x21
hde: DMA timeout error
hde: dma timeout error: status=0x58 { DriveReady SeekComplete
DataRequest }
ide: failed opcode was: unknown
hde: dma_timer_expiry: dma status == 0x21
hde: DMA timeout error
hde: dma timeout error: status=0x58 { DriveReady SeekComplete
DataRequest }
ide: failed opcode was: unknown
hde: dma_timer_expiry: dma status == 0x21
hde: DMA timeout error
hde: dma timeout error: status=0x58 { DriveReady SeekComplete
DataRequest }
ide: failed opcode was: unknown
end_request: I/O error, dev hdg, sector 12383
printk: 95 messages suppressed.
Buffer I/O error on device hdg1, logical block 1540
EXT3-fs error (device hdg1): ext3_readdir: directory #11 contains a hole
at offset 0
end_request: I/O error, dev hdg, sector 12391
Buffer I/O error on device hdg1, logical block 1541
end_request: I/O error, dev hdg, sector 12399
Buffer I/O error on device hdg1, logical block 1542
end_request: I/O error, dev hdg, sector 12407
Buffer I/O error on device hdg1, logical block 1543
end_request: I/O error, dev hdg, sector 12415
Buffer I/O error on device hdg1, logical block 1544
end_request: I/O error, dev hdg, sector 12391
EXT3-fs error (device hdg1): ext3_readdir: directory #11 contains a hole
at offset 4096
end_request: I/O error, dev hdg, sector 12431
Buffer I/O error on device hdg1, logical block 1546
end_request: I/O error, dev hdg, sector 12439
Buffer I/O error on device hdg1, logical block 1547
end_request: I/O error, dev hdg, sector 12447
Buffer I/O error on device hdg1, logical block 1548
end_request: I/O error, dev hdg, sector 12455
Buffer I/O error on device hdg1, logical block 1549
end_request: I/O error, dev hdg, sector 12463
Buffer I/O error on device hdg1, logical block 1550
end_request: I/O error, dev hdg, sector 12471
end_request: I/O error, dev hdg, sector 12479
end_request: I/O error, dev hdg, sector 12399
EXT3-fs error (device hdg1): ext3_readdir: directory #11 contains a hole
at offset 8192
end_request: I/O error, dev hdg, sector 12407
EXT3-fs error (device hdg1): ext3_readdir: directory #11 contains a hole
at offset 12288
end_request: I/O error, dev hdg, sector 488356190
EXT3-fs error (device hdg2): ext3_readdir: directory #11 contains a hole
at offset 0
end_request: I/O error, dev hdg, sector 488356198
end_request: I/O error, dev hdg, sector 488356206
end_request: I/O error, dev hdg, sector 488356214
end_request: I/O error, dev hdg, sector 488356222
end_request: I/O error, dev hdg, sector 488356198
EXT3-fs error (device hdg2): ext3_readdir: directory #11 contains a hole
at offset 4096
end_request: I/O error, dev hdg, sector 488356238
end_request: I/O error, dev hdg, sector 488356246
end_request: I/O error, dev hdg, sector 488356254
end_request: I/O error, dev hdg, sector 488356262
end_request: I/O error, dev hdg, sector 488356270
end_request: I/O error, dev hdg, sector 488356278
end_request: I/O error, dev hdg, sector 488356286
end_request: I/O error, dev hdg, sector 488356206
EXT3-fs error (device hdg2): ext3_readdir: directory #11 contains a hole
at offset 8192
end_request: I/O error, dev hdg, sector 488356214
EXT3-fs error (device hdg2): ext3_readdir: directory #11 contains a hole
at offset 12288
end_request: I/O error, dev hdg, sector 22626367
ARDVARC:~#