Join Log in
Score:0
Bo Breese avatar Server

MDADM Raid 5 stuck on "Check Status 98% Complete"

ec flag
Bo Breese

I have an ubuntu server running that works like a NVR and stores recordings from a IP Camera over the network. It worked fine for a little over a month, then today when I went to check on it, it hadn't received any recordings since Sunday. I realized the Raid 5 Array/MDADM is basically in a frozen state. Anytime I try to open one of the directories on the array or delete a file/folder it just hangs. This is what the mdadm status is showing:

/dev/md0:

           Version : 1.2
     Creation Time : Wed Apr 28 15:16:56 2021
        Raid Level : raid5
        Array Size : 3906764800 (3725.78 GiB 4000.53 GB)
     Used Dev Size : 1953382400 (1862.89 GiB 2000.26 GB)
      Raid Devices : 3
     Total Devices : 3
       Persistence : Superblock is persistent

     Intent Bitmap : Internal

       Update Time : Mon Jun  7 04:31:14 2021
             State : active, checking
    Active Devices : 3
   Working Devices : 3
    Failed Devices : 0
     Spare Devices : 0

            Layout : left-symmetric
        Chunk Size : 512K

Consistency Policy : bitmap

      Check Status : 98% complete

              Name : nas:0  (local to host nas)
              UUID : 15d44d4c:c292a2d1:c67565a3:b64af408
            Events : 25655

    Number   Major   Minor   RaidDevice State
       0       8       16        0      active sync   /dev/sdb
       1       8       32        1      active sync   /dev/sdc
       3       8       48        2      active sync   /dev/sdd

It seems to just be stuck on "State : active, checking 98% complete" - Yet all 3 of the raid drives show as working. Any ideas?

Here is the dmesg output: https://pastebin.com/FH5wE8wF

126
0 + 1
Mike Andrews avatar
ng flag
Mike Andrews
It looks like `/dev/sdb` is probably toast. Fail it out (`mdadm -f /dev/md0 /dev/sdb`), pop in a spare, and add it to the array. If you don't have a spare, order one now. Then, when sdb is out of the array test it out in another machine. Check smart stats, see if you can read some of those sectors from your kernel logs.
0
Reply
ธงชาติไทย
Elon Musk
I sit in a Tesla and translated this thread with Ai:

mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.