Data missing in a degraded zfs pool












-1















This is my first attempt to create a zfs pool manually under Proxmox.



I have created a raidz2 zfs pool with 5 drives (4 WD RED 1TB NAS drives and 1 old 1TB Seagate). I also forgot to specify 2 spares, so I ended up with 5 drives in the pool.
One of the HD stopped working properly (sometimes showing as FAULTED, sometimes as UNAVAIL) and the pool became degraded.



    NAME                                          STATE     READ WRITE CKSUM
storage DEGRADED 0 0 0
raidz2-0 DEGRADED 0 0 0
ata-ST31000524AS_9VPCK7DZ ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J1AKT5C7 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J1AKTPZ9 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J2RS3EP8 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J2YX0L9Z FAULTED 0 0 1 too many errors


I have also created a couple of subdirectories in order to separate the data from the VM's (eg: /storage/share/iso. /storage/share/Movies ...)



storage/share is to be mounted and shared via NFS by a VM.
storage/vmstorage is where the vm's are stored.



NAME                                  USED  AVAIL  REFER  MOUNTPOINT
storage 415G 2.19T 170K /storage
storage/repos 170K 2.19T 170K /storage/repos
storage/share 400G 2.19T 397G /storage/share
storage/share/Backups 170K 2.19T 170K /storage/share/Backups
storage/share/BuildDrop 170K 2.19T 170K /storage/share/BuildDrop
storage/share/Movies 170K 2.19T 170K /storage/share/Movies
storage/share/Software 170K 2.19T 170K /storage/share/Software
storage/share/Tv Shows 170K 2.19T 170K /storage/share/Tv Shows
storage/share/iso 3.21G 2.19T 3.21G /storage/share/iso
storage/vmstorage 14.8G 2.19T 199K /storage/vmstorage
storage/vmstorage/subvol-100-disk-1 850M 7.17G 850M /storage/vmstorage/subvol-100-disk-1
storage/vmstorage/subvol-101-disk-1 894M 7.13G 894M /storage/vmstorage/subvol-101-disk-1
storage/vmstorage/subvol-102-disk-1 1.06G 6.94G 1.06G /storage/vmstorage/subvol-102-disk-1
storage/vmstorage/subvol-103-disk-1 667M 7.35G 667M /storage/vmstorage/subvol-103-disk-1
storage/vmstorage/subvol-104-disk-1 460M 7.55G 460M /storage/vmstorage/subvol-104-disk-1
storage/vmstorage/subvol-108-disk-0 795M 7.22G 795M /storage/vmstorage/subvol-108-disk-0


I was able to access the shared folder from the network and use it as a normal network share with no issues, until the disk broke.
I had some data under the /storage/share/* that just disappeared. VM's are fine.



Shouldn't the data still be accessible even in a degraded mode?



Thanks for any help !










share|improve this question























  • why the downvote? would you mind explaining?

    – Mo7
    Jan 15 at 2:25


















-1















This is my first attempt to create a zfs pool manually under Proxmox.



I have created a raidz2 zfs pool with 5 drives (4 WD RED 1TB NAS drives and 1 old 1TB Seagate). I also forgot to specify 2 spares, so I ended up with 5 drives in the pool.
One of the HD stopped working properly (sometimes showing as FAULTED, sometimes as UNAVAIL) and the pool became degraded.



    NAME                                          STATE     READ WRITE CKSUM
storage DEGRADED 0 0 0
raidz2-0 DEGRADED 0 0 0
ata-ST31000524AS_9VPCK7DZ ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J1AKT5C7 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J1AKTPZ9 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J2RS3EP8 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J2YX0L9Z FAULTED 0 0 1 too many errors


I have also created a couple of subdirectories in order to separate the data from the VM's (eg: /storage/share/iso. /storage/share/Movies ...)



storage/share is to be mounted and shared via NFS by a VM.
storage/vmstorage is where the vm's are stored.



NAME                                  USED  AVAIL  REFER  MOUNTPOINT
storage 415G 2.19T 170K /storage
storage/repos 170K 2.19T 170K /storage/repos
storage/share 400G 2.19T 397G /storage/share
storage/share/Backups 170K 2.19T 170K /storage/share/Backups
storage/share/BuildDrop 170K 2.19T 170K /storage/share/BuildDrop
storage/share/Movies 170K 2.19T 170K /storage/share/Movies
storage/share/Software 170K 2.19T 170K /storage/share/Software
storage/share/Tv Shows 170K 2.19T 170K /storage/share/Tv Shows
storage/share/iso 3.21G 2.19T 3.21G /storage/share/iso
storage/vmstorage 14.8G 2.19T 199K /storage/vmstorage
storage/vmstorage/subvol-100-disk-1 850M 7.17G 850M /storage/vmstorage/subvol-100-disk-1
storage/vmstorage/subvol-101-disk-1 894M 7.13G 894M /storage/vmstorage/subvol-101-disk-1
storage/vmstorage/subvol-102-disk-1 1.06G 6.94G 1.06G /storage/vmstorage/subvol-102-disk-1
storage/vmstorage/subvol-103-disk-1 667M 7.35G 667M /storage/vmstorage/subvol-103-disk-1
storage/vmstorage/subvol-104-disk-1 460M 7.55G 460M /storage/vmstorage/subvol-104-disk-1
storage/vmstorage/subvol-108-disk-0 795M 7.22G 795M /storage/vmstorage/subvol-108-disk-0


I was able to access the shared folder from the network and use it as a normal network share with no issues, until the disk broke.
I had some data under the /storage/share/* that just disappeared. VM's are fine.



Shouldn't the data still be accessible even in a degraded mode?



Thanks for any help !










share|improve this question























  • why the downvote? would you mind explaining?

    – Mo7
    Jan 15 at 2:25
















-1












-1








-1








This is my first attempt to create a zfs pool manually under Proxmox.



I have created a raidz2 zfs pool with 5 drives (4 WD RED 1TB NAS drives and 1 old 1TB Seagate). I also forgot to specify 2 spares, so I ended up with 5 drives in the pool.
One of the HD stopped working properly (sometimes showing as FAULTED, sometimes as UNAVAIL) and the pool became degraded.



    NAME                                          STATE     READ WRITE CKSUM
storage DEGRADED 0 0 0
raidz2-0 DEGRADED 0 0 0
ata-ST31000524AS_9VPCK7DZ ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J1AKT5C7 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J1AKTPZ9 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J2RS3EP8 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J2YX0L9Z FAULTED 0 0 1 too many errors


I have also created a couple of subdirectories in order to separate the data from the VM's (eg: /storage/share/iso. /storage/share/Movies ...)



storage/share is to be mounted and shared via NFS by a VM.
storage/vmstorage is where the vm's are stored.



NAME                                  USED  AVAIL  REFER  MOUNTPOINT
storage 415G 2.19T 170K /storage
storage/repos 170K 2.19T 170K /storage/repos
storage/share 400G 2.19T 397G /storage/share
storage/share/Backups 170K 2.19T 170K /storage/share/Backups
storage/share/BuildDrop 170K 2.19T 170K /storage/share/BuildDrop
storage/share/Movies 170K 2.19T 170K /storage/share/Movies
storage/share/Software 170K 2.19T 170K /storage/share/Software
storage/share/Tv Shows 170K 2.19T 170K /storage/share/Tv Shows
storage/share/iso 3.21G 2.19T 3.21G /storage/share/iso
storage/vmstorage 14.8G 2.19T 199K /storage/vmstorage
storage/vmstorage/subvol-100-disk-1 850M 7.17G 850M /storage/vmstorage/subvol-100-disk-1
storage/vmstorage/subvol-101-disk-1 894M 7.13G 894M /storage/vmstorage/subvol-101-disk-1
storage/vmstorage/subvol-102-disk-1 1.06G 6.94G 1.06G /storage/vmstorage/subvol-102-disk-1
storage/vmstorage/subvol-103-disk-1 667M 7.35G 667M /storage/vmstorage/subvol-103-disk-1
storage/vmstorage/subvol-104-disk-1 460M 7.55G 460M /storage/vmstorage/subvol-104-disk-1
storage/vmstorage/subvol-108-disk-0 795M 7.22G 795M /storage/vmstorage/subvol-108-disk-0


I was able to access the shared folder from the network and use it as a normal network share with no issues, until the disk broke.
I had some data under the /storage/share/* that just disappeared. VM's are fine.



Shouldn't the data still be accessible even in a degraded mode?



Thanks for any help !










share|improve this question














This is my first attempt to create a zfs pool manually under Proxmox.



I have created a raidz2 zfs pool with 5 drives (4 WD RED 1TB NAS drives and 1 old 1TB Seagate). I also forgot to specify 2 spares, so I ended up with 5 drives in the pool.
One of the HD stopped working properly (sometimes showing as FAULTED, sometimes as UNAVAIL) and the pool became degraded.



    NAME                                          STATE     READ WRITE CKSUM
storage DEGRADED 0 0 0
raidz2-0 DEGRADED 0 0 0
ata-ST31000524AS_9VPCK7DZ ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J1AKT5C7 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J1AKTPZ9 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J2RS3EP8 ONLINE 0 0 0
ata-WDC_WD10EFRX-68FYTN0_WD-WCC4J2YX0L9Z FAULTED 0 0 1 too many errors


I have also created a couple of subdirectories in order to separate the data from the VM's (eg: /storage/share/iso. /storage/share/Movies ...)



storage/share is to be mounted and shared via NFS by a VM.
storage/vmstorage is where the vm's are stored.



NAME                                  USED  AVAIL  REFER  MOUNTPOINT
storage 415G 2.19T 170K /storage
storage/repos 170K 2.19T 170K /storage/repos
storage/share 400G 2.19T 397G /storage/share
storage/share/Backups 170K 2.19T 170K /storage/share/Backups
storage/share/BuildDrop 170K 2.19T 170K /storage/share/BuildDrop
storage/share/Movies 170K 2.19T 170K /storage/share/Movies
storage/share/Software 170K 2.19T 170K /storage/share/Software
storage/share/Tv Shows 170K 2.19T 170K /storage/share/Tv Shows
storage/share/iso 3.21G 2.19T 3.21G /storage/share/iso
storage/vmstorage 14.8G 2.19T 199K /storage/vmstorage
storage/vmstorage/subvol-100-disk-1 850M 7.17G 850M /storage/vmstorage/subvol-100-disk-1
storage/vmstorage/subvol-101-disk-1 894M 7.13G 894M /storage/vmstorage/subvol-101-disk-1
storage/vmstorage/subvol-102-disk-1 1.06G 6.94G 1.06G /storage/vmstorage/subvol-102-disk-1
storage/vmstorage/subvol-103-disk-1 667M 7.35G 667M /storage/vmstorage/subvol-103-disk-1
storage/vmstorage/subvol-104-disk-1 460M 7.55G 460M /storage/vmstorage/subvol-104-disk-1
storage/vmstorage/subvol-108-disk-0 795M 7.22G 795M /storage/vmstorage/subvol-108-disk-0


I was able to access the shared folder from the network and use it as a normal network share with no issues, until the disk broke.
I had some data under the /storage/share/* that just disappeared. VM's are fine.



Shouldn't the data still be accessible even in a degraded mode?



Thanks for any help !







zfs






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Jan 12 at 1:24









Mo7Mo7

194




194













  • why the downvote? would you mind explaining?

    – Mo7
    Jan 15 at 2:25





















  • why the downvote? would you mind explaining?

    – Mo7
    Jan 15 at 2:25



















why the downvote? would you mind explaining?

– Mo7
Jan 15 at 2:25







why the downvote? would you mind explaining?

– Mo7
Jan 15 at 2:25












1 Answer
1






active

oldest

votes


















0














The storage/share dataset got somehow unmounted.
Mounting the zfs dataset again solved the issue !






share|improve this answer























    Your Answer








    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "3"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });














    draft saved

    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1393396%2fdata-missing-in-a-degraded-zfs-pool%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    0














    The storage/share dataset got somehow unmounted.
    Mounting the zfs dataset again solved the issue !






    share|improve this answer




























      0














      The storage/share dataset got somehow unmounted.
      Mounting the zfs dataset again solved the issue !






      share|improve this answer


























        0












        0








        0







        The storage/share dataset got somehow unmounted.
        Mounting the zfs dataset again solved the issue !






        share|improve this answer













        The storage/share dataset got somehow unmounted.
        Mounting the zfs dataset again solved the issue !







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Jan 15 at 2:24









        Mo7Mo7

        194




        194






























            draft saved

            draft discarded




















































            Thanks for contributing an answer to Super User!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid



            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1393396%2fdata-missing-in-a-degraded-zfs-pool%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            "Incorrect syntax near the keyword 'ON'. (on update cascade, on delete cascade,)

            Alcedinidae

            RAC Tourist Trophy