<div dir="ltr">Good morning,<div><br></div><div>Any advice on how to remove those stale device mapper entries? </div><div><br></div><div>Thank you,</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, May 25, 2017 at 12:52 PM, Joel Diaz <span dir="ltr"><<a href="mailto:mrjoeldiaz@gmail.com" target="_blank">mrjoeldiaz@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="auto"><div><div dir="auto">Sahina,</div><div dir="auto"><br></div><div dir="auto">I believe you're correct regarding the stale devicemapper entries.</div><div dir="auto"><br></div><div dir="auto">Before this started happening, I added a new iscsi storage domain. Host 1 couldn't communicate with it and the engine kept setting host 1 as non-operational. I removed the iscsi domain to get host 1 working again but the other two host must still think the iscsi storage is attached.</div><div dir="auto"><br></div><div dir="auto">Below is the ouput from both hosts.</div><div dir="auto"><p style="font-family:sans-serif;font-size:13.696px">root@<host2> ~]# lvm lvs -a --unit k --nosuffix --nameprefixes --unquoted --noheadings -ovg_name,lv_name,lv_uuid,lv_s<wbr>ize,lv_attr,segtype<u></u><u></u></p><span class=""><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000f05a<wbr>ea0f2b50f8d76e5: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p></span><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000f05a<wbr>ea0f2b50f8d76e5: read failed after 0 of 4096 at 1099511562240: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000f05a<wbr>ea0f2b50f8d76e5: read failed after 0 of 4096 at 1099511619584: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000f05a<wbr>ea0f2b50f8d76e5: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/metadata: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/metadata: read failed after 0 of 4096 at 536805376: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/metadata: read failed after 0 of 4096 at 536862720: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/metadata: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/ids: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/ids: read failed after 0 of 4096 at 134152192: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/ids: read failed after 0 of 4096 at 134209536: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/ids: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/leases: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/leases: read failed after 0 of 4096 at <a href="tel:%28214%29%20741-8112" style="text-decoration-line:none;color:rgb(66,133,244)" target="_blank">2147418112</a>: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/leases: read failed after 0 of 4096 at <a href="tel:%28214%29%20747-5456" style="text-decoration-line:none;color:rgb(66,133,244)" target="_blank">2147475456</a>: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/leases: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/outbox: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/outbox: read failed after 0 of 4096 at 134152192: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/outbox: read failed after 0 of 4096 at 134209536: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/outbox: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/xleases: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/xleases: read failed after 0 of 4096 at 1073676288: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/xleases: read failed after 0 of 4096 at 1073733632: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/xleases: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/inbox: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/inbox: read failed after 0 of 4096 at 134152192: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/inbox: read failed after 0 of 4096 at 134209536: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/inbox: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/master: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/master: read failed after 0 of 4096 at 1073676288: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/master: read failed after 0 of 4096 at 1073733632: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/master: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000b8e8<wbr>21765d5febefda2: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000b8e8<wbr>21765d5febefda2: read failed after 0 of 4096 at 536870846464: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000b8e8<wbr>21765d5febefda2: read failed after 0 of 4096 at 536870903808: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000b8e8<wbr>21765d5febefda2: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=centos_ovirt-hyp-<wbr>02 LVM2_LV_NAME=home LVM2_LV_UUID=WmKd5N-uhew-w2uu-<wbr>P5Qy-Xpeq-quDz-LrLM3n LVM2_LV_SIZE=63627264.00 LVM2_LV_ATTR=-wi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=centos_ovirt-hyp-<wbr>02 LVM2_LV_NAME=root LVM2_LV_UUID=qeFOoZ-3WR0-LX2J-<wbr>BZXh-oo9u-mqXJ-NRJkq3 LVM2_LV_SIZE=52428800.00 LVM2_LV_ATTR=-wi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=centos_ovirt-hyp-<wbr>02 LVM2_LV_NAME=swap LVM2_LV_UUID=FQ6NIv-N5bc-uo6Q-<wbr>IdZS-i6XL-Y4TQ-5mOkSd LVM2_LV_SIZE=8192000.00 LVM2_LV_ATTR=-wi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=gluster_lv_data LVM2_LV_UUID=nhoFx5-aHEd-ZUe4-<wbr>eEuI-FItR-I0nJ-JS1wD3 LVM2_LV_SIZE=681574400.00 LVM2_LV_ATTR=Vwi-aotz-- LVM2_SEGTYPE=thin<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=gluster_lv_engine LVM2_LV_UUID=QAyxti-wHCB-LqEF-<wbr>HVdK-S1KM-i99p-QBhCun LVM2_LV_SIZE=26214400.00 LVM2_LV_ATTR=-wi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=gluster_lv_export LVM2_LV_UUID=Gb4qNx-djQV-85oW-<wbr>l8Q8-3AfH-zvoa-Y4EFie LVM2_LV_SIZE=104857600.00 LVM2_LV_ATTR=Vwi-aotz-- LVM2_SEGTYPE=thin<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=gluster_lv_iso LVM2_LV_UUID=9zHjQd-QW21-Nu5C-<wbr>8ggR-y3R7-TgsV-b1ydGp LVM2_LV_SIZE=52428800.00 LVM2_LV_ATTR=Vwi-aotz-- LVM2_SEGTYPE=thin<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=gluster_thinpool_<wbr>sdb LVM2_LV_UUID=F8J1Uh-So1O-2cju-<wbr>su1W-BFxI-cgfe-QBYpuT LVM2_LV_SIZE=838860800.00 LVM2_LV_ATTR=twi-aotz-- LVM2_SEGTYPE=thin-pool<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=[gluster_thinpool<wbr>_sdb_tdata] LVM2_LV_UUID=gkWCVU-yYuE-iqvU-<wbr>9p79-k8Oq-EK4g-kBg6py LVM2_LV_SIZE=838860800.00 LVM2_LV_ATTR=Twi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=[gluster_thinpool<wbr>_sdb_tmeta] LVM2_LV_UUID=6VDVJo-AAgI-HcrP-<wbr>ANQM-qvgo-GMOp-HAYeQM LVM2_LV_SIZE=16777216.00 LVM2_LV_ATTR=ewi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=[lvol0_pmspare] LVM2_LV_UUID=STxeFv-0sl2-fCqz-<wbr>jm4q-kVB5-sek1-BwSVNc LVM2_LV_SIZE=16777216.00 LVM2_LV_ATTR=ewi------- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"><u></u> <u></u></p><p style="font-family:sans-serif;font-size:13.696px"> [root@<host3> ~]# lvm lvs -a --unit k --nosuffix --nameprefixes --unquoted --noheadings -ovg_name,lv_name,lv_uuid,lv_s<wbr>ize,lv_attr,segtype<u></u><u></u></p><span class=""><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000f05a<wbr>ea0f2b50f8d76e5: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p></span><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000f05a<wbr>ea0f2b50f8d76e5: read failed after 0 of 4096 at 1099511562240: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000f05a<wbr>ea0f2b50f8d76e5: read failed after 0 of 4096 at 1099511619584: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000f05a<wbr>ea0f2b50f8d76e5: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/metadata: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/metadata: read failed after 0 of 4096 at 536805376: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/metadata: read failed after 0 of 4096 at 536862720: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/metadata: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/outbox: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/outbox: read failed after 0 of 4096 at 134152192: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/outbox: read failed after 0 of 4096 at 134209536: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/outbox: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/xleases: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/xleases: read failed after 0 of 4096 at 1073676288: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/xleases: read failed after 0 of 4096 at 1073733632: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/xleases: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/leases: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/leases: read failed after 0 of 4096 at <a href="tel:%28214%29%20741-8112" style="text-decoration-line:none;color:rgb(66,133,244)" target="_blank">2147418112</a>: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/leases: read failed after 0 of 4096 at <a href="tel:%28214%29%20747-5456" style="text-decoration-line:none;color:rgb(66,133,244)" target="_blank">2147475456</a>: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/leases: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/ids: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/ids: read failed after 0 of 4096 at 134152192: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/ids: read failed after 0 of 4096 at 134209536: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/ids: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/inbox: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/inbox: read failed after 0 of 4096 at 134152192: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/inbox: read failed after 0 of 4096 at 134209536: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/inbox: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/master: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/master: read failed after 0 of 4096 at 1073676288: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/master: read failed after 0 of 4096 at 1073733632: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/master: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/d7e958f7-e307-4c33<wbr>-95ea-f98532ad6fd0: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/d7e958f7-e307-4c33<wbr>-95ea-f98532ad6fd0: read failed after 0 of 4096 at 21608988672: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/d7e958f7-e307-4c33<wbr>-95ea-f98532ad6fd0: read failed after 0 of 4096 at 21609046016: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/81f7db35-cff2-4592-bad7-5<wbr>5f437bb09ee/d7e958f7-e307-4c33<wbr>-95ea-f98532ad6fd0: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000b8e8<wbr>21765d5febefda2: read failed after 0 of 4096 at 0: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000b8e8<wbr>21765d5febefda2: read failed after 0 of 4096 at 536870846464: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000b8e<wbr>821765d5febefda2: read failed after 0 of 4096 at 536870903808: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> /dev/mapper/36589cfc000000b8e8<wbr>21765d5febefda2: read failed after 0 of 4096 at 4096: Input/output error<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=centos_ovirt-hyp-<wbr>03 LVM2_LV_NAME=home LVM2_LV_UUID=d4pR6F-JD7f-JR7F-<wbr>RjYv-EkB9-ka7b-4BVJqZ LVM2_LV_SIZE=63832064.00 LVM2_LV_ATTR=-wi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=centos_ovirt-hyp-<wbr>03 LVM2_LV_NAME=root LVM2_LV_UUID=Dk3ihf-qtXB-8h7m-<wbr>0zul-d9wo-oTGd-4gijh1 LVM2_LV_SIZE=52428800.00 LVM2_LV_ATTR=-wi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=centos_ovirt-hyp-<wbr>03 LVM2_LV_NAME=swap LVM2_LV_UUID=RVT0Wl-f3Kx-vxha-<wbr>CIFA-nK1M-IEeU-CNyFFu LVM2_LV_SIZE=8192000.00 LVM2_LV_ATTR=-wi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=gluster_lv_data LVM2_LV_UUID=ILg0Ym-l0M3-Zxg7-<wbr>heDz-VsDF-yfHJ-jy8gJG LVM2_LV_SIZE=10485760.00 LVM2_LV_ATTR=Vwi-aotz-- LVM2_SEGTYPE=thin<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=gluster_lv_engine LVM2_LV_UUID=NnIR9J-4PIP-ksQA-<wbr>PdpX-1epc-X5iT-Wk9qiO LVM2_LV_SIZE=10485760.00 LVM2_LV_ATTR=-wi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=gluster_lv_export LVM2_LV_UUID=z6hJeU-wb4z-WzHv-<wbr>jHKv-2sB5-BUoR-XK9zRf LVM2_LV_SIZE=10485760.00 LVM2_LV_ATTR=Vwi-aotz-- LVM2_SEGTYPE=thin<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=gluster_lv_iso LVM2_LV_UUID=kj9fMh-SBym-erPu-<wbr>sgOe-m6kU-TWsc-LmRP65 LVM2_LV_SIZE=10485760.00 LVM2_LV_ATTR=Vwi-aotz-- LVM2_SEGTYPE=thin<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=gluster_thinpool_<wbr>sdb LVM2_LV_UUID=FGu1eb-T273-fEY0-<wbr>pThE-lXXc-zBCs-OfEJkJ LVM2_LV_SIZE=73400320.00 LVM2_LV_ATTR=twi-aotz-- LVM2_SEGTYPE=thin-pool<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=[gluster_thinpool<wbr>_sdb_tdata] LVM2_LV_UUID=CnqJbS-o7XA-4XD0-<wbr>0nQ5-t3Wu-iRfW-Nc337j LVM2_LV_SIZE=73400320.00 LVM2_LV_ATTR=Twi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=[gluster_thinpool<wbr>_sdb_tmeta] LVM2_LV_UUID=f9KiCq-UUMN-eve1-<wbr>lqLK-0lAI-VRP5-ASKGPt LVM2_LV_SIZE=16777216.00 LVM2_LV_ATTR=ewi-ao---- LVM2_SEGTYPE=linear<u></u><u></u></p><p style="font-family:sans-serif;font-size:13.696px"> LVM2_VG_NAME=gluster_vg_sdb LVM2_LV_NAME=[lvol0_pmspare] LVM2_LV_UUID=C24xEs-njob-0E7Q-<wbr>vwJG-q814-FmMQ-ebrb33 LVM2_LV_SIZE=16777216.00 LVM2_LV_ATTR=ewi------- LVM2_SEGTYPE=linear</p><p style="font-family:sans-serif;font-size:13.696px">How can I clean that up?</p><p style="font-family:sans-serif;font-size:13.696px">Thank you,</p><p style="font-family:sans-serif;font-size:13.696px">Joel</p></div><div><div class="h5"><div dir="auto"><br></div><br><div class="gmail_extra"><br><div class="gmail_quote">On May 25, 2017 11:49 AM, "Sahina Bose" <<a href="mailto:sabose@redhat.com" target="_blank">sabose@redhat.com</a>> wrote:<br type="attribution"><blockquote class="m_6358480661061770401quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><div class="m_6358480661061770401quoted-text">On Thu, May 25, 2017 at 8:29 PM, Joel Diaz <span dir="ltr"><<a href="mailto:mrjoeldiaz@gmail.com" target="_blank">mrjoeldiaz@gmail.com</a>></span> wrote:<br><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="auto"><div>I almost forgot about python-blivet. All 3 hosts are on version 0.61.15.59-1.</div><div dir="auto"><br></div><div dir="auto">The hosts and engine were updated using the snapshot repo last week. I updated them just now. I just noticed that host 2 and required the same 20 updates but host 1 required an additional update, ovirt-engine-appliance.</div><div><div class="m_6358480661061770401m_384928107744163853gmail-h5"><div dir="auto"><br></div><div dir="auto"><br><div dir="auto" class="gmail_extra"><br><div class="gmail_quote">On May 25, 2017 10:40 AM, "Joel Diaz" <<a href="mailto:mrjoeldiaz@gmail.com" target="_blank">mrjoeldiaz@gmail.com</a>> wrote:<br type="attribution"><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="m_6358480661061770401m_384928107744163853gmail-m_7093712584706549904quote"><div dir="auto">Hello Sahina,<div dir="auto"><br></div><div dir="auto">Thanks for the response.</div><div dir="auto"><br></div><div dir="auto">Attached are the requested supervsdm logs from both hosts.</div></div></blockquote></div></div></div></div></div></div></blockquote><div><br></div></div><div>Seems to be an error returned by lvm module.<br><br></div><div>" lvm lvs -a --unit k --nosuffix --nameprefixes --unquoted --noheadings -ovg_name,lv_name,lv_uuid,lv_s<wbr>ize,lv_attr,segtype" - seems to throw this error. Can you check?<br><br></div><div>Do you have stale devicemapper entries on these hosts?<br><br></div><div class="m_6358480661061770401quoted-text"><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="auto"><div><div class="m_6358480661061770401m_384928107744163853gmail-h5"><div dir="auto"><div dir="auto" class="gmail_extra"><div class="gmail_quote"><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="m_6358480661061770401m_384928107744163853gmail-m_7093712584706549904quote"><div dir="auto"><font color="#888888"><div dir="auto"><br></div><div dir="auto">Joel</div><div dir="auto"><br></div><div dir="auto"><br></div></font></div><div class="m_6358480661061770401m_384928107744163853gmail-m_7093712584706549904elided-text"><div class="gmail_extra"><br><div class="gmail_quote">On May 25, 2017 5:41 AM, "Sahina Bose" <<a href="mailto:sabose@redhat.com" target="_blank">sabose@redhat.com</a>> wrote:<br type="attribution"><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="ltr"><div><div>Could you provide the supervdsm.log from either host2 or host3.<br><br></div>Were the packages on these hosts updated?<br></div>What's the version of python-blivet? Is this different from host1?<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 24, 2017 at 6:26 PM, Joel Diaz <span dir="ltr"><<a href="mailto:mrjoeldiaz@gmail.com" target="_blank">mrjoeldiaz@gmail.com</a>></span> wrote:<br><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="auto"><p style="font-family:sans-serif">Good morning oVirt community,</p><p style="font-family:sans-serif">I need some assistance.</p><p style="font-family:sans-serif">I am running a 3 host, hosted engine, gluster environment. The hosts are running centos 7.3 and the engine is version 4.1.2.3</p><p style="font-family:sans-serif">Since yesterday, every 2 hours, the engine reports the error below on host 2 and 3. <br></p><p style="font-family:sans-serif"><u></u></p><p style="font-family:sans-serif">event ID 10802<u></u><u></u></p><p style="font-family:sans-serif">VDSM <host> command GetStorageDeviceListVDS failed: 'gluster_vg_sdb-/dev/mapper/36<wbr>589cfc000000f05aea0f2b50f8d76e<wbr>5: read failed after 0 of 4096 at 0: Input/output error'</p><p style="font-family:sans-serif">I've attached logs from both hosts. Hosts 3 is the SPM and holds the arbiter brick of all 4 gluster volumes.</p><p style="font-family:sans-serif">As always, your help is appreciated.</p><span class="m_6358480661061770401m_384928107744163853gmail-m_7093712584706549904m_5283642286326427326m_-2378387538378335199HOEnZb"><font color="#888888"><p style="font-family:sans-serif">Joel</p><br></font></span></div>
<br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a rel="noreferrer" href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
<br></blockquote></div><br></div>
</blockquote></div></div>
</div></blockquote></div><br></div></div></div></div></div>
</blockquote></div></div><br></div></div>
</blockquote></div><br></div></div></div></div></div>
</blockquote></div><br></div>