Re: adding hosts problems with GlusterFS
I think we are in a race to see who can get a new HCI setup built faster. There have been a few hurtles along the way :) On Tue, Jul 31, 2018, 6:53 AM Bill Dossett, <bill.dossett@pb.com> wrote:
Hmm, resounding silence…. Have attached a screen shot of the host storage devices on the host I added after the initial deployment. So at the bottom you can see that sdb – sdg are all locked and FS type is multipath_member those all equate to the UID type NAME at the top. The very top row, I created a brick, so it is also now locked, however when I go to brick view there is no brick. I also can’t seem to delete any brick one it is created either. On the first 3 hosts, sdb – sdg are all unlocked and I can create bricks… going to remove a host and re-add it to see if there is anything I am missing, but I don’t have any other ideas at this point.
Regards, Bill
*Bill Dossett*
DevOps Ninja
AWS-DevOps-Pro <https://aws.amazon.com/certification/certified-devops-engineer-professional/> , AWS-SA-A <https://aws.amazon.com/certification/certified-solutions-architect-associate/> VCAP-DCA <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30483&ui=www_cert>, VCAP-DCD <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30484&ui=www_cert>, MCSA Win Server
*IT – Software Innovation Solutions*
*M* +1 303-725 8163
bill.dossett@pb.com
pitneybowes.com
*Pitney Bowes*
4750 Walnut Street
Boulder CO, 80301
[image: sis]
Learn more about Software Innovation Solutions <http://teamsite.inside.pb.com/sites/TCPPM/GES/SitePages/Home.aspx>
In Engineering, Software Support or Professional Services?
*Raise a ticket via Remedy Anywhere [HERE <http://teamsite.inside.pb.com/sites/TCPPM/GES/Lists/Create%20Incident/newIncident.aspx>] takes less than a minute*
*CloudForms User Guide available [HERE <https://teamsite.inside.pb.com/sites/TCPPM/GES/SiteAssets/TC%20Knowledge%20Base/Cloudforms%20User%20Guide/Cloudforms%20-%20User%20Manual%20PB%20v3.pdf>]*
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/AR3D4HLVTAQPEU...
Yeah, for sure, I think I made it over my last one yesterday…. Going to start building out my storage today. I had to get down into the OS and work with the logical volume manager commands a bit to clean up some of my mess and also figured out how to blacklist the disks on my 4th and 5th host from multipath…. So that’s encouraging… if you need a hand feel free to ping me. From: Jayme [mailto:jaymef@gmail.com] Sent: Tuesday, July 31, 2018 5:11 AM To: Bill Dossett <bill.dossett@pb.com> Cc: users <users@ovirt.org> Subject: [ovirt-users] Re: adding hosts problems with GlusterFS I think we are in a race to see who can get a new HCI setup built faster. There have been a few hurtles along the way :) On Tue, Jul 31, 2018, 6:53 AM Bill Dossett, <bill.dossett@pb.com <mailto:bill.dossett@pb.com> > wrote: Hmm, resounding silence…. Have attached a screen shot of the host storage devices on the host I added after the initial deployment. So at the bottom you can see that sdb – sdg are all locked and FS type is multipath_member those all equate to the UID type NAME at the top. The very top row, I created a brick, so it is also now locked, however when I go to brick view there is no brick. I also can’t seem to delete any brick one it is created either. On the first 3 hosts, sdb – sdg are all unlocked and I can create bricks… going to remove a host and re-add it to see if there is anything I am missing, but I don’t have any other ideas at this point. Regards, Bill Bill Dossett DevOps Ninja <https://aws.amazon.com/certification/certified-devops-engineer-professional/> AWS-DevOps-Pro, <https://aws.amazon.com/certification/certified-solutions-architect-associate/> AWS-SA-A <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30483&ui=www_cert> VCAP-DCA, <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30484&ui=www_cert> VCAP-DCD, MCSA Win Server IT – Software Innovation Solutions M +1 303-725 8163 bill.dossett@pb.com <mailto:bill.dossett@pb.com> <http://pitneybowes.com> pitneybowes.com Pitney Bowes 4750 Walnut Street Boulder CO, 80301 <http://teamsite.inside.pb.com/sites/TCPPM/GES/SitePages/Home.aspx> Learn more about Software Innovation Solutions In Engineering, Software Support or Professional Services? Raise a ticket via Remedy Anywhere [ <http://teamsite.inside.pb.com/sites/TCPPM/GES/Lists/Create%20Incident/newIncident.aspx> HERE] takes less than a minute CloudForms User Guide available [ <https://teamsite.inside.pb.com/sites/TCPPM/GES/SiteAssets/TC%20Knowledge%20Base/Cloudforms%20User%20Guide/Cloudforms%20-%20User%20Manual%20PB%20v3.pdf> HERE] _______________________________________________ Users mailing list -- users@ovirt.org <mailto:users@ovirt.org> To unsubscribe send an email to users-leave@ovirt.org <mailto:users-leave@ovirt.org> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/AR3D4HLVTAQPEU...
Is the brick creation failing from UI? Can you run "gluster volume status" and check brick created or not? If bricks creation failing then Looks like multipath is causing issue.I think you need to clear multipath entries and try. On Tue, Jul 31, 2018 at 7:01 PM, William Dossett <william.dossett@gmail.com> wrote:
Yeah, for sure, I think I made it over my last one yesterday…. Going to start building out my storage today. I had to get down into the OS and work with the logical volume manager commands a bit to clean up some of my mess and also figured out how to blacklist the disks on my 4th and 5th host from multipath…. So that’s encouraging… if you need a hand feel free to ping me.
*From:* Jayme [mailto:jaymef@gmail.com] *Sent:* Tuesday, July 31, 2018 5:11 AM *To:* Bill Dossett <bill.dossett@pb.com> *Cc:* users <users@ovirt.org> *Subject:* [ovirt-users] Re: adding hosts problems with GlusterFS
I think we are in a race to see who can get a new HCI setup built faster. There have been a few hurtles along the way :)
On Tue, Jul 31, 2018, 6:53 AM Bill Dossett, <bill.dossett@pb.com> wrote:
Hmm, resounding silence…. Have attached a screen shot of the host storage devices on the host I added after the initial deployment. So at the bottom you can see that sdb – sdg are all locked and FS type is multipath_member those all equate to the UID type NAME at the top. The very top row, I created a brick, so it is also now locked, however when I go to brick view there is no brick. I also can’t seem to delete any brick one it is created either. On the first 3 hosts, sdb – sdg are all unlocked and I can create bricks… going to remove a host and re-add it to see if there is anything I am missing, but I don’t have any other ideas at this point.
Regards, Bill
*Bill Dossett*
DevOps Ninja
AWS-DevOps-Pro <https://aws.amazon.com/certification/certified-devops-engineer-professional/> , AWS-SA-A <https://aws.amazon.com/certification/certified-solutions-architect-associate/> VCAP-DCA <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30483&ui=www_cert>, VCAP-DCD <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30484&ui=www_cert>, MCSA Win Server
*IT – Software Innovation Solutions*
*M* +1 303-725 8163
bill.dossett@pb.com
pitneybowes.com
*Pitney Bowes*
4750 Walnut Street
Boulder CO, 80301
[image: sis]
Learn more about Software Innovation Solutions <http://teamsite.inside.pb.com/sites/TCPPM/GES/SitePages/Home.aspx>
In Engineering, Software Support or Professional Services?
*Raise a ticket via Remedy Anywhere [HERE <http://teamsite.inside.pb.com/sites/TCPPM/GES/Lists/Create%20Incident/newIncident.aspx>] takes less than a minute*
*CloudForms User Guide available [HERE <https://teamsite.inside.pb.com/sites/TCPPM/GES/SiteAssets/TC%20Knowledge%20Base/Cloudforms%20User%20Guide/Cloudforms%20-%20User%20Manual%20PB%20v3.pdf>]*
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community- guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/ message/AR3D4HLVTAQPEU774BP5LQYRHPP4234X/
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community- guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/ message/WOGYCVC5YLEYHH6HDHABIH2P5EQ7BQZO/
-- Thanks, Gobinda
Try doing a multipath -ll and if that displays anything try flushing with multipath -F On Tue, Jul 31, 2018 at 10:55 AM, Gobinda Das <godas@redhat.com> wrote:
Is the brick creation failing from UI? Can you run "gluster volume status" and check brick created or not? If bricks creation failing then Looks like multipath is causing issue.I think you need to clear multipath entries and try.
On Tue, Jul 31, 2018 at 7:01 PM, William Dossett < william.dossett@gmail.com> wrote:
Yeah, for sure, I think I made it over my last one yesterday…. Going to start building out my storage today. I had to get down into the OS and work with the logical volume manager commands a bit to clean up some of my mess and also figured out how to blacklist the disks on my 4th and 5th host from multipath…. So that’s encouraging… if you need a hand feel free to ping me.
*From:* Jayme [mailto:jaymef@gmail.com] *Sent:* Tuesday, July 31, 2018 5:11 AM *To:* Bill Dossett <bill.dossett@pb.com> *Cc:* users <users@ovirt.org> *Subject:* [ovirt-users] Re: adding hosts problems with GlusterFS
I think we are in a race to see who can get a new HCI setup built faster. There have been a few hurtles along the way :)
On Tue, Jul 31, 2018, 6:53 AM Bill Dossett, <bill.dossett@pb.com> wrote:
Hmm, resounding silence…. Have attached a screen shot of the host storage devices on the host I added after the initial deployment. So at the bottom you can see that sdb – sdg are all locked and FS type is multipath_member those all equate to the UID type NAME at the top. The very top row, I created a brick, so it is also now locked, however when I go to brick view there is no brick. I also can’t seem to delete any brick one it is created either. On the first 3 hosts, sdb – sdg are all unlocked and I can create bricks… going to remove a host and re-add it to see if there is anything I am missing, but I don’t have any other ideas at this point.
Regards, Bill
*Bill Dossett*
DevOps Ninja
AWS-DevOps-Pro <https://aws.amazon.com/certification/certified-devops-engineer-professional/> , AWS-SA-A <https://aws.amazon.com/certification/certified-solutions-architect-associate/> VCAP-DCA <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30483&ui=www_cert>, VCAP-DCD <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30484&ui=www_cert>, MCSA Win Server
*IT – Software Innovation Solutions*
*M* +1 303-725 8163
bill.dossett@pb.com
pitneybowes.com
*Pitney Bowes*
4750 Walnut Street <https://maps.google.com/?q=4750+Walnut+Street+Boulder+CO,+80301&entry=gmail&source=g>
Boulder CO, 80301 <https://maps.google.com/?q=4750+Walnut+Street+Boulder+CO,+80301&entry=gmail&source=g>
[image: sis]
Learn more about Software Innovation Solutions <http://teamsite.inside.pb.com/sites/TCPPM/GES/SitePages/Home.aspx>
In Engineering, Software Support or Professional Services?
*Raise a ticket via Remedy Anywhere [HERE <http://teamsite.inside.pb.com/sites/TCPPM/GES/Lists/Create%20Incident/newIncident.aspx>] takes less than a minute*
*CloudForms User Guide available [HERE <https://teamsite.inside.pb.com/sites/TCPPM/GES/SiteAssets/TC%20Knowledge%20Base/Cloudforms%20User%20Guide/Cloudforms%20-%20User%20Manual%20PB%20v3.pdf>]*
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/communit y/about/community-guidelines/ List Archives: https://lists.ovirt.org/archiv es/list/users@ovirt.org/message/AR3D4HLVTAQPEU774BP5LQYRHPP4234X/
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/communit y/about/community-guidelines/ List Archives: https://lists.ovirt.org/archiv es/list/users@ovirt.org/message/WOGYCVC5YLEYHH6HDHABIH2P5EQ7BQZO/
-- Thanks, Gobinda
Blacklisting the disks in multipath.conf did the trick, all good now. When adding a new host, the process should run that blacklist all disks shell script like the cockpit deploy does… if I may be so bold to suggest 😊 From: Jayme [mailto:jaymef@gmail.com] Sent: Tuesday, July 31, 2018 9:48 AM To: Gobinda Das <godas@redhat.com> Cc: William Dossett <william.dossett@gmail.com>; Bill Dossett <bill.dossett@pb.com>; users <users@ovirt.org> Subject: Re: [ovirt-users] Re: adding hosts problems with GlusterFS Try doing a multipath -ll and if that displays anything try flushing with multipath -F On Tue, Jul 31, 2018 at 10:55 AM, Gobinda Das <godas@redhat.com <mailto:godas@redhat.com> > wrote: Is the brick creation failing from UI? Can you run "gluster volume status" and check brick created or not? If bricks creation failing then Looks like multipath is causing issue.I think you need to clear multipath entries and try. On Tue, Jul 31, 2018 at 7:01 PM, William Dossett <william.dossett@gmail.com <mailto:william.dossett@gmail.com> > wrote: Yeah, for sure, I think I made it over my last one yesterday…. Going to start building out my storage today. I had to get down into the OS and work with the logical volume manager commands a bit to clean up some of my mess and also figured out how to blacklist the disks on my 4th and 5th host from multipath…. So that’s encouraging… if you need a hand feel free to ping me. From: Jayme [mailto:jaymef@gmail.com <mailto:jaymef@gmail.com> ] Sent: Tuesday, July 31, 2018 5:11 AM To: Bill Dossett <bill.dossett@pb.com <mailto:bill.dossett@pb.com> > Cc: users <users@ovirt.org <mailto:users@ovirt.org> > Subject: [ovirt-users] Re: adding hosts problems with GlusterFS I think we are in a race to see who can get a new HCI setup built faster. There have been a few hurtles along the way :) On Tue, Jul 31, 2018, 6:53 AM Bill Dossett, <bill.dossett@pb.com <mailto:bill.dossett@pb.com> > wrote: Hmm, resounding silence…. Have attached a screen shot of the host storage devices on the host I added after the initial deployment. So at the bottom you can see that sdb – sdg are all locked and FS type is multipath_member those all equate to the UID type NAME at the top. The very top row, I created a brick, so it is also now locked, however when I go to brick view there is no brick. I also can’t seem to delete any brick one it is created either. On the first 3 hosts, sdb – sdg are all unlocked and I can create bricks… going to remove a host and re-add it to see if there is anything I am missing, but I don’t have any other ideas at this point. Regards, Bill Bill Dossett DevOps Ninja <https://aws.amazon.com/certification/certified-devops-engineer-professional/> AWS-DevOps-Pro, <https://aws.amazon.com/certification/certified-solutions-architect-associate/> AWS-SA-A <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30483&ui=www_cert> VCAP-DCA, <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30484&ui=www_cert> VCAP-DCD, MCSA Win Server IT – Software Innovation Solutions M +1 303-725 8163 bill.dossett@pb.com <mailto:bill.dossett@pb.com> <http://pitneybowes.com> pitneybowes.com Pitney Bowes 4750 Walnut Street <https://maps.google.com/?q=4750+Walnut+Street+Boulder+CO,+80301&entry=gmail&source=g> Boulder CO, 80301 <https://maps.google.com/?q=4750+Walnut+Street+Boulder+CO,+80301&entry=gmail&source=g> <http://teamsite.inside.pb.com/sites/TCPPM/GES/SitePages/Home.aspx> Learn more about Software Innovation Solutions In Engineering, Software Support or Professional Services? Raise a ticket via Remedy Anywhere [ <http://teamsite.inside.pb.com/sites/TCPPM/GES/Lists/Create%20Incident/newIncident.aspx> HERE] takes less than a minute CloudForms User Guide available [ <https://teamsite.inside.pb.com/sites/TCPPM/GES/SiteAssets/TC%20Knowledge%20Base/Cloudforms%20User%20Guide/Cloudforms%20-%20User%20Manual%20PB%20v3.pdf> HERE] _______________________________________________ Users mailing list -- users@ovirt.org <mailto:users@ovirt.org> To unsubscribe send an email to users-leave@ovirt.org <mailto:users-leave@ovirt.org> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/AR3D4HLVTAQPEU... _______________________________________________ Users mailing list -- users@ovirt.org <mailto:users@ovirt.org> To unsubscribe send an email to users-leave@ovirt.org <mailto:users-leave@ovirt.org> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/WOGYCVC5YLEYHH... -- Thanks, Gobinda
On Tue, Jul 31, 2018 at 9:46 PM, William Dossett <william.dossett@gmail.com> wrote:
Blacklisting the disks in multipath.conf did the trick, all good now.
When adding a new host, the process should run that blacklist all disks shell script like the cockpit deploy does… if I may be so bold to suggest 😊
Once we have https://bugzilla.redhat.com/show_bug.cgi?id=1593459 this fixed, in 4.2.6 you should not have any issue.
*From:* Jayme [mailto:jaymef@gmail.com] *Sent:* Tuesday, July 31, 2018 9:48 AM *To:* Gobinda Das <godas@redhat.com> *Cc:* William Dossett <william.dossett@gmail.com>; Bill Dossett < bill.dossett@pb.com>; users <users@ovirt.org> *Subject:* Re: [ovirt-users] Re: adding hosts problems with GlusterFS
Try doing a multipath -ll and if that displays anything try flushing with multipath -F
On Tue, Jul 31, 2018 at 10:55 AM, Gobinda Das <godas@redhat.com> wrote:
Is the brick creation failing from UI? Can you run "gluster volume status" and check brick created or not?
If bricks creation failing then Looks like multipath is causing issue.I think you need to clear multipath entries and try.
On Tue, Jul 31, 2018 at 7:01 PM, William Dossett < william.dossett@gmail.com> wrote:
Yeah, for sure, I think I made it over my last one yesterday…. Going to start building out my storage today. I had to get down into the OS and work with the logical volume manager commands a bit to clean up some of my mess and also figured out how to blacklist the disks on my 4th and 5th host from multipath…. So that’s encouraging… if you need a hand feel free to ping me.
*From:* Jayme [mailto:jaymef@gmail.com] *Sent:* Tuesday, July 31, 2018 5:11 AM *To:* Bill Dossett <bill.dossett@pb.com> *Cc:* users <users@ovirt.org> *Subject:* [ovirt-users] Re: adding hosts problems with GlusterFS
I think we are in a race to see who can get a new HCI setup built faster. There have been a few hurtles along the way :)
On Tue, Jul 31, 2018, 6:53 AM Bill Dossett, <bill.dossett@pb.com> wrote:
Hmm, resounding silence…. Have attached a screen shot of the host storage devices on the host I added after the initial deployment. So at the bottom you can see that sdb – sdg are all locked and FS type is multipath_member those all equate to the UID type NAME at the top. The very top row, I created a brick, so it is also now locked, however when I go to brick view there is no brick. I also can’t seem to delete any brick one it is created either. On the first 3 hosts, sdb – sdg are all unlocked and I can create bricks… going to remove a host and re-add it to see if there is anything I am missing, but I don’t have any other ideas at this point.
Regards, Bill
*Bill Dossett*
DevOps Ninja
AWS-DevOps-Pro <https://aws.amazon.com/certification/certified-devops-engineer-professional/> , AWS-SA-A <https://aws.amazon.com/certification/certified-solutions-architect-associate/> VCAP-DCA <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30483&ui=www_cert>, VCAP-DCD <http://mylearn.vmware.com/mgrReg/plan.cfm?plan=30484&ui=www_cert>, MCSA Win Server
*IT – Software Innovation Solutions*
*M* +1 303-725 8163
bill.dossett@pb.com
pitneybowes.com
*Pitney Bowes*
4750 Walnut Street <https://maps.google.com/?q=4750+Walnut+Street+Boulder+CO,+80301&entry=gmail&source=g>
Boulder CO, 80301 <https://maps.google.com/?q=4750+Walnut+Street+Boulder+CO,+80301&entry=gmail&source=g>
Learn more about Software Innovation Solutions <http://teamsite.inside.pb.com/sites/TCPPM/GES/SitePages/Home.aspx>
In Engineering, Software Support or Professional Services?
*Raise a ticket via Remedy Anywhere [HERE <http://teamsite.inside.pb.com/sites/TCPPM/GES/Lists/Create%20Incident/newIncident.aspx>] takes less than a minute*
*CloudForms User Guide available [HERE <https://teamsite.inside.pb.com/sites/TCPPM/GES/SiteAssets/TC%20Knowledge%20Base/Cloudforms%20User%20Guide/Cloudforms%20-%20User%20Manual%20PB%20v3.pdf>]*
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community- guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/ message/AR3D4HLVTAQPEU774BP5LQYRHPP4234X/
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community- guidelines/
List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/ message/WOGYCVC5YLEYHH6HDHABIH2P5EQ7BQZO/
--
Thanks,
Gobinda
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community- guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/ message/HT3SIFUR3RYP5G4NNG2STR6H2UQUHZBO/
participants (4)
-
Gobinda Das -
Jayme -
Sahina Bose -
William Dossett