1. Created a lv on a VDO device, mounted on /gluster_bricks/brick 2. Created a new gluster brick on /gluster_bricks/brick/brick 3. Unable to add them new a new storage domain or import it. get a bunch of "finished disconnecting storage..." errors and nothing happens I've lost 30+ VMs due to previous issues with gluster deployment wizard, so I created drives manually to match settings from wizard, totally screwed now.
Hi, Can you send engine and vdsm log? On Tue, Jan 1, 2019 at 9:37 AM <michael@wanderingmad.com> wrote:
1. Created a lv on a VDO device, mounted on /gluster_bricks/brick 2. Created a new gluster brick on /gluster_bricks/brick/brick 3. Unable to add them new a new storage domain or import it.
get a bunch of "finished disconnecting storage..." errors and nothing happens I've lost 30+ VMs due to previous issues with gluster deployment wizard, so I created drives manually to match settings from wizard, totally screwed now. _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/2BKFCA7PYJHD2A...
-- Thanks, Gobinda
Today I went through and re-loaded all the hosts from bare metal, ran all the updates, created manual VDO storage, and manually created gluster using ovirt web interface, same issue adding storage domain. Gluster bricks are /gluster_bricks/ssd-storageone/ssd-storageone. Checking the hosts, they're not mounting the gluster storage anywhere, I think that's the problem, but can I run the gdeploy wizard and then increase the drive size? VDSM: 2019-01-02 17:11:41,485-0500 INFO (jsonrpc/2) [vdsm.api] START connectStorageServer(domType=7, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'mnt_options': u'backup-volfile-servers=10.100.50.14:10.100.50.12', u'id': u'00000000-0000-0000-0000-000000000000', u'connection': u'10.100.50.16:/ssd-storageone', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'vfs_type': u'glusterfs', u'password': '********', u'port': u''}], options=None) from=::ffff:172.16.9.202,58810, flow_id=5e9f8d6e-2b8e-4e6d-abda-d528fe7ae3a4, task_id=b0072909-c539-47ad-b03a-d19a237adae8 (api:46) 2019-01-02 17:11:41,683-0500 INFO (jsonrpc/2) [storage.StorageServer.MountConnection] Creating directory u'/rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone' (storageServer:167) 2019-01-02 17:11:41,683-0500 INFO (jsonrpc/2) [storage.fileUtils] Creating directory: /rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone mode: None (fileUtils:197) 2019-01-02 17:11:41,684-0500 INFO (jsonrpc/2) [storage.Mount] mounting 10.100.50.16:/ssd-storageone at /rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone (mount:204) 2019-01-02 17:11:41,944-0500 INFO (itmap/0) [IOProcessClient] (/glusterSD/10.100.50.16:_ssd-storageone) Starting client (__init__:308) 2019-01-02 17:11:41,952-0500 INFO (ioprocess/7805) [IOProcess] (/glusterSD/10.100.50.16:_ssd-storageone) Starting ioprocess (__init__:434) 2019-01-02 17:11:42,097-0500 INFO (jsonrpc/4) [vdsm.api] START connectStorageServer(domType=7, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'mnt_options': u'backup-volfile-servers=10.100.50.14:10.100.50.12', u'id': u'ab4b5ccb-3d8b-4fa5-add3-7534e3672772', u'connection': u'10.100.50.16:/ssd-storageone', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'vfs_type': u'glusterfs', u'password': '********', u'port': u''}], options=None) from=::ffff:172.16.9.202,58810, flow_id=300c8c7a, task_id=9d3955f7-c5d2-4242-b83b-10def6d2786b (api:46) 2019-01-02 17:11:42,107-0500 INFO (jsonrpc/6) [vdsm.api] START createStorageDomain(storageType=7, sdUUID=u'c68931fd-42d5-4b1e-9ad3-5933311da71d', domainName=u'Silver', typeSpecificArg=u'10.100.50.16:/ssd-storageone', domClass=1, domVersion=u'4', options=None) from=::ffff:172.16.9.202,58810, flow_id=300c8c7a, task_id=63f9d019-2df0-46f2-b50b-ac1 a42ee5a1a (api:46) 2019-01-02 17:11:42,466-0500 INFO (jsonrpc/6) [storage.StorageDomain] sdUUID=c68931fd-42d5-4b1e-9ad3-5933311da71d domainName=Silver remotePath=10.100.50.16:/ssd-storageone domClass=1 (nfsSD:70) 2019-01-02 17:11:42,500-0500 INFO (jsonrpc/6) [storage.StorageDomain] Creating domain metadata directory u'/rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone/c68931fd-42d5-4b1e-9ad3-5933311da71d/dom_md' (fileSD:450) 2019-01-02 17:11:42,576-0500 INFO (jsonrpc/6) [vdsm.api] FINISH createStorageDomain error=Command ['/usr/bin/dd', 'iflag=fullblock', u'of=/rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone/c68931fd-42d5-4b1e-9ad3-5933311da71d/dom_md/xleases', 'oflag=direct,seek_bytes', 'seek=1048576', 'bs=256512', 'count=1', 'conv=notrunc,nocreat,fsy nc'] failed with rc=1 out='[suppressed]' err="/usr/bin/dd: error writing '/rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone/c68931fd-42d5-4b1e-9ad3-5933311da71d/dom_md/xleases': Invalid argument\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.0186115 s, 0.0 kB/s\n" from=::ffff:172.16.9.202,58810, flow_id=300c8c7a, task_id=6 3f9d019-2df0-46f2-b50b-ac1a42ee5a1a (api:50) Error: Command ['/usr/bin/dd', 'iflag=fullblock', u'of=/rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone/c68931fd-42d5-4b1e-9ad3-5933311da71d/dom_md/xleases', 'oflag=direct,seek_bytes', 'seek=1048576', 'bs=256512', 'count=1', 'conv=notrunc,nocreat,fsync'] failed with rc=1 out='[suppressed]' err="/usr/bin/dd: error writing '/rhev/data -center/mnt/glusterSD/10.100.50.16:_ssd-storageone/c68931fd-42d5-4b1e-9ad3-5933311da71d/dom_md/xleases': Invalid argument\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.0186115 s, 0.0 kB/s\n" 2019-01-02 17:11:42,577-0500 INFO (jsonrpc/6) [storage.TaskManager.Task] (Task='63f9d019-2df0-46f2-b50b-ac1a42ee5a1a') aborting: Task is aborted: u'Command [\'/usr/bin/dd\', \'iflag=fullblock\', u\'of=/rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone/c68931fd-42d5-4b1e-9ad3-5933311da71d/dom_md/xleases\', \'oflag=direct,seek_bytes\', \'seek=1048576\', \'bs=256512\', \'count=1\', \'conv=notrunc,nocreat,fsync\'] failed with rc=1 out=\'[suppressed]\' err="/usr/bin/dd: error writing \'/rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone/c68931fd-42d5-4b1e-9ad3-5933311da71d/dom_md/xleases\': Invalid argument\\n1+0 records in\\n0+0 records out\\n0 bytes (0 B) copied, 0.0 186115 s, 0.0 kB/s\\n"' - code 100 (task:1181) 2019-01-02 17:11:42,577-0500 ERROR (jsonrpc/6) [storage.Dispatcher] FINISH createStorageDomain error=Command ['/usr/bin/dd', 'iflag=fullblock', u'of=/rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone/c68931fd-42d5-4b1e-9ad3-5933311da71d/dom_md/xleases', 'oflag=direct,seek_bytes', 'seek=1048576', 'bs=256512', 'count=1', 'conv=notrunc,n ocreat,fsync'] failed with rc=1 out='[suppressed]' err="/usr/bin/dd: error writing '/rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone/c68931fd-42d5-4b1e-9ad3-5933311da71d/dom_md/xleases': Invalid argument\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.0186115 s, 0.0 kB/s\n" (dispatcher:86) Error: Command ['/usr/bin/dd', 'iflag=fullblock', u'of=/rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone/c68931fd-42d5-4b1e-9ad3-5933311da71d/dom_md/xleases', 'oflag=direct,seek_bytes', 'seek=1048576', 'bs=256512', 'count=1', 'conv=notrunc,nocreat,fsync'] failed with rc=1 out='[suppressed]' err="/usr/bin/dd: error writing '/rhev/data -center/mnt/glusterSD/10.100.50.16:_ssd-storageone/c68931fd-42d5-4b1e-9ad3-5933311da71d/dom_md/xleases': Invalid argument\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.0186115 s, 0.0 kB/s\n" 2019-01-02 17:11:42,745-0500 INFO (jsonrpc/1) [vdsm.api] START disconnectStorageServer(domType=7, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'mnt_options': u'backup-volfile-servers=10.100.50.14:10.100.50.12', u'id': u'ab4b5ccb-3d8b-4fa5-add3-7534e3672772', u'connection': u'10.100.50.16:/ssd-storageone', u'iqn': u'', u'user': u' ', u'tpgt': u'1', u'vfs_type': u'glusterfs', u'password': '********', u'port': u''}], options=None) from=::ffff:172.16.9.202,58810, flow_id=b4ebe5ed-9626-43ca-a307-b3b3e7d01f2b, task_id=d8eb764a-bc46-46a6-9758-83cbc67529c3 (api:46) 2019-01-02 17:11:42,745-0500 INFO (jsonrpc/1) [storage.Mount] unmounting /rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone (mount:212) 2019-01-02 17:11:54,581-0500 INFO (jsonrpc/0) [vdsm.api] START connectStorageServer(domType=7, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'mnt_options': u'backup-volfile-servers=10.100.50.14:10.100.50.12', u'id': u'00000000-0000-0000-0000-000000000000', u'connection': u'10.100.50.16:/ssd-storageone', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'vfs_type': u'glusterfs', u'password': '********', u'port': u''}], options=None) from=::ffff:172.16.9.202,58810, flow_id=712a4a82-b947-4e18-b6e4-dacf0b09d4b4, task_id=0e24152e-c7e9-44b4-bc26-21648c00986a (api:46) 2019-01-02 17:11:54,775-0500 INFO (jsonrpc/0) [storage.StorageServer.MountConnection] Creating directory u'/rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone' (storageServer:167) 2019-01-02 17:11:54,775-0500 INFO (jsonrpc/0) [storage.fileUtils] Creating directory: /rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone mode: None (fileUtils:197) 2019-01-02 17:11:54,776-0500 INFO (jsonrpc/0) [storage.Mount] mounting 10.100.50.16:/ssd-storageone at /rhev/data-center/mnt/glusterSD/10.100.50.16:_ssd-storageone (mount:204) 2019-01-02 17:11:55,068-0500 INFO (jsonrpc/6) [vdsm.api] START connectStorageServer(domType=7, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'mnt_options': u'backup-volfile-servers=10.100.50.14:10.100.50.12', u'id': u'ddab3ffa-1165-4495-a7d0-7515b21c3c8e', u'connection': u'10.100.50.16:/ssd-storageone', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'vfs_type': u'glusterfs', u'password': '********', u'port': u''}], options=None) from=::ffff:172.16.9.202,58810, flow_id=124752ae, task_id=88fb682b-82b0-4d05-ac2f-90615901f616 (api:46) 2019-01-02 17:11:55,078-0500 INFO (jsonrpc/2) [vdsm.api] START createStorageDomain(storageType=7, sdUUID=u'f5c5042a-3c8a-4629-aece-b5b50611399b', domainName=u'Silver', typeSpecificArg=u'10.100.50.16:/ssd-storageone', domClass=1, domVersion=u'4', options=None) from=::ffff:172.16.9.202,58810, flow_id=124752ae, task_id=2163d5b7-49eb-4993-90c9-752 2bfd0708d (api:46) Ovirt-engine.log 2019-01-02 17:04:32,999-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-130) [41213d83-8594-41de-8e89-50786ecc7daa] EVENT_ID: GLUSTER_VOLUME_CREATE_FAILED(4,001), Creation of Gluster Volume ssd-storageone failed on cluster Wander-Cluster. 2019-01-02 17:05:15,818-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-133) [7efd0973-06ad-450e-b042-eb84f15de0f8] EVENT_ID: GLUSTER_VOLUME_CREATE_FAILED(4,001), Creation of Gluster Volume ssd-storageone failed on cluster Wander-Cluster. 2019-01-02 17:08:21,392-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-133) [44a5a53b-4687-4fdb-a5fc-ed18db00012b] EVENT_ID: GLUSTER_VOLUME_CREATE(4,000), Gluster Volume ssd-storageone created on cluster Wander-Cluster. 2019-01-02 17:08:21,424-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (default task-133) [7c032c48] START, SetGlusterVolumeOptionVDSCommand(HostName = Daedalus, GlusterVolumeOptionVDSParameters:{hostId='64991852-0106-4daf-baa6-b2b4b7272385', volumeName='ssd-storageone'}), log id: 181d15dc 2019-01-02 17:08:22,205-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-133) [7c032c48] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option nfs.disable=on set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:08:22,241-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (default task-133) [7afc62eb] START, SetGlusterVolumeOptionVDSCommand(HostName = Daedalus, GlusterVolumeOptionVDSParameters:{hostId='64991852-0106-4daf-baa6-b2b4b7272385', volumeName='ssd-storageone'}), log id: 30e0b58a 2019-01-02 17:08:22,793-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-133) [7afc62eb] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option user.cifs=disable set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:08:22,822-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (default task-133) [65a0f41f] START, SetGlusterVolumeOptionVDSCommand(HostName = Icarus, GlusterVolumeOptionVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 6b3968f0 2019-01-02 17:08:23,417-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-133) [65a0f41f] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option auth.allow=* set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:08:23,549-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] START, SetGlusterVolumeOptionVDSCommand(HostName = Daedalus, GlusterVolumeOptionVDSParameters:{hostId='64991852-0106-4daf-baa6-b2b4b7272385', volumeName='ssd-storageone'}), log id: 67ce8b8e 2019-01-02 17:08:24,641-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option group=virt set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:08:24,659-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] START, SetGlusterVolumeOptionVDSCommand(HostName = Icarus, GlusterVolumeOptionVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 5cd0588e 2019-01-02 17:08:25,284-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option storage.owner-uid=36 set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:08:25,299-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] START, SetGlusterVolumeOptionVDSCommand(HostName = Icarus, GlusterVolumeOptionVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 35488f82 2019-01-02 17:08:25,952-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option storage.owner-gid=36 set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:08:25,967-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] START, SetGlusterVolumeOptionVDSCommand(HostName = Icarus, GlusterVolumeOptionVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 1068e722 2019-01-02 17:08:26,626-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option performance.strict-o-direct=on set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:08:26,640-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] START, SetGlusterVolumeOptionVDSCommand(HostName = Prometheus, GlusterVolumeOptionVDSParameters:{hostId='8c0155dd-9c0a-4f88-b0aa-c777a57ef988', volumeName='ssd-storageone'}), log id: 2869456 2019-01-02 17:08:27,312-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option network.remote-dio=off set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:08:27,326-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] START, SetGlusterVolumeOptionVDSCommand(HostName = Icarus, GlusterVolumeOptionVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 1a4050bc 2019-01-02 17:08:27,960-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option cluster.granular-entry-heal=enable set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:08:27,977-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] START, SetGlusterVolumeOptionVDSCommand(HostName = Prometheus, GlusterVolumeOptionVDSParameters:{hostId='8c0155dd-9c0a-4f88-b0aa-c777a57ef988', volumeName='ssd-storageone'}), log id: 25bd2afd 2019-01-02 17:08:28,576-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16572) [d8e919c7-77af-4d44-9391-c451d50c03b5] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option network.ping-timeout=30 set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:08:29,722-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option cluster.shd-max-threads=8 on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,722-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'cluster.shd-max-threads'='8' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,725-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option performance.io-cache=off on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,725-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'performance.io-cache'='off' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,728-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option cluster.locking-scheme=granular on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,728-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'cluster.locking-scheme'='granular' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,731-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option performance.client-io-threads=off on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,731-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'performance.client-io-threads'='off' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,733-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option cluster.eager-lock=enable on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,733-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'cluster.eager-lock'='enable' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,736-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option performance.low-prio-threads=32 on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,736-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'performance.low-prio-threads'='32' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,739-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option cluster.quorum-type=auto on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,739-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'cluster.quorum-type'='auto' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,741-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option features.shard=on on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,741-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'features.shard'='on' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,745-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option performance.read-ahead=off on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,745-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'performance.read-ahead'='off' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,747-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option cluster.server-quorum-type=server on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,747-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'cluster.server-quorum-type'='server' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,750-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option performance.quick-read=off on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,750-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'performance.quick-read'='off' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,753-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option cluster.data-self-heal-algorithm=full on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,753-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'cluster.data-self-heal-algorithm'='full' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,755-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FROM_CLI(4,028), Detected new option cluster.shd-wait-qlength=10000 on volume ssd-storageone of cluster Wander-Cluster, and added it to engine DB. 2019-01-02 17:08:29,756-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] New option 'cluster.shd-wait-qlength'='10000' set on volume 'ssd-storageone' from gluster CLI. Updating engine DB accordingly. 2019-01-02 17:08:29,761-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [552ce8c5] EVENT_ID: GLUSTER_VOLUME_OPTION_CHANGED_FROM_CLI(4,041), Detected change in value of option user.cifs from disable to off on volume ssd-storageone of cluster Wander-Cluster, and updated it to engine DB. 2019-01-02 17:08:29,761-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] Detected change in value of option 'user.cifs=disable' of volume 'ssd-storageone' from 'disable' to 'off'. Updating engine DB accordingly. 2019-01-02 17:08:29,762-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler4) [552ce8c5] Detected option 'group' reset on volume 'ssd-storageone'. Removing it from engine DB as well. 2019-01-02 17:09:19,743-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartGlusterVolumeVDSCommand] (default task-134) [65340ca2-b521-4819-8b5a-9c5c7ef6e849] START, StartGlusterVolumeVDSCommand(HostName = Icarus, GlusterVolumeActionVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 6226ecb2 2019-01-02 17:09:23,243-05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-133) [] EVENT_ID: GLUSTER_BRICK_STATUS_CHANGED(4,086), Detected change in status of brick 10.100.50.16:/gluster_bricks/ssd-storageone/ssd-storageone of volume ssd-storageone of cluster Wander-Cluster from UP to UP via gluster event. 2019-01-02 17:09:27,844-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (default task-134) [65340ca2-b521-4819-8b5a-9c5c7ef6e849] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = Icarus, GlusterVolumeAdvancedDetailsVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 49051252 2019-01-02 17:09:29,513-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-134) [65340ca2-b521-4819-8b5a-9c5c7ef6e849] EVENT_ID: GLUSTER_VOLUME_START(4,004), Gluster Volume ssd-storageone of cluster Wander-Cluster started. 2019-01-02 17:11:41,483-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-134) [5e9f8d6e-2b8e-4e6d-abda-d528fe7ae3a4] START, ConnectStorageServerVDSCommand(HostName = Icarus, StorageServerConnectionManagementVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='null', connection='10.100.50.16:/ssd-storageone', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.100.50.14:10.100.50.12', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 5250290c 2019-01-02 17:11:42,098-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-134) [300c8c7a] START, ConnectStorageServerVDSCommand(HostName = Icarus, StorageServerConnectionManagementVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='ab4b5ccb-3d8b-4fa5-add3-7534e3672772', connection='10.100.50.16:/ssd-storageone', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.100.50.14:10.100.50.12', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 1e400372 2019-01-02 17:11:42,112-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-134) [300c8c7a] START, CreateStorageDomainVDSCommand(HostName = Icarus, CreateStorageDomainVDSCommandParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storageDomain='StorageDomainStatic:{name='Silver', id='c68931fd-42d5-4b1e-9ad3-5933311da71d'}', args='10.100.50.16:/ssd-storageone'}), log id: 7a64fc6d 2019-01-02 17:11:42,590-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-134) [300c8c7a] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM Icarus command CreateStorageDomainVDS failed: Error creating a storage domain: (u'storageType=7, sdUUID=c68931fd-42d5-4b1e-9ad3-5933311da71d, domainName=Silver, domClass=1, typeSpecificArg=10.100.50.16:/ssd-storageone domVersion=4',) 2019-01-02 17:11:42,590-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-134) [300c8c7a] Command 'org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand' return value 'StatusOnlyReturn [status=Status [code=351, message=Error creating a storage domain: (u'storageType=7, sdUUID=c68931fd-42d5-4b1e-9ad3-5933311da71d, domainName=Silver, domClass=1, typeSpecificArg=10.100.50.16:/ssd-storageone domVersion=4',)]]' 2019-01-02 17:11:42,590-05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-134) [300c8c7a] Command 'CreateStorageDomainVDSCommand(HostName = Icarus, CreateStorageDomainVDSCommandParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storageDomain='StorageDomainStatic:{name='Silver', id='c68931fd-42d5-4b1e-9ad3-5933311da71d'}', args='10.100.50.16:/ssd-storageone'})' execution failed: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Error creating a storage domain: (u'storageType=7, sdUUID=c68931fd-42d5-4b1e-9ad3-5933311da71d, domainName=Silver, domClass=1, typeSpecificArg=10.100.50.16:/ssd-storageone domVersion=4',), code = 351 2019-01-02 17:11:42,590-05 ERROR [org.ovirt.engine.core.bll.storage.domain.AddGlusterFsStorageDomainCommand] (default task-134) [300c8c7a] Command 'org.ovirt.engine.core.bll.storage.domain.AddGlusterFsStorageDomainCommand' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Error creating a storage domain: (u'storageType=7, sdUUID=c68931fd-42d5-4b1e-9ad3-5933311da71d, domainName=Silver, domClass=1, typeSpecificArg=10.100.50.16:/ssd-storageone domVersion=4',), code = 351 (Failed with error StorageDomainCreationError and code 351) 2019-01-02 17:11:42,745-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (default task-133) [b4ebe5ed-9626-43ca-a307-b3b3e7d01f2b] START, DisconnectStorageServerVDSCommand(HostName = Icarus, StorageServerConnectionManagementVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='ab4b5ccb-3d8b-4fa5-add3-7534e3672772', connection='10.100.50.16:/ssd-storageone', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.100.50.14:10.100.50.12', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 45987e16 2019-01-02 17:11:54,583-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-133) [712a4a82-b947-4e18-b6e4-dacf0b09d4b4] START, ConnectStorageServerVDSCommand(HostName = Icarus, StorageServerConnectionManagementVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='null', connection='10.100.50.16:/ssd-storageone', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.100.50.14:10.100.50.12', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 66814b6c 2019-01-02 17:11:55,070-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-133) [124752ae] START, ConnectStorageServerVDSCommand(HostName = Icarus, StorageServerConnectionManagementVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='ddab3ffa-1165-4495-a7d0-7515b21c3c8e', connection='10.100.50.16:/ssd-storageone', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.100.50.14:10.100.50.12', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: fe2bebd 2019-01-02 17:11:55,082-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-133) [124752ae] START, CreateStorageDomainVDSCommand(HostName = Icarus, CreateStorageDomainVDSCommandParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storageDomain='StorageDomainStatic:{name='Silver', id='f5c5042a-3c8a-4629-aece-b5b50611399b'}', args='10.100.50.16:/ssd-storageone'}), log id: 7f955a00 2019-01-02 17:11:55,557-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-133) [124752ae] Command 'org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand' return value 'StatusOnlyReturn [status=Status [code=361, message=Storage domain is not empty - requires cleaning: (u'10.100.50.16:/ssd-storageone',)]]' 2019-01-02 17:11:55,557-05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-133) [124752ae] Command 'CreateStorageDomainVDSCommand(HostName = Icarus, CreateStorageDomainVDSCommandParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storageDomain='StorageDomainStatic:{name='Silver', id='f5c5042a-3c8a-4629-aece-b5b50611399b'}', args='10.100.50.16:/ssd-storageone'})' execution failed: VDSGenericException: VDSErrorException: Failed in vdscommand to CreateStorageDomainVDS, error = Storage domain is not empty - requires cleaning: (u'10.100.50.16:/ssd-storageone',) 2019-01-02 17:11:55,557-05 ERROR [org.ovirt.engine.core.bll.storage.domain.AddGlusterFsStorageDomainCommand] (default task-133) [124752ae] Command 'org.ovirt.engine.core.bll.storage.domain.AddGlusterFsStorageDomainCommand' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed in vdscommand to CreateStorageDomainVDS, error = Storage domain is not empty - requires cleaning: (u'10.100.50.16:/ssd-storageone',) (Failed with error StorageDomainNotEmpty and code 361) 2019-01-02 17:11:55,747-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (default task-133) [6d58781b-8723-48b9-a1a7-36e93fcdc62b] START, DisconnectStorageServerVDSCommand(HostName = Icarus, StorageServerConnectionManagementVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='ddab3ffa-1165-4495-a7d0-7515b21c3c8e', connection='10.100.50.16:/ssd-storageone', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.100.50.14:10.100.50.12', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 300afade 2019-01-02 17:12:04,754-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-133) [ea7c92c2-14ec-447d-a501-4ed3b38327fc] START, ConnectStorageServerVDSCommand(HostName = Icarus, StorageServerConnectionManagementVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='null', connection='10.100.50.16:/ssd-storageone', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.100.50.14:10.100.50.12', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 3ba89582 2019-01-02 17:12:05,295-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-133) [126de8b0] START, ConnectStorageServerVDSCommand(HostName = Icarus, StorageServerConnectionManagementVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='fe0cdd72-07e8-4476-8bdf-184d32396600', connection='10.100.50.16:/ssd-storageone', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.100.50.14:10.100.50.12', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 14a5863 2019-01-02 17:12:05,309-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-133) [126de8b0] START, CreateStorageDomainVDSCommand(HostName = Icarus, CreateStorageDomainVDSCommandParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storageDomain='StorageDomainStatic:{name='Silver', id='c78cece3-70b3-4f5f-9ef5-ba5790d573dc'}', args='10.100.50.16:/ssd-storageone'}), log id: 498dbaf7 2019-01-02 17:12:05,694-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-133) [126de8b0] Command 'org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand' return value 'StatusOnlyReturn [status=Status [code=361, message=Storage domain is not empty - requires cleaning: (u'10.100.50.16:/ssd-storageone',)]]' 2019-01-02 17:12:05,694-05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (default task-133) [126de8b0] Command 'CreateStorageDomainVDSCommand(HostName = Icarus, CreateStorageDomainVDSCommandParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storageDomain='StorageDomainStatic:{name='Silver', id='c78cece3-70b3-4f5f-9ef5-ba5790d573dc'}', args='10.100.50.16:/ssd-storageone'})' execution failed: VDSGenericException: VDSErrorException: Failed in vdscommand to CreateStorageDomainVDS, error = Storage domain is not empty - requires cleaning: (u'10.100.50.16:/ssd-storageone',) 2019-01-02 17:12:05,694-05 ERROR [org.ovirt.engine.core.bll.storage.domain.AddGlusterFsStorageDomainCommand] (default task-133) [126de8b0] Command 'org.ovirt.engine.core.bll.storage.domain.AddGlusterFsStorageDomainCommand' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed in vdscommand to CreateStorageDomainVDS, error = Storage domain is not empty - requires cleaning: (u'10.100.50.16:/ssd-storageone',) (Failed with error StorageDomainNotEmpty and code 361) 2019-01-02 17:12:05,795-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (default task-134) [17f3ac07-5069-4ab7-b286-a5fc200a7ba9] START, DisconnectStorageServerVDSCommand(HostName = Icarus, StorageServerConnectionManagementVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='GLUSTERFS', connectionList='[StorageServerConnections:{id='fe0cdd72-07e8-4476-8bdf-184d32396600', connection='10.100.50.16:/ssd-storageone', iqn='null', vfsType='glusterfs', mountOptions='backup-volfile-servers=10.100.50.14:10.100.50.12', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 57e9da28 2019-01-02 17:12:16,983-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] START, SetGlusterVolumeOptionVDSCommand(HostName = Prometheus, GlusterVolumeOptionVDSParameters:{hostId='8c0155dd-9c0a-4f88-b0aa-c777a57ef988', volumeName='ssd-storageone'}), log id: 3284cb5e 2019-01-02 17:12:18,080-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option group=virt set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:12:18,093-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] START, SetGlusterVolumeOptionVDSCommand(HostName = Icarus, GlusterVolumeOptionVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 5b67ca4a 2019-01-02 17:12:18,735-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option storage.owner-uid=36 set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:12:18,756-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] START, SetGlusterVolumeOptionVDSCommand(HostName = Daedalus, GlusterVolumeOptionVDSParameters:{hostId='64991852-0106-4daf-baa6-b2b4b7272385', volumeName='ssd-storageone'}), log id: 199be138 2019-01-02 17:12:19,463-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option storage.owner-gid=36 set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:12:19,475-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] START, SetGlusterVolumeOptionVDSCommand(HostName = Daedalus, GlusterVolumeOptionVDSParameters:{hostId='64991852-0106-4daf-baa6-b2b4b7272385', volumeName='ssd-storageone'}), log id: 22879e9f 2019-01-02 17:12:20,140-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option performance.strict-o-direct=on set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:12:20,153-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] START, SetGlusterVolumeOptionVDSCommand(HostName = Icarus, GlusterVolumeOptionVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 2ce70403 2019-01-02 17:12:20,807-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] EVENT_ID: GLUSTER_VOLUME_OPTION_ADDED(4,002), Volume Option network.remote-dio=off set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:12:20,820-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] START, SetGlusterVolumeOptionVDSCommand(HostName = Prometheus, GlusterVolumeOptionVDSParameters:{hostId='8c0155dd-9c0a-4f88-b0aa-c777a57ef988', volumeName='ssd-storageone'}), log id: 70b3aa2f 2019-01-02 17:12:21,043-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16591) [bb744659-cef6-4bca-bfd8-af3d0832aca6] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FAILED(4,003), Volume Option cluster.granular-entry-heal=enable could not be set on ssd-storageone of cluster Wander-Cluster. 2019-01-02 17:12:21,229-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeHealInfoVDSCommand] (DefaultQuartzScheduler4) [8575d05] START, GetGlusterVolumeHealInfoVDSCommand(HostName = Daedalus, GlusterVolumeVDSParameters:{hostId='64991852-0106-4daf-baa6-b2b4b7272385', volumeName='ssd-storageone'}), log id: 4c5a9b16 2019-01-02 17:12:24,244-05 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler8) [ae1e46c] Detected option 'group' reset on volume 'ssd-storageone'. Removing it from engine DB as well. 2019-01-02 17:12:39,565-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler3) [79337af0] EVENT_ID: GLUSTER_VOLUME_SNAPSHOT_VOLUME_CONFIG_DETECTED_NEW(4,155), Found new gluster volume snapshot configuration snap-max-hard-limit with value 256 for volume ssd-storageone on cluster Wander-Cluster, and added it to engine DB." 2019-01-02 17:14:09,946-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler10) [58c36899] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = Daedalus, GlusterVolumeAdvancedDetailsVDSParameters:{hostId='64991852-0106-4daf-baa6-b2b4b7272385', volumeName='ssd-storageone'}), log id: 5be1d3da 2019-01-02 17:19:21,957-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler3) [4d122ce5] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = Icarus, GlusterVolumeAdvancedDetailsVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 3ccc9205 2019-01-02 17:22:21,975-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeHealInfoVDSCommand] (DefaultQuartzScheduler2) [314f1fee] START, GetGlusterVolumeHealInfoVDSCommand(HostName = Icarus, GlusterVolumeVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 5dbfffbb 2019-01-02 17:24:33,947-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler2) [5f1db4b6] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = Daedalus, GlusterVolumeAdvancedDetailsVDSParameters:{hostId='64991852-0106-4daf-baa6-b2b4b7272385', volumeName='ssd-storageone'}), log id: 3d76cc06 2019-01-02 17:29:45,860-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler7) [338cc9b2] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = Daedalus, GlusterVolumeAdvancedDetailsVDSParameters:{hostId='64991852-0106-4daf-baa6-b2b4b7272385', volumeName='ssd-storageone'}), log id: 7e372372 2019-01-02 17:32:22,568-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeHealInfoVDSCommand] (DefaultQuartzScheduler8) [6221273c] START, GetGlusterVolumeHealInfoVDSCommand(HostName = Icarus, GlusterVolumeVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 2f21cea7 2019-01-02 17:34:57,879-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler4) [72252954] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = Prometheus, GlusterVolumeAdvancedDetailsVDSParameters:{hostId='8c0155dd-9c0a-4f88-b0aa-c777a57ef988', volumeName='ssd-storageone'}), log id: c6e4fcd 2019-01-02 17:40:10,045-05 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler9) [21075cfb] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = Icarus, GlusterVolumeAdvancedDetailsVDSParameters:{hostId='5864fabe-37a2-4682-97b9-097dfd2b79c2', volumeName='ssd-storageone'}), log id: 13cb600d
AHHHH!!! I figured it out!!! I didn't realize that I had to enable the 512e emulation on the VDO drives, just got it successfully added!
On Thu, Jan 3, 2019 at 5:37 AM <michael@wanderingmad.com> wrote:
AHHHH!!! I figured it out!!! I didn't realize that I had to enable the 512e emulation on the VDO drives, just got it successfully added!
I thought this was the default in the cockpit wizard?
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/IVTZLR7ZZEJSHG...
Yes , if you create vdo volume via cockpit then you will get all necessary options default. On Mon, Jan 7, 2019 at 10:24 AM Sahina Bose <sabose@redhat.com> wrote:
On Thu, Jan 3, 2019 at 5:37 AM <michael@wanderingmad.com> wrote:
AHHHH!!! I figured it out!!! I didn't realize that I had to enable the
512e emulation on the VDO drives, just got it successfully added!
I thought this was the default in the cockpit wizard?
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/IVTZLR7ZZEJSHG...
Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/RUKJMNSAAMEKH6...
-- Thanks, Gobinda
When I created VDO in cockpit, All options were unchecked, enable compression, deduplication, and 512e emulation all defaulted to unchecked.
participants (3)
-
Gobinda Das -
michael＠wanderingmad.com -
Sahina Bose