Dear oVirt, Considering this COVID-19 situation, I hope you are all doing well and staying healthy. It has been more than two weeks since I reported this issue. So far I have not received a single update or request, and the issue is still registered as NEW. Considering this is one out of three issues regarding oVirt quotas, that I reported, in one day, not getting any update leads me to assumptions: - I am doing something fundamentally wrong with oVirt Quotas implementation - There is something fundamentally wrong with oVirt Quotas implementation, from the software side. - something else… In any case, I would highly appreciate it if you can find time to look into these issues so we can make progress. Once again, I am seeing this problem on all three deployed platforms, both in Staging and Production. Kindly awaiting your reply. Marko Vrgotic ActiveVideo From: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com&gt; Date: Tuesday, 17 March 2020 at 12:51 To: &quot;users(a)ovirt.org&quot; <users(a)ovirt.org&gt; Cc: Darko Stojchev <D.Stojchev(a)activevideo.com&gt; Subject: Re: oVirt Storage quota problems Dear oVirt, Regarding Issue #2 , I created bug at Bugzilla, if anyone is interested in following: https://bugzilla.redhat.com/show_bug.cgi?id=1814200 Regarding issue #1, there is already a bug: https://bugzilla.redhat.com/show_bug.cgi?id=1731049 And regarding percentage vs actual usage: https://bugzilla.redhat.com/show_bug.cgi?id=1814214 ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 e: m.vrgotic@activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com&gt; Date: Monday, 16 March 2020 at 09:40 To: &quot;users(a)ovirt.org&quot; <users(a)ovirt.org&gt; Cc: Darko Stojchev <D.Stojchev(a)activevideo.com&gt; Subject: Re: oVirt Storage quota problems Dear oVirt, Is there anyone willing and able to assist me in troubleshooting what seems to be multiple issues regarding quotas: 1. UI Exception each time I add Consumer to Quota. 2. User getting warning of not being authorized to ‘ConsumeQuota’ in order to AddVM or AddVMFromTemplate, even though User is in Consumers list. 3. Fishy quota usage percentage. I see this strange behavior on all my platforms, so it’s starting to look as a bug to me. Happy to provide any relevant logs or do tests needed. Kindly awaiting your reply. ----- kind regards/met vriendelijke groeten Marko Vrgotic ActiveVideo From: "Staniforth, Paul" <P.Staniforth(a)leedsbeckett.ac.uk&gt; Date: Friday, 13 March 2020 at 18:19 To: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com&gt;, &quot;users(a)ovirt.org&quot; <users(a)ovirt.org&gt; Cc: Darko Stojchev <D.Stojchev(a)activevideo.com&gt; Subject: Re: oVirt Storage quota problems Sorry haven't used quota in a while, one thought is there a template quota getting used? Regards, Paul S. ________________________________ From: Vrgotic, Marko <M.Vrgotic(a)activevideo.com&gt; Sent: 13 March 2020 15:15 To: Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users(a)ovirt.org <users(a)ovirt.org&gt; Cc: Stojchev, Darko <D.Stojchev(a)activevideo.com&gt; Subject: Re: oVirt Storage quota problems Caution External Mail: Do not click any links or open any attachments unless you trust the sender and know that the content is safe. Hey Paul, I did the check for another user that has same issue and what I found out its bit strange: * DC1 / infrastructure1 – quota storage_inf1 – user is added in Consumers list - gets “2020-03-13 08:26:18,057Z WARN [org.ovirt.engine.core.bll.AddVmFromTemplateCommand] (default task-3804) [a6ba871a-dc42-4d4b-a01a-a72cd5a45959] Validation of action 'AddVmFromTemplate' failed for user azabaleta@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA” * DC1 / development2 – quota storage_dev2 – user is added in Consumers list – works The following logs confirm that: * Fails against infrastructure1 : “2020-03-13 08:26:18,057Z INFO [org.ovirt.engine.core.bll.AddVmFromTemplateCommand] (default task-3804) [a6ba871a-dc42-4d4b-a01a-a72cd5a45959] No permission found for user '699687a1-da37-4b4 0-a86d-dc744208302d' or one of the groups he is member of, when running action 'AddVmFromTemplate', Required permissions are: Action type: 'USER' Action group: 'CONSUME_QUOTA' Object type: ' Quota' Object ID: '254f2582-839d-11e9-aaa2-00163e4f2a6d'. 2020-03-13 08:26:18,057Z WARN [org.ovirt.engine.core.bll.AddVmFromTemplateCommand] (default task-3804) [a6ba871a-dc42-4d4b-a01a-a72cd5a45959] Validation of action 'AddVmFromTemplate' failed for user azabaleta@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-13 08:27:03,426Z INFO [org.ovirt.engine.core.bll.AddVmFromTemplateCommand] (default task-3813) [1e11522e-b25a-4972-8ff8-1d9a08bd57ca] Lock Acquired to object 'EngineLock:{exclusiveLocks='[azabaleta-runner=VM_NAME]', sharedLocks='[a80c1f1f-9cd3-4e8c-bfe9-670aa36d2aff=DISK, 9c710118-bb68-45aa-bafd-0e90cb07b9cf=TEMPLATE]'}' * Works against development2: 2020-03-13 08:27:04,323Z INFO [org.ovirt.engine.core.bll.AddGraphicsDeviceCommand] (default task-3813) [2cd83827] Running command: AddGraphicsDeviceCommand internal: true. Entities affected : ID: d75c0d37-4640-49b0-afd1-7db27541f4d4 Type: VMAction group EDIT_VM_PROPERTIES with role type USER 2020-03-13 08:27:04,379Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-3813) [2cd83827] EVENT_ID: USER_ADD_VM_STARTED(37), VM azabaleta-runner creation was initiated by azabaleta@ictv.com(a)ictv.com-authz. 2020-03-13 08:27:04,777Z INFO [org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-39) [1e11522e-b25a-4972-8ff8-1d9a08bd57ca] Command 'CreateCloneOfTemplate' (id: '806f2e38-fc42-45c3-87ab-20bec50c226c') waiting on child command id: 'd3826f75-1095-4b5f-98c3-973f4683616b' type:'CopyImageGroupWithData' to complete 2020-03-13 08:27:04,777Z INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-39) [1e11522e-b25a-4972-8ff8-1d9a08bd57ca] Command 'CopyImageGroupWithData' (id: 'd3826f75-1095-4b5f-98c3-973f4683616b') waiting on child command id: 'eb9c3360-00a8-4539-bda4-89d70d22da68' type:'CreateVolumeContainer' to complete 2020-03-13 08:27:05,003Z INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (default task-3813) [e9f67a0f-aaf8-45a6-bdae-d501e757a3b6] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: d75c0d37-4640-49b0-afd1-7db27541f4d4 Type: VMAction group CREATE_VM with role type USER Please assist as it currently seems the Quota permissions are not working as expected. The Quotas storage_inf1 and storage_dev2 are configured in exact same way, expect that they are for different DataCenters. From: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com&gt; Date: Thursday, 12 March 2020 at 20:19 To: "Staniforth, Paul" <P.Staniforth(a)leedsbeckett.ac.uk&gt; Cc: &quot;users(a)ovirt.org&quot; <users(a)ovirt.org&gt;, Darko Stojchev <D.Stojchev(a)activevideo.com&gt; Subject: Re: oVirt Storage quota problems Hey Paul, Thank you. I believe I already added him via Consumers tab, but it does not hurt to doublecheck. Sent from my iPhone On 12 Mar 2020, at 17:53, Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk&gt; wrote: Hello Marko, if you select quota in the administration menu, then select the quota it is using you will see the consumers option and there it will allow you to add users or groups. https://www.ovirt.org/documentation/admin-guide/chap-Quotas_and_Service_L... Quotas and Service Level Agreement Policy | oVirt<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%... Chapter 16: Quotas and Service Level Agreement Policy Introduction to Quota. Quota is a resource limitation tool provided with oVirt. Quota may be thought of as a layer of limitations on top of the layer of limitations set by User Permissions. www.ovirt.org Regards, Paul S. ________________________________ From: Vrgotic, Marko <M.Vrgotic(a)activevideo.com&gt; Sent: 12 March 2020 15:46 To: users(a)ovirt.org <users(a)ovirt.org&gt; Cc: Stojchev, Darko <D.Stojchev(a)activevideo.com&gt; Subject: [ovirt-users] Re: oVirt Storage quota problems Caution External Mail: Do not click any links or open any attachments unless you trust the sender and know that the content is safe. I fond the following: “2020-03-12 14:03:05,260Z INFO [org.ovirt.engine.core.bll.AddVmCommand] (default task-3613) [b9635e29-4b8a-44c4-9611-e5af362c783c] No permission found for user '7f906bbf-d194-425f-b313-08a777b764ab' or one of the groups he is member of, when running action 'AddVm', Required permissions are: Action type: 'USER' Action group: 'CONSUME_QUOTA' Object type: 'Quota' Object ID: '47b5e9f4-67a4-4b78-abfd-175e3d9de8da'. 2020-03-12 14:03:05,260Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3613) [b9635e29-4b8a-44c4-9611-e5af362c783c] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA” Does anyone know which permission setting that is, or under which section belongs, as I cannot found clear check for it under Roles definition? Kindly awaiting your reply. ----- kind regards/met vriendelijke groeten Marko Vrgotic ActiveVideo From: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com&gt; Date: Thursday, 12 March 2020 at 16:28 To: &quot;users(a)ovirt.org&quot; <users(a)ovirt.org&gt; Cc: Darko Stojchev <D.Stojchev(a)activevideo.com&gt; Subject: Re: oVirt Storage quota problems Addiitonally, WARN from log file for one of the Users: 2020-03-12 14:03:05,218Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3607) [2bb50857-d018-48aa-b4ca-ed6fb5cd76bf] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:05,236Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3583) [4ef095e5-59fa-4c73-9035-c5251372066d] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:05,238Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3608) [a571bd5d-98af-4a92-bf74-40681c208d32] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:05,240Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3599) [a77740ff-e725-4632-a189-cac9979238df] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:05,260Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3613) [b9635e29-4b8a-44c4-9611-e5af362c783c] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:30,584Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3599) [90da1953-a2d6-45bb-8a5b-8f8e9a1b7e2c] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:30,597Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3613) [fb938e77-1b95-4405-bebc-b0dd89e99ff0] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:30,600Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3608) [d3c4cd69-134d-49c7-a977-c27d79ce2e24] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:43,460Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3599) [99b158c6-c476-43e4-838f-45cadf73c7e9] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:43,462Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3608) [300289be-d55d-468e-aeda-d845180621e2] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:43,467Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3613) [a6d267af-d14e-44d5-9573-de33a4d45586] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:45,101Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3613) [8efba949-8f58-427b-9add-ead7b54e69d5] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:55,071Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3613) [3444440d-5c3a-4ba7-9a6b-4de6ba71a2cd] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA 2020-03-12 14:03:55,093Z WARN [org.ovirt.engine.core.bll.AddVmCommand] (default task-3608) [34e8e6f9-7a5d-4d86-92bc-a595a3ae7688] Validation of action 'AddVm' failed for user esuilen@ictv.com(a)ictv.com-authz. Reasons: VAR__ACTION__ADD,VAR__TYPE__VM,USER_NOT_AUTHORIZED_TO_CONSUME_QUOTA ----- kind regards/met vriendelijke groeten Marko Vrgotic ActiveVideo From: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com&gt; Date: Thursday, 12 March 2020 at 16:09 To: &quot;users(a)ovirt.org&quot; <users(a)ovirt.org&gt; Cc: Darko Stojchev <D.Stojchev(a)activevideo.com&gt; Subject: oVirt Storage quota problems Dear oVirt, I am experiencing a quota related problem regarding two things: 1. Quota usage and exception trigger 2. User assigned as quota consumer First issue: I have defined quota for storage ( qstorage ), setting all following items: a. Defining quota for storage, with threshold and grace b. Setting quota mode to enforced in datacenter c. Added Users as consumers of the Quota d. Updated quota from Default to qstorage for Templates and related images e. Updated quota from Default to qstorage from all existing VMs and the related Disks Problem: * the percentage of the Storage Consumption is jumping up and down, between 3% and 97%, and at certain point goes back to Unlimited * when checking under Storage tab inside quota name, the value “Used MB out of Total MB” is correct, however, when attempting to exceed the threshold, I am not getting a warning, even though I am consumer of a quota Second issue: User is added to qstorage quota as consumer. Still, when he tries to launch the VMs, Waring is displayed: Cannot add VM. The user is not a consumer of the Quota assigned to the resource. Have I missed something – could it be a permission issue, not a consumer issue. All my users are utilizing Administration Portal with limited set of permissions. They all have same Role assigned, but only few of them are having the problem I described as Second problem. Please assist. ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 e: m.vrgotic@activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<https://eur02.safelinks.protection.outlook.com/?ur... ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com&gt; Date: Thursday, 27 February 2020 at 10:19 To: &quot;users(a)ovirt.org&quot; <users(a)ovirt.org&gt; Cc: Darko Stojchev <D.Stojchev(a)activevideo.com&gt; Subject: oVirt Storage quota questions Dear oVirt, My platform is running SHE oVirt version 4.3.8. Why is my StorageQuota consumption still showing “ 0 out of 3700” ? Did I forget something? <image001.png> I have setup storage quota “StorageQuota” for one of domains. It has 4400GB actual storage. • Quota is set to 3700GB. o Treshold for Quota is 85% and Grace is set to 110%. • Datacenter Quota is set to Enforced • The template image has been changed from Default to StorageQuota • I see that Vms created from Template are automatically assigned StorageQuota To present the following situation in screenshots: • Actual Quota: <image002.png> • VMs (more than on the screenshot) which have the StorageQuota assigned: <image003.png> • Templates which have the StorageQuota assigned <image004.png> Kindly awaiting your reply. Additionally – is there an easy&safe way to update all running VMs quota? ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 e: m.vrgotic@activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<https://eur02.safelinks.protection.outlook.com/?ur... ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. To view the terms under which this email is distributed, please go to:- http://leedsbeckett.ac.uk/disclaimer/email/ To view the terms under which this email is distributed, please go to:- http://leedsbeckett.ac.uk/disclaimer/email/