<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap:break-word; color:rgb(0,0,0); font-size:14px; font-family:'Courier New',sans-serif">
<div>
<div>
<div>Forgot one thing, the paste bin link!</div>
</div>
</div>
<div><br>
</div>
<div><a href="http://pastebin.com/3t7E41JK">http://pastebin.com/3t7E41JK</a></div>
<div><span style="font-family:Calibri; font-size:11pt; text-align:left; font-weight:bold"><br>
</span></div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; border-bottom:medium none; border-left:medium none; padding-bottom:0in; padding-left:0in; padding-right:0in; border-top:#b5c4df 1pt solid; border-right:medium none; padding-top:3pt">
<span style="font-weight:bold">Date: </span>Wednesday, July 17, 2013 7:08 PM<br>
<span style="font-weight:bold">To: </span>users <<a href="mailto:users@ovirt.org">users@ovirt.org</a>><br>
<span style="font-weight:bold">Subject: </span>HELP, ISCSI Freakin!<br>
</div>
<div><br>
</div>
<div>
<div style="word-wrap:break-word; color:rgb(0,0,0); font-size:14px; font-family:'Courier New',sans-serif">
<div>Hey Guys,</div>
<div><br>
</div>
<div>I am running oVirt 3.1; and I am getting the following in dmesg, and I have pasted my VG info below. We are running iSCSI luns and this is a node complaining in the log. Our equalogic storage was close to full; and this started happening. I have extended
it, and it is thin provisioned; but I am not sure if a pvresize is needed. If so, can it be done while online? Trying not to take down this cluster; several heavily used VMs on it. The VMs seem to be running ok for now; but this is filling up the logs pretty
quickly; as it appears to be retrying to connections and to release the resources.
<b>All help is appreciated</b>.</div>
<div><br>
</div>
<div>Thanks for all your help guys; and feel free to email me directly if I can provide any more info.</div>
<div><br>
</div>
<div><b>Log Snippet:</b></div>
<div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,335::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.69d66cf5-9426-4385-be6c-c55e2bd40617', Clearing records.</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,335::task::978::TaskManager.Task::(_decref) Task=`03810e67-5dab-4193-8cbd-c633c8c25fa4`::ref 0 aborting False</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,336::task::588::TaskManager.Task::(_updateState) Task=`7379fc72-5137-4432-861c-85b1f33ba843`::moving from state init -> state preparing</div>
<div>Thread-550892::INFO::2013-07-17 19:06:14,336::logUtils::37::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7cf8a585-34a8-470c-9b40-9d486456fcea', spUUID='2ecfa6dd-a1fa-428c-9d04-db17c6c4491d', imgUUID='8cbc183a-0afe-497a-a54b-ec5f03b7fe16',
volUUID='bcb8d500-5aa4-404a-9be2-9fb84bc87300', options=None)</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,336::resourceManager::175::ResourceManager.Request::(__init__) ResName=`Storage.7cf8a585-34a8-470c-9b40-9d486456fcea`ReqID=`7411edba-20b8-4855-8271-b6aa52a9203a`::Request was made in '/usr/share/vdsm/storage/resourceManager.py'
line '485' at 'registerResource'</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,336::resourceManager::486::ResourceManager::(registerResource) Trying to register resource 'Storage.7cf8a585-34a8-470c-9b40-9d486456fcea' for lock type 'shared'</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,336::resourceManager::528::ResourceManager::(registerResource) Resource 'Storage.7cf8a585-34a8-470c-9b40-9d486456fcea' is free. Now locking as 'shared' (1 active user)</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,336::resourceManager::212::ResourceManager.Request::(grant) ResName=`Storage.7cf8a585-34a8-470c-9b40-9d486456fcea`ReqID=`7411edba-20b8-4855-8271-b6aa52a9203a`::Granted request</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,337::task::817::TaskManager.Task::(resourceAcquired) Task=`7379fc72-5137-4432-861c-85b1f33ba843`::_resourcesAcquired: Storage.7cf8a585-34a8-470c-9b40-9d486456fcea (shared)</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,337::task::978::TaskManager.Task::(_decref) Task=`7379fc72-5137-4432-861c-85b1f33ba843`::ref 1 aborting False</div>
<div>Thread-550892::INFO::2013-07-17 19:06:14,338::logUtils::39::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '31138512896', 'apparentsize': '31138512896'}</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,338::task::1172::TaskManager.Task::(prepare) Task=`7379fc72-5137-4432-861c-85b1f33ba843`::finished: {'truesize': '31138512896', 'apparentsize': '31138512896'}</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,338::task::588::TaskManager.Task::(_updateState) Task=`7379fc72-5137-4432-861c-85b1f33ba843`::moving from state preparing -> state finished</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,338::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7cf8a585-34a8-470c-9b40-9d486456fcea': < ResourceRef 'Storage.7cf8a585-34a8-470c-9b40-9d486456fcea',
isValid: 'True' obj: 'None'>}</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,338::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,338::resourceManager::538::ResourceManager::(releaseResource) Trying to release resource 'Storage.7cf8a585-34a8-470c-9b40-9d486456fcea'</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,338::resourceManager::553::ResourceManager::(releaseResource) Released resource 'Storage.7cf8a585-34a8-470c-9b40-9d486456fcea' (0 active users)</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,338::resourceManager::558::ResourceManager::(releaseResource) Resource 'Storage.7cf8a585-34a8-470c-9b40-9d486456fcea' is free, finding out if anyone is waiting for it.</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,339::resourceManager::565::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7cf8a585-34a8-470c-9b40-9d486456fcea', Clearing records.</div>
<div>Thread-550892::DEBUG::2013-07-17 19:06:14,339::task::978::TaskManager.Task::(_decref) Task=`7379fc72-5137-4432-861c-85b1f33ba843`::ref 0 aborting False</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div><b><br>
</b></div>
<div><b>Dmesg Snippet:</b></div>
<div>
<div>__ratelimit: 28 callbacks suppressed</div>
<div>end_request: I/O error, dev dm-64, sector 5769088</div>
<div>end_request: I/O error, dev dm-64, sector 5769200</div>
<div>end_request: I/O error, dev dm-64, sector 5507072</div>
<div>end_request: I/O error, dev dm-64, sector 5507080</div>
<div>end_request: I/O error, dev dm-64, sector 5507072</div>
<div>end_request: I/O error, dev dm-64, sector 5506944</div>
<div>end_request: I/O error, dev dm-64, sector 5507056</div>
<div>end_request: I/O error, dev dm-64, sector 1312768</div>
<div>end_request: I/O error, dev dm-64, sector 1312776</div>
<div>end_request: I/O error, dev dm-64, sector 1312768</div>
<div>end_request: I/O error, dev dm-64, sector 6031232</div>
<div>end_request: I/O error, dev dm-64, sector 6031344</div>
<div>end_request: I/O error, dev dm-64, sector 5769216</div>
<div>end_request: I/O error, dev dm-64, sector 5769224</div>
<div>end_request: I/O error, dev dm-64, sector 5769216</div>
<div>end_request: I/O error, dev dm-64, sector 6293376</div>
<div>end_request: I/O error, dev dm-64, sector 6293488</div>
<div>end_request: I/O error, dev dm-64, sector 6031360</div>
<div>end_request: I/O error, dev dm-64, sector 6031368</div>
<div>end_request: I/O error, dev dm-64, sector 6031360</div>
<div>end_request: I/O error, dev dm-64, sector 8390528</div>
<div>end_request: I/O error, dev dm-64, sector 8390640</div>
<div>end_request: I/O error, dev dm-64, sector 6293504</div>
<div>end_request: I/O error, dev dm-64, sector 6293512</div>
<div>end_request: I/O error, dev dm-64, sector 6293504</div>
<div>__ratelimit: 25 callbacks suppressed</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Matt Curry</div>
<div><a href="mailto:Matt@MattCurry.com">Matt@MattCurry.com</a></div>
<div><br>
</div>
<br>
</div>
</div>
</span><br>
<hr>
<font color="Gray" face="Arial" size="1">This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to
bind SKOPOS to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose.</font>
</body>
</html>