Fwd: Planned outage: All Services - 2018-04-04 21:00 UTC
by Sandro Bonazzola
FYI
---------- Forwarded message ----------
From: Kevin Fenzi <kevin(a)scrye.com>
Date: 2018-04-02 21:44 GMT+02:00
Subject: Planned outage: All Services - 2018-04-04 21:00 UTC
To: devel-announce(a)lists.fedoraproject.org, announce(a)lists.fedoraproject.org
There will be an outage starting at 2018-04-04 21:00UTC, which will last
approximately 6 hours.
To convert UTC to your local time, take a look at
http://fedoraproject.org/wiki/Infrastructure/UTCHowto
or run:
date -d '2018-04-04 21:00UTC'
Reason for outage:
We will be applying critical security updates and rebooting all
servers.
Affected Services:
All services may be affected. We will try to keep any outages
short, but expect some things to go up or down in the outage window.
Contact Information:
Ticket Link:
https://pagure.io/fedora-infrastructure/issue/6816
Please join #fedora-admin or #fedora-noc on irc.freenode.net or add
comments to the ticket for this outage above.
_______________________________________________
devel-announce mailing list -- devel-announce(a)lists.fedoraproject.org
To unsubscribe send an email to devel-announce-leave(a)lists.fedoraproject.org
--
SANDRO BONAZZOLA
ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
Red Hat EMEA <https://www.redhat.com/>
sbonazzo(a)redhat.com
<https://red.ht/sig>
<https://redhat.com/summit>
6 years, 8 months
Re: Change in ovirt-system-tests[master]: Test hosted-engine cleanup
by Yedidyah Bar David
On Wed, Mar 21, 2018 at 11:48 AM, Code Review <gerrit(a)ovirt.org> wrote:
> From Jenkins CI:
>
> Jenkins CI has posted comments on this change.
>
> Change subject: Test hosted-engine cleanup
> ......................................................................
>
>
> Patch Set 19:
>
> Build Failed
>
> http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x8... : FAILURE
This is a retrigger of my previous mail to infra. Failed with:
09:48:27 CLEANUP: Stop all running containers and remove unwanted images
...
09:48:37 Error response from daemon: conflict: unable to delete
782fe38c8050 (cannot be forced) - image has dependent child images
09:48:37 Error response from daemon: conflict: unable to delete
bcec0ae8107e (cannot be forced) - image has dependent child images
09:48:37 ERROR: Failed to clean docker images
I have already seen this before.
Perhaps we should automatically reprovision all slaves periodically?
They should be cattle, not pets, right? :-)
I already suggested this in the past and there was some objection...
>
> --
> To view, visit https://gerrit.ovirt.org/88331
> To unsubscribe, visit https://gerrit.ovirt.org/settings
>
> Gerrit-Project: ovirt-system-tests
> Gerrit-Branch: master
> Gerrit-MessageType: comment
> Gerrit-Change-Id: I5876a419dc2437de51149b1fe02ffd900e6ab29e
> Gerrit-Change-Number: 88331
> Gerrit-PatchSet: 19
> Gerrit-Owner: Yedidyah Bar David <didi(a)redhat.com>
> Gerrit-Reviewer: Jenkins CI
> Gerrit-Reviewer: Sandro Bonazzola <sbonazzo(a)redhat.com>
> Gerrit-Reviewer: Yedidyah Bar David <didi(a)redhat.com>
> Gerrit-Comment-Date: Wed, 21 Mar 2018 09:48:41 +0000
> Gerrit-HasComments: No
--
Didi
6 years, 8 months
Change in stdci-staging[master]: jsut a change
by review@gerrit-staging.phx.ovirt.org
>From Daniel Belenky <dbelenky(a)redhat.com>:
Daniel Belenky has posted comments on this change. ( https://gerrit-staging.phx.ovirt.org/143 )
Change subject: jsut a change
......................................................................
Patch Set 1:
ci test please
--
To view, visit https://gerrit-staging.phx.ovirt.org/143
To unsubscribe, visit https://gerrit-staging.phx.ovirt.org/settings
Gerrit-Project: stdci-staging
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I1a6b44a25aada94d45fa81ef1f920194232b31ea
Gerrit-Change-Number: 143
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Belenky <dbelenky(a)redhat.com>
Gerrit-Reviewer: Daniel Belenky <dbelenky(a)redhat.com>
Gerrit-Reviewer: Jenkins CI <infra(a)ovirt.org>
Gerrit-Comment-Date: Wed, 04 Apr 2018 08:46:07 +0000
Gerrit-HasComments: No
6 years, 8 months
Change in stdci-staging[master]: jsut a change
by review@gerrit-staging.phx.ovirt.org
>From Daniel Belenky <dbelenky(a)redhat.com>:
Daniel Belenky has posted comments on this change. ( https://gerrit-staging.phx.ovirt.org/143 )
Change subject: jsut a change
......................................................................
Patch Set 1:
ci test please
--
To view, visit https://gerrit-staging.phx.ovirt.org/143
To unsubscribe, visit https://gerrit-staging.phx.ovirt.org/settings
Gerrit-Project: stdci-staging
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I1a6b44a25aada94d45fa81ef1f920194232b31ea
Gerrit-Change-Number: 143
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Belenky <dbelenky(a)redhat.com>
Gerrit-Reviewer: Daniel Belenky <dbelenky(a)redhat.com>
Gerrit-Reviewer: Jenkins CI <infra(a)ovirt.org>
Gerrit-Comment-Date: Wed, 04 Apr 2018 08:44:29 +0000
Gerrit-HasComments: No
6 years, 8 months
Change in stdci-staging[master]: jsut a change
by review@gerrit-staging.phx.ovirt.org
>From Daniel Belenky <dbelenky(a)redhat.com>:
Daniel Belenky has posted comments on this change. ( https://gerrit-staging.phx.ovirt.org/143 )
Change subject: jsut a change
......................................................................
Patch Set 1:
ci test please
--
To view, visit https://gerrit-staging.phx.ovirt.org/143
To unsubscribe, visit https://gerrit-staging.phx.ovirt.org/settings
Gerrit-Project: stdci-staging
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I1a6b44a25aada94d45fa81ef1f920194232b31ea
Gerrit-Change-Number: 143
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Belenky <dbelenky(a)redhat.com>
Gerrit-Reviewer: Daniel Belenky <dbelenky(a)redhat.com>
Gerrit-Reviewer: Jenkins CI <infra(a)ovirt.org>
Gerrit-Comment-Date: Wed, 04 Apr 2018 08:41:32 +0000
Gerrit-HasComments: No
6 years, 8 months
Collecting /etc (was: Unexpected end of ZLIB input stream)
by Yedidyah Bar David
On Tue, Apr 3, 2018 at 9:32 AM, Yedidyah Bar David <didi(a)redhat.com> wrote:
> http://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-tes...
>
> 10:44:32 FS info:
> 10:44:32 + df -h
> 10:44:32 Filesystem Size Used Avail Use% Mounted on
> 10:44:32 /dev/sda3 908G 64G 844G 8% /
> 10:44:32 tmpfs 24G 3.8G 20G 16% /dev/shm
> 10:44:32 tmpfs 24G 34M 24G 1% /run/libvirt
> 10:44:32 + echo 'RAM info:'
> 10:44:32 RAM info:
> 10:44:32 + free -h
> 10:44:32 total used free shared
> buff/cache available
> 10:44:32 Mem: 46G 4.4G 333M 3.8G
> 42G 38G
> 10:44:32 Swap: 23G 0B 23G
> 10:44:32 + [[ -d
> /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/default ]]
> 10:44:32 + echo 'Prefix size:'
> 10:44:32 Prefix size:
> 10:44:32 + du -h -d 1
> /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/default
> 10:44:32 592M /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/default/internal_repo
> 10:44:32 20K /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/default/virt
> 10:44:32 16K /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/default/scripts
> 10:44:32 3.2G /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/default/images
> 10:44:32 2.7M /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/default/logs
> 10:44:32 3.8G /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/default
> 10:44:32 + [[ -d
> /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/default/images
> ]]
> 10:44:32 + echo 'Images Size:'
> 10:44:32 Images Size:
> 10:44:32 + ls -lhs
> /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/default/images
> 10:44:32 total 3.2G
> 10:44:32 16K -rw-rw-rw-. 1 1015 1015 101G Apr 2 10:29
> lago-upgrade-from-prevrelease-suite-4-1-engine_iscsi.raw
> 10:44:32 1.8G -rw-rw-rw-. 1 1015 1015 101G Apr 2 10:30
> lago-upgrade-from-prevrelease-suite-4-1-engine_nfs.raw
> 10:44:32 1.5G -rw-rw-rw-. 1 1015 1015 1.5G Apr 2 10:44
> lago-upgrade-from-prevrelease-suite-4-1-engine_root.qcow2
> 10:44:32 + echo 'suite.sh: moving artifacts'
> 10:44:32 suite.sh: moving artifacts
> 10:44:32 + [[ -d
> /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/current/logs
> ]]
> 10:44:32 + mv /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1/current/logs
> exported-artifacts/lago_logs
> 10:44:32 + [[ -d exported_images ]]
> 10:44:32 + [[ -d /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1 ]]
> 10:44:32 + find
> /dev/shm/ost/deployment-upgrade-from-prevrelease-suite-4.1 -type f
> -iname '*.junit.xml' -exec mv '{}' exported-artifacts/ ';'
> 10:44:32 + [[ -d test_logs ]]
> 10:44:32 + mv test_logs exported-artifacts/
>
> This looks ok to me. Then:
>
> 10:44:46 Archiving artifacts
> 10:46:04 ERROR: Failed to archive artifacts: exported-artifacts/**
> 10:46:04 java.io.EOFException: Unexpected end of ZLIB input stream
> 10:46:04 at com.jcraft.jzlib.InflaterInputStream.fill(InflaterInputStream.java:186)
> 10:46:04 at com.jcraft.jzlib.InflaterInputStream.read(InflaterInputStream.java:106)
> 10:46:04 at org.apache.commons.compress.archivers.tar.TarArchiveInputStream.read(TarArchiveInputStream.java:614)
> 10:46:04 at java.io.InputStream.read(InputStream.java:101)
> 10:46:04 at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1792)
> 10:46:04 at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1769)
> 10:46:04 at org.apache.commons.io.IOUtils.copy(IOUtils.java:1744)
> 10:46:04 at hudson.util.IOUtils.copy(IOUtils.java:40)
> 10:46:04 at hudson.FilePath.readFromTar(FilePath.java:2307)
> 10:46:04 Also: Also: hudson.remoting.Channel$CallSiteStackTrace:
> Remote call to ovirt-srv19.phx.ovirt.org
> 10:46:04 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1693)
> 10:46:04 at hudson.remoting.UserResponse.retrieve(UserRequest.java:310)
> 10:46:04 at hudson.remoting.Channel$2.adapt(Channel.java:944)
> 10:46:04 at hudson.remoting.Channel$2.adapt(Channel.java:941)
> 10:46:04 at hudson.remoting.FutureAdapter.get(FutureAdapter.java:59)
> 10:46:04 at hudson.FilePath.copyRecursiveTo(FilePath.java:2224)
> 10:46:04 at jenkins.model.StandardArtifactManager.archive(StandardArtifactManager.java:61)
> 10:46:04 at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:245)
> 10:46:04 at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
> 10:46:04 at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
> 10:46:04 at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
> 10:46:04 at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
> 10:46:04 at hudson.model.Build$BuildExecution.post2(Build.java:186)
> 10:46:04 at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
> 10:46:04 at hudson.model.Run.execute(Run.java:1749)
> 10:46:04 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
> 10:46:04 at hudson.model.ResourceController.execute(ResourceController.java:97)
> 10:46:04 at hudson.model.Executor.run(Executor.java:429)
> 10:46:04 java.io.IOException: This archives contains unclosed entries.
> 10:46:04 at org.apache.commons.compress.archivers.tar.TarArchiveOutputStream.finish(TarArchiveOutputStream.java:225)
> 10:46:04 at org.apache.commons.compress.archivers.tar.TarArchiveOutputStream.close(TarArchiveOutputStream.java:241)
> 10:46:04 at hudson.util.io.TarArchiver.close(TarArchiver.java:127)
> 10:46:04 at hudson.FilePath.writeToTar(FilePath.java:2281)
> 10:46:04 at hudson.FilePath.access$2100(FilePath.java:196)
> 10:46:04 at hudson.FilePath$45.invoke(FilePath.java:2216)
> 10:46:04 at hudson.FilePath$45.invoke(FilePath.java:2212)
> 10:46:04 at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2760)
> 10:46:04 at hudson.remoting.UserRequest.perform(UserRequest.java:207)
> 10:46:04 at hudson.remoting.UserRequest.perform(UserRequest.java:53)
> 10:46:04 at hudson.remoting.Request$2.run(Request.java:358)
> 10:46:04 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
> 10:46:04 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> 10:46:04 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 10:46:04 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 10:46:04 at java.lang.Thread.run(Thread.java:748)
> 10:46:04 Caused: java.util.concurrent.ExecutionException
> 10:46:04 at hudson.remoting.Channel$2.adapt(Channel.java:946)
> 10:46:04 at hudson.remoting.Channel$2.adapt(Channel.java:941)
> 10:46:04 at hudson.remoting.FutureAdapter.get(FutureAdapter.java:59)
> 10:46:04 at hudson.FilePath.copyRecursiveTo(FilePath.java:2224)
> 10:46:04 Caused: java.io.IOException: Failed to extract
> /home/jenkins/workspace/ovirt-system-tests_manual/transfer of 8678
> files
I tend to guess this is the root cause. I wanted to collect all of /etc,
perhaps that's too many files for jenkins.
artifacts:
- /etc/*ovirt*
Are there objections to a patch that will fix this to support wildcards?
We have these on a typical engine machine, I'd rather not list all of them:
ovirt-engine
ovirt-engine-dwh
ovirt-engine-metrics
ovirt-engine-setup.conf.d
ovirt-engine-setup.env.d
ovirt-host-deploy.conf.d
ovirt-imageio-proxy
ovirt-provider-ovn
ovirt-vmconsole
ovirt-web-ui
> 10:46:04 at hudson.FilePath.readFromTar(FilePath.java:2317)
> 10:46:04 at hudson.FilePath.copyRecursiveTo(FilePath.java:2221)
> 10:46:04 at jenkins.model.StandardArtifactManager.archive(StandardArtifactManager.java:61)
> 10:46:04 at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:245)
> 10:46:04 at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
> 10:46:04 at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
> 10:46:04 at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
> 10:46:04 at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
> 10:46:04 at hudson.model.Build$BuildExecution.post2(Build.java:186)
> 10:46:04 at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
> 10:46:04 at hudson.model.Run.execute(Run.java:1749)
> 10:46:04 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
> 10:46:04 at hudson.model.ResourceController.execute(ResourceController.java:97)
> 10:46:04 at hudson.model.Executor.run(Executor.java:429)
> 10:46:04 Build step 'Archive the artifacts' changed build result to FAILURE
>
> Any idea?
>
> Now running it again, let's see what happens.
>
> http://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-tes...
> --
> Didi
--
Didi
6 years, 8 months