Outage on us jenkins/foreman
--a8Wt8u1KmwUX3Y2C Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi everyone, Currently there's an outage on us services hosted on alterway, that affects= our monitoring, foreman and artifactory. This reflects on java based jobs beign unable to fetch any dependencies. We are working on it, will update with more info in 30 min or when solved. --=20 David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro@redhat.com Web: www.redhat.com RHT Global #: 82-62605 --a8Wt8u1KmwUX3Y2C Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJVt2ixAAoJEEBxx+HSYmnDHrUH/RCvC56UqBEHAxPSFhrHAbiU Kf2hZo8NiboG1AMeD4490I7G60SPfwtzRRz5GPlHYAtoTYnTBbVOlGmgwupXUF1B 8cg6fTU+mbiPNb1C9p2oIwkOWuiVu8oAJufoqSMdTi0aa1YpVX5RWWDE/45olahE AkJT/MkZRt/0fI1QtxMOM1yitgFhihOhxywXdIacNEaSBPqUo5lyGK0qnOURqd16 RBsBb+fAHgUKZexVnZUzYhHx0Si2jCytmoaIC+pUzpKAgnv8/VmnJW/7E1StpkIp oDkJN9HsftvFPPtLY1ObgRW01ryqOLcq03o3G1j3yfAkGdHzpGwcBBfbPVfeoFQ= =qnN6 -----END PGP SIGNATURE----- --a8Wt8u1KmwUX3Y2C--
--v9Ux+11Zm5mwPlX6 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable We are still working on it, it seems that we are having issues with dhcp running in the vms, and a few segfaults on the vdsm host... on it On 07/28, David Caro wrote:
=20 Hi everyone, =20 Currently there's an outage on us services hosted on alterway, that affec= ts our monitoring, foreman and artifactory. =20 This reflects on java based jobs beign unable to fetch any dependencies. =20 We are working on it, will update with more info in 30 min or when solved. =20 =20 --=20 David Caro =20 Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D =20 Tel.: +420 532 294 605 Email: dcaro@redhat.com Web: www.redhat.com RHT Global #: 82-62605
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
--=20 David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro@redhat.com Web: www.redhat.com RHT Global #: 82-62605 --v9Ux+11Zm5mwPlX6 Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJVt28kAAoJEEBxx+HSYmnDFJEIAJZgC4Vz6IgybflKHmzQMRcH VOSpC7Y/9XrQp39D7cvq0BWQvYtLXnw+eKNexf6kSwhIbDv3MBH0K5A7sXlPRhFn sCm69DPcFZehEVa7gH88nesle9lSq6ziol4jXkOMM7UgVJjSmhSYNka/VDtcizT/ 5rZcyXEhTVO4y2U53Jht1209/HKpgLt1zLz/uhjAWp4Qukwu4K0rey691Kwrv+Bx vylbqNzb8Hdwm1CjscaULd0iMq5Lxslg7Xs9/yfgolT9ZPwBAESKY0zqCSYELzRq g5R7iWjAOU7XQ74NCYJgynJE4YxDAc+lPbLsey4M4bwjq6Cn8Y3atHoFVRNgMXM= =R8vp -----END PGP SIGNATURE----- --v9Ux+11Zm5mwPlX6--
--ncSAzJYg3Aa9+CRW Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Still on it, we have upgraded dhclient on all the vms there, and rebooted, = but it seems it did not solve the issue. On 07/28, David Caro wrote:
=20 We are still working on it, it seems that we are having issues with dhcp running in the vms, and a few segfaults on the vdsm host... on it =20 On 07/28, David Caro wrote:
=20 Hi everyone, =20 Currently there's an outage on us services hosted on alterway, that aff= ects our monitoring, foreman and artifactory. =20 This reflects on java based jobs beign unable to fetch any dependencies. =20 We are working on it, will update with more info in 30 min or when solv= ed. =20 =20 --=20 David Caro =20 Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D =20 Tel.: +420 532 294 605 Email: dcaro@redhat.com Web: www.redhat.com RHT Global #: 82-62605 =20 =20 =20 _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra =20 =20 --=20 David Caro =20 Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D =20 Tel.: +420 532 294 605 Email: dcaro@redhat.com Web: www.redhat.com RHT Global #: 82-62605
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
--=20 David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro@redhat.com Web: www.redhat.com RHT Global #: 82-62605 --ncSAzJYg3Aa9+CRW Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJVt3mNAAoJEEBxx+HSYmnD74AH/2J27EuVzOjpS1C07i/eHS6p Cu0vmzD48nYqYO2ORHosgDpPP+ktt1i3mLqzdGEmhLO1L/O2Eh16Z5METOF3JLgj hcGhmGFQ937LFPDccLihTyYeUAfPQie3n2wz54wKueT5YuldHYCUxD4HeIcRAEpc C/lPBMaV1hWqYDnYH3TSNNLFvV7vWWMnGZISCW0WH6d0RXhKy8vUKAGAic9h6GsK 8qamI4Hy7e9O3TYn2hAtoqaQ2S+9JN8H6uSf/2C7Kv/6upbHpYhYvHlc6hbmhgET VwNIt/yZy0qA/Ce66xKM0uTQOK/XEMp6bPgOGO/loaiyLBFwGlnRwym1OK8A/EM= =PfnL -----END PGP SIGNATURE----- --ncSAzJYg3Aa9+CRW--
Hello All. The situation on alterway is stabilized, however it may repeat again and we try to keep it proactively monitoring. The reason for outage was dhcp leases not always renewing in time leaving hosts periodically without IP addresses. This is possible due to some networking issues between hosts. As a mitigation measure DHCP lease times has been increased also. artifactory, monitoring and stats are up now. Anton. On 07/28/2015 02:46 PM, David Caro wrote:
Still on it, we have upgraded dhclient on all the vms there, and > rebooted, but it seems it did not solve the issue. > -- Anton Marchukov Senior Software Engineer, RHEV CI
participants (2)
-
Anton Marchukov -
David Caro