Is lfedora1 experiancing some kind of downtime atm?

Hi Dan, We're seeing weird errors from jobs we're running on lfedora1, as if some basic binaries like `touch`, and `sleep`, and `git` are missing... Do you know what is going on there? Thanks, Barak. -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

On Wed, 29 May 2019 15:46:23 +0300 Barak Korren <bkorren@redhat.com> wrote:
Hi Dan,
We're seeing weird errors from jobs we're running on lfedora1, as if some basic binaries like `touch`, and `sleep`, and `git` are missing...
Do you know what is going on there?
uff, no idea now, but I'll look everything looked OK just an hour or two ago Dan

On Wed, 29 May 2019 at 16:05, Dan Horák <dhorak@redhat.com> wrote:
On Wed, 29 May 2019 15:46:23 +0300 Barak Korren <bkorren@redhat.com> wrote:
Hi Dan,
We're seeing weird errors from jobs we're running on lfedora1, as if some basic binaries like `touch`, and `sleep`, and `git` are missing...
Do you know what is going on there?
uff, no idea now, but I'll look everything looked OK just an hour or two ago
Turns out its my fault - I was a little careless and managed to cause mock to effectively do `rm -rf /`. (I can explain in detail, but its kind of a boring thing that happens to have spectacular results...) Terribly sorry about that. I already erased the code that could have caused that on my end. -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

On Wed, 29 May 2019 16:10:24 +0300 Barak Korren <bkorren@redhat.com> wrote:
On Wed, 29 May 2019 at 16:05, Dan Horák <dhorak@redhat.com> wrote:
On Wed, 29 May 2019 15:46:23 +0300 Barak Korren <bkorren@redhat.com> wrote:
Hi Dan,
We're seeing weird errors from jobs we're running on lfedora1, as if some basic binaries like `touch`, and `sleep`, and `git` are missing...
Do you know what is going on there?
uff, no idea now, but I'll look everything looked OK just an hour or two ago
Turns out its my fault - I was a little careless and managed to cause mock to effectively do `rm -rf /`. (I can explain in detail, but its kind of a boring thing that happens to have spectacular results...) Terribly sorry about that. I already erased the code that could have caused that on my end.
ah, that's not good, but things like that happen. Will see how much can be saved. Good is that I transferred all user accounts (not their data) and a bit more of the setup under my ansible playbooks couple weeks ago. Dan

Hi Barak, On Wed, 29 May 2019 16:10:24 +0300 Barak Korren <bkorren@redhat.com> wrote:
On Wed, 29 May 2019 at 16:05, Dan Horák <dhorak@redhat.com> wrote:
On Wed, 29 May 2019 15:46:23 +0300 Barak Korren <bkorren@redhat.com> wrote:
Hi Dan,
We're seeing weird errors from jobs we're running on lfedora1, as if some basic binaries like `touch`, and `sleep`, and `git` are missing...
Do you know what is going on there?
uff, no idea now, but I'll look everything looked OK just an hour or two ago
Turns out its my fault - I was a little careless and managed to cause mock to effectively do `rm -rf /`. (I can explain in detail, but its kind of a boring thing that happens to have spectacular results...) Terribly sorry about that. I already erased the code that could have caused that on my end.
seems it's a lucky day today, the system should be recovered and back online. It looks like only the /bin and /lib64 symlinks were lost, so I've re-created them, rest looks intact. Dan

On Wed, 29 May 2019 at 18:51, Dan Horák <dhorak@redhat.com> wrote:
Hi Barak,
On Wed, 29 May 2019 16:10:24 +0300 Barak Korren <bkorren@redhat.com> wrote:
On Wed, 29 May 2019 at 16:05, Dan Horák <dhorak@redhat.com> wrote:
On Wed, 29 May 2019 15:46:23 +0300 Barak Korren <bkorren@redhat.com> wrote:
Hi Dan,
We're seeing weird errors from jobs we're running on lfedora1, as if some basic binaries like `touch`, and `sleep`, and `git` are missing...
Do you know what is going on there?
uff, no idea now, but I'll look everything looked OK just an hour or two ago
Turns out its my fault - I was a little careless and managed to cause mock to effectively do `rm -rf /`. (I can explain in detail, but its kind of a boring thing that happens to have spectacular results...) Terribly sorry about that. I already erased the code that could have caused that on my end.
seems it's a lucky day today, the system should be recovered and back online. It looks like only the /bin and /lib64 symlinks were lost, so I've re-created them, rest looks intact.
Good to know! And thanks for handling this so quickly! Again, sorry for causing this mess.
Dan
-- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted
participants (2)
-
Barak Korren
-
Dan Horák