News and Notes

16 Dec Website Degradation [resolved]

1058 Views
Permalink: ID #1400
Date: 2019-12-16 08:28 AM
Author: Daryl Herzmann
Tags: outage
An important disk unexpectedly ran out of inodes and caused a strange cascading failure that knocked out the IEM website between about 5 AM and 8:30 AM on 16 December 2019. I thought I had things under control shortly after the issue started, but the cascading failure caused the NAT gateway to not properly operate and things went downhill for a Monday morning after that. Will boggle this all and try to figure out how to keep it from happening again! Thanks for your patience.