We had a freak occurrence this morning. One of our ISP was doing some network maintenance, and this normally does not cause an issue in our case. However, somewhere during the network “upgrade” some routing policies and peering agreements information was lost.
That’s the bad news. Worse than that, we called tech support after the outage went longer than we where told it would, they informed us that our firewall or gateway was misconfiguration. Now, I can attest to some pretty strange occurances, but a switch or firewall reconfigured by itself, is a little much to swallow.
Good news is the issue was identified by their NOC and corrected with 2 hours. The lesson learned is to never take routine maintenance for granted. Be vigilant in keeping backup images of all network equipment, just in case.
