[OPLINTECH] OPLIN post-mortem - Intermittent Connectivity on Spectrum circuits Sunday Afternoon

[Karl Jendretzky]

Good morning All,

Yesterday afternoon OPLIN sites serviced via Spectrum experienced
intermittent connectivity between ~2:55pm and 5:50pm. All services are now
stable.

Root cause was a failed 10G network card which took out parts of multiple
redundant circuits. Spectrum service was the only one impacted, because low
light levels on the remaining fiber path caused intermittent connectivity.

To remediate we bypassed the unstable fiber path, swapped out the bad card,
then rerouted/polished each fiber jump on the unstable path to restore
normal light levels.

Sorry for the disruption on such a sunny Sunday afternoon.

Karl Jendretzky
Technology Projects Manager
Ohio Public Library Information Network
(614) 728-1515
karl at oplin.ohio.gov
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.oplin.org/pipermail/oplintech/attachments/20210308/361475a0/attachment.htm>