Blasted power companies, and useless power surge boards

Power cables in WN should be buried; not left to blow in the wind.

Power surges on saturday causing all my servers to reboot. And a complete power outage for almost 2hrs on sunday night.

The complete power outage caused a hard drive to fail in one of my VM hosts. I am not impressed !. Especially as it took me at least 40 minutes just to get it booted to the point I could diagnose the problem.

Every time there is a windy day, the power goes out, probably averaging at least once a month this year. And as the weather is supposed to be getting worse every year it is a shame we can expect this to continue happening.

WN is on par with a 3rd world country for more than just bad roads. Seems a lot of the infrastructure is being left to eventually break; actually it is guaranteed to break and expected to get worse, how nice.

Anyway, I have a server I have to pull apart and guess which of the three disks has failed. Well ok guess which of the two as it was one of the spinning disks that failed and not the SSD.

Anyway it was all the user profiles and configuration scripts that were on the failed disk… which prevented anyone including me logging on until I forced it into maintenance mode, making it hard to fix.

Have made a temporary directory on the still spinning disk, changed the userid entries to use the temporary directory, and done a full restore from the last full backup and all the incrementals since then. Can at least logon to it now.
Sigh, where are my screwdrivers, I have a spare 320Gb SATA disk in a drawer, but then how to figure out which is the dead one as power will be off when I poke in a screwdriver; ugh.

And all of these machines were powered by seperate DSE surge protected power boards. And none of those power boards have a red light on. I guess the power surge protection feature is to protect the power surge boards, not the devices plugged into them.

Anyway I effectively don’t have a backup VM server anymore. Due to power companies letting infrastructure become unmaintainable and surge protector boards proving useless.

About mark

At work, been working on Tandems for around 30yrs (programming + sysadmin), plus AIX and Solaris sysadmin also thrown in during the last 20yrs; also about 5yrs on MVS (mainly operations and automation but also smp/e work). At home I have been using linux for decades. Programming background is commercially in TAL/COBOL/SCOBOL/C(Tandem); 370 assembler(MVS); C, perl and shell scripting in *nix; and Microsoft Macro Assembler(windows).
This entry was posted in Home Life. Bookmark the permalink.