Thanks DC OPs guy who disconnected VMWare hosts and went haywire even after reconnecting it. Man that was a strange cascading problem.
I once had a CIO who pulled plugs in the DC for fun to test redundancies. Redundancies the company hadn't built out yet because they were too cheap.
I worked for a place once that had the A/C go out in the server room..... on a long weekend. People had to take turns sitting in the room for hours on end to keep an eye on the temperature and chase out the birds that were flying in the open windows....
Similar thing happened once in a lab environment (not monitored for paging 24/7).
Came in one day ang et to my desk. People come up to me I can't access the environment." There was a big storm previous night and sometimes we needed to reboot the switches, so I go check that. All was fine so I head down to the server room.
Barricades in hallway leading up to server room. "Oh that's not good." I get to the server room door, other sys admin comes out dripping in sweat. "Don't go in there, AC went down and it's about 4 decrees C in there".
When he got in and got blown back by the heat, he went to the breaker panel and shut everything off.
We were down the whole day, powered up the next morning.
