As someone from a country where it almost never snows most places, the idea turning off the power can kill people is terrifying. Even if the water went off here I know where there are more or less potable natural water sources. Also I think a good chunk of the main infrastructure is gravity fed which is lucky.

With fairly rudimentary skills you can have clean water. A slow sand filter with a biochar layer, a couple sedimentation tanks, and a drip connection from one to the next would suffice for nearly all biological contaminants and many chemical ones.