Yeah, I'm fudging just a little bit. Part of how the symmetry gets broken is that the Earth itself (obviously) has a magnetic field, so spins that "line up" with that external field are slightly more likely. It's not enough to magnetize most materials directly, but it's enough to start the phase change happening.