they only kinda-literally speak anglo-saxon, because everything is "translated"

in reality they speak a language related to westron.

but yeah, the translation conceit came later, the rohirrim became what they are cos tolkien went "what if anglo saxons but with horses! wouldnt that be coooooool?"