I tend to do whatever the person hosting me wants. Very often I simply ask if I should take my shoes off and the friend hosting me will say no. Other people I know prefer that everybody take their shoes off. I will say that I grew up in a decently well-off suburb in the midwestern US but with a wide range of income levels at the public high school I went to, and growing up the general trend was that people with bigger, fancier houses always asked you to take your shoes off, while the people in more modest neighborhoods didn't do so. That's just how it is where I grew up, I don't have any strong opinion about one way being better or more correct.