I hear that explanation often, but then they’ll turn around and speak authoritatively about that country, as though they’re “from there”.

Americans speak authoritatively about everything. It's not unique to places where their family is from. Almost every American could speak confidently on what is wrong in the middle east despite not claiming heritage or even reading a single book on the area. I think you're connecting two unrelated traits here.