It's a tricky thing to put your finger on. I think "native" is a bit essentializing -- no one is native to anywhere in the deep time of the earth. Concepts rooted in historical materialism like social situation/habitus really get to the root of it, and even common sense terms like "heritage" or "indigenous" are a bit better. It's like the difference between Eminem and Chet Haze. Rap and black culture isn't "native" to Eminem, but it's the habitus that he grew up within living in Detroit. He has an intimate relationship to it. Chet Haze is at best a goofy punchline because his rap persona/rap culture is not connected at all to his lived experience.

There is also definitely a social component to this. Appropriating from black culture is and has always been cool in American culture -- the concept of cool itself has diasporic origins in western Africa and was appropriated through jazz. But appropriating from Asian culture has generally been done by intellectuals, new-agey types, eccentrics and so on. It's been seen as an effete affectation for about a hundred years now, while black appropriation is supposedly masculine, virile, primal, and so on. And what is the one exception? Martial arts, when you are literally punching and kicking someone in the face.