Isekai is probably the worst case of people thinking a genre is defined by its name. Most of them are in no way about being from another world, and a lot of portal fantasy media is mistakenly identified as isekai even though they share pretty much no similarities with the core of the genre.