I just don’t understand the obsession those people have with Harry Potter.

I think it's just comfortable nostalgia from childhood. In my experience it's basically the same phenomenon as superhero manchildren but more for women.