When people talk about locations like I know where tf so-and-so street and that one building is off the top of my head.

I think in terms of paths eg. how I would get there from my place, so turn here then there etc. Numbered streets are slightly more helpful for me because of this, but I still need to walk/drive there or see the Google Maps street view to understand fully

One time someone kept drilling me beyond the limits of casual conversation about where I worked. I ended up just pulling out my phone and telling him to look it up if he really needs to know, wtf