I love No Dogs In Space, specifically for the way they describe an era thru a few episodes focusing on one band, and also describe that bands history and how it was meaningful/impactful. The chatting is cute, but not a must.
I also love Tides Of History.
I haven't listened to it in a while, but And Introducing by Chris and Molly Wade (yep, the Chapo producer) is pretty entertaining. I've mostly listened to the older episodes that are focused on books about musicians, but I think they've pivoted to doing quite a few artist interviews more recently