The number one problem in housing is that it is financialized: the entire system is built on infinite growth in real estate value and borrowing against it, etc etc. Zoning is the micro scale effect of this, where homeowners become protective of their supposed infinite value cow (for lack of guaranteed housing and retirement, everyone must instead scramble to get theirs).

You can mildly push back on this through zoning, but you aren't going to stop the spiral, just slow it down.