Former lolbertarian here. Opposing the CRA is extremely common in those circles. Of course, they frame it as an issue of big gubbermint forcing poor small business tyrants to serve customers even if they don't want to. Even during that phase of my life, I stayed the hell away from that argument because it was so outlandish.