So you're including free models like freeware, not FOSS only, by non big tech.

Your choice of models will be quite limited as the compute resource and training corpus needed to make a viable base model isn't anyone can do.