Not all landlords are rich, but every one of them makes more money than they deserve.

I think his point was his dad wasn't rich when be rented his first house, but the hypersonic rise after he stopped actually working sort of disproves this. Landlordism is about making money without working. A 'poor' landlord just hasn't mastered the technique yet, but they're fundamentally the same as the rich ones.