You're on the money. I wish they had been more explicit about the duke wanting to basically exploit the Fremen for his own gain. In the book he plans to use them as an army believing that they could match the sardukar in battle. It's why he walks into the obvious trap. He's not trying to wipe them out, but like you said he's not going to leave them alone like they want.