I just got up from conversation with a couple of older black men, that I said "well I got to go back to work and start cracking the whip." And it occurred to me then that it was probably a really insensitive stupid thing to say.
Sadly, it hadn't occurred to me until it's already said.
The misunderstanding of your objection comes from the fact that I’ve just never heard of it in the context of “giving good weather and taking it away” as in “Indian giver”. The fact that they both have the word Indian the only connection I can make to what you’re saying. The only references I can find to a pejorative origin is in articles from years ago saying that the phrase possibly needs to be changed because of possible negative origins. Obviously culture hasn’t decided it’s necessary to change the phrase (yet). The fact that it’s used as a positive metaphor for non-weather things should be considered too.