Don't just not talk to the cops, you have to explicitly invoke your right to remain silent otherwise, if you haven't had your rights read, they can still use your silence against you.

"I wish to observe my 5th amendment right to remain silent" or something like that.