NB is a big umbrella with a lot of people who really don't want to be put into boxes (not that there aren't lots of binary people also in that camp: people shouldn't try to shove each other into narrow boxes regardless). I think the autistic meme that could be adapted to NBs is "if you've met an NB, you've met one NB."

OTOH, if using the label leads to making assumptions about you that you don't want, it makes sense to avoid it. Labels should be for your benefit, not detriment.