This is where I'm at. I think anyone can talk about "special interests", as long as they remember you can just have a regular interest. The term should be for communicating that a topic is important to you in a way other people may not be expecting, possibly something odd and specific. It shouldn't be because you feel like you need an excuse to care about something at all.