If your position is "I would never sleep with a trans person" you're just transphobic. I usually respond with "but what if they pass and are post op?" and the answer is almost always still no, because the problem isn't some specific sexual preference, the problem is they still view you as your AGAB.