they can downvote if their instance is federated with yours, the downvotes won't federate though and will only be seen by users on the same instance.

look at some hexbear posts from lemmy.ml and lemm.ee for instance.

Woops read this the wrong way around. No they can't at least not with the UI. Look at any lemm.ml or lemm.ee post from hexbear.