Wouldn’t camouflage still work? The color of the camouflage would still match the color of what it’s trying to blend in with if you switched the colors.

Colorblind tests measure your failure to distinguish the relation of multiple subjectivities. It can be said that this relation is objective. Color blindness is a dysfunction of the cells in your eye, something much more easily examined than internal experience.