I think you make a great point, but I also think an actual reply would be a much better way to express disapproval. If the downvote is available, most users would probably just go straight to that and be done with it. If it were disabled, however, it might encourage people to instead explain why they disapprove of something, which would give better feedback for the person who made the offending comment and help them learn.