Exactly this, the idea that every viewpoint deserves to be respected and given an equal share of attention is false. Racists, homophobes, ect don’t deserve to be given a platform to spread their views and down votes are one of the more effective tools a community has to limit those kinds of content.