Abuses of the freedom of speech ought to be repressed, but...

Abuses of the freedom of speech ought to be repressed, but to whom are we to commit the power of doing it?