Attacking Roberts as unlikely to defend the personal freedoms you are concerned about would have more resonance with many voters.
Associating Roberts with some kind of extremism would likely backfire because he is unlikely to be seen as extremist.