The concern is that the government is using the ideological exclusion provision and other immigration laws to manipulate and censor political and academic debate inside the United States.
Barring people from the country because of their ideas skews and impoverishes political debate inside the United States.