The reason we set limits in the first place is because it has an impact on everyone else. Changing it will change the illegality, but it doesn't change the impact. Immigration affects labor markets and social institutions.
There is no reason to flood the labor market with more unskilled workers when we have a more than ample supply in this country.