That's the thing, it doesn't have to affect a lot of people to be a big problem. Founders are pretty valuable, keeping even a small number of them out with artificial barriers is bad thing, since the alternative (letting them in) does not seem that daunting (unless you fear foreign founders for some reason).