"someone who uses the site casually but who has useful things to say." will quickly get a lot more than 50 karma, so it doesn't really work against them at all.