You'd have more cars constantly on the road because the smaller pool of cars has to also travel to where the people are. If I go from A to B and later from B to A, a robotaxi would also need to get to A and B when I need them. It really won't matter if they're in use or drove off to a parking lot somewhere else, that is extra traffic.