Good point. So maybe the answer is some sort of quid pro quo. You're forcing me to give up driving myself? I'm forcing you, the government (through voting; cue laughter from the cynical gallery), to restrict what you're able to do to self-driving cars (need a warrant to force-stop, no en-masse disabling, etc.). I say that with a US-centric viewpoint, of course, because there's zero chance countless countries around the world be sensitive to their citizens' objections (questionable in the US as well of course, but not out of the question).