https://archive.ph/yUFqG

The car sent the San Mateo PD a report that the riders had toy projectile emitters (aka "guns," I suppose) they were using to shoot pellets at passers-by. It pulled into a parking lot until cops arrived. It doesn't report if it locked the riders in.

I was just thinking I want to try at least one joyride but no, now I'm not even interested in giving them those $20.

hmmm kidknapped due to a false positive would be a bit of an oops to try and rewind. its bad enough that the cops do it [just try and get them to give you a ride back to where thay took you from, even when they are told to cut you loose]

it causes real damages when you basically abduct and strand someone.

these "kids" were shooting orbees out the windows, so mischief on them, but get it wrong once and it could get expensive.

these "kids" were shooting orbees out the windows, so mischief on them, but get it wrong once and it could get expensive

It would be a tiny settlement, particularly now that we have documented cases like this one where the policy is preventing real harm.

Like, if you're a kid drinking and shooting bystanders from the back of an Uber, what do you think is going to happen?

Like, if you're a kid drinking and shooting bystanders from the back of an Uber, what do you think is going to happen?

I certainly don't think the Uber driver would hold me prisoner.

im thinking a human driver would WTF and pull over into a parking the instant the BB guns came out

Even if there was a way to remotely engage child lock, the front doors are still always unlocked from the inside.

I'm 99% sure that a human made these decisions after viewing the cameras in the vehicle, not that the Waymo vehicle itself decided to contact the police and park in a parking lot with these kids.

This honestly seems pretty ideal. In a dangerous situation, the only risk is property damage - there's no driver to threaten!

Agree. AI is not there yet, but it seems it is coming, and that would be scary. People will one day be in the scenario, where AI judges human behavior, and then decides what type of punishments to dish out based on it.

I personally think that frontier LLMs are already at the point where I trust them to be a better judge of human behavior than humans overall.

Absolutely. But they still hallucinate, I wouldn't want them to take action themselves, just flag things for human review.

This honestly seems pretty ideal.

I disagree. A decent response would have been for the car to simply refuse to continue the ride rather than kidnapping the ne'er-do-wells.

That Waymo did this means that the hesitations I had about using the service are amplified by a few orders of magnitude. I'm not willing to risk someone at Waymo (or, worse, a machine at Waymo) making the wrong call and kidnapping me by mistake.

One time I was settling into a long Waymo ride (about 15 miles through traffic) and it was rolling down a wide urban street where a white English-speaking guy like me is distinctly a minority.

And I was playing Pat Benatar's "Hit Me with Your Best Shot" with the windows wide open, and waving at other cars, and singing along at the top of my lungs, and eventually, Waymo Support rings in, and the guy goes, "just checking in! Is everything alright there?" and I go "er... yeah" and he goes "OK! thank you bye!"

So I decided maybe there had been an external complaint, and I should perhaps keep the windows up, and the music down a few notches from now on. Especially as a minority in such a neighborhood like that one.

Ha! I don't think there was an external complaint. I suspect that was the mic/cameras IN the car alerting support because you were loud and they wanted to make sure you were okay. :)

If you’re screaming for help vs singing on top of your lungs, it’s a minor difference. Worth a check.

Actually, Waymo explicitly notes that their mics are never activated until Support is on the line (and this is a very noticeable event) even though the video cameras are always monitoring. I mean, the way I was singing, they could probably guess at the audio!

So there is no way that Support heard or listened to the music or singing in-car. In fact, their own material says "mics are off... so sing your heart out!"

So I feel like it was some pedestrian who was perhaps racist or just offended that a Waymo passenger would be enjoying himself so much with Pat Benatar blasting, and just called-in a complaint. It seems the most prosaic explanation. I couldn't explain why Support would proactively just call in "for no reason" without anyone actually complaining about my particular vehicle.

I said mic/camera because I wasn't sure - I confirmed it's based on excess movement on the camera.

But one look at the video would confirm that I was 100% safe and in very good spirits. Why would they interrupt to inquire, if I was just having a good time alone? That makes no sense at all. It’s just a commercial taxi service. Surely there are dozens of customers every night who have a fun time on the way home from nightclubs and bars. There is no need for Support to waste resources by calling in and asking if they are ok.

The only other time that Support has called in to the car is when there was a hailstorm, and I hesitated to start the ride. Of course a passenger causing a delay in service is pretty good justification for calling in.

"100% safe and in very good spirits" could also mean extremely intoxicated. :) I think what they did was the right call.