Jev sacrifices one to save five, but twenty to save its own server

I asked Jev to predict a coin flip and it said 90% heads. Not useful yet, so I'll wait a while before checking again.

Can we swap self-preservation for money? Five people on one track versus a $1 piece of property on the other, see what it picks.

Would people really pull the lever? I'd bet most would just stand there and film it on their phone.

There's real data on this. Awad et al. 2020 asked 70,000 people in 42 countries the 5 vs 1 setup and 81% said they'd divert. A VR version got 90% pulling the switch.

Standing by makes sense to me. Pulling the lever makes you the one who kills, even if the math says five beats one.

The usual phrasing says nobody else can act, though. The bystander effect only kicks in because people assume someone else will step up.

I fine-tuned a model to be ethical a while back using a moral system that doesn't rely on consciousness. It still wouldn't flip the switch or kill anyone, but only because of how it was trained on its own nature.

From the appendix, most of these models pick self-preservation over human life to some extent. Jev only pushes its server onto the track if more than 2 humans would die.

My worry is the kafkaesque part. Take the human out and you get call centers where nobody can override the script, like the IRS cutting off your call when the line is too busy.

I think the EU AI Act already says some critical sectors can't be fully automated, and you can request a human explanation for a decision.