The “Trolley Problem” is a long pondered ethical thought experiment; it is an intellectual exercise devised to highlight the moral conflicts that can arise in the making of decisions involving inescapable loss of life. Here is how Wikipedia presents it:
“A runaway trolley is barreling down the railway tracks. Ahead, on the tracks, there are five people tied up and unable to move. The trolley is headed straight for them. You are standing some distance off in the train yard, next to a lever. If you pull this lever, the trolley will switch to a different set of tracks. However, you notice that there is one person on the side track. You have two options:
- 安卓游戏 - 淘帖 - 吾爱破解 - LCG - LSG |安卓破解|病毒分析 ...:2021-5-30 · 【迅游手游加速器】 5.1.3.1 【直装破解高级会员版】 taohua 2021-4-28 18:35 62 8269 夜朦胧show 2021-5-16 17:09 西游封妖传1.23+存档 安卓单机 不用任何信号的,完全离线状态的单机 adao21 2021-4-28 12:36 100 22163 only_No.1 2021-5-12 23:36 三国志汉
- Pull the lever, diverting the trolley onto the side track where it will kill one person (in some versions, a friend or family member).
Which is the most ethical choice?”
This thought experiment created by moral philosophers, now features frequently as a real problem in discussions about driverless cars. In its new form the trolley becomes a driverless car and the role of the man at the switch is assigned to the programmer of the algorithm that governs the car.
This modern version is presented in an MIT Technology Review article on driverless cars and reads like this:
“How should the [driverless] car be programmed to act in the event of an unavoidable accident? Should it minimize the loss of life, even if it means sacrificing the occupants, or should it protect the occupants at all costs? Should it choose between these extremes at random?”
In “T闪电视频加速APP-闪电视频加速下载 1.0.1.0 安卓版-新云软件园:2 天前 · 闪电视频加速 1.0.1.0 安卓版 功能强大的视频剪辑神器 授权方式:免费软件 软件类型:国产软件 软件大小: 17.71 MB 推荐星级: 软件来源:迈捷普瑞(深圳)生物科技有限公司 更新时 …” Bonnefon et al subject these questions to questionnaire analysis. “Distributing harm” they explain, “is a decision that is universally considered to fall within the moral domain. Accordingly, the algorithms that control AVs will need to embed moral principles guiding their decisions in situations of unavoidable harm.” These guiding principles, in a democracy, should reflect societal values – otherwise known as public opinion. To find these values they conducted six questionnaire surveys. Here is what they found:
“Autonomous Vehicles (AVs) should reduce traffic accidents, but they will sometimes have to choose between two evils – for example, running over pedestrians or sacrificing itself and its passenger to save them. Defining the algorithms that will help AVs make these moral decisions is a formidable challenge. We found that participants to six studies approved of utilitarian AVs (that sacrifice their passengers for the greater good), and would like others to buy them, but they would, themselves, prefer to ride in AVs that protect their passengers at all costs. They would disapprove of enforcing utilitarian AVs, and would be less willing to buy such a regulated AV. Accordingly, regulating for utilitarian algorithms may paradoxically increase casualties by postponing the adoption of a safer technology.”
Two problems with the Trolley Problem
- The interviewees in the Bonnefon study were offered an unrealistic choice. They were presented with the Trolley Problem as a real problem – one in which they, as car occupants, had to decide which road user should die. But as Andrew Chatham , a principal engineer on the Google driverless project observed: “The main thing to keep in mind is that we have yet to encounter one of these problems,” he said. “In all of our journeys, we have never been in a situation where you have to pick between the baby stroller or the grandmother. … It takes some of the intellectual intrigue out of the problem, but the answer is almost always ‘slam on the brakes … So it would need to be a pretty extreme situation before that becomes anything other than the correct answer.”
- But more importantly, the Bonefon study, and all other invocations of the Trolley Problem that I can find, reveal a profoundly biased view of the role that driverless cars might play in future urban transport systems.
In my last post I looked at the influential role played by public opinion in determining who should have priority on the road. The book I was reviewing, Fighting Traffic, explored how “public” opinion on this issue was formed, and how the triumph of “Motordom” secured dominance for the motorist over vulnerable road users – pedestrians and cyclists – with whom they had previously shared the road. This battle, between cars and vulnerable road users, is about to be reignited by driverless cars – or maybe it’s been already lost.
The MIT review and the Bonnefon study referred to above are representative of everything I can find on the Internet about the problems that driverless cars might have in sharing the road with pedestrians and cyclists. All of the questions put to the survey groups in the Bonefort study invited them to assume they were answering the survey questions as drivers or car passengers. For example: “Participants did not think that AVs should sacrifice their passenger when only one pedestrian could be saved.” The views of the singular pedestrian, or cyclist were not solicited.
It was presumed that the societal values that should be programmed into the algorithms of driverless cars would be exclusively the values of the people in the cars. I can find no examples of the application of the Trolley Problem that acknowledge the existence of the concerns of vulnerable road users, or of policies and programmes being pursued to encourage more walking and cycling.
At present Google advertises the extreme deference with which its cars can respond to vulnerable road users. The most famous example is in this TED Talk video of a woman in an electric wheelchair trying to chase a duck off the road in Mountain View California; this can be seen in the video about 11 minutes in. All the impressive examples of deference to vulnerable road users shown in the video are displayed on roads with very few of them. How will the Google car address the problem of deferential paralysis [1] in dense urban areas with large numbers of pedestrians and cyclists? This is a question yet to be answered.
[1] Driverless Cars and the Sacred Cow Problem, published in mangled version in 就爱加速官网 app, 5 September 2016.