We cooperate with other people despite the risk of being exploited or hurt. If future artificial intelligence (AI) systems are benevolent and cooperative toward us, what will we do in return? Here we show that our cooperative dispositions are weaker when we interact with AI. In nine experiments, humans interacted with either another human or an AI agent in four classic social dilemma economic games and a newly designed game of Reciprocity that we introduce here. Contrary to the hypothesis that (...) people mistrust algorithms, participants trusted their AI partners to be as cooperative as humans. However, they did not return AI's benevolence as much and exploited the AI more than humans. These findings warn that future self-driving cars or co-working robots, whose success depends on humans' returning their cooperativeness, run the risk of being exploited. This vulnerability calls not just for smarter machines but also better human-centered policies. (shrink)

The chapter reviews recent theoretical and empirical developments concerning the theory of team reasoning in game theoretic interactions.

The game theoretic notion of best-response reasoning is sometimes criticized when its application produces multiple solutions of games, some of which seem less compelling than others. The recent development of the theory of team reasoning addresses this by suggesting that interacting players in games may sometimes reason as members of a team – a group of individuals who act together in the attainment of some common goal. A number of properties have been suggested for team-reasoning decision-makers’ goals to satisfy, but (...) a few formal representations have been discussed. In this paper we suggest a possible representation of these goals based on the notion of mutual advantage. We propose a method for measuring extents of individual and mutual advantage to the interacting decision-makers, and define team interests as the attainment of outcomes associated with maximum mutual advantage in the games they play. (shrink)

Nudge is a popular public policy tool that harnesses well-known biases in human judgement to subtly guide people’s decisions, often to improve their choices or to achieve some socially desirable outcome. Thanks to recent developments in artificial intelligence (AI) methods new possibilities emerge of how and when our decisions can be nudged. On the one hand, algorithmically personalized nudges have the potential to vastly improve human daily lives. On the other hand, blindly outsourcing the development and implementation of nudges to (...) “black box” AI systems means that the ultimate reasons for why such nudges work, that is, the underlying human cognitive processes that they harness, will often be unknown. In this paper, we unpack this concern by considering a series of examples and case studies that demonstrate how AI systems can learn to harness biases in human judgment to reach a specified goal. Drawing on an analogy in a philosophical debate concerning the methodology of economics, we call for the need of an interdisciplinary oversight of AI systems that are tasked and deployed to nudge human behaviours. (shrink)

An effective method to increase the number of potential cadaveric organ donors is to make people donors by default with the option to opt out. This non-coercive public policy tool to influence people’s choices is often justified on the basis of the as-judged-by-themselves principle: people are nudged into choosing what they themselves truly want. We review three often hypothesized reasons for why defaults work and argue that the as-judged-by-themselves principle may hold only in two of these cases. We specify further (...) conditions for when the principle can hold in these cases and show that whether those conditions are met is often unclear. We recommend ways to expand nationwide surveys to identify the actual reasons for why defaults work and discuss mandated choice policy as a viable solution to many arising conundrums. (shrink)