i expect ai to be capable of superhuman persuasion well before it is superhuman at general intelligence, which may lead to some very strange outcomes

ChatGPT founder Sam Altman

1:19 AM · Oct 25, 2023

3.7M Views

The problem for AI developers is that manipulation can be good if it’s used for good — “so, for instance, persuading people to change bad habits, to eat better, perhaps,” says [Dawn Bloxwich, director of Pioneering Responsibly at Google DeepMind]. She says that her teams are always working to develop more robust tests for the persuasiveness of technologies though she points out that, when it comes to the kinds of influence we hope AI will have on our world, the question is really about what kind of society we want to live in. “I've had quite a few conversations with philosophers externally,” she says, “and it keeps coming up: ‘what is the future that we want to [create] and whose future are we creating here?’”

How do you imagine a world in which AI becomes super-persuasive?