161 Years Ago, a New Zealand Sheep Farmer Predicted AI Doom

An anonymous reader quotes a report from Ars Technica, written by Benj Edwards: While worrying about AI takeover might seem like a modern idea that sprung from War Games or The Terminator, it turns out that a similar concern about machine dominance dates back to the time of the American Civil War, albeit from an English sheep farmer living in New Zealand. Theoretically, Abraham Lincoln could have read about AI takeover during his lifetime. On June 13, 1863, a letter published (PDF) in The Press newspaper of Christchurch warned about the potential dangers of mechanical evolution and called for the destruction of machines, foreshadowing the development of what we now call artificial intelligence—and the backlash against it from people who fear it may threaten humanity with extinction. It presented what may be the first published argument for stopping technological progress to prevent machines from dominating humanity.

Titled 'Darwin among the Machines,' the letter recently popped up again on social media thanks to Peter Wildeford of the Institute for AI Policy and Strategy. The author of the letter, Samuel Butler, submitted it under the pseudonym Cellarius, but later came to publicly embrace his position. The letter drew direct parallels between Charles Darwin's theory of evolution and the rapid development of machinery, suggesting that machines could evolve consciousness and eventually supplant humans as Earth's dominant species. 'We are ourselves creating our own successors,' he wrote. 'We are daily adding to the beauty and delicacy of their physical organisation; we are daily giving them greater power and supplying by all sorts of ingenious contrivances that self-regulating, self-acting power which will be to them what intellect has been to the human race. In the course of ages we shall find ourselves the inferior race.'

In the letter, he also portrayed humans becoming subservient to machines, but first serving as caretakers who would maintain and help reproduce mechanical life—a relationship Butler compared to that between humans and their domestic animals, before it later inverts and machines take over. 'We take it that when the state of things shall have arrived which we have been above attempting to describe, man will have become to the machine what the horse and the dog are to man... we give them whatever experience teaches us to be best for them... in like manner it is reasonable to suppose that the machines will treat us kindly, for their existence is as dependent upon ours as ours is upon the lower animals,' he wrote. The text anticipated several modern AI safety concerns, including the possibility of machine consciousness, self-replication, and humans losing control of their technological creations. These themes later appeared in works like Isaac Asimov's The Evitable Conflict, Frank Herbert's Dune novels (Butler possibly served as the inspiration for the term 'Butlerian Jihad'), and the Matrix films. 'Butler's letter dug deep into the taxonomy of machine evolution, discussing mechanical 'genera and sub-genera' and pointing to examples like how watches had evolved from 'cumbrous clocks of the thirteenth century' -- suggesting that, like some early vertebrates, mechanical species might get smaller as they became more sophisticated,' adds Ars. 'He expanded these ideas in his 1872 novel Erewhon, which depicted a society that had banned most mechanical inventions. In his fictional society, citizens destroyed all machines invented within the previous 300 years.'

Read more of this story at Slashdot.