All articles tagged with #ai apocalypse
Former Anthropic insider Jacob Coxon’s viral warning that AI could cause human extinction, backed by corroborating colleagues and recent safety incidents, has amplified calls for tighter regulation amid a polarized tech-political climate.
Tech workers and Silicon Valley residents are increasingly preparing for potential AI-driven catastrophes, ranging from economic collapse to existential threats, by investing in survival bunkers, rethinking careers, and embracing a 'live in the moment' philosophy due to fears of an AI apocalypse.
Silicon Valley researchers are using a new metric called p(doom), short for "probability of doom," to assess the likelihood of artificial intelligence (A.I.) causing catastrophic events or threatening human survival. This statistic has gained popularity as concerns about the rapid advancement of A.I. grow. Estimates of p(doom) range from 5% to 50%, reflecting varying levels of belief in the potential dangers posed by A.I.
The recent leadership shakeup at OpenAI, which saw CEO Sam Altman removed and then reinstated after a mass protest by staff, has raised concerns about the governance and regulation of artificial intelligence (AI) companies. Altman's removal exposed the limitations of OpenAI's nonprofit governance board and highlighted the need for a more robust mechanism to oversee the development of AI technology. The incident has also sparked debates over the future of AI governance, with some advocating for self-regulation by AI companies and others calling for stronger public oversight. The outcome of OpenAI's governance crisis could have implications for the regulation of AI companies globally, including the ongoing negotiations over the European Union's AI Act.
Confuse-A-Bot is an upcoming video game that invites players to verify images incorrectly with bunk data, specifically with cheese, to confuse bots and help save humanity from an AI apocalypse. The game pulls in images from the internet and players verify them incorrectly, and the game automatically re-releases the incorrectly verified images online for AI to scrape and absorb. The more players verify images incorrectly, the more points they get. The game will be available in early fall.
Former OpenAI safety researcher Paul Christiano warns that there is a 10-20% chance of AI takeover, resulting in the death of many or most humans. He believes that the end by AI will come more gradually, with a year's transition from AI systems that are a pretty big deal, to kind of accelerating change, followed by further acceleration. Christiano's new nonprofit, the Alignment Research Center, is based on the concept of AI alignment, which broadly defined back in 2018 as having machines' motives align with those of humans.
AI researcher Eliezer Yudkowsky, who has been warning about the dangers of AI for over 20 years, has called for an "indefinite and worldwide" ban on AI development, stating that the most likely result of building superhumanly smart AI is that everyone on Earth will die. Yudkowsky refrained from signing an open letter calling for a six-month moratorium on AI development, stating that it understated the seriousness of the situation. Yudkowsky has been described as an "AI doomer" and has been warning about the possibility of an "AI apocalypse" for a long time.