AI Researchers Warn Self-Improving Systems Could Endanger Humanity

A wave of AI researchers warns that rapid progress and recursive self-improvement could push AI beyond human control, citing resignations (e.g., Rishub Jain) and warnings from Anthropic and others that existential risk could rise as systems self-improve; scenarios range from misusing AI to biolabs and cyberattacks, fueling debate over slowing development, safety research, and keeping humans in the loop, even as some researchers push for alignment and safer deployment.