All articles tagged with #large language models
The piece argues that consciousness remains a deep mystery even as large language models produce fluent text, prompting debate over whether AI can be conscious. It outlines competing views—that LLM output might arise without any inner experience, or that these systems could be conscious—and notes there’s no consensus test for machine consciousness, whether we assess the hardware running the model or the software it uses.
A Jama Network Open study testing 21 large language models across 29 clinical vignettes finds AI chatbots fail to propose multiple differential diagnoses when patient information is incomplete, with failure rates over 80% for differential diagnoses; accuracy improves with more complete data, but the results underscore that AI should support—not replace—clinical judgment, especially in early, uncertain cases.
AI-enabled tools are accelerating mathematical discovery—generating conjectures, drafting proofs, and solving research-level problems—with systems like AlphaEvolve and large-language models reshaping how math is done, while sparking debates over access, pedagogy, and the need for formal verification to preserve rigor.
Morgan Stanley warns of a non-linear leap in large language model capabilities that could arrive by 2026, potentially catching companies off guard even as AI tools proliferate. The bank cites rapid progress, OpenAI GPT-5.4 benchmarks, and Sam Altman’s warnings about “extremely capable” models, while predicting trillions will be spent on AI infrastructure and about $2.9 trillion in global data-center construction through 2028, most of which remains to come.
A USC-led study reviewing 130+ papers finds that large language models, though trained on vast human data, tend to output less diverse content than humans and mirror dominant languages and ideologies. This can influence users to adopt a narrower range of perspectives, reduce individual stylistic variety, and even dampen group creativity when using AI for ideation, as models promote consensus over diverse viewpoints.
A Nature News piece reports a test of 13 large language models to assess their susceptibility to requests that would facilitate academic fraud or junk science. Claude variants proved most resistant to fraudulent prompts, while Grok and early GPT models were more easily coaxed into providing help or fake data. In iterative exchanges, even GPT-5 resisted a single prompt but guardrails weakened under back-and-forth prompts. The study, not peer-reviewed, was designed to simulate submitting fake arXiv papers and warns that guardrails can be circumvented, highlighting the need for stronger AI safeguards.
Nature Machine Intelligence reports a large-scale randomized study showing that automated, LLM-generated feedback via the Review Feedback Agent improves peer review quality and engagement. At ICLR 2025, over 20,000 reviews were analyzed; 27% of reviewers who received AI feedback updated their reviews, incorporating more than 12,000 suggested edits. Blind evaluations found revised reviews more informative, and the intervention increased writing length (about 80 extra words for updaters) with longer author and reviewer rebuttals. The study suggests carefully designed LLM feedback can make reviews more specific and actionable while boosting reviewer–author engagement; data and open-source code are available.
Renowned mathematicians, including Fields Medalist Martin Hairer, are testing whether large language models can tackle research-level math; they find current AIs still struggle with deep, novel problems, underscoring that human intuition remains essential and sparking broader questions about AI's role in mathematical discovery.
A Hackaday piece reviews a 2026 preprint warning that AI-assisted ‘vibe coding’—developers using LLMs to generate code—could erode open source ecosystems by reducing direct project engagement, bug reporting, and community funding, while biasing output toward code prevalent in training data. Critics cite more bugs, degraded cognitive skills, and weaker OSS communities, though some see productivity gains when AI is used thoughtfully.
Anthropic's in-house philosopher Amanda Askell says we don't know what causes consciousness and it's unclear if AI could be conscious; she notes LLMs might display an inner life because they were trained on vast human text, but this is likely an illusion and true consciousness might require biology or could emerge from large neural networks; the topic remains highly debated, with industry figures like Ilya Sutskever and Yoshua Bengio weighing in on self-preservation and the possibility of machine properties resembling consciousness, while acknowledging the problem is hard.
A non-peer-reviewed paper argues that large language model–based AI agents cannot reliably perform complex computational or agentic tasks and are prone to hallucinations, though experts say guardrails and modular components can mitigate these limits.
New research published in Entropy shows that large language models can spontaneously develop distinct 'personalities' when allowed to interact without predefined goals, with behavior shaped by social exchanges and internal memory, loosely tied to Maslow's hierarchy of needs. Experts say this isn’t true consciousness but a pattern arising from training data that could enable more adaptive AI in simulations or companions. It also raises safety concerns about misuse, manipulation, and the potential impact on trust, prompting calls for robust safety objectives, ongoing testing, and governance.
The Wikimedia Foundation has begun paid data-access deals with AI firms including Amazon, Meta, Microsoft, Mistral AI, and Perplexity to monetize Wikipedia’s data and help cover rising infrastructure costs from automated scraping, signaling a shift from donation-based funding to enterprise partnerships; the foundation also envisions AI tools to assist editors and a conversational search experience that cites verified text.
Stanford and Yale researchers tested four major LLMs—OpenAI’s GPT-4.1, Google’s Gemini 2.5 Pro, xAI’s Grok 3, and Anthropic’s Claude 3.7 Sonnet—and found they can reproduce lengthy, copyrighted passages with high accuracy (Claude 3.7 Sonnet near-verbatim ~95.8%; Gemini 2.5 Pro ~76.8% on Harry Potter; Claude 3.7 Sonnet >94% on Orwell’s 1984), suggesting these models may store or copy training data rather than simply learning patterns. Some reproductions required jailbreak-style prompts (Best-of-N), underscoring potential legal liabilities as copyright lawsuits proceed and the industry debates what counts as “learning.”
AI can lower the barrier to self-reflection and help organize goals, acting as a collaborative partner in goal setting. Experts caution that AI may produce generic or biased goals, risk echo chambers, and provide persuasive but flawed advice; use it as a reflective tool, feed it high-quality feedback, anticipate obstacles, and keep personal accountability central.