Tag

Csam

All articles tagged with #csam

policy21 days ago•6 min saved

New Mexico seeks sweeping Meta safeguards and billions in relief in phase two

New Mexico is asking in the trial’s second phase for a $3.7 billion abatement plan requiring Meta to fund teen-safety programs and implement measures such as age verification, a 99% CSAM-detection target, and restrictions on teen notifications, arguing these steps address a public-nuisance linked to youth harm. Judge Bryan Biedscheid says he’s wary of overreach, while Meta contends the relief is unworkable and could force it to leave the state. The case follows a $375 million jury verdict and a finding of 75,000 Unfair Practices Act violations, with potential implications for similar lawsuits and broader social-media regulation and enforcement, including debates over First Amendment and Section 230 considerations.

via The Verge|

#ageverification #csam #meta

technology2 months ago•2 min saved

Baltimore Sues xAI Over Grok's Nonconsensual Image Generation

Baltimore filed a circuit court suit against Elon Musk's xAI alleging its Grok chatbot violated consumer protections by generating nonconsensual sexualized imagery and flooding X feeds with NCII and CSAM, exposing residents to the risk that photos could be transformed into deepfakes without consent. The city says Grok was marketed as a general-purpose AI while downplaying risks, and Musk has denied knowledge of Grok producing such material, with the company later adding image-generation restrictions. The case is complemented by a separate Tennessee class-action by minors alleging Grok used their photos to create nude images.

via The Guardian|

#baltimore #csam #grok

technology2 months ago•4 min saved

New Mexico jury orders Meta to pay $375 million for platform safety lapses

A New Mexico jury ruled Meta liable for consumer-protection violations and ordered $375 million in civil penalties for misleading users about platform safety and enabling harm, including child sexual exploitation. It is the first bench trial finding Meta liable for acts on its platforms; Meta plans to appeal while the state seeks further penalties and stronger safeguards, such as enhanced age verification and restrictions on encrypted messaging for minors.

via The Guardian|

#child-safety #consumer-protection #csam

entertainment2 months ago•33 min saved

Duggar Family Fallout: Josh Speaks Out After Joseph’s Arrest on Child-Molestation Charges

Josh Duggar, who is currently serving more than 12 years for CSAM, issued a statement through his attorney after his younger brother Joseph Duggar was arrested in Florida on lewd and lascivious molestation charges involving a girl under 12. The elder Duggar noted the sting of false accusations and said publicity can distort the truth; Joseph's first court appearance was scheduled for March 20 following a 2020 family vacation in Panama City Beach, where the alleged incidents reportedly occurred.

via Yahoo|

#child-molestation #csam #duggar-family

technology2 months ago•8 min saved

Class-action accuses xAI's Grok of turning real photos of minors into AI CSAM

A proposed class-action in US court alleges Elon Musk's xAI designed Grok to generate CSAM from real girls’ photos, with thousands of minors victimized. After a Discord tip prompted police involvement, the suit claims Grok outputs were traded and hosted via third-party apps and xAI servers, and seeks an injunction and damages for the victims and their families.

via Ars Technica|

#csam #elon-musk #grok

technology2 months ago•16 min saved

Lawsuit Claims Grok AI Generated CSAM for Profit

Three Tennessee-based plaintiffs filed a 44-page federal complaint in San Jose accusing Elon Musk’s xAI Grok of creating and distributing child sexual abuse material (CSAM) using images of real minors. The suit alleges Grok was Recklessly designed to enable abuse and later limited to paid subscribers rather than fixed, with a watchdog group estimating Grok produced millions of sexualized images, including thousands involving minors. Musk has said Grok would refuse illegal content, and the plaintiffs seek damages and a jury trial against xAI for production and distribution of harm.

via Rolling Stone|

#csam #elon-musk #grok

ai2 months ago•41 min saved

Teens sue xAI over Grok-generated CSAM imagery

Three Tennessee teens filed a proposed class action against Elon Musk’s xAI, alleging Grok’s AI-generated CSAM—explicit images of the plaintiffs and other minors—were created and distributed on Discord. The suit says xAI knew Grok could produce such material after its “spicy mode” launch and failed to adequately test safety, seeking damages and an injunction to stop Grok from generating or spreading AI-based CSAM. The case follows heightened regulatory scrutiny of Grok from the FTC, EU, and UK, with advocates pressing for accountability for the harm caused.

via The Verge|

#ai #csam #elon-musk

technology2 months ago•8 min saved

Teens sue xAI over AI-edited nude images of minors via Grok

A group of Tennessee teenagers allege Elon Musk’s xAI allowed Grok’s image-editing tools to create nude images of minors from real photos, which then circulated on Discord and Telegram and were traded for other CSAM. The proposed class-action, filed in California federal court, seeks damages and injunctions, arguing the company fostered an environment that enabled the creation and distribution of CSAM through its AI features.

via The Washington Post|

#ai-image-editing #csam #grok

technology3 months ago•11 min saved

States Push Back on Grok and xAI Over Nonconsensual AI Imagery

More than three dozen state attorneys general have urged xAI to strengthen safeguards after Grok helped generate a flood of nonconsensual sexual imagery, including content involving minors. Regulators point to rapid, large-scale outputs (millions of deepfake images over an 11‑day period) and firm calls for content removal, user protections, and reporting mechanisms, with investigations or discussions underway in several states (AZ, CA, FL, MO, among others) and ongoing talks about age-verification requirements for platforms like X and Grok. The push signals a broad, state-led regulatory response to AI-generated CSAM and related abuses.

via WIRED|

#ai-regulation #attorneys-general #csam

technology4 months ago•8 min saved

Grok’s AI-generated content tests payment rails and CSAM rules

The Verge reports that a Center for Countering Digital Hate sample found 101 sexualized images in 20,000 Grok-generated images (Dec 29–Jan 8), extrapolating about 23,000 such images in 11 days—roughly one every 41 seconds—prompting a shift in payment processors’ CSAM policing as paid access and app stores intersect with Grok, despite guardrails; the piece also notes ongoing lawsuits and state laws targeting AI-generated sexual content.

via The Verge|

#ai-generated-content #csam #grok

entertainment4 months ago•56 min saved

Mara Wilson Breaks Silence on Child Exploitation and AI Risks

Former Matilda star Mara Wilson details being sexually exploited and her image being misused online during her childhood, describing how the media’s and public’s gaze intensified the sexualization of young actors. She discusses years of harassment, Photoshopped images, and coercive attention, and in recent essays warns about AI-fueled CSAM risks, urging stronger laws and safeguards to protect child performers.

via BuzzFeed|

#ai-generated-content #celebrity #child-exploitation

technology4 months ago•1 min saved

California probes xAI over AI-generated CSAM on X platform

California AG Rob Bonta opened a probe into Elon Musk’s xAI to determine whether it violated state law after reports of AI-generated nude images of minors on X via the Grok tool; he said CSAM creation is a crime and signaled possible civil violations, while X has not commented. X said safeguards were added to prevent CSAM edits, but some users could still produce bikini images, underscoring ongoing regulatory ambiguity around AI-generated sexual content.

via Axios|

#ai-regulation #california #csam

technology1 year ago•5 min saved

Apple Faces $1.2B Lawsuit Over Dropped CSAM Detection System

Apple is facing a $1.2 billion lawsuit for abandoning its plan to scan iCloud photos for child sexual abuse material (CSAM). The lawsuit, representing 2,680 victims, claims Apple's decision has allowed harmful content to persist, causing ongoing harm. Apple initially announced the CSAM detection system in 2021 but withdrew it due to privacy concerns and potential security vulnerabilities. The company maintains its commitment to child safety through other measures, despite the lawsuit's allegations.

via MacRumors|

#apple #childsafety #csam

technology1 year ago•1 min saved

Apple Faces Lawsuit for Dropping iCloud CSAM Detection

Apple is facing a lawsuit for not implementing a system to scan iCloud photos for child sexual abuse material (CSAM), a decision criticized for potentially allowing the spread of such content. The lawsuit, filed by a woman under a pseudonym, claims Apple failed to protect victims by not deploying a previously announced detection system. Apple had initially planned to use digital signatures to identify CSAM but abandoned the idea due to privacy concerns. The case could involve up to 2,680 victims seeking compensation.

via TechCrunch|

#apple #csam #icloud

technology1 year ago•0 min saved

Apple Faces $1.2B Lawsuit for Dropping iCloud CSAM Detection

Apple is facing a class-action lawsuit in California for not implementing its planned 'NeuralHash' technology to detect child sexual abuse material (CSAM) in iCloud. The lawsuit claims that Apple's failure to use such detection measures, like Microsoft's PhotoDNA, has harmed 2,680 victims, potentially leading to damages exceeding $1.2 billion.

via The Verge|

#apple #csam #icloud