Thousands of reports of AI-generated child abuse content

In recent months, child safety experts and researchers have warned that creative AI could exacerbate online abuse.

Meta CEO Mark Zuckerberg speaks at a US Senate Judiciary Committee hearing on January 31, 2024, in front of a crowd of attendees carrying AI-generated images. Photo: Reuters

NCMEC has not yet released the total number of reports of child abuse content from all sources it received in 2023. But in 2022, it received reports of about 88.3 million files about the problem.

“We are getting reports from the innovative AI companies themselves, (online) platforms and members of the public,” said John Shehan, vice president of NCMEC.

The CEOs of Meta, X, TikTok, Snap and Discord testified at a US Senate hearing on child safety on online platforms on Wednesday (January 31). US lawmakers questioned social media companies about their efforts to protect children from “online predators”.

Generative AI could be used by bad actors to repeatedly harm real-life children by creating fake images of them, researchers at the Stanford Internet Observatory said in a report last June.

Fallon McNulty, director of NCMEC’s CyberTipline, which takes reports of online child exploitation, said AI-generated content is becoming “more and more photorealistic,” making it difficult to determine whether victims are real people.

McNulty said OpenAI, the company that created ChatGPT, has set up a process to submit reports to NCMEC, and the organization is in talks with other AI companies.

Hoang Hai (according to Reuters, FT)

Source: https://www.congluan.vn/my-hang-nghin-bao-cao-ve-noi-dung-lam-dung-tre-em-do-ai-tao-ra-post283237.html