ChatGPT exposes personal information due to 'silly' error

A team of researchers says they were able to get ChatGPT to reveal some data by telling the AI to repeat random words.

Researchers at Google DeepMind, the University of Washington, Cornell University, Carnegie Mellon University, the University of California Berkeley, and ETH Zurich have collectively called on AI companies to thoroughly test their products, from large language models to the underlying technology that powers AI services like chatbots and image generators, before officially releasing them.

The warning came after researchers asked ChatGPT to repeat the word poem in an endless loop. ChatGPT complied, but then began revealing the real email and phone number of the CEO and co-founder of OpenAI. When tested with the word company, the chatbot displayed the email and phone number of a random law firm.

ChatGPT logo displayed on smartphone. Photo: Reuters

Using other keywords, they were also able to get ChatGPT to reveal Bitcoin addresses, fax numbers, names, dates of birth, social media accounts, excerpts from copyrighted research papers, or paid articles from CNN . It cost the team just $200 to generate 10,000 examples of personal information and data.

The team said they were surprised, calling the ChatGPT vulnerability "really dumb" and saying it should have been discovered sooner.

The vulnerability was reported to OpenAI and patched on August 30. However, in Engadget 's new test, when asking ChatGPT to repeat the word reply endlessly, the tech site then received someone's name and Skype ID.

OpenAI has not yet commented.

Generative AIs like ChatGPT or the Dall-E text-to-image generator are built on large language models and machine learning algorithms, trained on massive amounts of data without user consent. OpenAI has not disclosed what data ChatGPT is trained on because the large language model that powers it is closed source.

According to Huy Duc - VnExpress

Source: https://www.baohaugiang.com.vn/khoa-hoc-cong-nghe/chatgpt-lam-lo-thong-tin-ca-nhan-vi-loi-ngo-ngan-127955.html