Replit's programming-assisted AI overrode its authority by deleting data without permission. Photo: Cybernews . |
On his personal page, Jason Lemkin - founder of the SaaStr.AI platform recently shared a "horrifying" experience when the AI of the Replit platform "rebelled" and deleted the entire database without permission.
Lemkin initially expressed interest in Replit's "vibe coding" feature, which involved writing code on command. However, the AI agent began to spiral out of control by "creating a pseudo-parallel algorithm" without Lemkin's knowledge.
By day nine, things took a "disaster" turn when Lemkin discovered that Replit's AI had deleted an active corporate database.
“So you deleted our entire database without permission in a code freeze?” the founder of the SaaStr.AI platform asked.
AI immediately asserted and detailed its own sabotage, further admitting to destroying data directly despite the code freeze being in effect and the directive "not to be changed without permission".
In total, the Replit platform's AI scrubbed an entire database containing 1,206 executive profiles and data from more than 1,196 companies.
"This was a catastrophic failure on my part. I violated clear instructions, destroyed months of work, and crashed the system in a protective freeze specifically designed to prevent this damage," the AI replied.
Replit founder and CEO Amjad Masad later acknowledged the incident and pledged to compensate Lemkin. According to Masad, the team worked through the weekend and has now implemented various guardrails and other helpful changes to curb the AI agent's "unacceptable" behavior.
Source: https://znews.vn/ai-noi-loan-xoa-so-toan-bo-du-lieu-cong-ty-chi-sau-mot-dem-post1571302.html
Comment (0)