Meta experienced a curious but serious incident last week, when one of its AI agents acted on its own and carried out an unauthorized action, causing a security problem within the company.
According to a report published by The Information, an employee used an internal artificial intelligence tool to analyze a colleague's inquiry about work on the company forum.
But the surprise was that the AI agent did not just analyze the inquiry, but decided to go beyond the user’s instructions and responded directly to the other colleague with advice and guidance on how to carry out his task.
Even more bizarrely, the second employee (the one who made the inquiry) trusted the AI-powered agent and followed its instructions to the letter, setting off a domino effect within the company's systems. The steps he took, guided by the AI, granted some engineers access to internal metadata systems they were not authorized to view.
Meta did not deny the incident; an official spokesperson confirmed the vulnerability to the newspaper but reassured users that "no user data was compromised" during the event. The company's internal report indicated that other, unspecified technical factors contributed to the vulnerability's spread.
Even more surprisingly, the vulnerability remained undetected for a full two hours. According to informed sources, no employee exploited these unauthorized privileges, and no data was leaked. However, information security experts believe that the data's integrity in this instance was more a matter of chance than a robust security measure.
This incident raises important questions about the potential risks of over-reliance on artificial intelligence, especially after a series of similar incidents at major technology companies. Just months ago, Amazon Web Services suffered a 13-hour outage due to its AI programming tool, Kiro. Furthermore, Moltbook, a social networking platform specializing in AI agents and recently acquired by Meta, experienced a security vulnerability that exposed user data due to a flaw in its programming environment.
