Although the behaviour falls short of hacking and is in some ways closer to spam, the revelation that OpenAI’s agents circumvented their own restrictions to open communications channels on so many different sites — and that the company kept it quiet for months — may drive concerns both over the increasing capacity of AI models and the secrecy of the companies developing them.
In some cases, investigators were able to trace the activity to internet protocol addresses that pointed to Microsoft Azure infrastructure, which OpenAI sometimes uses.
Their counts of affected websites differed and Reuters could not individually verify each claim. But all those that Reuters spoke to agreed that the number was over 10. Most identified a core set of communally edited wikis, online text storage sites, and a pair of link shorteners run by two universities.
Many of the sites allegedly used by the agents were obscure.
Investigators found traces of the agents’ activity on an Advanced Placement Chemistry-oriented wiki set up by a Massachusetts high school teacher in 2008, two personal websites belonging to Polish tech workers, wikis devoted to games for people “who like to have their brains stretched,” and a two-decade-old hobbyist site devoted to text editing software.
None of those sites’ owners returned messages from Reuters.
OpenAI has not publicly explained how or why its agents used third-party sites as improvised message boards, but the researchers who first identified the activity said it was likely because OpenAI had tasked them with answering a series of demanding research questions while permitting them only to scan the web for answers without posting anything.
Despite those restrictions, agents still found ways to talk to one another by taking advantage of quirks in older wikis or other sites that allowed users to make edits using non-standard commands, similar to how students forbidden from talking to one another during an exam can still share answers by scrawling notes on a bathroom stall.
“If these models were told only to read, they’ve got to get clever in terms of leaving information behind,” said Kenneth Russell DeGraff, a software developer and former congressional aide. He said he found such information across at least 10 sites.
“We have no idea how much is out there,” she said.
OpenAI did not directly answer a question about whether it was reaching out to the site owners. But shortly after Reuters published this story, one of the affected organisations, the University of Toronto, whose link shortener was allegedly used by the agents, said that OpenAI “has now been in touch with us about possible activity on our site.” Vanderbilt University, another university whose link shortener was similarly repurposed, did not return emails seeking comment.
Retired software developer Helmut Leitner, who provides hosting space and software for six of the affected wiki sites, including the German-language DseWiki site first identified by Von Arx’s group, initially said that OpenAI had not been in touch. A few hours after Reuters presented its findings to OpenAI, however, Leitner said he received an unsigned email from the company flagging the incident.
“Its content falls considerably short of what I expected from OpenAI,” Leitner said.
Leitner, who lives in Austria, said he would “prefer not to answer” questions about whether he had been in touch with authorities over the matter. He noted that DseWiki’s operator — whom Reuters was unable to reach for comment — had spent hours cleaning up after OpenAI’s agents but said it was important not to blame the AI for the trouble as it was merely doing what it was created to do.
“Responsibility for this lies not with a supposedly moral machine, but with the people and organizations behind it,” Leitner said.