Openai bans accounts of a group of Chinese users who attempt to use Chatgpt to debug and edit code for use with AI social media monitoring tools . Openai said the peer review campaign saw the team prompt Chatgpt to create sales pitches for the program, which are designed to monitor anti-China sentiment on X, Facebook, YouTube, Instagram and other platforms. The operation appears to be particularly interested in the discovery of calls for protests against human rights violations in China, with the aim of sharing these insights with the country’s authorities.
“The network consists of a ChatGpt account that aligns with business hours in a time mode to mainland China, prompting our model Chinese and using tools that have tools and varieties that are consistent with manual prompts (rather than automation,” Openai said. “Operators use our model to proofread their insights that their insights have been sent to Chinese embassies abroad and oversee protests in countries such as the United States, Germany and the United Kingdom to intelligence personnel.”
This is the first time the company has discovered such an AI tool, according to OpenAI’s chief investigator Ben Nimmo. “Threat participants sometimes give us a glimpse of what they do in other parts of the internet because they use our AI model,” Nemo told him. .
Most of the code for the monitoring tool appears to be based on an open source version of Meta . The team also appears to have used Chatgpt for an end-of-year performance review, which claimed to have written phishing emails on behalf of Chinese customers.
“Evaluating the impact of this activity will require input from multiple stakeholders, including any operator that can shed light on the open source model of the activity,” Openai said of the operation’s efforts.
Openai said it has recently banned accounts that use Chatgpt to generate social media posts a Chinese political scientist and dissident who lives in exile in the United States. The same group also used chatbots to generate articles criticizing the United States in Spanish. These articles are published by “mainstream” news organizations in Latin America and are often attributed to individuals or Chinese companies.
