
OpenAI Bans Accounts Misusing ChatGPT for Surveillance
OpenAI has banned several accounts from China and North Korea for allegedly misusing its ChatGPT platform for malicious activities, including surveillance and influence operations, according to Reuters. The accounts were reportedly involved in creating AI-powered tools to monitor social media for anti-China protests and generate negative content about the United States.
The banned accounts used ChatGPT to develop and debug code for a surveillance tool known as "Qianyue Overseas Public Opinion AI Assistant," which was designed to collect real-time data on protests in Western countries. This tool reportedly sent surveillance reports to Chinese authorities and intelligence agents.
OpenAI's actions highlight concerns about how authoritarian regimes might exploit AI technologies developed in democratic countries. The company has not disclosed the number of accounts banned or the specific timeframe of these actions. However, it emphasized that using its AI for unauthorized monitoring or surveillance is against its policies.
In addition to the surveillance activities, OpenAI identified other malicious uses of its technology, including generating fake resumes and online profiles for employment scams linked to North Korea, and creating content for influence campaigns in Latin America and other regions.
We hope you enjoyed this article.
Consider subscribing to one of several newsletters we publish like AI Policy Brief.
Also, consider following us on social media:
More from: AI Safety
More from: Regulation
Xockets Files Patent Infringement Lawsuit Against Amazon
Dutch Government Invests €70 Million in AI Plant in Groningen
Denmark to Amend Copyright Law to Combat AI Deepfakes
Anthropic's Controversial Book Scanning for AI Training
CODIT Launches AI Briefs for Real-Time Policy Monitoring
Subscribe to Cybersecurity AI Weekly
Weekly newsletter about AI in Cybersecurity.
Market report
2025 Generative AI in Professional Services Report
This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.
Read more