China's top internet regulator has launched a sweeping crackdown on low-grade AI-generated content flooding social media and news feeds, removing millions of harmful posts and tens of thousands of accounts from platforms including Douyin, WeChat, and RedNote.
- Over 5.6 million pieces of harmful AI content removed
- Nearly 49,000 accounts banned in crackdown
- Targets include Douyin, WeChat, RedNote, and Kuaishou
What happened
China’s Cyberspace Administration (CAC) announced it has removed over 5.61 million pieces of illegal or harmful AI-generated content and banned approximately 49,000 user accounts. The crackdown affected 2,400 websites and applications, including major platforms such as Douyin, WeChat, RedNote, and Kuaishou, highlighting the scope of the enforcement drive.
The campaign focused on synthetic content produced by generative AI technologies that create low-quality, sensationalized, or misleading information. Examples include AI recreations of classic literature transformed into clickbait, AI-generated digital humans, fabricated news, and deceptive marketing campaigns particularly targeting vulnerable elderly users.
Why it matters
This enforcement highlights Beijing’s concern over the increasing ease and sophistication of generative AI tools, which challenge traditional content moderation frameworks with their ability to produce large volumes of convincing but often false or harmful content rapidly. The prevalence of AI “slop” risks undermining trust in digital information and endangering user safety, particularly minors and elderly demographics.
By intensifying regulation, the Chinese government aims to balance curbing the malicious and abusive use of AI-generated content while supporting the technology’s healthy development. This is important as Chinese tech giants, including ByteDance and Alibaba, implement stricter data handling, output controls, and labeling protocols to improve content authenticity and control.
What to watch next
Moving forward, the CAC plans to maintain close surveillance of AI-generated content risks and continue implementing measures to prevent abuse and malicious exploitation of generative AI. This includes further collaboration with domestic internet companies to refine their moderation and compliance capabilities.
The evolution of AI regulation in China will be critical to observe, particularly as generative AI becomes more integrated into user-facing applications. Developments may set precedents for other countries balancing innovation with digital safety, especially in relation to automated content creation and synthetic media technologies.