What happened

The second phase of a special campaign targeting AI-related online chaos has removed more than 5.61 million pieces of illegal and harmful information, according to China's cyberspace regulator. More than 49,000 accounts were investigated and punished, and over 2,400 websites, apps, and related services were dealt with.

The campaign focuses on major harms involving artificial intelligence, such as generating false information, spreading violent or vulgar content, impersonating real people, and infringing on minors' rights. Local authorities were instructed to strengthen enforcement, and platforms were required to systematically purge AI-generated content that breaches laws and regulations.

Regulators also made public a set of typical cases for educational effect. These include using AI to 'magically alter' classic works, producing artificial 'digital garbage', distributing false information, impersonating others, making violent or obscene material, and harming minors. Additional cases covered AI-powered 'internet water army' behavior and violations by AI products and mobile applications.

Why it matters

The action signals that AI governance is moving from general content moderation to custom-built controls for synthetic media and automated content. The large scale of removals and account penalties shows how quickly AI misuse has spread and that regulators see platform accountability as a required part of the AI ecosystem.

By publicly listing typical cases, the authorities are not only punishing wrongdoers but also setting expectations for users and companies about what kinds of AI-generated content and services will not be tolerated.

Key facts

The campaign is the second phase of a special cleanup action focused on AI application chaos.

As of the report, 5.61 million+ illegal and harmful pieces of information were removed, 49,000+ accounts were dealt with, and 2,400+ websites and apps were handled.

Main targets include AI-generated false content, violence and vulgar content, impersonation, and infringement of minors' rights.

Typical cases include AI 'magic changes' of classics, fake news, impersonation, harmful content, AI-run 'water army' activity, and violations by AI products and apps.

What to watch next

Future steps may include whether cyberspace authorities extend the campaign to more types of AI services, and whether the platform-side review mechanisms now under construction become a permanent governance layer.

Market watchers will likely also look for more detailed rules on labeling or detecting AI-generated content as the regulator works to prevent 'synthetic content chaos'.

Sources