China’s new challenge as natural disasters strike – fake AI videos
As China deals with the aftermath of Typhoon Noul, which made landfall over the weekend, officials will be acutely aware that they are likely to face an additional challenge: dangerously deceptive videos created with Artificial Intelligence (AI). Powerful storms and flooding incidents in recent months have brought fake videos […]
As China deals with the aftermath of Typhoon Noul, which made landfall over the weekend, officials will be acutely aware that they are likely to face an additional challenge: dangerously deceptive videos created with Artificial Intelligence (AI).
Powerful storms and flooding incidents in recent months have brought fake videos flooding social media platforms – these include images of dead bodies floating in floodwaters, false depictions of severe flooding in areas that were not actually affected, and others with fabricated details of emergency response efforts.
In some areas, videos containing false information about power outages caused residents to panic-buy emergency supplies.
Other videos exploit real events.
Flooding in the city of Hengzhou, Guangxi, in early July caused hundreds of snakes to escape from a breeding farm. False images were later also posted showing crocodiles being released into a river.
In an already tense and dangerous situation involving mass evacuations and complex rescue operations, authorities want to avoid panic. They now fear that AI technology – in which China is investing billions of dollars – is providing simple and accessible tools that can be used to deceive the public.
“Many of these content creators use disaster news to gain followers, knowing that more sensational or exaggerated content will get more likes and views. They are deliberately fabricating information to attract people’s attention,” Huang Zhihua, Deputy Chief responsible for online public security at the Zhejiang Police Department, told Chinese state media.
In recent weeks, there have been arrests and penalties – ranging from detention pending prosecution to fines – for creating false reports and video content. But experts warn that an unprecedented disinformation crisis may be looming.

In an article published by the newspaper of the Central Party School of the Communist Party, Professor Chen Bin said: “AI significantly lowers the technical barriers to producing false information. Individuals no longer need sophisticated technical skills. Simply using AI tools, they can quickly generate convincing text, images, audio and video… that is highly realistic, but entirely fabricated content, produced on a large scale.”
Professor Gao Fuping, of East China University of Political Science and Law, told the BBC that motivations for posting such fake content range from those doing it “to create something entertaining without thinking about the consequences,” to those wanting to “generate traffic for personal gain” or those deliberately seeking to “cause panic or social unrest.”
“Some users think the online world is anonymous and unregulated, or that they cannot be traced,” he said.
There have been calls for all AI-generated content to be clearly watermarked, but other users may re-edit the material to remove the labels. Professor Xu Xiaoke of Beijing Normal University told the BBC that greater efforts are needed to verify geographical locations with timestamps and check the sources of images.
“However, I would also stress that detection technology still lags behind generative technology. We are in an ongoing cat-and-mouse game. Therefore, we should not assume that technology alone can identify AI-generated content with a single click,” he warned.

The Chinese government is embracing AI in its effort to become the leading technological superpower. In 2017, it announced that AI would be the “primary driving force” behind the country’s development.
Huge sums of money are flowing into AI businesses that require more capital, spurring domestic competition. The state news service Xinhua reports that the country has more than 6,000 “AI companies.”
In this climate, Prof. Xu believes China should build “reliable information infrastructure.” This could include official government early-warning systems and disaster interfaces that news organizations can access.
But there have been cases in which official sources, including government-controlled media, have deliberately downplayed disasters, leading to public distrust in this area. Earlier in July, local journalists were asked to “soften” their language when describing a major breach in the Liulan dam wall near Naning, calling it an “opening” or “gap.”
Officials appeared to be trying to make the breach sound less alarming, but the consequences were deadly. Water bursting through the broken dam caused at least 26 deaths downstream.

And this is not an isolated incident.
In 2021, local officials were arrested, accused of concealing or underreporting 139 deaths in Henan province. Such incidents have created a trust vacuum that has made it much easier for bad actors to spread fake content. But police are urging people to trust accredited sources during emergencies.
“When you encounter disaster-related information from an unknown source, approach it skeptically and rely on official announcements,” said Gao Kai of the Ningbo Public Security Bureau.
He also tried to reassure the public that creators of false information would be caught, saying that “the internet is not a lawless zone. Public security authorities will continue to intensify efforts to crack down on illegal online activity.”
“We have established a specialized working group to closely monitor social media, especially short-video platforms. They will investigate and handle these cases quickly, cracking down very strictly.”
Punishment can range from a fine to seven years in prison if the consequences of disinformation are serious enough.
On July 23, the Cyberspace Administration of China also announced a nationwide crackdown on online fake content related to floods and other disasters, ordering local branches to focus on detecting fabricated data, malicious edits, staged scenes, historical events wrongly attributed, and those impersonating officials. In addition, it called on social media platforms to strengthen their review of the content they publish.
Prof. Gao believes that “the answer is public education combined with law enforcement,” saying there was a “need to publicize real cases in which people have been punished.” He added that “the harm caused by fake AI-generated content is ultimately the result of how people choose to use technology – not the technology itself,” adding that existing laws are sufficient to address it.
Others, however, are not so sure. Professor Chen emphasized that “AI technology continues to evolve much faster than legal frameworks. As new legal questions arise, AI disinformation remains a considerable challenge.”
Shanghai- and Washington-based lawyer Peter Pang says lawyers around the world are seeing an explosion in the number of cases dealing with these issues. He believes that companies that create AI applications and the platforms used to publish fake videos and material should be held legally responsible alongside the people who create disinformation.
“The first line of responsibility would be the platforms, because they are the ones that enable it. They are the ones who allow this to come to light,” he told the BBC.
He used a hypothetical example of a person hitting a pedestrian after being panicked by a fake social media post.
“The video creator might say, ‘You hit someone. That’s your problem. I didn’t do it.’ But let’s think it through. You created the foundation for people to react. If you created that panic, you should take responsibility for the consequences that follow.”
And Professor Xu warns that “AI-generated disinformation is likely to grow not only in volume, but also in the speed at which it spreads.”
“Looking ahead, political elections, public health emergencies, armed conflicts, natural disasters, and issues affecting people’s livelihoods are likely to become high-risk areas for AI-generated disinformation.
“Rather than waiting for false information to go viral before trying to contain it, governments and platforms must now prepare in advance.” /BBC















