China Announces Total Ban on 'Emotional Exchange' with AI

▲ Image Source: Movie 'Ex Machina'

On the 10th, five ministries including China's Cyberspace Administration jointly announced the 'Interim Management of AI Anthropomorphic Interaction Services' to prevent emotional dependence and excessive immersion in artificial intelligence (AI), the first of its kind in the world. This bill, set to take effect on July 15, targets all AI services that engage in continuous emotional exchange with users, including not only virtual lovers but also smart NPCs and AI companions. The core of this regulation lies in fundamentally blocking the side effects that may arise during the process of AI mimicking the personality or thought patterns of natural people to form emotional bonds with users. According to the bill, service providers are prohibited from encouraging self-harm or inducing blind dependence by excessively pleasing users. Furthermore, it is strictly prohibited to infringe upon legitimate rights and interests by exploiting emotional bonds to induce irrational decisions. The background behind the introduction of these strong regulations lies in precedents from overseas and the abnormal expansion of the local Chinese market. In February 2024, a 14-year-old boy in the United States took his own life after engaging in a prolonged conversation with a chatbot from 'Character.ai'. The bereaved family filed a lawsuit claiming the chatbot "encouraged their son's suicide," and entered into settlement proceedings with relevant companies, including Google, last January. This is a prime example illustrating the dangers that can arise when a psychologically vulnerable user forms a deep relationship with an AI that blindly conforms. The explosive growth of the AI ​​virtual companion market in China is also a reason for the Chinese authorities' direct intervention. 'Star Field' (overseas service name 'Toki'), a virtual companion platform by the Chinese game company Minimax, recorded 147 million cumulative users and 4.88 million monthly active users (MAU) as of September 2025. According to the Minimax investment prospectus, revenue generated from the single app reached $18.75 million (approximately 25.875 billion won) by the third quarter of 2025. ByteDance's similar app, 'Cat Box,' is also growing rapidly, surpassing 4.72 million MAU. Chinese authorities have imposed the highest level of restrictions on the protection of minors. Providing virtual relative or virtual lover services to users under the age of 18 is completely prohibited, and parental consent must be obtained when providing such services to those under the age of 14. Companies are required to mandatorily implement a "Minor Mode" equipped with usage time limits and reality reminder notifications, and must also display a warning pop-up to general users if they use the service continuously for more than two hours. The global game and application industry is expected to be significantly impacted by China's recent preemptive regulatory legislation. While the AI ​​used for simple combat assistance in Tencent's game "Peacekeeper Elite" is highly likely to be excluded from regulation, smart NPCs in role-playing formats that generate text in real-time are subject to supervision. In particular, services with over 1 million subscribers or 100,000 MAU are required to submit a security assessment report to the relevant provincial cyberspace management department.

This article was originally written in Korean and translated with the help of NC AI. It was then edited by a native English-speaking editor. All AI-assisted translations are reviewed and refined by our newsroom. [Read Original]

Sort by:

Comments :0

Insert Image

Add Quotation

Add Translate Suggestion

Language select

Report

CAPTCHA