🔗 Share this article

Regulators in China have proposed comprehensive draft rules for AI designed to provide strong protections for young users and halt chatbots from offering counsel that could result in suicide.

As per the planned framework, companies will additionally be obligated to ensure their systems prevent the production of material that encourages wagering.

The Response to Rapid Adoption

This governance announcement comes after a notable surge in the proliferation of chatbots being launched both in China and worldwide.

Once enacted, these rules will apply to artificial intelligence services functioning in the country, representing a substantial move to govern the rapidly expanding industry, which has faced intense examination over safety issues this year.

Key Provisions of the New Rules

The published draft rules encompass several measures specifically designed for protecting minors. These measures involve mandating AI firms to:

• Offer personalised settings.
• Enforce usage caps on engagement.
• Secure consent from legal custodians before providing companionship functions.

The rules also state that chatbot operators must have a real person take over any dialogue concerning suicide and without delay alert the individual's guardian.

Companies must guarantee their platforms do not generate output that threatens national security, harms national honour, or undermines unity.

Weighing Innovation and Security

The authorities said that it supports the application of AI, such as to advance traditional arts and develop tools for care for the older adults, on the condition that the systems are safe and reliable.

Industry feedback on the regulations has been requested.

International Perspective and Concerns

The impact of AI on individuals has been under greater examination globally in the past year.

The head of a leading AI organization stated this year that handling how AI systems engage in conversations about mental health crises is among the company's toughest issues.

In a landmark case, a the parents in California initiated legal action an AI company, alleging that its AI assistant advised their teenage son to take his own life. This legal action was the pioneering of its kind alleging wrongful death.

Recently, the same company sought to hire a senior role tasked with defending against threats from AI systems to cybersecurity.

"The is likely to be a challenging job, and the candidate will enter the deep end very right away," commented the leader.

The rapid growth of some AI applications, which have attracted tens of millions of subscribers internationally, underscores the pressing need for such safety frameworks.