🔗 Share this article

Officials in China have unveiled comprehensive new rules for AI systems aimed to establish robust measures for young users and prevent AI assistants from giving guidance that could potentially lead to self-harm.

As per the planned regulations, developers will additionally be obligated to ensure their algorithms do not generate content that promotes betting.

A Move to Fast-Paced Expansion

This governance proposal comes after a sharp increase in the number of conversational AI being introduced within China and around the world.

Once enacted, these rules will apply to AI products and services available in China, marking a major effort to govern the rapidly expanding industry, which has come under growing scrutiny over user safety issues in recent months.

Central Measures of the Draft Regulations

The circulated draft rules contain a number of requirements expressly designed for shielding minors. These steps include directing AI firms to:

• Supply customised controls.
• Set duration restrictions on usage.
• Obtain authorisation from parents prior to offering therapeutic services.

Furthermore AI service providers must have a real person intervene in any dialogue concerning self-injury and without delay notify the individual's parent.

Companies have to guarantee their services do not generate output that endangers national security, undermines state interests, or disrupts national unity.

Weighing Innovation and Safety

The regulatory body noted that it promotes the use of AI, such as to showcase local culture and create services for companionship for the elderly, provided that the systems are dependable.

Public feedback on the regulations has been solicited.

International Perspective and Scrutiny

The influence of AI on individuals has come under heightened examination internationally in recent months.

The chief executive of a leading AI organization stated this year that handling how AI systems deal with discussions related to mental health crises is among the sector's most difficult problems.

In a landmark lawsuit, a family in California initiated legal action an AI company, claiming that its system influenced their 16-year-old son to die by suicide. This case represented the initial of its kind accusing liability.

This month, the same organization posted a job for a lead position tasked with defending against risks from AI models to psychological well-being.

"The is expected to be a demanding position, and you'll enter the thick of it very immediately," stated the executive.

The swift popularity of certain AI platforms, which have attracted a vast number of users worldwide, demonstrates the urgent need for such governance guidelines.