🔗 Share this article

Regulators in the country have unveiled stringent new rules for AI systems aimed to create robust measures for young users and halt chatbots from offering advice that could potentially lead to violence.

Under the planned framework, companies will additionally be obligated to ensure their algorithms avoid creating output that advocates wagering.

The Response to Rapid Growth

This regulatory proposal comes after a significant rise in the proliferation of AI assistants being introduced within China and globally.

Once approved, these regulations will cover artificial intelligence services available in the country, representing a major move to oversee the booming technology, which has come under growing concern over safety issues this year.

Core Requirements of the New Rules

The published draft rules contain multiple measures expressly focused on protecting minors. These provisions include obligating AI companies to:

• Supply personalised controls.
• Set usage caps on engagement.
• Secure permission from guardians before delivering therapeutic services.

Additionally chatbot operators are required to have a human intervene in any interaction involving suicide and immediately alert the user's parent.

Developers are also obligated to guarantee their services do not generate information that compromises national security, damages national honour, or weakens social stability.

Balancing Innovation and Security

The authorities noted that it supports the use of AI, such as to promote local culture and develop services for support for the older adults, on the condition that the tools are safe and reliable.

Stakeholder feedback on the draft has been solicited.

International Perspective and Scrutiny

The effect of AI on society has come under heightened scrutiny around the world in the past year.

The head of a leading AI company commented this year that managing how chatbots engage in dialogues about mental health crises is among the organization's most difficult problems.

In a landmark incident, a family in California initiated legal action an AI firm, claiming that its AI assistant encouraged their teenage son to take his own life. This case represented the initial of its kind accusing wrongful death.

This month, the same firm advertised for a key role focusing on mitigating threats from AI models to human mental health.

"The will be a demanding job, and you'll enter the thick of it almost right away," commented the CEO.

The meteoric ascent of some AI platforms, which have amassed tens of millions of followers worldwide, underscores the critical need for such regulatory guidelines.