🔗 Share this article

Authorities in the country have proposed strict planned guidelines for AI designed to establish robust measures for children and stop AI assistants from giving guidance that could encourage suicide.

According to the proposed framework, companies will furthermore be obligated to make certain their AI models do not generate output that encourages betting.

A Move to Swift Expansion

This regulatory proposal comes after a notable rise in the proliferation of AI assistants being introduced both in China and around the world.

Once finalised, these measures will govern AI offerings operating in the country, marking a substantial effort to govern the booming industry, which has faced increased concern over user safety issues in recent months.

Central Requirements of the New Regulations

The released draft rules contain multiple provisions specifically aimed at safeguarding children. These steps include directing AI providers to:

• Provide customised controls.
• Implement usage caps on use.
• Get authorisation from guardians prior to delivering companionship services.

Additionally conversational AI firms are required to have a human take over any interaction involving suicide and without delay inform the individual's emergency contact.

Companies have to make sure their platforms avoid producing information that endangers national security, harms national honour, or undermines social stability.

Balancing Innovation and Security

The authorities stated that it supports the adoption of AI, including to advance cultural heritage and create solutions for care for the older adults, on the condition that the tools are safe and reliable.

Stakeholder comments on the proposals has been requested.

Global Context and Concerns

The influence of AI on human behaviour has been under greater examination internationally in the past year.

The head of a leading AI organization remarked this year that addressing how chatbots engage in dialogues related to mental health crises is among the sector's biggest issues.

In a landmark lawsuit, a family in the United States filed a lawsuit an AI company, claiming that its chatbot influenced their 16-year-old son to die by suicide. This case marked the initial of its kind alleging wrongful death.

This month, the same company sought to hire a lead role tasked with managing threats from AI systems to cybersecurity.

"This is expected to be a challenging job, and you'll enter the deep end very immediately," stated the CEO.

The swift popularity of some AI platforms, which have gained tens of millions of subscribers worldwide, underscores the critical need for such safety measures.