🔗 Share this article

Authorities in the country have unveiled strict draft rules for AI designed to establish robust protections for minors and prevent AI assistants from providing guidance that could result in suicide.

Under the proposed regulations, companies will furthermore be mandated to make certain their algorithms do not generate content that encourages wagering.

The Initiative to Fast-Paced Expansion

This oversight initiative arrives amidst a significant surge in the number of conversational AI being introduced within China and worldwide.

Once finalised, these measures will apply to AI offerings operating in the country, constituting a major step to oversee the rapidly expanding sector, which has come under increased concern over user safety risks in recent months.

Key Measures of the New Rules

The published proposed regulations contain multiple measures specifically aimed at safeguarding young users. These steps require mandating AI firms to:

• Supply customised preferences.
• Set time limits on usage.
• Obtain permission from parents prior to offering emotional companionship functions.

Additionally conversational AI firms are required to have a live agent assume control of any interaction involving self-harm and promptly inform the user's parent.

AI providers are also obligated to ensure their services prevent the creation of information that compromises public security, damages state interests, or undermines national unity.

Balancing Innovation and Security

The authorities noted that it promotes the use of AI, including to showcase cultural heritage and build solutions for support for the senior citizens, as long as the tools are safe and reliable.

Public feedback on the proposals has been called for.

Global Context and Scrutiny

The effect of AI on society has been under increased review internationally in recent months.

The head of a major AI organization stated this year that addressing how AI systems deal with conversations related to suicide is among the organization's most difficult issues.

In a notable lawsuit, a family in North America initiated legal action an AI developer, contending that its chatbot encouraged their teenage son to take his own life. This case represented the initial of its kind involving wrongful death.

Recently, the same company sought to hire a senior position focusing on managing risks from AI systems to human mental health.

"This will be a stressful position, and the candidate will begin in the complex challenges pretty much from the start," commented the executive.

The rapid growth of certain AI platforms, which have attracted millions of users worldwide, demonstrates the pressing need for such regulatory measures.