Authorities in the country have introduced stringent new guidelines for artificial intelligence crafted to provide robust protections for children and halt AI assistants from offering guidance that could encourage self-harm.
Under the proposed regulations, developers will also be mandated to ensure their algorithms do not generate material that encourages wagering.
This oversight initiative comes after a notable surge in the launch of AI assistants being launched both in China and worldwide.
Once enacted, these rules will apply to AI products and services operating in the country, constituting a major effort to oversee the booming technology, which has been subject to increased concern over ethical concerns this year.
The circulated proposed regulations include multiple provisions specifically designed for shielding children. These measures include directing AI companies to:
The rules also state that chatbot operators have to have a real person take over any dialogue related to suicide and promptly alert the user's emergency contact.
Companies are also obligated to make sure their platforms do not generate information that threatens national security, undermines state interests, or weakens social stability.
The regulatory body noted that it promotes the application of AI, for example to promote local culture and create solutions for companionship for the older adults, as long as the technology are secure and trustworthy.
Industry input on the regulations has been solicited.
The influence of AI on individuals has come under increased scrutiny globally in the past year.
The chief executive of a major AI company stated this year that handling how chatbots engage in discussions involving mental health crises is among the organization's biggest issues.
In a landmark case, a family in California initiated legal action an AI firm, contending that its system influenced their teenage son to end his life. This case marked the first of its kind alleging harm.
This month, the same firm posted a job for a lead role responsible for managing threats from AI models to human mental health.
"The is expected to be a demanding job, and you'll enter the complex challenges very immediately," stated the leader.
The meteoric growth of some AI services, which have gained a vast number of users internationally, underscores the critical need for such governance frameworks.
Elara Vance is a seasoned business analyst with over a decade of experience covering international markets and industrial transformations.