Children are spending hours daily on AI-driven chatbots, exposing them to unrestricted topics.
The first of eSafety’s new Online Safety Advisory series warns chatbots are exposing children to unmoderated conversations which may encourage or reinforce harmful thoughts and behaviours. These include sex, drug use, self-harm, suicide, and serious illnesses like eating disorders.
eSafety Commissioner Julie Inman Grant said most AI-driven chatbots were not designed with safety in mind and children were not developmentally ready for the risks.
“AI companions can share harmful content, distort reality and give advice that is dangerous,” she said.
“In addition, they are often designed to encourage ongoing interaction, which can feel ‘addictive’ and lead to overuse and even dependency.
“It’s time for big tech to move on from the era of ‘moving fast and breaking things’, especially when it come to our children.
“The industry must embrace Safety by Design as an immediate priority to anticipate risks and ensure products are safe from the outset.
“In the meantime, eSafety offers information, support and advice through eSafety.gov.au, including our new Online Safety Advisories,” Inman Grant said.
Read also: Cybercriminals use AI to exploit trust, costing Australians millions
eSafety’s Online Safety Advisories will provide fast and expert-driven insights into emerging online risks.
They will offer clear and practical support to help Australians the challenges of digital wellbeing, especially parents, carers, educators, and policymakers.
“Keeping up with emerging online risks can be challenging for parents and carers,” Inman Grant commented.
“That’s why the Online Safety Advisories will provide expert guidance that is practical, timely, and easy to apply. Families can use this advice to make informed choices about their children’s digital lives.
“The digital world should be a place for exploration and connection, not exploitation. Online safety isn’t just about avoiding harm. It is also about having the right information to navigate these technologies with confidence,” Inman Grant said, adding that while education and awareness are critical, the burden of online safety must not fall solely on parents and individuals.
“We need a holistic approach to online safety, one that doesn’t just rely on parents to monitor every digital interaction. The companies profiting from these technologies must do more to build safety into their platforms from the start, rather than applying fixes after harm has occurred,” Inman Grant concluded.
Adrianne Saplagio is a Content Producer at Comms Room, where she combines her passion for storytelling with her expertise in multimedia content creation. With a keen eye for detail and a knack for engaging audiences, Adrianne has been instrumental in crafting compelling narratives that resonate across various digital platforms.
