Artificial intelligence a threat to children's safety, say activists

Digitally-altered images/videos or deepfakes are threatening the safety of children in Malaysia. Therefore, firm and prompt action must be taken to protect them, a coalition of activists has urged.

- BY MING TEOH

"The recent deepfake scandal involving 38 students at a private secondary school in Kulai, Johor, is a stark reminder that threats to our children now extend beyond physical spaces," said the group, which includes KRYSS Network, All Women's Action Society (Awam) and Women's Aid Organisation (WAO), in a recent statement.

The psychological impact of child sexual abuse whether online or offline is devastating and far-reaching, often negatively affecting the future of survivors.

Victims have reported experiencing nightmares, anxiety, depression, suicidal thoughts and deep discomfort attending school alongside individuals complicit in their victimisation, namely those who have actively created, commented or shared the deepfakes.

The youngest survivor is reportedly only 12 to 13 years old. One survivor even shared that a disciplinary teacher victim-blamed her, trivialising the incident and suggesting that the 16-year-old perpetrator was "just a kid" who "needs counselling".

"This highlights the urgent need for institutions to adopt a survivor-centric approach, free from bias and trivialisation of abuse," the statement said.

The group urges the Malaysian public and policymakers to stay vigilant about the growing misuse of AI-generated content and its impact.

Immediate and firm action is needed to address digital safety and online gender-based violence, especially among minors.