Singapore launches framework to safeguard against rogue AI agents

The capacity for an artificial intelligence (AI) system to draw from multiple databases and act independently has introduced new risks, such as potential unauthorised payments and personal data theft.

- Sarah Koh

Mrs Josephine Teo said the framework is being introduced now to articulate the Government's expectations while organisations are still in the midst of developing their own agent architecture.

(PHOTO: WORLD ECONOMIC FORUM)

Such risks, as well as guardrails to prevent the unintended outcomes, are outlined in a new framework, dubbed Model AI Governance Framework for Agentic AI, launched by the Infocomm Media Development Authority on Jan 22.

Unlike traditional AI, new agentic AI systems with the ability to understand natural language can reason and independently complete tasks on behalf of users.

AI agents include coding assistants that generate, test and debug code through prompts in natural language.

While these agents allow organisations to automate repetitive tasks and allow employees to take up “higher-value” activities, their ability to access sensitive data and make changes to the digital environment introduces new risks, said IMDA on Jan 22.

For instance, an agent could fix a medical appointment on the wrong date, negatively affecting a patient’s health outcomes. An agent could also take action outside its permitted scope of authority without human approval.