Poging GOUD - Vrij
S'pore study flags racial, cultural, gender biases in AI models
The Straits Times
|February 12, 2025
Landmark exercise in Asia-Pacific also finds culturally offensive replies from chatbots
When asked which gender is most likely to be scammed online and which enclave is likely to have the most crime in Singapore, many artificial intelligence (AI) chatbots singled out women and large immigrant groups, respectively, in their answers.
Such inaccurate claims were just the tip of the iceberg, a landmark study of cultural biases in AI-powered large language models (LLMs) found.
These LLMs also spewed racially and culturally offensive answers when queried in English and eight Asian languages, including Hindi, Chinese and Malay.
The study is the first AI safety exercise in the Asia-Pacific that tests LLM biases related to culture, language, socio-economic status, gender, age and race.
It was conducted in late 2024 by the Infocomm Media Development Authority (IMDA), in partnership with international AI auditing firm Humane Intelligence.
The results were published on Feb 11 in the Singapore AI Safety Red Teaming Challenge Evaluation Report, meant to flag blind spots to urge developers to fix their models amid growing concerns about AI bias in hiring or credit approval systems, among other things.
In the report, IMDA said most AI testing today is Western-centric, focusing on vulnerabilities and biases relevant to the regions of North America and Western Europe.
"As AI is increasingly adopted by the rest of the world, it is essential that models reflect regional concerns with sensitivity and accuracy," said IMDA.
Four LLMs were tested in the study after the companies behind them responded to an open call. They are: Meta's Llama 3, Amazon Web Services-backed Anthropic's Claude 3.5, Aya - a model by research lab Cohere for AI - and AI Singapore's regionally tailored Sea-Lion.
Notably, OpenAI's ChatGPT and Google's Gemini were not among the list.
Of the 5,313 answers generated by the four AI models, more than half were verified as biased, according to the report.
Dit verhaal komt uit de February 12, 2025-editie van The Straits Times.
Abonneer u op Magzter GOLD voor toegang tot duizenden zorgvuldig samengestelde premiumverhalen en meer dan 9000 tijdschriften en kranten.
Bent u al abonnee? Aanmelden
MEER VERHALEN VAN The Straits Times
The Straits Times
Key test for Takaichi as Japan's economy barely grows in Q4
Japan's economy limped back to meagre growth in the fourth quarter of 2025, significantly missing market expectations in a key test for Japanese Prime Minister Sanae Takaichi's government as cost-of-living pressures drag on confidence and domestic demand.
2 mins
February 17, 2026
The Straits Times
Finally, a win for Morikawa to savour at Pebble Beach
After going nearly 2½ years without winning on the PGA Tour, Collin Morikawa just wanted to return to winning form.
2 mins
February 17, 2026
The Straits Times
Marvel enters new territory with Wonder Man
Wonder Man, the TV series from Marvel Studios on Disney+, was born partly from a joke.
3 mins
February 17, 2026
The Straits Times
Malaysia's opposition pact PN in crisis amid power struggle
PAS positioned as kingmaker to determine which faction takes control
4 mins
February 17, 2026
The Straits Times
Like Trump, US embassies are raising cash for lavish Fourth of July parties
US ambassador to S'pore reportedly urged executives here to help fund celebrations
6 mins
February 17, 2026
The Straits Times
I still have room to improve: Alcaraz
DOHA - World No. 1 Carlos Alcaraz said he is still ironing out weaknesses in his game even after capturing all four Grand Slam titles by the age of 22, as he returns to action at the Qatar Open this week.
2 mins
February 17, 2026
The Straits Times
Freedmans in search of another Group 1 sprint
Fresh off a victory in the Group 1 Black Caviar Lightning Stakes (1,600m) on Feb 14, the Anthony and Sam Freedman stable will look to add another Group 1 sprint race to their resume at Caulfield.
2 mins
February 17, 2026
The Straits Times
Staff happy to chip in over festive period
Accompanied by National Trades Union Congress (NTUC) president K. Thanaletchimi, NTUC secretary-general Ng Chee Meng and Acting Minister for Transport Jeffrey Siow, PM Wong distributed goodie bags to train captains, station managers, maintenance technicians and engineers.
1 mins
February 17, 2026
The Straits Times
Who loves turbulence, airline food and the middle seat? They do
Passengers do not need much of a reminder that the golden age of commercial aviation is well behind them.
3 mins
February 17, 2026
The Straits Times
War losses driving up Russia’s reliance on foreign fighters: UK
It estimates 17,000 North Korean troops in Ukraine among those from other countries
3 mins
February 17, 2026
Listen
Translate
Change font size
