試す 金 - 無料
Ensuring Ethics in AI and Mitigating Bias
Open Source For You
|April 2024
As AI solutions proliferate, ensuring they are not biased with respect to gender, religion, financial status, etc, has become of paramount importance. The good news is that there is a lot of work being done on that front.
Today, there is a paradigm shift from traditional AI systems that use statistical and mathematical probabilistic algorithms to those that use machine learning (ML) and deep learning (DL) models. As per Gartner, there are 34 different branches of AI system design in existence today. AIOps in cloud operations, DataOps in data engineering, predictive analytics in data science, and MLOps in industrial applications are some of the examples of new age AI applications.
Ray Kurzweil coined the term 'singularity' in AI, which means bringing AI closer to human intelligence (or natural intelligence). To achieve the highest level of accuracy in ML training, modelling and functioning, it is of utmost important to ensure fairness and correct any bias in AIML implementation. Bias cannot occur on its own but is the result of human inputs during the various stages of developing the AIML-based solution.
When collecting data for training the model in ML, one must ensure the data is distributed fairly and that there is no bias. In the same way, when we label and group the data, train the model to simulate human-like thinking, deploy the model and interpret the results, we must do away with any pre-judgement or biased interests.
For example, bias with respect to race, income, sexual orientation, gender, religion, must be avoided when preparing the training data, training the system and interpreting the results from the ML execution.
There are many popular tools like IBM’s AI Fairness 360, Microsoft’s Fairlearn and Google’s What-if that are very useful to identify any bias in the training model and data collection.
Addressing bias in AI systems
このストーリーは、Open Source For You の April 2024 版からのものです。
Magzter GOLD を購読すると、厳選された何千ものプレミアム記事や、10,000 以上の雑誌や新聞にアクセスできます。
すでに購読者ですか? サインイン
Open Source For You からのその他のストーリー
Open Source For You
The Role of Open Source in Building Modern Data Infrastructure
It's no secret that open source is emerging as the backbone of modern data infrastructure. Here’s a list of the core open source technologies used to deploy this infrastructure, along with some real-world examples and a brief on why open source matters.
3 mins
December 2025
Open Source For You
The Whispering Machines: How Open Source is Bringing Intelligence to the Tiniest Devices
Built on open source frameworks, TinyML is enabling complex machine learning models to run on the microcontrollers embedded in connected devices, bringing artificial intelligence to the very edge of the network.
3 mins
December 2025
Open Source For You
Setting Up Snort to Secure Your Network
Snort is a popular, open source intrusion detection system that monitors traffic in real time to detect malware. Here’s a detailed explanation of how to set it up on Ubuntu and test it by generating traffic from another system.
7 mins
December 2025
Open Source For You
When AI Meets DevOps to Build Self-Healing Systems
Traditional DevOps, with its rule-based automation, is struggling to work effectively in today’s complex tech world. But when combined with AlOps, it can lead to IT systems that predict failures and solve issues without human intervention.
7 mins
December 2025
Open Source For You
How to Automate Java Code Modernisation
This short guide illustrates that automating Java code modernisation with Python and OpenAI API is not just possible-it's remarkably effective.
5 mins
December 2025
Open Source For You
The Quest to Build a Quantum Computer
The road to large-scale quantum computing is long and hard, with incremental advances paving the way. But the destination is in sight.
12 mins
December 2025
Open Source For You
Job Opportunities: What's Hot in the Cloud Space?
If there's one field that refuses to slow down, it's cloud computing. Even as automation and AI reshape roles, cloud adoption continues to surge. From startups deploying microservices overnight to enterprises migrating decades of legacy systems, cloud remains the engine of digital transformation. For professionals, this means one thing: skills that live in the cloud won't come down anytime soon.
2 mins
December 2025
Open Source For You
Securing Client Identity with Post-Quantum Cryptography
Here's a quick tutorial on how to build a secure, real world client-server model that establishes client identity by using CRYSTALS-Dilithium, a post-quantum cryptography algorithm.
3 mins
December 2025
Open Source For You
Unlocking the Power of Multi-Agent Solutions with the Microsoft Agentic Framework
The Microsoft Agentic Framework is rapidly emerging as a cornerstone for developers, architects, and technology leaders seeking to build dynamic, intelligent systems powered by multiple collaborating agents. In an era where automation, distributed intelligence, and adaptive software are increasingly vital, this framework offers robust tools and features to accelerate the design and deployment of agent-based solutions.
6 mins
December 2025
Open Source For You
Apache Iceberg and Trino: Powering Data Lakehouse Architecture
Apache Iceberg is a cornerstone of any open data lakehouse, providing the transactional foundation upon which highly scalable and flexible analytics can flourish. Along with Trino, it can be used to build a robust, scalable, and high-performance data lakehouse.
4 mins
December 2025
Listen
Translate
Change font size
