Data Science for AI Chatbot Bias Detection and Mitigation in Healthcare

The integration of AI chatbots into healthcare systems presents transformative potential to enhance patient access, assist clinical decision-making, and streamline administrative workflows. Despite these advantages, the deployment of AI chatbots introduces significant concerns related to bias, which...

Full description

Bibliographic Details
Main Authors: Amareshwari, Parunandhi, Sathwika, Nagasamudrala, Laxmi Prasanna, Mendu, Sreeja, Somanaboina
Format: Article
Language:English
English
Published: INTI International University 2025
Subjects:
Online Access:http://eprints.intimal.edu.my/2156/
http://eprints.intimal.edu.my/2156/1/jods2025_14.pdf
http://eprints.intimal.edu.my/2156/2/699
Description
Summary:The integration of AI chatbots into healthcare systems presents transformative potential to enhance patient access, assist clinical decision-making, and streamline administrative workflows. Despite these advantages, the deployment of AI chatbots introduces significant concerns related to bias, which can diminish care quality and reinforce existing health disparities. This paper investigates the key sources of bias in AI chatbots, including dataset imbalances, algorithmic design flaws, and linguistic biases that may perpetuate stereotypes. These forms of bias can lead to misdiagnoses, inequitable treatment suggestions, and a breakdown of trust in AI-driven tools, particularly affecting marginalized or underserved populations. The study underscores the broader consequences of biased AI systems in healthcare, such as reinforcing discrimination and widening healthcare inequalities. To confront these challenges, the paper outlines methodologies for bias detection, including the use of fairness metrics and testing across diverse demographic cohorts. It also discusses mitigation strategies like representative data sampling, algorithmic refinement, feedback loops, and human oversight to ensure ethical and equitable AI usage.