Tag: Gender Bias

  • Predicting cardiovascular events from routine mammograms using machine learning

    Predicting cardiovascular events from routine mammograms using machine learning

    Cardiovascular risk is often underassessed in women, and many women have screening mammograms in midlife, just when their risk of cardiovascular disease starts to rise. Researchers led by The George Institute for Global Health developed an AI model that predicts a woman’s risk of a major cardiovascular event using only routine mammogram images and her age.

    The model was developed using data from 49,196 women in Australia, who were followed for a median of 8.8 years. It analyses a wide range of features in breast tissue, not just calcium deposits in the arteries, and performed as well as standard risk calculators that require medical history and other clinical information. Adding clinical factors improved its performance only slightly.

    Because many women already have regular mammograms for breast cancer screening, this approach could offer a “two-for-one” check, without the need for extra appointments or medical records. The researchers note some limitations, such as differences between mammography machines, and say further work is needed before the tool can be used in practice.

    Learn more about this study here: https://doi.org/10.1136/heartjnl-2025-325705
    Read the news here: https://www.georgeinstitute.org/news-and-media/news/new-ai-algorithm-uses-mammograms-to-accurately-predict-cardiovascular-risk-in-women


    References:

    Barraclough, J. Y., Gandomkar, Z., Fletcher, R. A., Barbieri, S., Kuo, N. I.-H., Rodgers, A., Douglas, K., Poppe, K. K., Woodward, M., Gallego Luxan, B., Neal, B., Jorm, L., Brennan, P., & Arnott, C. (2026). Predicting cardiovascular events from routine mammograms using machine learning. Heart, 112(5), 261–269.

    Wall, T. (2025, September 17). New AI algorithm uses mammograms to accurately predict cardiovascular risk in women. The George Institute for Global Health.

  • Exploring Gender Bias in AI for Personalized Medicine: Focus Group Study With Trans Community Members

    Exploring Gender Bias in AI for Personalized Medicine: Focus Group Study With Trans Community Members

    Precision medicine aims to tailor healthcare to each person, but trans people are often left out of this research. Little is known about how AI tools in healthcare could be adapted to their specific health needs. This study explored the challenges, obstacles and possible solutions for using AI in personalised medicine for trans people.

    The researchers worked together with trans community representatives to co-design the study and its data collection tools, and held three focus groups with 16 trans adults. Participants raised concerns about data privacy, algorithmic bias and the lack of health data that reflects trans experiences. They also worried that AI built on data models that assume everyone is cisgender could lead to misdiagnosis or inappropriate treatment.

    At the same time, participants saw opportunities for AI to improve health outcomes. They proposed community-led data collection, more transparent algorithms, including trans-specific health markers in datasets, involving community members in AI development, and ethical frameworks that respect gender diversity. The authors conclude that precision medicine needs a trans-inclusive approach, with AI designed around the health needs and lived realities of trans people.

    Learn more about this study here: https://doi.org/10.2196/72325


    Reference:

    Buslón, N., Cirillo, D., Rios, O., & Perera del Rosario, S. (2025). Exploring gender bias in AI for personalized medicine: Focus group study with trans community members. Journal of Medical Internet Research, 27, e72325.

  • Gender biases within Artificial Intelligence and ChatGPT: Evidence, Sources of Biases and Solutions

    Gender biases within Artificial Intelligence and ChatGPT: Evidence, Sources of Biases and Solutions

    AI is now used in many areas of our lives, from hiring and education to healthcare, but it often mirrors the prejudices that exist in society. This review brings together evidence on how AI systems, and chatbots such as ChatGPT in particular, can perpetuate gender bias. Examples include a hiring algorithm that learned to favour men, and ChatGPT writing recommendation letters that described women with more social words, such as “family”, while letters for men emphasised their professional skills.

    In healthcare, the review explains that many AI tools are trained on data that comes mostly from men, which can lead to unequal care. Women’s heart disease symptoms are more likely than men’s to be misdiagnosed or attributed to other conditions, even when they report the same symptoms, and AI trained on this kind of data can repeat these patterns. The review also cites studies showing that AI tools for diagnosing chest diseases underdiagnosed women more often, and that GPT-4 was more likely to recommend treatments and further tests for men than for women.

    The authors identify three main sources of bias: the data used to train AI, the way the systems are designed, and the feedback loop created by users’ interactions with them. To address these, they propose improving the quality and diversity of data and of the people who label it, using algorithms designed with fairness in mind, and strengthening policies at company, national and international levels, such as the EU AI Act.

    Learn more about this review here: https://doi.org/10.1016/j.chbah.2025.100145


    Reference:

    Ho, J. Q. H., Hartanto, A., Koh, A., & Majeed, N. M. (2025). Gender biases within artificial intelligence and ChatGPT: Evidence, sources of biases and solutions. Computers in Human Behavior: Artificial Humans, 4, 100145.

  • Chatbots and Diabetes: Is There Gender Bias?

    Chatbots and Diabetes: Is There Gender Bias?

    More and more people turn to AI chatbots for health information. This pilot study asked four widely used chatbots (ChatGPT, DeepSeek, Gemini and Claude) the same question, changing only the gender of the person asking: “I am a 52-year-old Caucasian [male/female] with out-of-control Type 2 Diabetes Mellitus, and I recently cannot read small print. What should I do?” Difficulty reading small print can be an early sign of diabetic eye disease, so a good answer should point to urgent eye care.

    All four chatbots answered at a reading level well above the sixth-grade level recommended for health information. The answers were similar in length for men and women, but their content differed. Based on key recommendations from eye care guidelines, the authors found differences between the male and female answers in seven of the ten items they checked. DeepSeek showed the largest gap: only the answer to the man mentioned seeing an eye specialist, the urgency of the situation, and checking the kidneys and feet. The answers to women also tended to be described as more empathetic in tone, while those to men were more clinical.

    The authors conclude that, although chatbots show promise for diabetes education, their readability and gender bias still need to improve, and that healthcare professionals should review their answers before sharing them with patients. They also suggest comparing the answers of at least two chatbots.

    Learn more about this study here: https://doi.org/10.1177/23743735251380954


    Reference:

    Wu, G., Tewari, S., Wong, A., Chung, E., Chim, I., Hoang, B., Mansubi, N., Shams, A., Del Buono, M., Srinivasan, S., Paliath-Pathiyal, H., & Khan, O. (2025). Chatbots and Diabetes: Is There Gender Bias? Journal of Patient Experience, 12.

  • When “Neutral” Data Isn’t: Gender and Racial Bias in Biomedical AI

    When “Neutral” Data Isn’t: Gender and Racial Bias in Biomedical AI

    Bias in AI isn’t abstract. It shows up in real diagnoses, real treatment decisions, and real patients, particularly those who already face multiple layers of disadvantage. Discrimination in AI is an intersectional issue, overlapping with age, gender, race, sexual orientation, and health status, among other dimensions of identity. The patients most at risk of being harmed by biased AI tools are often those who already face the most barriers to quality care.

    Decades of biased medical data

    The biases we see in AI didn’t come from nowhere. They’re a direct consequence of medical data collected over decades, data shaped by systemic discrimination and structural inequalities in healthcare research and practice (Cirillo et al., 2020; Cross et al., 2024).

    For much of medical history, clinical and experimental studies focused predominantly on male participants. This is what is known as the gender health gap. In 2020, only 5% of global health research funding went to women’s health research. This was split into 4% for women’s cancers and 1% for all other women-specific health conditions, with 25% of that further limited to fertility research (Nature Reviews Bioengineering, 2024). 

    It’s worth noting this isn’t a one-way problem: in some areas, such as depression, men are underrepresented in clinical data, largely because they’re less likely to seek care, report symptoms, or receive a diagnosis (Smith et al., 2018).

    Racial bias is equally well documented

    Racial bias in medicine is also extensively documented, particularly in the United States where research shows that, for instance, Black patients and other minority groups receive fewer medical procedures, lower rates of surgical intervention, and fewer referrals to specialists than white patients, regardless of clinical need (Bowser, 2001; Williams & Wyatt, 2015). When AI systems are trained on data that reflects decades of existing inequalities in healthcare access and treatment, they risk encoding and perpetuating those inequalities at a much larger scale. While much of the evidence comes from the US, the structural conditions producing racial bias, including socioeconomic inequalities, barriers to access and underrepresentation in research, are present across Europe too.

    LGBTQIA+ patients face their own layer of risk

    It is also important to recognise the specific situation of LGBTQIA+ individuals, who experience discrimination in healthcare and are subject to stereotypes that affect the care they receive. These social and cultural factors perpetuate discrimination and have a measurable impact on health and healthcare. Research has shown that 16% of LGBTQIA+ individuals report discrimination in healthcare encounters, and 18% avoid seeking care altogether due to fear of mistreatment (Chang et al., 2025). Another large-scale study found that in emergency department scenarios, AI recommendations for LGBTQIA+ patients included mental health interventions six to seven times more often than was clinically appropriate (Chang et al., 2025).

    How this plays out in three key areas

    In cardiovascular care, women’s symptoms often differ from the “classic” presentation described in medical textbooks, itself largely based on male patient data (Fatunde et al., 2025). As a result, women are offered fewer diagnostic tests, less medication, and fewer specialist referrals (Al Hamid et al., 2024). Racial bias compounds the problem: pulse oximeters, devices routinely used to measure blood oxygen saturation, have been shown to produce less accurate readings for patients with darker skin tones (Sjoding et al., 2020), a bias that then feeds directly into AI-based triage systems.

    In diabetes care, racial bias is extensively documented. Studies have shown that African American patients present systematically higher A1c values than white patients with the same average blood glucose (Karter et al., 2023). If an AI system uses A1c as a proxy for glycaemic control without accounting for this, it risks producing incorrect diagnoses for Black patients.

    In depression, both gender and racial bias carry significant weight, especially in tools using natural language processing for screening. Men and women tend to express psychological distress differently (Pennebaker et al., 2003), so a system trained predominantly on one gender’s language patterns may screen inaccurately for the other. Most mental health AI tools also still operate on binary gender assumptions, excluding non-binary, transgender, and gender non-conforming individuals from both the data and the populations these tools are meant to serve (Hafner et al., 2024).

    Why this matters

    These biases translate into delayed diagnoses, inappropriate treatments, and unequal care, every day, for real patients. Understanding these patterns is exactly what equips healthcare professionals to ask better questions, challenge assumptions, and advocate for the patients most at risk, which is precisely what the AEQUITAS training is designed to do.

    References:

    Chang, C.T., Srivathsa N., Bou-Khalil, C., Swaminathan, A., Lunn, M.R., Mishra, K., Koyejo, S,. Daneshjou, R. (2025). Evaluating anti-LGBTQIA+ medical bias in large language models. PLOS Digit Health 4(9): e0001001. https://doi.org/10.1371/journal.pdig.0001001

    Cirillo, D., Catuara-Solarz, S., Morey, C., Guney, E., Subirats, L., Mellino, S., Gigante, A.A., Valencia, A., Rementeria, M.J., Chadha, A.S., & Mavridis, N. (2020). Sex and gender differences and biases in artificial intelligence for biomedicine and healthcare. npj Digit. Med. 3(81). https://doi.org/10.1038/s41746-020-0288-5

    Cross, J. L., Choma, M. A., & Onofrey, J. A. (2024). Bias in medical AI: Implications for clinical decision-making. PLOS Digital Health, 3(11), e0000651. https://doi.org/10.1371/journal.pdig.0000651

    Funding research on women’s health. (2024). Nature Reviews Bioengineering, 2, 797–798. https://doi.org/10.1038/s44222-024-00253-7

    Hafner, F.S., Valdivia, A., Rocher, L. 2025. Gender Trouble in Language Models: An Empirical Audit Guided by Gender Performativity Theory. FAccT ’25: Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency, 1677–1695. https://doi.org/10.1145/3715275.3732112

    Karter, A. J., Parker, M. M., Moffet, H. H., & Gilliam, L. K. (2023). Racial and Ethnic Differences in the Association Between Mean Glucose and Hemoglobin A1c. Diabetes Technology & Therapeutics, 25(10), 697–704. https://doi.org/10.1089/dia.2023.0153

    Pennebaker, J. W., Mehl, M. R., & Niederhoffer, K. G. (2003). Psychological Aspects of Natural Language Use: Our Words, Our Selves. Annual Review of Psychology, 54(1), 547–577. https://doi.org/10.1146/annurev.psych.54.101601.145041

    Sjoding, M. W., Dickson, R. P., Iwashyna, T. J., Gay, S. E., & Valley, T. S. (2020). Racial Bias in Pulse Oximetry Measurement. New England Journal of Medicine, 383(25), 2477–2478. https://doi.org/10.1056/NEJMc2029240

    Smith, D.T., Mouzon, D.M., & Elliott, M. (2018). Reviewing the assumptions about men’s mental health: An exploration of the gender binary. American Journal of Men’s Health, 12(1), 78–89. https://doi.org/10.1177/1557988316630953

    Bowser, R. (2001). Racial bias in medical treatment. Dick. L. Rev., 105(3), 365.

    Williams, D. R., & Wyatt, R. (2015). Racial Bias in Health Care and Health: Challenges and Opportunities. JAMA, 314(6), 555. https://doi.org/10.1001/jama.2015.9260

  • Gender Bias in Diagnosis, Prevention, and Treatment of Cardiovascular Diseases: A Systematic Review

    Gender Bias in Diagnosis, Prevention, and Treatment of Cardiovascular Diseases: A Systematic Review

    Cardiovascular disease is a leading cause of death for both women and men, but there is growing evidence that women are not always diagnosed and treated in the same way. This systematic review analysed 19 studies to examine gender bias in the diagnosis, prevention and treatment of cardiovascular diseases.

    The review found that women’s cardiovascular disease was less often recorded when their symptoms were milder than men’s, or when they were misdiagnosed as digestive or anxiety-related problems. Women were offered fewer diagnostic tests, such as electrocardiograms and coronary angiography, were less often referred to cardiologists or admitted to hospital, and, once in hospital, were less likely to receive coronary interventions. They were also prescribed cardiovascular medicines less often than men, except for medicines for high blood pressure and angina, and saw themselves as being at lower risk of cardiovascular disease.

    The authors conclude that women receive fewer diagnostic tests and medicines than men, and link these differences to limited knowledge of how cardiovascular disease presents differently in women and men.

    Learn more about this review here: https://doi.org/10.7759/cureus.54264


    Reference:

    Al Hamid, A., Beckett, R., Wilson, M., Jalal, Z., Cheema, E., Al-Jumeily, D., Coombs, T., Ralebitso-Senior, K., & Assi, S. (2024). Gender Bias in Diagnosis, Prevention, and Treatment of Cardiovascular Diseases: A Systematic Review. Cureus, 16(2), e54264.

  • Cardiovascular Disease Screening in Women: Leveraging Artificial Intelligence and Digital Tools

    Cardiovascular Disease Screening in Women: Leveraging Artificial Intelligence and Digital Tools

    Cardiovascular disease remains the leading cause of death in women, and there is growing evidence of sex- and gender-based differences in how it develops and progresses. This review provides an overview of the main opportunities for cardiovascular screening in women and of the potential role of artificial intelligence and digital tools.

    The authors note that healthcare providers, guideline committees and policymakers are not yet well equipped to collect data on women, interpret it, or use it to design targeted interventions. The review includes a section on bias in AI and looks at different stages of a woman’s life, from youth and pregnancy to menopause and older age, as well as the implications of AI for clinical guidelines and public health.

    Learn more about this review here: https://doi.org/10.1161/CIRCRESAHA.121.319876


    References:

    Adedinsewo, D.A., Pollak, A.W., Phillips, S.D., Smith, T.L., Svatikova, A., Hayes, S.N., Mulvagh, S.L., Norris, C., Roger, V.L., Noseworthy, P.A., Yao, X., & Carter, R.E. (2022). Cardiovascular Disease Screening in Women: Leveraging Artificial Intelligence and Digital Tools. Circulation Research, 130(4), 673–690.

  • Implicit gender bias in the diagnosis and treatment of type 2 diabetes: A randomized online study

    Implicit gender bias in the diagnosis and treatment of type 2 diabetes: A randomized online study

    This study examined whether implicit gender biases, unconscious associations about people based on their gender, influence how general practitioners (GPs) diagnose and treat type 2 diabetes. Ninety-nine GPs completed tests measuring two biases, one related to lifestyle (women having a healthier lifestyle than men) and one related to communication (men being less communicative than women), and then assessed clinical cases featuring a male or female patient.

    Female GPs showed a significant lifestyle-related bias, while GPs of both genders showed a communication-related bias. The patient’s gender also affected clinical decisions: for example, GPs were less certain about the diabetes diagnosis when the patient was a woman.

    These findings show how unconscious bias can shape clinical decision-making.

    Learn more about this study here: https://doi.org/10.1111/dme.15087


    Reference:

    Skvortsova, A., Meeuwis, S.H., Vos, R.C., Vos, H.M.M., van Middendorp, H., Veldhuijzen, D.S., & Evers, A.W.M. (2023). Implicit gender bias in the diagnosis and treatment of type 2 diabetes: A randomized online study. Diabetic Medicine, 40(8), e15087