Structural Inequity in Digital Health: A Compounding Model of Algorithmic Bias Across the Data–Model–Deployment–Governance Pipeline
PDF
Full Text

Supplementary Files

Supplementary File 1

Keywords

Algorithmic bias
Digital health equity
Health inequities
Narrative review
Structural compounding model

Categories

How to Cite

1.
Nayak K. Structural Inequity in Digital Health: A Compounding Model of Algorithmic Bias Across the Data–Model–Deployment–Governance Pipeline. JPCHR. 2026;2(1):e26060801. doi:10.63486/jpchr.26060801

Abstract

Introduction: Digital health technologies including clinical decision-support systems, digital phenotyping, and mental health applications offer population health benefits but risk perpetuating inequalities through algorithmic bias, structural inequities in health system data, and differential digital access. Methods: SANRA-guided narrative-review with thematic synthesis was conducted using structured searches across PubMed, Web of Science, and CINAHL for English-language literature published from January 1, 2018, through May 17, 2026. Of 2,304 database records identified, 300 records were retained for title and abstract screening after deduplication and preliminary relevance assessment. Forty sources underwent full-text review, and 22 sources were included in the final narrative synthesis. Results: Six interrelated domains were identified: (1) digital pathways, social determinants, and generalizability; (2) algorithmic bias and clinical decision-making; (3) digital phenotyping and mental health inequity; (4) digital access, use, and infrastructure; (5) data foundations and structural bias; and (6) lifecycle governance and accountability structures. Thematic synthesis identified ways in which these inequities may interact across multiple pipeline levels in a manner consistent with a compounding structural process. Based on the synthesis, we propose the Structural Compounding Model of Digital Health Inequity, a four-level conceptual model covering Data, Model, Deployment, and Governance pipeline stages. Conclusion: Algorithmic bias and digital health inequity often reflect structural forces including historical underinvestment, biased data collection, proxy outcome selection, and unequal access to digital technologies. Equitable outcomes are likely to require coordinated attention across all four tiers of the Structural Compounding Model of Digital Health Inequity.

PDF
Full Text

References

A Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019;366(6464):447-453. doi:10.1126/science.aax2342

Chen RJ, Wang JJ, Williamson DFK, et al. Algorithmic fairness in artificial intelligence for medicine and healthcare. Nat Biomed Eng. 2023;7(6):719-742. doi:10.1038/s41551-023-01056-8

Sieck CJ, Sheon A, Ancker JS, Castek J, Callahan B, Siefer A. Digital inclusion as a social determinant of health. NPJ Digit Med. 2021;4(1):52. doi:10.1038/s41746-021-00413-8

Marmot MG, Wilkinson RG, eds. Social Determinants of Health. 2nd ed. Oxford: Oxford University Press; 2006.

Agarwal R, Bjarnadottir M, Rhue L, et al. Addressing algorithmic bias and the perpetuation of health inequities: an AI bias aware framework. Health Policy Technol. 2023;12(1):100702. doi:10.1016/j.hlpt.2022.100702

Goodman SN, Goel S, Cullen MR. Machine learning, health disparities, and causal reasoning. Ann Intern Med. 2018;169(12):883-884. doi:10.7326/M18-3297

Paulus JK, Kent DM. Predictably unequal: understanding and addressing concerns that algorithmic clinical prediction may increase health disparities. NPJ Digit Med. 2020;3:99. doi:10.1038/s41746-020-0304-9

Embi PJ. Algorithmovigilance: advancing methods to analyze and monitor artificial intelligence-driven health care for effectiveness and equity. JAMA Netw Open. 2021;4(4):e214622. doi:10.1001/jamanetworkopen.2021.4622

Siddique SM, Tipton K, Leas B, et al. The impact of health care algorithms on racial and ethnic disparities: a systematic review. Ann Intern Med. 2024;177(4):484-496. doi:10.7326/M23-2960

Benjamin R. Assessing risk, automating racism: a health care algorithm reflects underlying racial bias in society. Science. 2019;366(6464):421-422. doi:10.1126/science.aaz3873

Badr J, Motulsky A, Denis JL. Digital health technologies and inequalities: a scoping review of potential impacts and policy recommendations. Health Policy. 2024;146:105122. doi:10.1016/j.healthpol.2024.105122

Zhang J, Gallifant J, Pierce RL, et al. Quantifying digital health inequality across a national healthcare system. BMJ Health Care Inform. 2023;30(1):e100809. doi:10.1136/bmjhci-2023-100809

Suresh H, Guttag JV. A framework for understanding sources of harm throughout the machine learning life cycle. In: Proceedings of the 1st ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO ’21). New York: Association for Computing Machinery; 2021. doi:10.1145/3465416.3483305

Char DS, Abràmoff MD, Feudtner C. Identifying ethical considerations for machine learning healthcare applications. Am J Bioeth. 2020;20(11):7-17. doi:10.1080/15265161.2020.1819469

Kim JY, Hasan A, Kellogg KC, et al. Development and preliminary testing of Health Equity Across the AI Lifecycle (HEAAL): a framework for healthcare delivery organizations to mitigate the risk of AI solutions worsening health inequities. PLOS Digit Health. 2024;3(5):e0000390. doi:10.1371/journal.pdig.0000390

Groom LL, Schoenthaler AM, Mann DM, Brody AA. Construction of the Digital Health Equity-Focused Implementation Research Conceptual Model: bridging the divide between equity-focused digital health and implementation research. PLOS Digit Health. 2024;3(5):e0000509. doi:10.1371/journal.pdig.0000509

Abràmoff MD, Tarver ME, Loyo-Berrios N, et al. Considerations for addressing bias in artificial intelligence for health equity. NPJ Digit Med. 2023;6(1):170. doi:10.1038/s41746-023-00913-9

Hatef E, Scholle SH, Buckley B, Weiner JP, Austin JM. Development of an evidence- and consensus-based Digital Healthcare Equity Framework. JAMIA Open. 2024;7(4):ooae136. doi:10.1093/jamiaopen/ooae136

Wang SW, Killedar A, Von Huben A, et al. Evaluation of health equity frameworks in telehealth and digital health: a systematic review and narrative synthesis. Front Public Health. 2025;13:1690117. doi:10.3389/fpubh.2025.1690117

Colacci M, Huang YQ, Postill G, et al. Sociodemographic bias in clinical machine learning models: a scoping review of algorithmic bias instances and mechanisms. J Clin Epidemiol. 2025;178:111606. doi:10.1016/j.jclinepi.2024.111606

Busch F, Kather JN, Johner C, et al. Navigating the European Union Artificial Intelligence Act for healthcare. NPJ Digit Med. 2024;7(1):210. doi:10.1038/s41746-024-01213-6

Baethge C, Goldbeck-Wood S, Mertens S. SANRA: a scale for the quality assessment of narrative review articles. Res Integr Peer Rev. 2019;4:5. doi:10.1186/s41073-019-0064-8

Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77-101. doi:10.1191/1478088706qp063oa

Cui Y. Digital pathways connecting social and biological factors to health outcomes and equity. NPJ Digit Med. 2025;8:172. doi:10.1038/s41746-025-01564-8

Mhasawade V, Zhao Y, Chunara R. Machine learning and algorithmic fairness in public and population health. Nat Mach Intell. 2021;3(8):659-666. doi:10.1038/s42256-021-00373-4

Charpignon ML, Carrel A, Jiang Y, et al. Going beyond the means: exploring the role of bias from digital determinants of health in technologies. PLOS Digit Health. 2023;2(10):e0000244. doi:10.1371/journal.pdig.0000244

Otokiti AU, Shih HJ, Williams KS. Gender and racial bias unveiled: clinical artificial intelligence and machine learning algorithms are fanning the flames of inequity. Oxf Open Digit Health. 2025;3:oqaf027. doi:10.1093/oodh/oqaf027

Hussain SA, Bresnahan M, Zhuang J. The bias algorithm: how AI in healthcare exacerbates ethnic and racial disparities - a scoping review. Ethn Health. 2025;30(2):197-214. doi:10.1080/13557858.2024.2422848

Lee KG, Lee TC, Yefimova M, et al. Using digital phenotyping to understand health-related outcomes: a scoping review. Int J Med Inform. 2023;174:105061. doi:10.1016/j.ijmedinf.2023.105061

Birk RH, Samuel G. Can digital data diagnose mental health problems? A sociological exploration of digital phenotyping. Sociol Health Illn. 2020;42(8):1873-1887. doi:10.1111/1467-9566.13175

Buda T, Guerreiro J, Iglesias J, et al. Foundations for fairness in digital health apps. Front Digit Health. 2022;4:943514. doi:10.3389/fdgth.2022.943514

Rowe S, Newby D, Wykes T. Digital phenotyping: how it could change mental health care and why we should all keep up. J Ment Health. 2024;33(4):439-442. doi:10.1080/09638237.2024.2395537

Robinson A, Flom M, Forman-Hoffman VL, et al. Equity in digital mental health interventions in the United States: where to next? J Med Internet Res. 2024;26:e59939. doi:10.2196/59939

Yao R, Zhang W, Evans R, Cao G, Rui T, Shen L. Inequities in health care services caused by the adoption of digital health technologies: scoping review. J Med Internet Res. 2022;24(3):e34144. doi:10.2196/34144

Zhen Z, Tang D, Wang X, Feng Q. The impact of digital technology on health inequality: evidence from China. BMC Health Serv Res. 2024;24(1):1531. doi:10.1186/s12913-024-12022-8

Sylla B, Ismaila O, Diallo G. 25 years of digital health toward universal health coverage in low- and middle-income countries: rapid systematic review. J Med Internet Res. 2025;27:e59042. doi:10.2196/59042

Osonuga A, Osonuga AA, Fidelis SC, et al. Bridging the digital divide: artificial intelligence as a catalyst for health equity in primary care settings. Int J Med Inform. 2025;204:106051. doi:10.1016/j.ijmedinf.2025.106051

Cahan EM, Hernandez-Boussard T, Thadaney-Israni S, Rubin DL. Putting the data before the algorithm in big data: addressing personalized healthcare. NPJ Digit Med. 2019;2(1):78. doi:10.1038/s41746-019-0157-2

Celi LA, Cellini J, Charpignon ML, et al. Sources of bias in artificial intelligence that perpetuate healthcare disparities: a global review. PLOS Digit Health. 2022;1(3):e0000022. doi:10.1371/journal.pdig.0000022

Alderman JE, Palmer J, Laws E, et al. Tackling algorithmic bias and promoting transparency in health datasets: the STANDING Together consensus recommendations. Lancet Digit Health. 2025;7(1):e64-e88. doi:10.1016/S2589-7500(24)00224-3

Chin MH, Afsar-Manesh N, Bierman AS, et al. Guiding principles to address the impact of algorithm bias on racial and ethnic disparities in health and health care. JAMA Netw Open. 2023;6(12):e2345050. doi:10.1001/jamanetworkopen.2023.45050

Davis SE, Dorn C, Park DJ, Matheny ME. Emerging algorithmic bias: fairness drift as the next dimension of model maintenance and sustainability. J Am Med Inform Assoc. 2025;32(5):845-854. doi:10.1093/jamia/ocaf039

Ferryman K. Addressing health disparities in the Food and Drug Administration’s artificial intelligence and machine learning regulatory framework. J Am Med Inform Assoc. 2020;27(12):2016-2019. doi:10.1093/jamia/ocaa133

Crawford AD, Slavin R, Tabar M, et al. Methodological approaches in developing and implementing digital health interventions amongst underserved women. Public Health Nurs. 2024;41(6):1612-1621. doi:10.1111/phn.13410

Naderbagi A, Loblay V, Zahed IUM, et al. Cultural and contextual adaptation of digital health interventions: narrative review. J Med Internet Res. 2024;26:e55130. doi:10.2196/55130

Richardson S, Lawrence K, Schoenthaler AM, Mann D. A framework for digital health equity. NPJ Digit Med. 2022;5(1):119. doi:10.1038/s41746-022-00663-0

Mackin S, Major VJ, Chunara R. Post-processing methods for mitigating algorithmic bias in healthcare classification models: an extended umbrella review. BMC Digit Health. 2025;3:26. doi:10.1186/s44247-025-00166-4

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Copyright (c) 2026 Kinjal Nayak (Author)