Echo Chambers: Bias and Representation in Cardiac Imaging Datasets for Artificial Intelligence.
Authors
Affiliations (17)
Affiliations (17)
- School of Medicine, Johns Hopkins University, Baltimore, MD, USA.
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA.
- Artificial Intelligence for Responsible, Generalizable, and Open Surgical Research Group, Baltimore, MD, USA.
- Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Faculty of Medicine and Health Sciences, McGill University, Montreal, QC, Canada.
- Berkeley College of Engineering, University of California, Berkeley, CA, USA.
- Unidad de Cuidados Intensivos Pediátricos (UCIP) del Hospital de Niños Ricardo Gutiérrez, Buenos Aires, Argentina.
- Argentine Society of Intensive Care, Programa de Calidad SATI-Q, Buenos Aires, Argentina.
- School of Medicine, Santa Marcelina College, São Paulo, Brazil.
- School of Public Health, University of São Paulo, São Paulo, Brazil.
- Department of Computing and Technology, Uganda Christian University, Mukono, Uganda.
- Department of Software and Informatics Engineering, Mbarara University of Science and Technology, Mbarara, Uganda.
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada.
- Temerty Centre for Artificial Intelligence Research and Education in Medicine, Department of Laboratory Medicine and Pathobiology, Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
- Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA. [email protected].
- Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA. [email protected].
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA. [email protected].
Abstract
We examined the landscape of publicly available cardiac imaging datasets to assess how their distribution and construction shape bias and equity in cardiovascular AI. Across 38 publicly available echocardiography, cardiac magnetic resonance imaging, and cardiac computed tomography datasets, nearly 80% originate from high-income countries, with no public cardiac imaging datasets from Africa or South America. Fewer than two-thirds of these public datasets report any demographic information, and only a small minority are linked to clinical outcomes. Studies reveal consistent gaps in model performance across racial and ethnic groups, substantial variability in labeling and disease definitions, and strong evidence that harmonization and label quality often improve performance more than changes in model architecture. Cardiovascular AI developed using publicly available cardiac imaging datasets is largely constructed on geographically narrow, demographically uncharacterized data from well-resourced health systems. This creates an "echo chamber" that may limit representation of the global majority within publicly available data resources. While these findings are specific to publicly available datasets and may not necessarily extend to private or commercial data resources, they highlight the importance of considering equitable data infrastructure, prioritizing globally representative outcome-linked datasets and local capacity building.