Logo

American Heart Association

  2
  0


Final ID: 4170777

PanEcho: Complete AI-enabled echocardiography interpretation with multi-task deep learning

Abstract Body (Do not enter title and authors here): Introduction: Transthoracic echocardiography (TTE) is integral to cardiovascular evaluation but relies on manual reporting. Artificial intelligence (AI) promises to automate cardiac pathology detection, however existing applications of AI to TTE reporting have focused on individual conditions and echocardiographic views. To bridge this gap, we developed PanEcho, a view-agnostic, multi-task AI model that automates TTE interpretation across views and acquisitions for all key echocardiographic metrics and findings.

Methods: PanEcho was developed using 1.23 million echocardiographic videos from 33,927 TTE studies (mean age 67 years, 52.2% male) performed at a New England Health System (NEHS) from Jan 2016-Jun 2022. The model can perform 39 TTE reporting tasks, spanning the full spectrum of myocardial and valvular structure and function from any parasternal, apical, and subcostal views, including B-mode and color Doppler videos. It consists of an image encoder to learn spatial features, a Transformer for temporal modeling, and task-specific output heads; PanEcho was evaluated on a temporally distinct YNHHS cohort from Jul-Dec 2022 and two external California cohorts from 2008-2020 (Fig 1). We assessed both its off-the-shelf diagnostic performance and ability to function as a foundation model for fine-tuning in novel domains.

Results: PanEcho achieves a median area under the receiver operating characteristic curve (AUC) of 0.91 across 18 classification tasks, detecting severe aortic stenosis with 0.99 AUC, moderate-severe left ventricular (LV) systolic dysfunction with 0.98 AUC (0.94 AUC externally), moderate-severe LV dilation with 0.95 AUC (0.98 AUC externally), among others. (Fig 2A). The model estimates continuous metrics with a median normalized mean absolute error (MAE) of 0.13 across 21 tasks, e.g., defining LV ejection fraction (EF) with 4.4% MAE (5.5% MAE externally) and LV internal diameter with 3.8 mm MAE (Fig 2B). Multi-view evaluation confirms PanEcho’s ability to identify which views are most informative for each task (Fig 3). Further, the learned representations efficiently transfer to LVEF estimation in novel pediatric populations, outperforming existing approaches (3.9% MAE vs. next-best 4.5% MAE).

Conclusion: PanEcho is a view-agnostic, multi-task, externally validated, open-source AI model that enables echocardiographic interpretation across a broad range of TTE views and labels, representing a flexible foundation model for echocardiography.
  • Holste, Gregory  ( Yale School of Medicine , New Haven , Connecticut , United States )
  • Oikonomou, Evangelos  ( Yale School of Medicine , New Haven , Connecticut , United States )
  • Wang, Zhangyang  ( The University of Texas at Austin , San Antonio , Texas , United States )
  • Khera, Rohan  ( Yale School of Medicine , New Haven , Connecticut , United States )
  • Author Disclosures:
    Gregory Holste: DO NOT have relevant financial relationships | Evangelos Oikonomou: DO have relevant financial relationships ; Ownership Interest:Evidence2Health, LLC:Active (exists now) ; Consultant:Caristo Diagnostics Ltd:Past (completed) ; Royalties/Patent Beneficiary:University of Oxford:Past (completed) ; Consultant:Ensight-AI, Inc:Active (exists now) | Zhangyang Wang: DO NOT have relevant financial relationships | Rohan Khera: DO have relevant financial relationships ; Research Funding (PI or named investigator):Bristol-Myers Squibb:Active (exists now) ; Ownership Interest:Ensight-AI, Inc:Active (exists now) ; Ownership Interest:Evidence2Health LLC:Active (exists now) ; Research Funding (PI or named investigator):BridgeBio:Active (exists now) ; Research Funding (PI or named investigator):Novo Nordisk:Active (exists now)
Meeting Info:

Scientific Sessions 2024

2024

Chicago, Illinois

Session Info:

Smart Cardiology: Harnessing AI and Innovation for Better Heart Health

Saturday, 11/16/2024 , 03:15PM - 04:30PM

Late-Breaking Science

More abstracts on this topic:
A Deep Learning Digital Biomarker for Mitral Valve Prolapse using Echocardiogram Videos

Al-alusi Mostafa, Khurshid Shaan, Sanborn Danita, Picard Michael, Ho Jennifer, Maddah Mahnaz, Ellinor Patrick, Lau Emily, Small Aeron, Reeder Christopher, Shnitzer Dery Tal, Andrews Carl, Kany Shinwan, Ramo Joel, Haimovich Julian

Acute Brain Attack: Peering Through The Esophageal Window In Cryptogenic Ischemic Stroke

Galeano Santiago, Adedinsewo Demilade, White Richard

More abstracts from these authors:
You have to be authorized to contact abstract author. Please, Login
Not Available