English
Related papers

Related papers: EchoAgent: Guideline-Centric Reasoning Agent for E…

200 papers

Early detection of cardiovascular diseases is crucial for effective treatment and an electrocardiogram (ECG) is pivotal for diagnosis. The accuracy of Deep Learning based methods for ECG signal classification has progressed in recent years…

Signal Processing · Electrical Eng. & Systems 2022-04-12 Likith Reddy , Vivek Talwar , Shanmukh Alle , Raju. S. Bapi , U. Deva Priyakumar

The electrocardiogram (ECG) remains a fundamental tool in cardiac diagnostics, yet its interpretation traditionally reliant on the expertise of cardiologists. The emergence of deep learning has heralded a revolutionary era in medical data…

Signal Processing · Electrical Eng. & Systems 2024-09-13 Cheng Ding , Tianliang Yao , Chenwei Wu , Jianyuan Ni

Automated chest radiographs interpretation requires both accurate disease classification and detailed radiology report generation, presenting a significant challenge in the clinical workflow. Current approaches either focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Difei Gu , Yunhe Gao , Yang Zhou , Mu Zhou , Dimitris Metaxas

Respiratory diseases remain major global health challenges, and traditional auscultation is often limited by subjectivity, environmental noise, and inter-clinician variability. This study presents an explainable multimodal deep learning…

Sound · Computer Science 2025-12-02 S M Asiful Islam Saky , Md Rashidul Islam , Md Saiful Arefin , Shahaba Alam

Maintaining narrative coherence and visual consistency remains a central challenge in open-domain video generation. Existing text-to-video models often treat each shot independently, resulting in identity drift, scene inconsistency, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Qinglin Zeng , Kaitong Cai , Ruiqi Chen , Qinhan Lv , Keze Wang

Vocal health plays a crucial role in peoples' lives, significantly impacting their communicative abilities and interactions. However, despite the global prevalence of voice disorders, many lack access to convenient diagnosis and treatment.…

Electrocardiogram (ECG) analysis is crucial for diagnosing heart disease, but most self-supervised learning methods treat ECG as a generic time series, overlooking physiologic semantics and rhythm-level structure. Existing contrastive…

Machine Learning · Computer Science 2026-02-27 Xin Wang , Burcu Ozek , Aruna Mohan , Amirhossein Ravari , Or Zilbershot , Fatemeh Afghah

Speech Language Models (SLMs) have made significant progress in spoken language understanding. Yet it remains unclear whether they can fully perceive non lexical vocal cues alongside spoken words, and respond with empathy that aligns with…

Computation and Language · Computer Science 2026-03-06 Li Zhou , Lutong Yu , You Lyu , Yihang Lin , Zefeng Zhao , Junyi Ao , Yuhao Zhang , Benyou Wang , Haizhou Li

Understanding egocentric videos plays a vital role for embodied intelligence. Recent multi-modal large language models (MLLMs) can accept both visual and audio inputs. However, due to the challenge of obtaining text labels with coherent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Ashish Seth , Xinhao Mei , Changsheng Zhao , Varun Nagaraja , Ernie Chang , Gregory P. Meyer , Gael Le Lan , Yunyang Xiong , Vikas Chandra , Yangyang Shi , Dinesh Manocha , Zhipeng Cai

In a noisy conversation environment such as a dinner party, people often exhibit selective auditory attention, or the ability to focus on a particular speaker while tuning out others. Recognizing who somebody is listening to in a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Fiona Ryan , Hao Jiang , Abhinav Shukla , James M. Rehg , Vamsi Krishna Ithapu

As embodied models become powerful, humans will collaborate with multiple embodied AI agents at their workplace or home in the future. To ensure better communication between human users and the multi-agent system, it is crucial to interpret…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Kangsan Kim , Yanlai Yang , Suji Kim , Woongyeong Yeo , Youngwan Lee , Mengye Ren , Sung Ju Hwang

Electrocardiogram (ECG) is a widely used reliable, non-invasive approach for cardiovascular disease diagnosis. With the rapid growth of ECG examinations and the insufficiency of cardiologists, accurate and automatic diagnosis of ECG signals…

Machine Learning · Computer Science 2020-10-21 Dongdong Zhang , Xiaohui Yuan , Ping Zhang

In the field of chest X-ray (CXR) diagnosis, existing works often focus solely on determining where a radiologist looks, typically through tasks such as detection, segmentation, or classification. However, these approaches are often…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Trong Thang Pham , Jacob Brecheisen , Anh Nguyen , Hien Nguyen , Ngan Le

Driven by recent advances in vision-language models (VLMs) and egocentric perception research, the emerging topic of an egocentric procedural AI assistant (EgoProceAssist) is introduced to step-by-step support daily procedural tasks in a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Junlong Li , Huaiyuan Xu , Sijie Cheng , Kejun Wu , Kim-Hui Yap , Lap-Pui Chau , Yi Wang

Multimodal neuroimaging analysis often involves complex, modality-specific preprocessing workflows that require careful configuration, quality control, and coordination across heterogeneous toolchains. Beyond preprocessing, downstream…

Artificial Intelligence · Computer Science 2026-05-08 Lujia Zhong , Yihao Xia , Jianwei Zhang , Shuo huang , Jiaxin Yue , Mingyang Xia , Yonggang Shi

In echocardiography (echo), an electrocardiogram (ECG) is conventionally used to temporally align different cardiac views for assessing critical measurements. However, in emergencies or point-of-care situations, acquiring an ECG is often…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Fatemeh Taheri Dezaki , Christina Luong , Tom Ginsberg , Robert Rohling , Ken Gin , Purang Abolmaesumi , Teresa Tsang

Audio often serves as an auxiliary modality in video understanding tasks of audio-visual large language models (LLMs), merely assisting in the comprehension of visual information. However, a thorough understanding of videos significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yudong Yang , Jimin Zhuang , Guangzhi Sun , Changli Tang , Yixuan Li , Peihan Li , Yifan Jiang , Wei Li , Zejun Ma , Chao Zhang

Deep learning has achieved expert-level performance in automated electrocardiogram (ECG) diagnosis, yet the "black-box" nature of these models hinders their clinical deployment. Trust in medical AI requires not just high accuracy but also…

Machine Learning · Computer Science 2026-02-11 Vajira Thambawita , Jonas L. Isaksen , Jørgen K. Kanters , Hugo L. Hammer , Pål Halvorsen

We present Experiment Automation Agents (EAA), a vision-language-model-driven agentic system designed to automate complex experimental microscopy workflows. EAA integrates multimodal reasoning, tool-augmented action, and optional long-term…

Artificial Intelligence · Computer Science 2026-02-18 Ming Du , Yanqi Luo , Srutarshi Banerjee , Michael Wojcik , Jelena Popovic , Mathew J. Cherukara

Accurately assessing internal human states is key to understanding preferences, offering personalized services, and identifying challenges in real-world applications. Originating from psychometrics, adaptive testing has become the…

Artificial Intelligence · Computer Science 2025-06-04 Junhao Yu , Yan Zhuang , YuXuan Sun , Weibo Gao , Qi Liu , Mingyue Cheng , Zhenya Huang , Enhong Chen