English
Related papers

Related papers: ECHOPulse: ECG controlled echocardio-grams video g…

200 papers

Generating emotion-specific talking head videos from audio input is an important and complex challenge for human-machine interaction. However, emotion is highly abstract concept with ambiguous boundaries, and it necessitates disentangled…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Xuli Shen , Hua Cai , Dingding Yu , Weilin Shen , Qing Xu , Xiangyang Xue

Egocentric human motion generation and forecasting with scene-context is crucial for enhancing AR/VR experiences, improving human-robot interaction, advancing assistive technologies, and enabling adaptive healthcare solutions by accurately…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Chaitanya Patel , Hiroki Nakamura , Yuta Kyuragi , Kazuki Kozuka , Juan Carlos Niebles , Ehsan Adeli

Audio-driven talking-head generation is a crucial and useful technology for virtual human interaction and film-making. While recent advances have focused on improving image fidelity and lip synchronization, generating accurate emotional…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Wenqing Wang , Yun Fu

Human motion generation aims to generate natural human pose sequences and shows immense potential for real-world applications. Substantial progress has been made recently in motion data collection technologies and generation methods, laying…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Wentao Zhu , Xiaoxuan Ma , Dongwoo Ro , Hai Ci , Jinlu Zhang , Jiaxin Shi , Feng Gao , Qi Tian , Yizhou Wang

Generating training examples for supervised tasks is a long sought after goal in AI. We study the problem of heart signal electrocardiogram (ECG) synthesis for improved heartbeat classification. ECG synthesis is challenging: the generation…

Signal Processing · Electrical Eng. & Systems 2020-06-30 Tomer Golany , Daniel Freedman , Kira Radinsky

Electrocardiograms (ECGs) are essential for diagnosing cardiac pathologies, yet traditional paper-based ECG storage poses significant challenges for automated analysis. This study introduces ECGtizer, an open-source, fully automated tool…

Signal Processing · Electrical Eng. & Systems 2024-12-18 Alex Lence , Ahmad Fall , Samuel David Cohen , Federica Granese , Jean-Daniel Zucker , Joe-Elie Salem , Edi Prifti

Cardiopulmonary exercise testing (CPET) provides a comprehensive assessment of functional capacity by measuring key physiological variables including oxygen consumption ($VO_2$), carbon dioxide production ($VCO_2$), and pulmonary…

Machine Learning · Computer Science 2025-03-19 Muhammet Alkan , Gruschen Veldtman , Fani Deligianni

In the field of portrait video generation, the use of single images to generate portrait videos has become increasingly prevalent. A common approach involves leveraging generative models to enhance adapters for controlled generation.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Cong Wang , Kuan Tian , Jun Zhang , Yonghang Guan , Feng Luo , Fei Shen , Zhiwei Jiang , Qing Gu , Xiao Han , Wei Yang

Audio-driven cospeech video generation typically involves two stages: speech-to-gesture and gesture-to-video. While significant advances have been made in speech-to-gesture generation, synthesizing natural expressions and gestures remains…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Renda Li , Xiaohua Qi , Qiang Ling , Jun Yu , Ziyi Chen , Peng Chang , Mei HanJing Xiao

Despite the impressive progress of multimodal generative models, video-to-audio generation still suffers from limited performance and limits the flexibility to prioritize sound synthesis for specific objects within the scene. Conversely,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yujin Jeong , Yunji Kim , Sanghyuk Chun , Jiyoung Lee

Synthetic electrocardiogram generation serves medical AI applications requiring privacy-preserving data sharing and training dataset augmentation. Current diffusion-based methods achieve high generation quality but require hundreds of…

Signal Processing · Electrical Eng. & Systems 2025-09-16 Vitalii Bondar , Serhii Semenov , Vira Babenko , Dmytro Holovniak

Cardiovascular diseases stand as the primary global cause of mortality. Among the various imaging techniques available for visualising the heart and evaluating its function, echocardiograms emerge as the preferred choice due to their safety…

Image and Video Processing · Electrical Eng. & Systems 2023-11-22 Adil Dahlan , Cyril Zakka , Abhinav Kumar , Laura Tang , Rohan Shad , Robyn Fong , William Hiesinger

Modern artistic productions increasingly demand automated choreography generation that adapts to diverse musical styles and individual dancer characteristics. Existing approaches often fail to produce high-quality dance videos that…

Graphics · Computer Science 2025-07-29 Xuanchen Wang , Heng Wang , Weidong Cai

With the ongoing heart problems of the population worldwide, the medical requirements of the people are expected to increase. Electrocardiogram (ECG) is one of the proven to capture the heart response signal to assess the electrical and…

Signal Processing · Electrical Eng. & Systems 2021-09-08 Ayan Chatterjee , Sundar Gopalakrishnan , Martin Gerdes , Santiago Martinez , Nibedita Pahari , Pankaj Khatiwada

Achieving precise camera control in video generation remains challenging, as existing methods often rely on camera pose annotations that are difficult to scale to large and dynamic datasets and are frequently inconsistent with depth…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zelin Zhao , Xinyu Gong , Bangya Liu , Ziyang Song , Jun Zhang , Suhui Wu , Yongxin Chen , Hao Zhang

Modern wearable devices are embedded with a range of noninvasive biomarker sensors that hold promise for improving detection and treatment of disease. One such sensor is the single-lead electrocardiogram (ECG) which measures electrical…

Machine Learning · Statistics 2020-12-02 Jeffrey Chan , Andrew C. Miller , Emily B. Fox

The task of audio-driven portrait animation involves generating a talking head video using an identity image and an audio track of speech. While many existing approaches focus on lip synchronization and video quality, few tackle the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Jian Zhang , Weijian Mai , Zhijun Zhang

This study introduces the development of a state of the art, real time ECG monitoring and analysis system, incorporating cutting edge medical technology and innovative data security measures. Our system performs three distinct functions…

Cryptography and Security · Computer Science 2024-11-05 Beyazit Bestami Yuksel , Ayse Yilmazer Metin

Neonatal echocardiography is vital for early detection of heart anomalies in newborns, enabling timely, non-invasive interventions where 4D ultrasound, adds the dimension of time to 3D imaging, enhances diagnostic capabilities by…

Human-Computer Interaction · Computer Science 2024-12-10 Deepthy Rose Jose , Venkataseshan Sundaram , M Manivannan

Question answering (QA) in the field of healthcare has received much attention due to significant advancements in natural language processing. However, existing healthcare QA datasets primarily focus on medical images, clinical notes, or…

Quantitative Methods · Quantitative Biology 2023-10-12 Jungwoo Oh , Gyubok Lee , Seongsu Bae , Joon-myoung Kwon , Edward Choi