English
Related papers

Related papers: Self-Supervised Predictive Coding with Multimodal …

200 papers

Estimation of patient acuity in the Intensive Care Unit (ICU) is vital to ensure timely and appropriate interventions. Advances in artificial intelligence (AI) technologies have significantly improved the accuracy of acuity predictions.…

Chronic respiratory diseases, such as chronic obstructive pulmonary disease and asthma, are a serious health crisis, affecting a large number of people globally and inflicting major costs on the economy. Current methods for assessing the…

Image and Video Processing · Electrical Eng. & Systems 2021-04-06 Rohan Tan Bhowmik

Advancements in machine learning algorithms have had a beneficial impact on representation learning, classification, and prediction models built using electronic health record (EHR) data. Effort has been put both on increasing models'…

Machine Learning · Computer Science 2021-03-24 Yiwen Meng , William Speier , Michael K. Ong , Corey W. Arnold

For dynamic human motion sequences, the original KeyNode-Driven codec often struggles to retain compression efficiency when confronted with rapid movements or strong non-rigid deformations. This paper proposes a novel Bi-modal coding…

Signal Processing · Electrical Eng. & Systems 2025-09-23 Huong Hoang , Keito Suzuki , Truong Nguyen , Pamela Cosman

Multimodal survival prediction, a crucial yet challenging task, demands the integration of multimodal medical data (\eg Whole Slide Images (WSIs) and Genomic Profiles) to achieve accurate prognostic modeling. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Huayi Wang , Haochao Ying , Yuyang Xu , Qiyao Zheng , jun wang , Cheng Zhang , Ying Sun , Jian Wu

To test the hypothesis that accuracy, discrimination, and precision in predicting postoperative complications improve when using both preoperative and intraoperative data input features versus preoperative data alone. Models that predict…

The ever-growing multimedia traffic has underscored the importance of effective multimedia codecs. Among them, the up-to-date lossy video coding standard, Versatile Video Coding (VVC), has been attracting attentions of video coding…

Image and Video Processing · Electrical Eng. & Systems 2022-05-10 Tiesong Zhao , Yuhang Huang , Weize Feng , Yiwen Xu , Sam Kwong

The rapid growth of e-commerce has placed considerable pressure on customs representatives, prompting advanced methods. In tackling this, Artificial intelligence (AI) systems have emerged as a promising approach to minimize the risks faced.…

Software Engineering · Computer Science 2024-06-10 Otmane Amel , Sedrick Stassin , Sidi Ahmed Mahmoudi , Xavier Siebert

Introspection of deep supervised predictive models trained on functional and structural brain imaging may uncover novel markers of Alzheimer's disease (AD). However, supervised training is prone to learning from spurious features (shortcut…

Machine Learning · Computer Science 2022-05-24 Alex Fedorov , Lei Wu , Tristan Sylvain , Margaux Luck , Thomas P. DeRamus , Dmitry Bleklov , Sergey M. Plis , Vince D. Calhoun

Understanding and predicting human visuomotor coordination is crucial for applications in robotics, human-computer interaction, and assistive technologies. This work introduces a forecasting-based task for visuomotor modeling, where the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Wenqi Jia , Bolin Lai , Miao Liu , Danfei Xu , James M. Rehg

Early recognition of abnormal rhythms in ECG signals is crucial for monitoring and diagnosing patients' cardiac conditions, increasing the success rate of the treatment. Classifying abnormal rhythms into exact categories is very challenging…

Machine Learning · Computer Science 2019-12-18 Jing Zhang , Jing Tian , Yang Cao , Yuxiang Yang , Xiaobin Xu

Multimodal data fusion is a key approach for enhancing diagnosis in medical applications. We propose an asymmetric fusion strategy starting from a primary modality and integrating secondary modalities by disentangling shared and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Jérémie Stym-Popper , Nathan Painchaud , Clément Rambour , Pierre-Yves Courand , Nicolas Thome , Olivier Bernard

Multimodal fusion is crucial in joint decision-making systems for rendering holistic judgments. Since multimodal data changes in open environments, dynamic fusion has emerged and achieved remarkable progress in numerous applications.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Bing Cao , Yinan Xia , Yi Ding , Changqing Zhang , Qinghua Hu

In this study, we propose a novel multi-modal end-to-end neural approach for automated assessment of non-native English speakers' spontaneous speech using attention fusion. The pipeline employs Bi-directional Recurrent Convolutional Neural…

Computation and Language · Computer Science 2021-11-30 Manraj Singh Grover , Yaman Kumar , Sumit Sarin , Payman Vafaee , Mika Hama , Rajiv Ratn Shah

The emotion detection technology to enhance human decision-making is an important research issue for real-world applications, but real-life emotion datasets are relatively rare and small. The experiments conducted in this paper use the…

Computation and Language · Computer Science 2023-06-13 Théo Deschamps-Berger , Lori Lamel , Laurence Devillers

In realistic scenarios, multivariate timeseries evolve over case-by-case time-scales. This is particularly clear in medicine, where the rate of clinical events varies by ward, patient, and application. Increasingly complex models have been…

Machine Learning · Computer Science 2020-03-06 Jacob Deasy , Ari Ercole , Pietro Liò

Integrating the different data modalities of cancer patients can significantly improve the predictive performance of patient survival. However, most existing methods ignore the simultaneous utilization of rich semantic features at different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Liangrui Pan , Yijun Peng , Yan Li , Yiyi Liang , Liwen Xu , Qingchun Liang , Shaoliang Peng

Self-supervision has emerged as a propitious method for visual representation learning after the recent paradigm shift from handcrafted pretext tasks to instance-similarity based approaches. Most state-of-the-art methods enforce similarity…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Sravanti Addepalli , Kaushal Bhogale , Priyam Dey , R. Venkatesh Babu

Predicting stroke risk is a complex challenge that can be enhanced by integrating diverse clinically available data modalities. This study introduces a self-supervised multimodal framework that combines 3D brain imaging, clinical data, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Camille Delgrange , Olga Demler , Samia Mora , Bjoern Menze , Ezequiel de la Rosa , Neda Davoudi

The growing uncertainty from renewable power and electricity demand brings significant challenges to unit commitment (UC). While various advanced forecasting and optimization methods have been developed to predict better and address this…

Optimization and Control · Mathematics 2025-09-30 Rui Xie , Yue Chen , Pierre Pinson