English
Related papers

Related papers: Representation Disentanglement for Multi-modal bra…

200 papers

In clinical practice, the robustness of deep learning models for multimodal brain tumor segmentation is severely compromised by incomplete MRI data. This vulnerability stems primarily from modality bias, where models exploit spurious…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Bo Liu , Yulong Zou , Jin Hong

Recent neuroimaging studies that focus on predicting brain disorders via modern machine learning approaches commonly include a single modality and rely on supervised over-parameterized models.However, a single modality provides only a…

Multimodal emotion recognition (MMER) is an active research field that aims to accurately recognize human emotions by fusing multiple perceptual modalities. However, inherent heterogeneity across modalities introduces distribution gaps and…

Sound · Computer Science 2023-12-22 Haoqin Sun , Shiwan Zhao , Xuechen Wang , Wenjia Zeng , Yong Chen , Yong Qin

Visible (VIS) to near infrared (NIR) face matching is a challenging problem due to the significant domain discrepancy between the domains and a lack of sufficient data for training cross-modal matching algorithms. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Xiang Wu , Huaibo Huang , Vishal M. Patel , Ran He , Zhenan Sun

Multi-view representation learning aims to derive robust representations that are both view-consistent and view-specific from diverse data sources. This paper presents an in-depth analysis of existing approaches in this domain, highlighting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Guanzhou Ke , Bo Wang , Xiaoli Wang , Shengfeng He

The integration of different imaging modalities, such as structural, diffusion tensor, and functional magnetic resonance imaging, with deep learning models has yielded promising outcomes in discerning phenotypic characteristics and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Zhiyuan Li , Hailong Li , Anca L. Ralescu , Jonathan R. Dillman , Mekibib Altaye , Kim M. Cecil , Nehal A. Parikh , Lili He

Existing methods for multi-modal time series representation learning aim to disentangle the modality-shared and modality-specific latent variables. Although achieving notable performances on downstream tasks, they usually assume an…

Machine Learning · Computer Science 2024-05-28 Ruichu Cai , Zhifang Jiang , Zijian Li , Weilin Chen , Xuexin Chen , Zhifeng Hao , Yifan Shen , Guangyi Chen , Kun Zhang

Recent years have seen growing interest in learning disentangled representations, in which distinct features, such as size or shape, are represented by distinct neurons. Quantifying the extent to which a given representation is disentangled…

Machine Learning · Computer Science 2023-04-06 Louis Mahon , Lei Shah , Thomas Lukasiewicz

Disentangled representation learning offers useful properties such as dimension reduction and interpretability, which are essential to modern deep learning approaches. Although deep learning techniques have been widely applied to…

Machine Learning · Computer Science 2022-04-11 Sichen Zhao , Wei Shao , Jeffrey Chan , Flora D. Salim

Reinforcement Learning (RL) environments can produce training data with spurious correlations between features due to the amount of training data or its limited feature coverage. This can lead to RL agents encoding these misleading…

Machine Learning · Computer Science 2023-10-13 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

Self-supervised learning approaches leverage unlabeled samples to acquire generic knowledge about different concepts, hence allowing for annotation-efficient downstream task learning. In this paper, we propose a novel self-supervised method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Aiham Taleb , Christoph Lippert , Tassilo Klein , Moin Nabi

Confounding bias is a crucial problem when applying machine learning to practice, especially in clinical practice. We consider the problem of learning representations independent to multiple biases. In literature, this is mostly solved by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Xianjing Liu , Bo Li , Esther Bron , Wiro Niessen , Eppo Wolvius , Gennady Roshchupkin

Segmentation has been a major task in neuroimaging. A large number of automated methods have been developed for segmenting healthy and diseased brain tissues. In recent years, deep learning techniques have attracted a lot of attention as a…

Image and Video Processing · Electrical Eng. & Systems 2019-07-05 Jimit Doshi , Guray Erus , Mohamad Habes , Christos Davatzikos

Neuroimaging is essential in brain studies for the diagnosis and identification of disease, structure, and function of the brain in its healthy and disease states. Literature shows that there are advantages of multitasking with some deep…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 Mohammad Eslami , Solale Tabarestani , Malek Adjouadi

Multi-contrast magnetic resonance imaging (MRI) is the most common management tool used to characterize neurological disorders based on brain tissue contrasts. However, acquiring high-resolution MRI scans is time-consuming and infeasible…

Image and Video Processing · Electrical Eng. & Systems 2023-06-08 Ye Mao , Lan Jiang , Xi Chen , Chao Li

Estimating individual-level treatment effect from observational data is a fundamental problem in causal inference and has attracted increasing attention in the fields of education, healthcare, and public policy.In this work, we concentrate…

Machine Learning · Computer Science 2025-07-10 Hui Meng , Keping Yang , Xuyu Peng , Bo Zheng

Magnetic resonance imaging (MRI) is a widely used neuroimaging technique that can provide images of different contrasts (i.e., modalities). Fusing this multi-modal data has proven particularly effective for boosting model performance in…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Tao Zhou , Huazhu Fu , Geng Chen , Jianbing Shen , Ling Shao

Deep learning methods have recently made notable advances in the tasks of classification and representation learning. These tasks are important for brain imaging and neuroscience discovery, making the methods attractive for porting to a…

Neural and Evolutionary Computing · Computer Science 2014-02-20 Sergey M. Plis , Devon R. Hjelm , Ruslan Salakhutdinov , Vince D. Calhoun

Multimodal learning has exhibited a significant advantage in affective analysis tasks owing to the comprehensive information of various modalities, particularly the complementary information. Thus, many emerging studies focus on…

Artificial Intelligence · Computer Science 2024-04-09 Ying Zhou , Xuefeng Liang , Han Chen , Yin Zhao , Xin Chen , Lida Yu

Decoding neural visual representations from electroencephalogram (EEG)-based brain activity is crucial for advancing brain-machine interfaces (BMI) and has transformative potential for neural sensory rehabilitation. While multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yueyang Li , Zijian Kang , Shengyu Gong , Wenhao Dong , Weiming Zeng , Hongjie Yan , Wai Ting Siok , Nizhuan Wang
‹ Prev 1 4 5 6 7 8 10 Next ›