English
Related papers

Related papers: BrainTAP: Brain Disorder Prediction with Adaptive …

200 papers

Accurate molecular property prediction (MPP) is a critical step in modern drug development. However, the scarcity of experimental validation data poses a significant challenge to AI-driven research paradigms. Under few-shot learning…

Machine Learning · Computer Science 2025-05-20 Yifan Dai , Xuanbai Ren , Tengfei Ma , Qipeng Yan , Yiping Liu , Yuansheng Liu , Xiangxiang Zeng

Multimodal emotion recognition is a challenging task in emotion computing as it is quite difficult to extract discriminative features to identify the subtle differences in human emotions with abstract concept and multiple expressions.…

Sound · Computer Science 2021-11-18 Hengshun Zhou , Jun Du , Yuanyuan Zhang , Qing Wang , Qing-Feng Liu , Chin-Hui Lee

Multimodal emotion recognition in conversation (MER) aims to accurately identify emotions in conversational utterances by integrating multimodal information. Previous methods usually treat multimodal information as equal quality and employ…

Multimedia · Computer Science 2024-11-18 Xiaofei Zhu , Jiawei Cheng , Zhou Yang , Zhuo Chen , Qingyang Wang , Jianfeng Yao

Background: Accurate short-term readmission prediction of ICU patients is significant in improving the efficiency of resource assignment by assisting physicians in making discharge decisions. Clinically, both individual static static and…

Machine Learning · Computer Science 2024-07-17 Zhe Sun , Runzhi Li , Jing Wang , Gang Chen , Siyu Yan , Lihong Ma

Brain age is a critical measure that reflects the biological ageing process of the brain. The gap between brain age and chronological age, referred to as brain PAD (Predicted Age Difference), has been utilized to investigate…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Lemuel Puglisi , Alessia Rondinella , Linda De Meo , Francesco Guarnera , Sebastiano Battiato , Daniele Ravì

This paper delves into the task of arbitrary modality salient object detection (AM SOD), aiming to detect salient objects from arbitrary modalities, eg RGB images, RGB-D images, and RGB-D-T images. A novel modality-adaptive Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Nianchang Huang , Yang Yang , Qiang Zhang , Jungong Han , Jin Huang

Sepsis accounts for nearly 20% of global ICU admissions, yet conventional prediction models often fail to effectively integrate heterogeneous data streams, remaining either siloed by modality or reliant on brittle early fusion. In this…

Machine Learning · Computer Science 2025-12-18 Ryan Cartularo

In multi-modal learning, some modalities are more influential than others, and their absence can have a significant impact on classification/segmentation accuracy. Addressing this challenge, we propose a novel approach called Meta-learned…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Hu Wang , Salma Hassan , Yuyuan Liu , Congbo Ma , Yuanhong Chen , Qing Li , Jiahui Geng , Bingjie Wang , Yu Tian , Yutong Xie , Jodie Avery , Louise Hull , Ian Reid , Mohammad Yaqub , Gustavo Carneiro

Deep neural networks often suffer performance degradation upon deployment due to distribution shifts. Continual Test-Time Adaptation (CTTA) aims to address this issue in an unsupervised manner. However, existing methods that rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Xiao Chen , Jiazhen Huang , Zhiming Liu , Qinting Jiang , Fanding Huang , Jingyan Jiang , Zhi Wang

Few-shot class-incremental learning (FSCIL) poses significant challenges for artificial neural networks due to the need to efficiently learn from limited data while retaining knowledge of previously learned tasks. Inspired by the brain's…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Wanyi Li , Wei Wei , Yongkang Luo , Peng Wang

Multimodal Federated Learning (MFL) enables clients with heterogeneous data modalities to collaboratively train models without sharing raw data, offering a privacy-preserving framework that leverages complementary cross-modal information.…

Machine Learning · Computer Science 2026-03-06 Min Tan , Junchao Ma , Yinfu Feng , Jiajun Ding , Wenwen Pan , Tingting Han , Qian Zheng , Zhenzhong Kuang , Zhou Yu

Background/Aim. This study aims to predict Amyloid Positron Emission Tomography (AmyloidPET) status with multimodal retinal imaging and convolutional neural networks (CNNs) and to improve the performance through pretraining with synthetic…

Image and Video Processing · Electrical Eng. & Systems 2024-06-27 I. R. Slootweg , M. Thach , K. R. Curro-Tafili , F. D. Verbraak , F. H. Bouwman , Y. A. L. Pijnenburg , J. F. Boer , J. H. P. de Kwisthout , L. Bagheriye , P. J. González

The early detection of Alzheimer's Disease is imperative to ensure early treatment and improve patient outcomes. There has consequently been extenstive research into detecting AD and its intermediate phase, mild cognitive impairment (MCI).…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Jamie Vo , Naeha Sharif , Ghulam Mubashar Hassan

Brain transcriptomics provides insights into the molecular mechanisms by which the brain coordinates its functions and processes. However, existing multimodal methods for predicting Alzheimer's disease (AD) primarily rely on imaging and…

Artificial Intelligence · Computer Science 2025-04-03 Shan Cong , Zhoujie Fan , Hongwei Liu , Yinghan Zhang , Xin Wang , Haoran Luo , Xiaohui Yao

In recent years, deep face recognition methods have demonstrated impressive results on in-the-wild datasets. However, these methods have shown a significant decline in performance when applied to real-world low-resolution benchmarks like…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Mohammad Saeed Ebrahimi Saadabadi , Sahar Rahimi Malakshan , Hossein Kashiani , Nasser M. Nasrabadi

This paper presents FeTal-SAM, a novel adaptation of the Segment Anything Model (SAM) tailored for fetal brain MRI segmentation. Traditional deep learning methods often require large annotated datasets for a fixed set of labels, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Qi Zeng , Weide Liu , Bo Li , Ryne Didier , P. Ellen Grant , Davood Karimi

Brain tumors are highly heterogeneous in terms of their spatial and scaling characteristics, making tumor segmentation in medical images a difficult task that might result in wrong diagnosis and therapy. Automation of a task like tumor…

Image and Video Processing · Electrical Eng. & Systems 2025-01-24 Satyaki Roy Chowdhury , Golrokh Mirzaei

Multimedia online platforms (e.g., Amazon, TikTok) have greatly benefited from the incorporation of multimedia (e.g., visual, textual, and acoustic) content into their personal recommender systems. These modalities provide intuitive…

Information Retrieval · Computer Science 2024-03-12 Wei Wei , Jiabin Tang , Yangqin Jiang , Lianghao Xia , Chao Huang

In this work, we introduce Brain Latent Progression (BrLP), a novel spatiotemporal disease progression model based on latent diffusion. BrLP is designed to predict the evolution of diseases at the individual level on 3D brain MRIs. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Lemuel Puglisi , Daniel C. Alexander , Daniele Ravì

Multimodal learning enhances the perceptual capabilities of cognitive systems by integrating information from different sensory modalities. However, existing multimodal fusion research typically assumes static integration, not fully…

Neural and Evolutionary Computing · Computer Science 2025-05-16 Xiang He , Dongcheng Zhao , Yang Li , Qingqun Kong , Xin Yang , Yi Zeng