中文
相关论文

相关论文: A multimodal method based on cross-attention and c…

200 篇论文

Depression, a prevalent and serious mental health issue, affects approximately 3.8\% of the global population. Despite the existence of effective treatments, over 75\% of individuals in low- and middle-income countries remain untreated,…

计算与语言 · 计算机科学 2024-07-19 Shengjie Li , Yinhao Xiao

The integration of different imaging modalities, such as structural, diffusion tensor, and functional magnetic resonance imaging, with deep learning models has yielded promising outcomes in discerning phenotypic characteristics and…

图像与视频处理 · 电气工程与系统科学 2024-10-08 Zhiyuan Li , Hailong Li , Anca L. Ralescu , Jonathan R. Dillman , Mekibib Altaye , Kim M. Cecil , Nehal A. Parikh , Lili He

Medical images play an important role in clinical applications. Multimodal medical images could provide rich information about patients for physicians to diagnose. The image fusion technique is able to synthesize complementary information…

计算机视觉与模式识别 · 计算机科学 2022-12-12 Meng Zhou , Xiaolan Xu , Yuxuan Zhang

Multi-modal learning has been intensified in recent years, especially for applications in facial analysis and action unit detection whilst there still exist two main challenges in terms of 1) relevant feature learning for representation and…

计算机视觉与模式识别 · 计算机科学 2022-03-23 Xiang Zhang , Lijun Yin

The advent of deep learning has significantly propelled the capabilities of automated medical image diagnosis, providing valuable tools and resources in the realm of healthcare and medical diagnostics. This research delves into the…

图像与视频处理 · 电气工程与系统科学 2023-11-20 Ryan Donghan Kwon , Dohyun Lim , Yoonha Lee , Seung Won Lee

Distal myopathy represents a genetically heterogeneous group of skeletal muscle disorders with broad clinical manifestations, posing diagnostic challenges in radiology. To address this, we propose a novel multimodal attention-aware fusion…

Accurate identification of protein nucleic-acid-binding residues poses a significant challenge with important implications for various biological processes and drug design. Many typical computational methods for protein analysis rely on a…

生物大分子 · 定量生物学 2023-12-21 Linglin Jing , Sheng Xu , Yifan Wang , Yuzhe Zhou , Tao Shen , Zhigang Ji , Hui Fang , Zhen Li , Siqi Sun

The major challenge in audio-visual event localization task lies in how to fuse information from multiple modalities effectively. Recent works have shown that attention mechanism is beneficial to the fusion process. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2020-08-18 Bin Duan , Hao Tang , Wei Wang , Ziliang Zong , Guowei Yang , Yan Yan

Major depressive disorder (MDD) is a prevalent mental disorder associated with complex neurobiological changes that cannot be fully captured using a single imaging modality. The use of multimodal magnetic resonance imaging (MRI) provides a…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Nojod M. Alotaibi , Areej M. Alhothali

Attention mechanisms have raised significant interest in the research community, since they promise significant improvements in the performance of neural network architectures. However, in any specific problem, we still lack a principled…

计算机视觉与模式识别 · 计算机科学 2021-12-24 Rafael Pedro , Arlindo L. Oliveira

The global outbreak of the Mpox virus, classified as a Public Health Emergency of International Concern (PHEIC) by the World Health Organization, presents significant diagnostic challenges due to its visual similarity to other skin lesion…

图像与视频处理 · 电气工程与系统科学 2025-08-19 Ayush Deshmukh

The integration of multimodal medical imaging can provide complementary and comprehensive information for the diagnosis of Alzheimer's disease (AD). However, in clinical practice, since positron emission tomography (PET) is often missing,…

计算工程、金融与科学 · 计算机科学 2024-12-03 Fuyou Mao , Lixin Lin , Ming Jiang , Dong Dai , Chao Yang , Hao Zhang , Yan Tang

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

计算机视觉与模式识别 · 计算机科学 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

Deep learning models have gained increasing adoption in medical image analysis. However, these models often produce overconfident predictions, which can compromise clinical accuracy and reliability. Bridging the gap between high-performance…

图像与视频处理 · 电气工程与系统科学 2026-03-24 Jutika Borah , Hidam Kumarjit Singh

Alzheimer's disease (AD) is a common neurodegenerative disease among the elderly. Early prediction and timely intervention of its prodromal stage, mild cognitive impairment (MCI), can decrease the risk of advancing to AD. Combining…

图像与视频处理 · 电气工程与系统科学 2025-01-22 Xiangyang Hu , Xiangyu Shen , Yifei Sun , Xuhao Shan , Wenwen Min , Liyilei Su , Xiaomao Fan , Ahmed Elazab , Ruiquan Ge , Changmiao Wang , Xiaopeng Fan

Postoperative delirium (POD), a severe neuropsychiatric complication affecting nearly 50% of high-risk surgical patients, is defined as an acute disorder of attention and cognition, It remains significantly underdiagnosed in the intensive…

机器学习 · 计算机科学 2025-05-14 Bingxu Wang , Min Ge , Kunzhi Cai , Yuqi Zhang , Zeyi Zhou , Wenjiao Li , Yachong Guo , Wei Wang , Qing Zhou

Protein-protein interaction (PPI) prediction plays a pivotal role in deciphering cellular functions and disease mechanisms. To address the limitations of traditional experimental methods and existing computational approaches in cross-modal…

机器学习 · 计算机科学 2025-04-29 Shengrui XU , Tianchi Lu , Zikun Wang , Jixiu Zhai

Pathological complete response (pCR) is a key prognostic factor in breast cancer patients undergoing neoadjuvant therapy, strongly associated with long-term survival and treatment personalization. However, accurate pre-treatment pCR…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Alice Natalina Caragliano , Valerio Guarrasi , Michela Gravina , Carlo Sansone , Paolo Soda

Multimodal intent understanding is a significant research area that requires effective leveraging of multiple modalities to analyze human language. Existing methods face two main challenges in this domain. Firstly, they have limitations in…

多媒体 · 计算机科学 2025-05-26 Hanlei Zhang , Qianrui Zhou , Hua Xu , Jianhua Su , Roberto Evans , Kai Gao

Post-translational modifications (PTMs) affecting a protein's residues (amino acids) can disturb its function, leading to illness. Whether or not a PTM is pathogenic depends on its type and the status of neighboring residues. In this paper,…

定量方法 · 定量生物学 2022-10-19 Nicolas F. Chaves-de-Plaza , Klaus Hildebrandt , Anna Vilanova