中文
相关论文

相关论文: Transformer representation learning is necessary f…

200 篇论文

Alzheimer's disease (AD) is a progressive neurodegenerative disorder and the leading cause of dementia, affecting memory, reasoning, communication, and daily functioning. Early diagnosis is particularly important, as timely intervention may…

声音 · 计算机科学 2026-05-26 Loukas Ilias , Dimitris Askounis

This paper introduces an innovative multi-modal fusion deep learning approach to overcome the drawbacks of traditional single-modal recognition techniques. These drawbacks include incomplete information and limited diagnostic accuracy.…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Xiaoyi Liu , Hongjie Qiu , Muqing Li , Zhou Yu , Yutian Yang , Yafeng Yan

Early and accurate diagnosis of pulmonary hypertension (PH) is essential for optimal patient management. Differentiating between pre-capillary and post-capillary PH is critical for guiding treatment decisions. This study develops and…

图像与视频处理 · 电气工程与系统科学 2025-04-03 Fubao Zhu , Yang Zhang , Gengmin Liang , Jiaofen Nan , Yanting Li , Chuang Han , Danyang Sun , Zhiguo Wang , Chen Zhao , Wenxuan Zhou , Jian He , Yi Xu , Iokfai Cheang , Xu Zhu , Yanli Zhou , Weihua Zhou

Alzheimer's Disease (AD) is a complex neurodegenerative disorder marked by memory loss, executive dysfunction, and personality changes. Early diagnosis is challenging due to subtle symptoms and varied presentations, often leading to…

计算机视觉与模式识别 · 计算机科学 2025-01-06 Yifei Chen , Shenghao Zhu , Zhaojie Fang , Chang Liu , Binfeng Zou , Yuhe Wang , Shuo Chang , Fan Jia , Feiwei Qin , Jin Fan , Yong Peng , Changmiao Wang

Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convolutional neural…

图像与视频处理 · 电气工程与系统科学 2022-07-08 Jiashun Chen , Donghuan Lu , Yu Zhang , Dong Wei , Munan Ning , Xinyu Shi , Zhe Xu , Yefeng Zheng

Medical multimodal representation learning aims to integrate heterogeneous clinical data into unified patient representations to support predictive modeling, which remains an essential yet challenging task in the medical data mining…

机器学习 · 计算机科学 2025-09-09 Xiaoguang Zhu , Lianlong Sun , Yang Liu , Pengyi Jiang , Uma Srivatsa , Nipavan Chiamvimonvat , Vladimir Filkov

Self-supervised, multi-modal learning has been successful in holistic representation of complex scenarios. This can be useful to consolidate information from multiple modalities which have multiple, versatile uses. Its application in…

计算机视觉与模式识别 · 计算机科学 2020-11-03 Aniruddha Tamhane , Jie Ying Wu , Mathias Unberath

Machine learning (ML) classifiers serve as essential tools facilitating classification and prediction across various domains. The performance of these algorithms should be known to ensure their reliable application. In certain fields,…

系统与控制 · 电气工程与系统科学 2024-08-29 Zahra Rastin , Dirk Söffker

Deep learning approaches, together with neuroimaging techniques, play an important role in psychiatric disorders classification. Previous studies on psychiatric disorders diagnosis mainly focus on using functional connectivity matrices of…

图像与视频处理 · 电气工程与系统科学 2023-10-05 Guoxin Wang , Xuyang Cao , Shan An , Fengmei Fan , Chao Zhang , Jinsong Wang , Feng Yu , Zhiren Wang

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

机器学习 · 计算机科学 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Chronic Obstructive Pulmonary Disorder (COPD) is an irreversible and progressive disease which is highly heritable. Clinically, COPD is defined using the summary measures derived from a spirometry test but these are not always adequate.…

机器学习 · 计算机科学 2024-11-15 Soham Gadgil , Joshua Galanter , Mohammadreza Negahdar

Multimodal regression aims to predict a continuous target from heterogeneous input sources and typically relies on fusion strategies such as early or late fusion. However, existing methods lack principled tools to disentangle and quantify…

机器学习 · 计算机科学 2025-12-29 Zhaozhao Ma , Shujian Yu

Multimodal large language models (MLLMs) recently showed strong capacity in integrating data among multiple modalities, empowered by a generalizable attention architecture. Advanced methods predominantly focus on language-centric tuning…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Zhicheng Zhang , Wuyou Xia , Chenxi Zhao , Zhou Yan , Xiaoqiang Liu , Yongjie Zhu , Wenyu Qin , Pengfei Wan , Di Zhang , Jufeng Yang

Missing modalities pose a major issue in Alzheimer's Disease (AD) diagnosis, as many subjects lack full imaging data due to cost and clinical constraints. While multi-modal learning leverages complementary information, most existing methods…

图像与视频处理 · 电气工程与系统科学 2025-08-28 Yanfei Li , Teng Yin , Wenyi Shang , Jingyu Liu , Xi Wang , Kaiyang Zhao

Endometriosis, affecting about 10% of individuals assigned female at birth, is challenging to diagnose and manage. Diagnosis typically involves the identification of various signs of the disease using either laparoscopic surgery or the…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Hu Wang , David Butler , Yuan Zhang , Jodie Avery , Steven Knox , Congbo Ma , Louise Hull , Gustavo Carneiro

Clinical diagnosis is a highly specialized discipline requiring both domain expertise and strict adherence to rigorous guidelines. While current AI-driven medical research predominantly focuses on knowledge graphs or natural text…

机器学习 · 计算机科学 2025-12-12 Haolin Li , Tianjie Dai , Zhe Chen , Siyuan Du , Jiangchao Yao , Ya Zhang , Yanfeng Wang

This contribution proposes novel data-driven surrogate modeling approaches for parameterized parabolic PDEs, where the parameter dependence can be split into two parts with different decay behavior of the Kolmogorov $N$-width. Such problems…

数值分析 · 数学 2026-04-27 Dawid Kotowski , Mario Ohlberger

According to the 2021 World Health Organization (WHO) Classification scheme for gliomas, glioma segmentation is a very important basis for diagnosis and genotype prediction. In general, 3D multimodal brain MRI is an effective diagnostic…

图像与视频处理 · 电气工程与系统科学 2025-06-23 Xiaoyu Shi , Shurong Chai , Yinhao Li , Jingliang Cheng , Jie Bai , Guohua Zhao , Yen-Wei Chen

The paradigm of representation learning through transfer learning has the potential to greatly enhance clinical natural language processing. In this work, we propose a multi-task pre-training and fine-tuning approach for learning…

计算与语言 · 计算机科学 2021-03-15 Yuqi Si , Elmer V Bernstam , Kirk Roberts

Humans can resort to long-form inspection to build intuition on predicting the 3D configurations of unseen objects. The more we observe the object motion, the better we get at predicting its 3D state immediately. Existing systems either…

计算机视觉与模式识别 · 计算机科学 2025-04-25 Mingxuan Wu , Huang Huang , Justin Kerr , Chung Min Kim , Anthony Zhang , Brent Yi , Angjoo Kanazawa