中文
相关论文

相关论文: TTMFN: Two-stream Transformer-based Multimodal Fus…

200 篇论文

Trajectory forecasting in healthcare data has been an important area of research in precision care and clinical integration for computational methods. In recent years, generative AI models have demonstrated promising results in capturing…

信号处理 · 电气工程与系统科学 2024-12-09 Rosemary Y. He , Jeffrey N. Chiang

Pathological images play an essential role in cancer prognosis, while survival analysis, which integrates computational techniques, can predict critical clinical events such as patient mortality or disease recurrence from whole-slide images…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Guo Tang , Songhan Jiang , Jinpeng Lu , Linghan Cai , Yongbing Zhang

Cancer is one of the leading causes of death worldwide, making the development of rapid, minimally invasive, label-free and scalable diagnostic strategies a major challenge in modern oncology. In this context, spectroscopic liquid biopsy…

In the health domain, decisions are often based on different data modalities. Thus, when creating prediction models, multimodal fusion approaches that can extract and combine relevant features from different data modalities, can be highly…

人工智能 · 计算机科学 2024-02-20 Mafalda Malafaia , Thalea Schlender , Peter A. N. Bosman , Tanja Alderliesten

Leveraging multimodal information from Magnetic Resonance Imaging (MRI) plays a vital role in lesion segmentation, especially for brain tumors. However, in clinical practice, multimodal MRI data are often incomplete, making it challenging…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Yulong Zou , Bo Liu , Cun-Jing Zheng , Yuan-ming Geng , Siyue Li , Qiankun Zuo , Shuihua Wang , Yudong Zhang , Jin Hong

Fault diagnosis in multimode processes plays a critical role in ensuring the safe operation of industrial systems across multiple modes. It faces a great challenge yet to be addressed - that is, the significant distributional differences…

机器学习 · 计算机科学 2025-07-24 Guangqiang Li , M. Amine Atoui , Xiangshun Li

Cancer clinics capture disease data at various scales, from genetic to organ level. Current bioinformatic methods struggle to handle the heterogeneous nature of this data, especially with missing modalities. We propose PARADIGM, a Graph…

细胞行为 · 定量生物学 2024-11-22 Asim Waqas , Aakash Tripathi , Paul Stewart , Mia Naeini , Matthew B. Schabath , Ghulam Rasool

In this paper, we propose a novel fully convolutional two-stream fusion network (FCTSFN) for interactive image segmentation. The proposed network includes two sub-networks: a two-stream late fusion network (TSLFN) that predicts the…

计算机视觉与模式识别 · 计算机科学 2018-10-04 Yang Hu , Andrea Soltoggio , Russell Lock , Steve Carter

With the increasing use of surgical robots in clinical practice, enhancing their ability to process multimodal medical images has become a key research challenge. Although traditional medical image fusion methods have made progress in…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Qinhua Xie , Hao Tang

This study proposed a hybrid model of a convolutional neural network (CNN) and a Transformer to predict and diagnose heart disease. Based on CNN's strength in detecting local features and the Transformer's high capacity in sensing global…

机器学习 · 计算机科学 2025-03-05 Ran Hao , Yanlin Xiang , Junliang Du , Qingyuan He , Jiacheng Hu , Ting Xu

RGB-D saliency detection integrates information from both RGB images and depth maps to improve prediction of salient regions under challenging conditions. The key to RGB-D saliency detection is to fully mine and fuse information at multiple…

计算机视觉与模式识别 · 计算机科学 2021-12-02 Yue Wang , Xu Jia , Lu Zhang , Yuke Li , James Elder , Huchuan Lu

Cancer survival prediction from whole slide images (WSIs) is a challenging task in computational pathology due to the large size, irregular shape, and high granularity of the WSIs. These characteristics make it difficult to capture the full…

图像与视频处理 · 电气工程与系统科学 2025-03-05 Rustin Soraki , Huayu Wang , Joann G. Elmore , Linda Shapiro

In medical imaging, radiological scans of different modalities serve to enhance different sets of features for clinical diagnosis and treatment planning. This variety enriches the source information that could be used for outcome…

图像与视频处理 · 电气工程与系统科学 2020-06-01 William Le , Francisco Perdigón Romero , Samuel Kadoury

Prediction tasks in digital pathology are challenging due to the massive size of whole-slide images (WSIs) and the weak nature of training signals. Advances in computing, data availability, and self-supervised learning (SSL) have paved the…

图像与视频处理 · 电气工程与系统科学 2026-02-02 Vishwesh Ramanathan , Tony Xu , Pushpak Pati , Faruk Ahmed , Maged Goubran , Anne L. Martel

Probabilistic time series forecasting is crucial in many application domains such as retail, ecommerce, finance, or biology. With the increasing availability of large volumes of data, a number of neural architectures have been proposed for…

机器学习 · 计算机科学 2021-12-15 Olivier Sprangers , Sebastian Schelter , Maarten de Rijke

This paper focuses on the task of survival time analysis for lung cancer. Although much progress has been made in this problem in recent years, the performance of existing methods is still far from satisfactory. Traditional and some deep…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Yujiao Wu , Yaxiong Wang , Xiaoshui Huang , Fan Yang , Sai Ho Ling , Steven Weidong Su

Recently, TabPFN has gained attention as a foundation model for tabular data. However, it struggles to integrate heterogeneous modalities such as images and text, which are common in domains like healthcare and marketing, thereby limiting…

机器学习 · 计算机科学 2026-04-10 Wall Kim , Chaeyoung Song , Hanul Kim

Multimodal fusion learning has shown significant promise in classifying various diseases such as skin cancer and brain tumors. However, existing methods face three key limitations. First, they often lack generalizability to other diagnosis…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Joy Dhar , Nayyar Zaidi , Maryam Haghighat , Puneet Goyal , Sudipta Roy , Azadeh Alavi , Vikas Kumar

We have trained a fully convolutional spatio-temporal model for fast and accurate representation learning in the challenging exemplar application area of fusion energy plasma science. The onset of major disruptions is a critically important…

计算物理 · 物理学 2020-09-29 Ge Dong , Kyle Gerard Felker , Alexey Svyatkovskiy , William Tang , Julian Kates-Harbeck

Rapid growth of machine learning methodologies and their applications offer new opportunity for improved transformer asset management. Accordingly, power system operators are currently looking for data-driven methods to make better-informed…

系统与控制 · 计算机科学 2017-11-10 Mohsen Mahoor , Amin Khodaei