中文
相关论文

相关论文: Multimodal Multitask Representation Learning for P…

200 篇论文

There exist numerous diagnostic tasks in pathology. Conventional computational pathology formulates and tackles them as independent and individual image classification problems, thereby resulting in computational inefficiency and high…

图像与视频处理 · 电气工程与系统科学 2024-07-15 Anh Tien Nguyen , Keunho Byeon , Kyungeun Kim , Boram Song , Seoung Wan Chae , Jin Tae Kwak

In industrial recommendation systems, multi-task learning (learning multiple tasks simultaneously on a single model) is a predominant approach to save training/serving resources and improve recommendation performance via knowledge transfer…

Deep neural network models can learn clinically relevant features from millions of histopathology images. However generating high-quality annotations to train such models for each hospital, each cancer type, and each diagnostic task is…

The development of computational pathology lies in the consensus that pathological characteristics of tumors are significant guidance for cancer diagnostics. Most existing research focuses on the inner-contextual information within each WSI…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Jun Shi , Tong Shu , Zhiguo Jiang , Wei Wang , Haibo Wu , Yushan Zheng

Transfer learning for bio-signals has recently become an important technique to improve prediction performance on downstream tasks with small bio-signal datasets. Recent works have shown that pre-training a neural network model on a large…

机器学习 · 计算机科学 2024-12-19 Eloy Geenjaar , Lie Lu

Automatic integration of whole slide images (WSIs) and gene expression profiles has demonstrated substantial potential in precision clinical diagnosis and cancer progression studies. However, most existing studies focus on individual gene…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Junzhuo Liu , Xuemei Du , Daniel Reisenbuchler , Ye Chen , Markus Eckstein , Christian Matek , Friedrich Feuerhake , Dorit Merhof

In biomedical imaging, deep learning-based methods are state-of-the-art for every modality (virtual slides, MRI, etc.) In histopathology, these methods can be used to detect certain biomarkers or classify lesions. However, such techniques…

Computer-assisted surgery research requires large, deeply annotated video datasets that capture clinical and technical variability. Existing cataract surgery resources lack the diversity and annotation depth required to train generalizable…

In line with the latest research, the task of identifying helpful reviews from a vast pool of user-generated textual and visual data has become a prominent area of study. Effective modal representations are expected to possess two key…

多媒体 · 计算机科学 2024-03-26 HongLin Gong , Mengzhao Jia , Liqiang Jing

Recognizing atypical mitotic figures in histopathology images allows physicians to correctly assess tumor aggressiveness. Although machine learning models could be exploited for automatically performing such a task, under domain shift these…

图像与视频处理 · 电气工程与系统科学 2025-09-10 Gennaro Percannella , Mattia Sarno , Francesco Tortorella , Mario Vento

Selecting an appropriate pre-trained source model is a critical, yet computationally expensive, task in transfer learning. Model Transferability Estimation (MTE) methods address this by providing efficient proxy metrics to rank models…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Yuhang Liu , Wenjie Zhao , Yunhui Guo

Learning multimodal representations from medical images and other data sources can provide richer information for decision-making. While various multimodal models have been developed for this, they overlook learning features that are both…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Boyu Chen , Weiye Bao , Junjie Liu , Michael Shen , Bo Peng , Paul Taylor , Zhu Li , Mengyue Yang

Tissue typology annotation in Whole Slide histological images is a complex and tedious, yet necessary task for the development of computational pathology models. We propose to address this problem by applying Open Set Recognition techniques…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Adrian Galdran , Katherine J. Hewitt , Narmin L. Ghaffari , Jakob N. Kather , Gustavo Carneiro , Miguel A. González Ballester

The integration of multi-modal data, such as pathological images and genomic data, is essential for understanding cancer heterogeneity and complexity for personalized treatments, as well as for enhancing survival predictions. Despite the…

定量方法 · 定量生物学 2023-01-09 Lin Qiu , Aminollah Khormali , Kai Liu

This study proposes a multi-modal fusion framework Multitrans based on the Transformer architecture and self-attention mechanism. This architecture combines the study of non-contrast computed tomography (NCCT) images and discharge diagnosis…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Danqing Ma , Meng Wang , Ao Xiang , Zongqing Qi , Qin Yang

Spinal metastasis is the most common disease in bone metastasis and may cause pain, instability and neurological injuries. Early detection of spinal metastasis is critical for accurate staging and optimal treatment. The diagnosis is usually…

计算机视觉与模式识别 · 计算机科学 2024-02-15 Shiqi Peng , Bolin Lai , Guangyu Yao , Xiaoyun Zhang , Ya Zhang , Yan-Feng Wang , Hui Zhao

Automatic radiology report generation can alleviate the workload for physicians and minimize regional disparities in medical resources, therefore becoming an important topic in the medical image analysis field. It is a challenging task, as…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Xinyi Wang , Grazziela Figueredo , Ruizhe Li , Wei Emma Zhang , Weitong Chen , Xin Chen

Training multimodal networks requires a vast amount of data due to their larger parameter space compared to unimodal networks. Active learning is a widely used technique for reducing data annotation costs by selecting only those samples…

多媒体 · 计算机科学 2023-08-22 Meng Shen , Yizheng Huang , Jianxiong Yin , Heqing Zou , Deepu Rajan , Simon See

Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually…

机器学习 · 计算机科学 2021-07-02 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yao Zhao

Gait recognition is an important biometric for human identification at a distance, particularly under low-resolution or unconstrained environments. Current works typically focus on either 2D representations (e.g., silhouettes and skeletons)…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Zhao-Yang Wang , Zhimin Shao , Anirudh Nanduri , Basudha Pal , Laura McDaniel , Jieneng Chen , Rama Chellappa