中文
相关论文

相关论文: Modality-Projection Universal Model for Comprehens…

200 篇论文

Recent advancements in foundation models, typically trained with self-supervised learning on large-scale and diverse datasets, have shown great potential in medical image analysis. However, due to the significant spatial heterogeneity of…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Lingxiao Luo , Xuanzhong Chen , Bingda Tang , Xinsheng Chen , Rong Han , Chengpeng Hu , Yujiang Li , Ting Chen

Recent developments in Multimodal Large Language Models (MLLMs) have shown rapid progress, moving towards the goal of creating versatile MLLMs that understand inputs from various modalities. However, existing methods typically rely on joint…

计算机视觉与模式识别 · 计算机科学 2024-07-29 Chi Chen , Yiyang Du , Zheng Fang , Ziyue Wang , Fuwen Luo , Peng Li , Ming Yan , Ji Zhang , Fei Huang , Maosong Sun , Yang Liu

Statistical shape modeling (SSM) is an enabling quantitative tool to study anatomical shapes in various medical applications. However, directly using 3D images in these applications still has a long way to go. Recent deep learning methods…

计算机视觉与模式识别 · 计算机科学 2023-10-04 Abu Zahid Bin Aziz , Jadie Adams , Shireen Elhabian

Recent advancements in large-scale Vision Transformers have made significant strides in improving pre-trained models for medical image segmentation. However, these methods face a notable challenge in acquiring a substantial amount of…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Yiqing Wang , Zihan Li , Jieru Mei , Zihao Wei , Li Liu , Chen Wang , Shengtian Sang , Alan Yuille , Cihang Xie , Yuyin Zhou

Deep learning-based computer-aided diagnosis is gradually deployed to review and analyze medical images. However, this paradigm is restricted in real-world clinical applications due to the poor robustness and generalization. The issue is…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Yurong Chen

Image compression aims to reduce the information redundancy in images. Most existing neural image compression methods rely on side information from hyperprior or context models to eliminate spatial redundancy, but rarely address the channel…

计算机视觉与模式识别 · 计算机科学 2023-06-12 Lin Liu , Mingming Zhao , Shanxin Yuan , Wenlong Lyu , Wengang Zhou , Houqiang Li , Yanfeng Wang , Qi Tian

Multimodal data modeling has emerged as a powerful approach in clinical research, enabling the integration of diverse data types such as imaging, genomics, wearable sensors, and electronic health records. Despite its potential to improve…

Scaling up model size and training data has advanced foundation models for instance-level perception, achieving state-of-the-art in-domain and zero-shot performance across object detection and segmentation. However, their high computational…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Mattia Segu , Marta Tintore Gazulla , Yongqin Xian , Luc Van Gool , Federico Tombari

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

计算机视觉与模式识别 · 计算机科学 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang

Multi-modal learning has achieved remarkable success by integrating information from various modalities, achieving superior performance in tasks like recognition and retrieval compared to uni-modal approaches. However, real-world scenarios…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Xiaohao Liu , Xiaobo Xia , Zhuo Huang , See-Kiong Ng , Tat-Seng Chua

Deep learning has led to state-of-the-art results for many medical imaging tasks, such as segmentation of different anatomical structures. With the increased numbers of deep learning publications and openly available code, the approach to…

图像与视频处理 · 电气工程与系统科学 2020-05-19 Tom van Sonsbeek , Veronika Cheplygina

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Variations in medical imaging modalities and individual anatomical differences pose challenges to cross-modality generalization in multi-modal tasks. Existing methods often concentrate exclusively on common anatomical patterns, thereby…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Zhaorui Tan , Xi Yang , Tan Pan , Tianyi Liu , Chen Jiang , Xin Guo , Qiufeng Wang , Anh Nguyen , Yuan Qi , Kaizhu Huang , Yuan Cheng

While the Segment Anything Model (SAM) excels in semantic segmentation for general-purpose images, its performance significantly deteriorates when applied to medical images, primarily attributable to insufficient representation of medical…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Yiming Zhang , Tianang Leng , Kun Han , Xiaohui Xie

In this extended abstract, we will present and discuss opportunities and challenges brought about by a new deep learning method by AUC maximization (aka \underline{\bf D}eep \underline{\bf A}UC \underline{\bf M}aximization or {\bf DAM}) for…

机器学习 · 计算机科学 2021-11-05 Tianbao Yang

Over the last few years machine learning has demonstrated groundbreaking results in many areas of medical image analysis, including segmentation. A key assumption, however, is that the train- and test distributions match. We study a…

计算机视觉与模式识别 · 计算机科学 2019-08-20 Kenneth Lau , Jonas Adler , Jens Sjölund

For medical image analysis, segmentation models trained on one or several domains lack generalization ability to unseen domains due to discrepancies between different data acquisition policies. We argue that the degeneration in segmentation…

计算机视觉与模式识别 · 计算机科学 2022-08-09 Ziqi Zhou , Lei Qi , Yinghuan Shi

The universal model emerges as a promising trend for medical image segmentation, paving up the way to build medical imaging large model (MILM). One popular strategy to build universal models is to encode each task as a one-hot vector and…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Yiwen Ye , Yutong Xie , Jianpeng Zhang , Ziyang Chen , Yong Xia

Contemporary computational neuroscience features two prominent modeling traditions. Bottom-up whole-brain modeling (WBM) builds biophysically detailed simulations of brain structure and dynamics, whereas top-down neuroconnectionism…

神经元与认知 · 定量生物学 2026-05-19 Mario Senden , Leonardo Dalla Porta , Jan Fousek , Jorge F. Mejias , Gorka Zamora-López

We address prevailing challenges of the brain-powered research, departing from the observation that the literature hardly recover accurate spatial information and require subject-specific models. To address these challenges, we propose…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Weihao Xia , Raoul de Charette , Cengiz Öztireli , Jing-Hao Xue