English
Related papers

Related papers: MuellerPT: Decomposition Driven Pretraining for De…

200 papers

There has been a growing interest in developing multimodal machine translation (MMT) systems that enhance neural machine translation (NMT) with visual knowledge. This problem setup involves using images as auxiliary information during…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Devaansh Gupta , Siddhant Kharbanda , Jiawei Zhou , Wanhua Li , Hanspeter Pfister , Donglai Wei

In multi-organ segmentation of abdominal CT scans, most existing fully supervised deep learning algorithms require lots of voxel-wise annotations, which are usually difficult, expensive, and slow to obtain. In comparison, massive unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Yuyin Zhou , Yan Wang , Peng Tang , Song Bai , Wei Shen , Elliot K. Fishman , Alan L. Yuille

The ability to dynamically extend a model to new data and classes is critical for multiple organ and tumor segmentation. However, due to privacy regulations, accessing previous data and annotations can be problematic in the medical domain.…

Image and Video Processing · Electrical Eng. & Systems 2023-07-24 Yixiao Zhang , Xinyi Li , Huimiao Chen , Alan Yuille , Yaoyao Liu , Zongwei Zhou

Dense prediction is a fundamental requirement for many medical vision tasks such as medical image restoration, registration, and segmentation. The most popular vision model, Convolutional Neural Networks (CNNs), has reached bottlenecks due…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Mingyuan Meng , Yuxin Xue , Dagan Feng , Lei Bi , Jinman Kim

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang

Liver segmentation on images acquired using computed tomography (CT) and magnetic resonance imaging (MRI) plays an important role in clinical management of liver diseases. Compared to MRI, CT images of liver are more abundant and readily…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Jin Hong , Simon Chun-Ho Yu , Weitian Chen

Recent deep learning models for tabular data currently compete with the traditional ML models based on decision trees (GBDT). Unlike GBDT, deep models can additionally benefit from pretraining, which is a workhorse of DL for vision and NLP.…

Machine Learning · Computer Science 2022-07-13 Ivan Rubachev , Artem Alekberov , Yury Gorishniy , Artem Babenko

The classification of mental health is challenging for a variety of reasons. For one, there is overlap between the mental health issues. In addition, the signs of mental health issues depend on the context of the situation, making…

Machine Learning · Computer Science 2026-03-17 Menna Elgabry , Ali Hamdi , Khaled Shaban

Lung tumors, especially those located close to or surrounded by soft tissues like the mediastinum, are difficult to segment due to the low soft tissue contrast on computed tomography images. Magnetic resonance images contain superior…

Image and Video Processing · Electrical Eng. & Systems 2019-09-11 Jue Jiang , Jason Hu , Neelam Tyagi , Andreas Rimner , Sean L. Berry , Joseph O. Deasy , Harini Veeraraghavan

Polarized light microscopy provides high contrast to birefringent specimen and is widely used as a diagnostic tool in pathology. However, polarization microscopy systems typically operate by analyzing images collected from two or more light…

As the computing power of modern hardware is increasing strongly, pre-trained deep learning models (e.g., BERT, GPT-3) learned on large-scale datasets have shown their effectiveness over conventional methods. The big progress is mainly…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Hanting Chen , Yunhe Wang , Tianyu Guo , Chang Xu , Yiping Deng , Zhenhua Liu , Siwei Ma , Chunjing Xu , Chao Xu , Wen Gao

There are not many large medical image datasets available. For these datasets, too small deep learning models can't learn useful features, so they don't work well due to underfitting, and too big models tend to overfit the limited data. As…

Image and Video Processing · Electrical Eng. & Systems 2023-11-02 Pervaiz Iqbal Khan , Andreas Dengel , Sheraz Ahmed

In recent years, deep learning methods such as convolutional neural network (CNN) and transformers have made significant progress in CT multi-organ segmentation. However, CT multi-organ segmentation methods based on masked image modeling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yunhao Lv , Lingyu Chen , Jian Wang , Yangxi Li , Fang Chen

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Zhe Li , Laurence T. Yang , Bocheng Ren , Xin Nie , Zhangyang Gao , Cheng Tan , Stan Z. Li

Masked auto-encoder pre-training has emerged as a prevalent technique for initializing and enhancing dense retrieval systems. It generally utilizes additional Transformer decoder blocks to provide sustainable supervision signals and…

Information Retrieval · Computer Science 2024-04-23 Guangyuan Ma , Xing Wu , Zijia Lin , Songlin Hu

Background: Dual-energy CT (DECT) and material decomposition play vital roles in quantitative medical imaging. However, the decomposition process may suffer from significant noise amplification, leading to severely degraded image…

Deep learning has shown promising results in medical image analysis, however, the lack of very large annotated datasets confines its full potential. Although transfer learning with ImageNet pre-trained classification models can alleviate…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Ken C. L. Wong , Tanveer Syeda-Mahmood , Mehdi Moradi

Histologic examination plays a crucial role in oncology research and diagnostics. The adoption of digital scanning of whole slide images (WSI) has created an opportunity to leverage deep learning-based image classification methods to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Md Zahangir Alom , Quynh T. Tran , Brent A. Orr

Purpose: Magnetic polarizability tensors (MPTs) provide an economical characterisation of conducting magnetic metallic objects and their spectral signature can aid in the solution of metal detection inverse problems, such as scrap metal…

Numerical Analysis · Mathematics 2024-05-01 James Elgy , Paul D. Ledger

Since 2017, the Transformer-based models play critical roles in various downstream Natural Language Processing tasks. However, a common limitation of the attention mechanism utilized in Transformer Encoder is that it cannot automatically…

Computation and Language · Computer Science 2022-04-20 Ziyang Luo , Yadong Xi , Jing Ma , Zhiwei Yang , Xiaoxi Mao , Changjie Fan , Rongsheng Zhang