English
Related papers

Related papers: Video Pretraining Advances 3D Deep Learning on Che…

200 papers

While transformers have surpassed convolutional neural networks (CNNs) in various computer vision tasks, microelectronics defect detection still largely relies on CNNs. We hypothesize that this gap is due to the fact that a) transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Nikolai Röhrich , Alwin Hoffmann , Richard Nordsieck , Emilio Zarbali , Alireza Javanmardi

The ability to predict lung and heart based diseases using deep learning techniques is central to many researchers, particularly in the medical field around the world. In this paper, we present a unique outlook of a very familiar problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Sairamvinay Vijayaraghavan , David Haddad , Shikun Huang , Seongwoo Choi

For most natural language processing tasks, the dominant practice is to finetune large pretrained transformer models (e.g., BERT) using smaller downstream datasets. Despite the success of this approach, it remains unclear to what extent…

Computation and Language · Computer Science 2023-05-29 Kundan Krishna , Saurabh Garg , Jeffrey P. Bigham , Zachary C. Lipton

Pre-training for Reinforcement Learning (RL) with purely video data is a valuable yet challenging problem. Although in-the-wild videos are readily available and inhere a vast amount of prior world knowledge, the absence of action…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Hao Luo , Bohan Zhou , Zongqing Lu

Foundation models for medical imaging are typically pretrained on increasingly large datasets, following a "scale-at-all-costs" paradigm. However, this strategy faces two critical challenges: large-scale medical datasets often contain…

The Vision Transformer (ViT) has demonstrated remarkable performance in Self-Supervised Learning (SSL) for 3D medical image analysis. Masked AutoEncoder (MAE) for feature pre-training can further unleash the potential of ViT on various…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Jiaxin Zhuang , Linshan Wu , Qiong Wang , Peng Fei , Varut Vardhanabhuti , Lin Luo , Hao Chen

The exploration of various vision-language tasks, such as visual captioning, visual question answering, and visual commonsense reasoning, is an important area in artificial intelligence and continuously attracts the research community's…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Yayun Qi , Hongxi Li , Yiqi Song , Xinxiao Wu , Jiebo Luo

In recent years, deep learning models have become the standard for agricultural computer vision. Such models are typically fine-tuned to agricultural tasks using model weights that were originally fit to more general, non-agricultural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Amogh Joshi , Dario Guevara , Mason Earles

A method of a Convolutional Neural Networks (CNN) for image classification with image preprocessing and hyperparameters tuning was proposed. The method aims at increasing the predictive performance for COVID-19 diagnosis while more complex…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Kenan Morani , Devrim Unay

Remarkable progress in 2D Vision-Language Models (VLMs) has spurred interest in extending them to 3D settings for tasks like 3D Question Answering, Dense Captioning, and Visual Grounding. Unlike 2D VLMs that typically process images through…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Haoyuan Li , Yanpeng Zhou , Yufei Gao , Tao Tang , Jianhua Han , Yujie Yuan , Dave Zhenyu Chen , Jiawang Bian , Hang Xu , Xiaodan Liang

Abstract Background: Pulmonary function tests (PFTs) and computed tomography (CT) imaging are vital in diagnosing, managing, and monitoring lung diseases. A common issue in practice is the lack of access to recorded pulmonary functions…

Image and Video Processing · Electrical Eng. & Systems 2024-08-13 Kaiwen Geng , Zhiyi Shi , Xiaoyan Zhao , Alaa Ali , Jing Wang , Joseph Leader , Jiantao Pu

Transfer learning has gained attention in medical image analysis due to limited annotated 3D medical datasets for training data-driven deep learning models in the real world. Existing 3D-based methods have transferred the pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Eunji Jun , Seungwoo Jeong , Da-Woon Heo , Heung-Il Suk

We propose a supervised nonrigid image registration method, trained using artificial displacement vector fields (DVF), for which we propose and compare three network architectures. The artificial DVFs allow training in a fully supervised…

Image and Video Processing · Electrical Eng. & Systems 2019-08-28 Hessam Sokooti , Bob de Vos , Floris Berendsen , Mohsen Ghafoorian , Sahar Yousefi , Boudewijn P. F. Lelieveldt , Ivana Isgum , Marius Staring

Commercial iterative reconstruction techniques on modern CT scanners target radiation dose reduction but there are lingering concerns over their impact on image appearance and low contrast detectability. Recently, machine learning,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Hongming Shan , Atul Padole , Fatemeh Homayounieh , Uwe Kruger , Ruhani Doda Khera , Chayanin Nitiwarangkul , Mannudeep K. Kalra , Ge Wang

In this study, we investigated whether self-supervised pretraining could produce a neural network feature extractor applicable to multiple classification tasks in B-mode lung ultrasound analysis. When fine-tuning on three lung ultrasound…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Blake VanBerlo , Brian Li , Jesse Hoey , Alexander Wong

In recent years, domains such as natural language processing and image recognition have popularized the paradigm of using large datasets to pretrain representations that can be effectively transferred to downstream tasks. In this work we…

Machine Learning · Computer Science 2023-10-26 David Brandfonbrener , Ofir Nachum , Joan Bruna

Learning robust 3D shape segmentation functions with deep neural networks has emerged as a powerful paradigm, offering promising performance in producing a consistent part segmentation of each 3D shape. Generalizing across 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yu Hao , Hao Huang , Shuaihang Yuan , Yi Fang

Transfer learning from supervised ImageNet models has been frequently used in medical image analysis. Yet, no large-scale evaluation has been conducted to benchmark the efficacy of newly-developed pre-training techniques for medical image…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Mohammad Reza Hosseinzadeh Taher , Fatemeh Haghighi , Ruibin Feng , Michael B. Gotway , Jianming Liang

Pre-training techniques play a crucial role in deep learning, enhancing models' performance across a variety of tasks. By initially training on large datasets and subsequently fine-tuning on task-specific data, pre-training provides a solid…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Fulong Ma , Guoyang Zhao , Weiqing Qi , Ming Liu , Jun Ma

Vision Transformer (ViT), a radically different architecture than convolutional neural networks offers multiple advantages including design simplicity, robustness and state-of-the-art performance on many vision tasks. However, in contrast…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Hanan Gani , Muzammal Naseer , Mohammad Yaqub