中文
相关论文

相关论文: Multi-task pre-training of deep neural networks fo…

200 篇论文

Understanding and leveraging the 3D structures of proteins is central to a variety of biological and drug discovery tasks. While deep learning has been applied successfully for structure-based protein function prediction tasks, current…

机器学习 · 计算机科学 2024-04-03 Rong Han , Wenbing Huang , Lingxiao Luo , Xinyan Han , Jiaming Shen , Zhiqiang Zhang , Jun Zhou , Ting Chen

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

图像与视频处理 · 电气工程与系统科学 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

We propose a unified cross-domain transfer learning framework that leverages knowledge from multiple heterogeneous medical imaging datasets to improve performance across segmentation, classification, and object detection tasks. Our approach…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Ceausescu Ciprian-Mihai , Anghelina Ion-Marian , Alexe Dumitru-Bogdan

Digital whole slides images contain an enormous amount of information providing a strong motivation for the development of automated image analysis tools. Particularly deep neural networks show high potential with respect to various tasks…

计算机视觉与模式识别 · 计算机科学 2023-12-07 Michael Gadermayr , Maximilian Tschuchnig

Pre-training techniques play a crucial role in deep learning, enhancing models' performance across a variety of tasks. By initially training on large datasets and subsequently fine-tuning on task-specific data, pre-training provides a solid…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Fulong Ma , Guoyang Zhao , Weiqing Qi , Ming Liu , Jun Ma

This paper strives for video event detection using a representation learned from deep convolutional neural networks. Different from the leading approaches, who all learn from the 1,000 classes defined in the ImageNet Large Scale Visual…

计算机视觉与模式识别 · 计算机科学 2017-12-14 Pascal Mettes , Dennis C. Koelma , Cees G. M. Snoek

Deep learning based methods have achieved impressive results in many applications for image-based diet assessment such as food classification and food portion size estimation. However, existing methods only focus on one task at a time,…

计算机视觉与模式识别 · 计算机科学 2020-04-29 Jiangpeng He , Zeman Shao , Janine Wright , Deborah Kerr , Carol Boushey , Fengqing Zhu

Pretraining on large natural image classification datasets such as ImageNet has aided model development on data-scarce 2D medical tasks. 3D medical tasks often have much less data than 2D medical tasks, prompting practitioners to rely on…

图像与视频处理 · 电气工程与系统科学 2023-04-04 Alexander Ke , Shih-Cheng Huang , Chloe P O'Connell , Michal Klimont , Serena Yeung , Pranav Rajpurkar

Neural network models have shown their promising opportunities for multi-task learning, which focus on learning the shared layers to extract the common and task-invariant features. However, in most existing approaches, the extracted shared…

计算与语言 · 计算机科学 2017-04-20 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

With the emergence of large-scale pre-trained neural networks, methods to adapt such "foundation" models to data-limited downstream tasks have become a necessity. Fine-tuning, preference optimization, and transfer learning have all been…

机器学习 · 统计学 2025-07-09 Javan Tahir , Surya Ganguli , Grant M. Rotskoff

Multi-label classification models have a wide range of applications in E-commerce, including visual-based label predictions and language-based sentiment classifications. A major challenge in achieving satisfactory performance for these…

计算机视觉与模式识别 · 计算机科学 2023-06-07 Xin Shen , Praful Agrawal , Zhongwei Cheng

Supervised machine learning based state-of-the-art computer vision techniques are in general data hungry and pose the challenges of not having adequate computing resources and of high costs involved in human labeling efforts. Training data…

计算机视觉与模式识别 · 计算机科学 2018-05-30 Vishal Kaushal , Anurag Sahoo , Khoshrav Doctor , Narasimha Raju , Suyash Shetty , Pankaj Singh , Rishabh Iyer , Ganesh Ramakrishnan

Transfer learning allows us to exploit knowledge gained from one task to assist in solving another but relevant task. In modern computer vision research, the question is which architecture performs better for a given dataset. In this paper,…

图像与视频处理 · 电气工程与系统科学 2022-01-03 Sandhya Aneja , Nagender Aneja , Pg Emeroylariffion Abas , Abdul Ghani Naim

Fine-tuning a pre-trained deep neural network has become a successful paradigm in various machine learning tasks. However, such a paradigm becomes particularly challenging with tabular data when there are discrepancies between the feature…

机器学习 · 计算机科学 2023-10-24 Qi-Le Zhou , Han-Jia Ye , Le-Ye Wang , De-Chuan Zhan

Finetuning from a pretrained deep model is found to yield state-of-the-art performance for many vision tasks. This paper investigates many factors that influence the performance in finetuning for object detection. There is a long-tailed…

计算机视觉与模式识别 · 计算机科学 2016-04-15 Wanli Ouyang , Xiaogang Wang , Cong Zhang , Xiaokang Yang

Automated analysis of tissue sections allows a better understanding of disease biology and may reveal biomarkers that could guide prognosis or treatment selection. In digital pathology, less abundant cell types can be of biological…

图像与视频处理 · 电气工程与系统科学 2021-02-24 Yeman Brhane Hagos , Catherine SY Lecat , Dominic Patel , Lydia Lee , Thien-An Tran , Manuel Rodriguez- Justo , Kwee Yong , Yinyin Yuan

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate…

计算机视觉与模式识别 · 计算机科学 2023-09-22 Zhiyun Song , Penghui Du , Junpeng Yan , Kailu Li , Jianzhong Shou , Maode Lai , Yubo Fan , Yan Xu

Multi-task learning is to improve the performance of the model by transferring and exploiting common knowledge among tasks. Existing MTL works mainly focus on the scenario where label sets among multiple tasks (MTs) are usually the same,…

机器学习 · 计算机科学 2022-01-10 Quan Feng , Songcan Chen

Multitask learning assumes that models capable of learning from multiple tasks can achieve better quality and efficiency via knowledge transfer, a key feature of human learning. Though, state of the art ML models rely on high customization…

机器学习 · 计算机科学 2022-11-17 Andrea Gesmundo , Jeff Dean

Transfer learning leverages pre-trained model features from a large dataset to save time and resources when training new models for various tasks, potentially enhancing performance. Due to the lack of large datasets in the medical imaging…

图像与视频处理 · 电气工程与系统科学 2023-11-10 Gabriel Efrain Humpire-Mamani , Colin Jacobs , Mathias Prokop , Bram van Ginneken , Nikolas Lessmann