中文
相关论文

相关论文: Multi-task pre-training of deep neural networks fo…

200 篇论文

Pretrained Transformer based models finetuned on domain specific corpora have changed the landscape of NLP. Generally, if one has multiple tasks on a given dataset, one may finetune different models or use task specific adapters. In this…

This paper proposes a joint multi-task learning algorithm to better predict attributes in images using deep convolutional neural networks (CNN). We consider learning binary semantic attributes through a multi-task CNN model, where each CNN…

计算机视觉与模式识别 · 计算机科学 2016-01-05 Abrar H. Abdulnabi , Gang Wang , Jiwen Lu , Kui Jia

Unsupervised pre-training approaches have achieved great success in many fields such as Computer Vision (CV), Natural Language Processing (NLP) and so on. However, compared to typical deep learning models, pre-training or even fine-tuning…

计算机视觉与模式识别 · 计算机科学 2023-02-22 Penghao Jiang , Xuanchen Hou , Yinsi Zhou

Motivation: In recent years, image-based biological assays have steadily become high-throughput, sparking a need for fast automated methods to extract biologically-meaningful information from hundreds of thousands of images. Taking…

计算机视觉与模式识别 · 计算机科学 2021-11-25 Stanley Bryan Z. Hua , Alex X. Lu , Alan M. Moses

In this paper, we introduce a fully convolutional network for the document layout analysis task. While state-of-the-art methods are using models pre-trained on natural scene images, our method Doc-UFCN relies on a U-shaped model trained…

计算机视觉与模式识别 · 计算机科学 2021-09-20 Mélodie Boillet , Christopher Kermorvant , Thierry Paquet

By leveraging large amounts of product data collected across hundreds of live e-commerce websites, we construct 1000 unique classification tasks that share similarly-structured input data, comprised of both text and images. These…

人工智能 · 计算机科学 2021-07-29 Cameron R. Wolfe , Keld T. Lundgaard

This paper introduces a deep learning model tailored for document information analysis, emphasizing document classification, entity relation extraction, and document visual question answering. The proposed model leverages transformer-based…

计算机视觉与模式识别 · 计算机科学 2023-10-26 Tofik Ali , Partha Pratim Roy

The medical imaging community generates a wealth of datasets, many of which are openly accessible and annotated for specific diseases and tasks such as multi-organ or lesion segmentation. Current practices continue to limit model training…

图像与视频处理 · 电气工程与系统科学 2024-01-09 Constantin Ulrich , Fabian Isensee , Tassilo Wald , Maximilian Zenk , Michael Baumgartner , Klaus H. Maier-Hein

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

计算机视觉与模式识别 · 计算机科学 2019-10-10 Qianru Sun , Yaoyao Liu , Zhaozheng Chen , Tat-Seng Chua , Bernt Schiele

Purpose: Neural networks have received recent interest for reconstruction of undersampled MR acquisitions. Ideally network performance should be optimized by drawing the training and testing data from the same domain. In practice, however,…

计算机视觉与模式识别 · 计算机科学 2019-05-07 Salman Ul Hassan Dar , Muzaffer Özbey , Ahmet Burak Çatlı , Tolga Çukur

It is a big problem that a model of deep learning for a picking robot needs many labeled images. Operating costs of retraining a model becomes very expensive because the object shape of a product or a part often is changed in a factory. It…

机器人学 · 计算机科学 2020-03-13 Yasuto Yokota , Kanata Suzuki , Yuzi Kanazawa , Tomoyoshi Takebayashi

Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data,…

计算机视觉与模式识别 · 计算机科学 2023-04-19 Mingu Kang , Heon Song , Seonwook Park , Donggeun Yoo , Sérgio Pereira

Advancement in digital pathology and artificial intelligence has enabled deep learning-based computer vision techniques for automated disease diagnosis and prognosis. However, WSIs present unique computational and algorithmic challenges.…

计算机视觉与模式识别 · 计算机科学 2021-06-15 Yash Sharma , Lubaina Ehsan , Sana Syed , Donald E. Brown

In the last years, neural networks have proven to be a powerful framework for various image analysis problems. However, some application domains have specific limitations. Notably, digital pathology is an example of such fields due to…

计算机视觉与模式识别 · 计算机科学 2018-02-06 Gleb Makarchuk , Vladimir Kondratenko , Maxim Pisov , Artem Pimkin , Egor Krivov , Mikhail Belyaev

The training of medical image analysis systems using machine learning approaches follows a common script: collect and annotate a large dataset, train the classifier on the training set, and test it on a hold-out test set. This process bears…

计算机视觉与模式识别 · 计算机科学 2019-02-05 Gabriel Maicas , Andrew P. Bradley , Jacinto C. Nascimento , Ian Reid , Gustavo Carneiro

Neural network based models have achieved impressive results on various specific tasks. However, in previous works, most models are learned separately based on single-task supervised objectives, which often suffer from insufficient training…

计算与语言 · 计算机科学 2016-09-26 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

计算机视觉与模式识别 · 计算机科学 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

In this work we examine the performance enhancement in classification of medical imaging data when image features are combined with associated non-image data. We compare the performance of eight state-of-the-art deep neural networks in…

图像与视频处理 · 电气工程与系统科学 2021-11-30 Spencer A. Thomas

Although multi-task deep neural network (DNN) models have computation and storage benefits over individual single-task DNN models, they can be further optimized via model compression. Numerous structured pruning methods are already…

机器学习 · 计算机科学 2023-04-17 Siddhant Garg , Lijun Zhang , Hui Guan

Pre-trained Vision Transformers now serve as powerful tools for computer vision. Yet, efficiently adapting them for multiple tasks remains a challenge that arises from the need to modify the rich hidden representations encoded by the…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Krishna Sri Ipsit Mantri , Carola-Bibiane Schönlieb , Bruno Ribeiro , Chaim Baskin , Moshe Eliasof