English
Related papers

Related papers: KPTransfer: improved performance and faster conver…

200 papers

Learning high-quality domain word embeddings is important for achieving good performance in many NLP tasks. General-purpose embeddings trained on large-scale corpora are often sub-optimal for domain-specific applications. However,…

Computation and Language · Computer Science 2018-05-28 Hu Xu , Bing Liu , Lei Shu , Philip S. Yu

In this paper, we are interested in pose estimation of animals. Animals usually exhibit a wide range of variations on poses and there is no available animal pose dataset for training and testing. To address this problem, we build an animal…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Jinkun Cao , Hongyang Tang , Hao-Shu Fang , Xiaoyong Shen , Cewu Lu , Yu-Wing Tai

The typical bottom-up human pose estimation framework includes two stages, keypoint detection and grouping. Most existing works focus on developing grouping algorithms, e.g., associative embedding, and pixel-wise keypoint regression that we…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Ke Sun , Zigang Geng , Depu Meng , Bin Xiao , Dong Liu , Zhaoxiang Zhang , Jingdong Wang

Continual pre-training has been urgent for adapting a pre-trained model to a multitude of domains and tasks in the fast-evolving world. In practice, a continually pre-trained model is expected to demonstrate not only greater capacity when…

Computation and Language · Computer Science 2023-10-23 Gangwei Jiang , Caigao Jiang , Siqiao Xue , James Y. Zhang , Jun Zhou , Defu Lian , Ying Wei

Transfer learning is a promising method for AOI applications since it can significantly shorten sample collection time and improve efficiency in today's smart manufacturing. However, related research enhanced the network models by applying…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Erik Isai Valle Salgado , Haoxin Yan , Yue Hong , Peiyuan Zhu , Shidong Zhu , Chengwei Liao , Yanxiang Wen , Xiu Li , Xiang Qian , Xiaohao Wang , Xinghui Li

Lack of training data hinders automatic recognition and prediction of surgical activities necessary for situation-aware operating rooms. We propose using knowledge transfer to compensate for data deficit and improve prediction. We used two…

Machine Learning · Computer Science 2017-11-17 Olga Dergachyova , Xavier Morandi , Pierre Jannin

In this paper, we propose an effective knowledge transfer framework to boost the weakly supervised object detection accuracy with the help of an external fully-annotated source dataset, whose categories may not overlap with the target…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Yuanyi Zhong , Jianfeng Wang , Jian Peng , Lei Zhang

We introduce a novel method that enables parameter-efficient transfer and multi-task learning with deep neural networks. The basic approach is to learn a model patch - a small set of parameters - that will specialize to each task, instead…

Machine Learning · Computer Science 2019-02-26 Pramod Kaushik Mudrakarta , Mark Sandler , Andrey Zhmoginov , Andrew Howard

Domain adaptation (DA) aims at transferring knowledge from a labeled source domain to an unlabeled target domain. Though many DA theories and algorithms have been proposed, most of them are tailored into classification settings and may fail…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Junguang Jiang , Yifei Ji , Ximei Wang , Yufeng Liu , Jianmin Wang , Mingsheng Long

In the problem of domain transfer learning, we learn a model for the predic-tion in a target domain from the data of both some source domains and the target domain, where the target domain is in lack of labels while the source domain has…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Guohui Zhang , Gaoyuan Liang , Fang Su , Fanxin Qu , Jing-Yan Wang

Human pose information is a critical component in many downstream image processing tasks, such as activity recognition and motion tracking. Likewise, a pose estimator for the illustrated character domain would provide a valuable prior for…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Shuhong Chen , Matthias Zwicker

Transformers have recently been shown to generate high quality images from text input. However, the existing method of pose conditioning using skeleton image tokens is computationally inefficient and generate low quality images. Therefore…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Soon Yau Cheong , Armin Mustafa , Andrew Gilbert

Domain Adaptation is the process of alleviating distribution gaps between data from different domains. In this paper, we show that Domain Adaptation methods using pair-wise relationships between source and target domain data can be…

Machine Learning · Computer Science 2021-10-26 Lukas Hedegaard , Omar Ali Sheikh-Omar , Alexandros Iosifidis

Although numerous improvements have been made in the field of image segmentation using convolutional neural networks, the majority of these improvements rely on training with larger datasets, model architecture modifications, novel loss…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Saied Asgari Taghanaki , Kumar Abhishek , Ghassan Hamarneh

Cross domain recommender systems have been increasingly valuable for helping consumers identify the most satisfying items from different categories. However, previously proposed cross-domain models did not take into account bidirectional…

Information Retrieval · Computer Science 2019-10-14 Pan Li , Alexander Tuzhilin

Deep learning models detect pneumonia from chest X-rays with high accuracy, but the performance declines under domain shifts caused by differences in devices, patients, or institutions. We present PneumoNet, a domain-incremental learning…

Machine Learning · Computer Science 2026-05-20 Danu Kim

The recent success of neural machine translation models relies on the availability of high quality, in-domain data. Domain adaptation is required when domain-specific data is scarce or nonexistent. Previous unsupervised domain adaptation…

Computation and Language · Computer Science 2019-08-29 Zi-Yi Dou , Junjie Hu , Antonios Anastasopoulos , Graham Neubig

In this paper, we are interested in the bottom-up paradigm of estimating human poses from an image. We study the dense keypoint regression framework that is previously inferior to the keypoint detection and grouping framework. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Zigang Geng , Ke Sun , Bin Xiao , Zhaoxiang Zhang , Jingdong Wang

Recently, human pose estimation mainly focuses on how to design a more effective and better deep network structure as human features extractor, and most designed feature extraction networks only introduce the position of each anatomical…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Zhangjian Ji , Zilong Wang , Ming Zhang , Yapeng Chen , Yuhua Qian

Pretrained language models have shown success in various areas of natural language processing, including reading comprehension tasks. However, when applying machine learning methods to new domains, labeled data may not always be available.…

Computation and Language · Computer Science 2022-06-15 Xiang Pan , Alex Sheng , David Shimshoni , Aditya Singhal , Sara Rosenthal , Avirup Sil