中文
相关论文

相关论文: Variational Pretraining for Semi-supervised Text C…

200 篇论文

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in terms of energy and…

计算机视觉与模式识别 · 计算机科学 2022-09-20 Yoshitomo Matsubara , Ruihan Yang , Marco Levorato , Stephan Mandt

Contrastive Language-Image Pre-training (CLIP) has drawn increasing attention recently for its transferable visual representation learning. However, due to the semantic gap within datasets, CLIP's pre-trained image-text alignment becomes…

计算机视觉与模式识别 · 计算机科学 2023-08-11 Longtian Qiu , Renrui Zhang , Ziyu Guo , Ziyao Zeng , Zilu Guo , Yafeng Li , Guangnan Zhang

Active learning aims to alleviate the amount of labor involved in data labeling by automating the selection of unlabeled samples via an acquisition function. For example, variational adversarial active learning (VAAL) leverages an…

机器学习 · 计算机科学 2024-08-26 Zongyao Lyu , William J. Beksi

Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component,…

计算机视觉与模式识别 · 计算机科学 2020-08-21 Weijie Chen , Shiliang Pu , Di Xie , Shicai Yang , Yilu Guo , Luojun Lin

Self-supervised learning (SSL) has emerged as a central paradigm for training foundation models by leveraging large-scale unlabeled datasets, often producing representations with strong generalization capabilities. These models are…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Brown Ebouky , Ajad Chhatkuli , Cristiano Malossi , Christoph Studer , Roy Assaf , Andrea Bartezzaghi

Recent advances in unsupervised representation learning have demonstrated the impact of pretraining on large amounts of read speech. We adapt these techniques for domain adaptation in low-resource -- both in terms of data and compute --…

计算与语言 · 计算机科学 2022-02-14 Chak-Fai Li , Francis Keith , William Hartmann , Matthew Snover

Conventional multi-source domain few-shot adaptation (MFDA) faces the challenge of further reducing the load on edge-side devices in low-resource scenarios. Considering the native language-supervised advantage of CLIP and the plug-and-play…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Kuanghong Liu , Jin Wang , Kangjian He , Dan Xu , Xuejie Zhang

Support vector machine (SVM) is a popular classifier known for accuracy, flexibility, and robustness. However, its intensive computation has hindered its application to large-scale datasets. In this paper, we propose a new optimal leverage…

统计方法学 · 统计学 2023-08-25 Yixin Han , Jun Yu , Nan Zhang , Cheng Meng , Ping Ma , Wenxuan Zhong , Changliang Zou

In this work, we focus on the task of weakly supervised affordance grounding, where a model is trained to identify affordance regions on objects using human-object interaction images and egocentric object images without dense labels.…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Peiran Xu , Yadong Mu

Despite the impressive improvements achieved by unsupervised deep neural networks in computer vision and NLP tasks, such improvements have not yet been observed in ranking for information retrieval. The reason may be the complexity of the…

信息检索 · 计算机科学 2017-05-30 Mostafa Dehghani , Hamed Zamani , Aliaksei Severyn , Jaap Kamps , W. Bruce Croft

In this work we address the problem of transferring knowledge obtained from a vast annotated source domain to a low labeled target domain. We propose Adversarial Variational Domain Adaptation (AVDA), a semi-supervised domain adaptation…

Sparse document representations have been widely used to retrieve relevant documents via exact lexical matching. Owing to the pre-computed inverted index, it supports fast ad-hoc search but incurs the vocabulary mismatch problem. Although…

信息检索 · 计算机科学 2023-10-06 Eunseong Choi , Sunkyung Lee , Minjin Choi , Hyeseon Ko , Young-In Song , Jongwuk Lee

Document layout comprises both structural and visual (eg. font-sizes) information that is vital but often ignored by machine learning models. The few existing models which do use layout information only consider textual contents, and…

计算与语言 · 计算机科学 2021-04-20 Te-Lin Wu , Cheng Li , Mingyang Zhang , Tao Chen , Spurthi Amba Hombaiah , Michael Bendersky

Text classification must sometimes be applied in a low-resource language with no labeled training data. However, training data may be available in a related language. We investigate whether character-level knowledge transfer from a related…

计算与语言 · 计算机科学 2020-04-29 Mozhi Zhang , Yoshinari Fujinuma , Jordan Boyd-Graber

Poor sample efficiency is a major limitation of deep reinforcement learning in many domains. This work presents an attention-based method to project neural network inputs into an efficient representation space that is invariant under…

机器学习 · 计算机科学 2020-03-23 John Mern , Dorsa Sadigh , Mykel J. Kochenderfer

This paper proposes a learning-based video compression framework for variable-rate coding on YUV 4:2:0 content. Most existing learning-based video compression models adopt the traditional hybrid-based coding architecture, which involves…

图像与视频处理 · 电气工程与系统科学 2022-10-18 Yung-Han Ho , Chih-Hsuan Lin , Peng-Yu Chen , Mu-Jung Chen , Chih-Peng Chang , Wen-Hsiao Peng , Hsueh-Ming Hang

Large-scale vision-language pre-trained (VLP) models (e.g., CLIP) are renowned for their versatility, as they can be applied to diverse applications in a zero-shot setup. However, when these models are used in specific domains, their…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Anh-Quan Cao , Maximilian Jaritz , Matthieu Guillaumin , Raoul de Charette , Loris Bazzani

Instance segmentation is a fundamental task in computer vision with broad applications across various industries. In recent years, with the proliferation of deep learning and artificial intelligence applications, how to train effective…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Chih-Chung Hsu , Chia-Ming Lee , Ming-Shyen Wu

The divergence between labeled training data and unlabeled testing data is a significant challenge for recent deep learning models. Unsupervised domain adaptation (UDA) attempts to solve such a problem. Recent works show that self-training…

计算机视觉与模式识别 · 计算机科学 2020-08-28 Ke Mei , Chuang Zhu , Jiaqi Zou , Shanghang Zhang

Large-scale weakly supervised product retrieval is a practically useful yet computationally challenging problem. This paper introduces a novel solution for the eBay Visual Search Challenge (eProduct) held at the Ninth Workshop on…

计算机视觉与模式识别 · 计算机科学 2022-08-02 Xiao Han , Kam Woh Ng , Sauradip Nag , Zhiyu Qu