English
Related papers

Related papers: Boot and Switch: Alternating Distillation for Zero…

200 papers

In continual learning, a model learns incrementally over time while minimizing interference between old and new tasks. One of the most widely used approaches in continual learning is referred to as replay. Replay methods support interleaved…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Truman Hickok , Dhireesha Kudithipudi

Dense retrievers have achieved state-of-the-art performance in various information retrieval tasks, but their robustness against tokenizer poisoning remains underexplored. In this work, we assess the vulnerability of dense retrieval systems…

Computation and Language · Computer Science 2024-10-29 Ming Zhong , Zhizhi Wu , Nanako Honda

Semantic segmentation has a broad range of applications, but its real-world impact has been significantly limited by the prohibitive annotation costs necessary to enable deployment. Segmentation methods that forgo supervision can side-step…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Gyungin Shin , Weidi Xie , Samuel Albanie

We aim at the problem named One-Shot Unsupervised Domain Adaptation. Unlike traditional Unsupervised Domain Adaptation, it assumes that only one unlabeled target sample can be available when learning to adapt. This setting is realistic but…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yawei Luo , Ping Liu , Tao Guan , Junqing Yu , Yi Yang

Text compression has diverse applications such as Summarization, Reading Comprehension and Text Editing. However, almost all existing approaches require either hand-crafted features, syntactic labels or parallel data. Even for one that…

Computation and Language · Computer Science 2019-09-10 Tong Niu , Caiming Xiong , Richard Socher

In zero-shot image retrieval (ZSIR) task, embedding learning becomes more attractive, however, many methods follow the traditional metric learning idea and omit the problems behind zero-shot settings. In this paper, we first emphasize the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Binghui Chen , Weihong Deng

Large language models are highly sensitive to prompt wording. However, popular automatic prompt search methods, including InstructZero, often degrade under distribution shift and adversarial evaluation because they optimize expected…

Machine Learning · Computer Science 2025-10-20 Yangyang Li

Dense embeddings deliver strong retrieval performance but often lack interpretability and controllability. This paper introduces a novel approach using sparse autoencoders (SAE) to interpret and control dense embeddings via the learned…

Information Retrieval · Computer Science 2025-02-25 Hao Kang , Tevin Wang , Chenyan Xiong

Unsupervised active learning has attracted increasing attention in recent years, where its goal is to select representative samples in an unsupervised setting for human annotating. Most existing works are based on shallow linear models by…

Machine Learning · Computer Science 2020-07-29 Changsheng Li , Handong Ma , Zhao Kang , Ye Yuan , Xiao-Yu Zhang , Guoren Wang

A supervised ranking model, despite its advantage of being effective, usually involves complex processing - typically multiple stages of task-specific pre-training and fine-tuning. This has motivated researchers to explore simpler pipelines…

Information Retrieval · Computer Science 2024-10-08 Nilanjan Sinhababu , Andrew Parry , Debasis Ganguly , Debasis Samanta , Pabitra Mitra

Text style transfer is an important task in controllable language generation. Supervised approaches have pushed performance improvement on style-oriented rewriting such as formality conversion. However, challenges remain due to the scarcity…

Computation and Language · Computer Science 2022-05-20 Zhengyuan Liu , Nancy F. Chen

Large-scale labeled training datasets have enabled deep neural networks to excel on a wide range of benchmark vision tasks. However, in many applications it is prohibitively expensive or time-consuming to obtain large quantities of labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sicheng Zhao , Bichen Wu , Joseph Gonzalez , Sanjit A. Seshia , Kurt Keutzer

A recent advancement in the domain of biomedical Entity Linking is the development of powerful two-stage algorithms, an initial candidate retrieval stage that generates a shortlist of entities for each mention, followed by a candidate…

Machine Learning · Computer Science 2023-02-01 Maciej Wiatrak , Eirini Arvaniti , Angus Brayne , Jonas Vetterle , Aaron Sim

Unsupervised style transfer models are mainly based on an inductive learning approach, which represents the style as embeddings, decoder parameters, or discriminator parameters and directly applies these general rules to the test cases.…

Computation and Language · Computer Science 2021-09-17 Fei Xiao , Liang Pang , Yanyan Lan , Yan Wang , Huawei Shen , Xueqi Cheng

Language models can be viewed as functions that embed text into Euclidean space, where the quality of the embedding vectors directly determines model performance, training such neural networks involves various uncertainties. This paper…

Computation and Language · Computer Science 2025-03-31 Yifei Duan , Raphael Shang , Deng Liang , Yongqiang Cai

Large language models show impressive results on few-shot NLP tasks. However, these models are memory and computation-intensive. Meta-training allows one to leverage smaller models for few-shot generalization in a domain-general and…

Computation and Language · Computer Science 2023-07-04 Aaron Mueller , Kanika Narang , Lambert Mathias , Qifan Wang , Hamed Firooz

For object detection, it is possible to view the prediction of bounding boxes as a reverse diffusion process. Using a diffusion model, the random bounding boxes are iteratively refined in a denoising step, conditioned on the image. We…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Leander van den Heuvel , Gertjan Burghouts , David W. Zhang , Gwenn Englebienne , Sabina B. van Rooij

Although deep networks have significantly increased the performance of visual recognition methods, it is still challenging to achieve the robustness across visual domains that is necessary for real-world applications. To tackle this issue,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Antonio D'Innocente , Silvia Bucci , Barbara Caputo , Tatiana Tommasi

In the literature, coarse-to-fine or scale-recurrent approach i.e. progressively restoring a clean image from its low-resolution versions has been successfully employed for single image deblurring. However, a major disadvantage of existing…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Praveen Kandula , Rajagopalan. A. N

Due to domain bias, directly deploying a deep person re-identification (re-ID) model trained on one dataset often achieves considerably poor accuracy on another dataset. In this paper, we propose an Adaptive Exploration (AE) method to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Yuhang Ding , Hehe Fan , Mingliang Xu , Yi Yang