中文
相关论文

相关论文: Boot and Switch: Alternating Distillation for Zero…

200 篇论文

Learning to search is the task of building artificial agents that learn to autonomously use a search box to find information. So far, it has been shown that current language models can learn symbolic query reformulation policies, in…

计算与语言 · 计算机科学 2023-03-30 Michelle Chen Huebscher , Christian Buck , Massimiliano Ciaramita , Sascha Rothe

Many software engineering tasks, such as testing, and anomaly detection can benefit from the ability to infer a behavioral model of the software.Most existing inference approaches assume access to code to collect execution sequences. In…

机器学习 · 计算机科学 2021-10-13 Foozhan Ataiefard , Mohammad Jafar Mashhadi , Hadi Hemmati , Niel Walkinshaw

Many active learning and search approaches are intractable for large-scale industrial settings with billions of unlabeled examples. Existing approaches search globally for the optimal examples to label, scaling linearly or even…

Humans can perform unseen tasks by recalling relevant skills acquired previously and then generalizing them to the target tasks, even if there is no supervision at all. In this paper, we aim to improve this kind of cross-task generalization…

计算与语言 · 计算机科学 2022-10-19 Bill Yuchen Lin , Kangmin Tan , Chris Miller , Beiwen Tian , Xiang Ren

Deep neural networks often make decisions based on the spurious correlations inherent in the dataset, failing to generalize in an unbiased data distribution. Although previous approaches pre-define the type of dataset bias to prevent the…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Eungyeup Kim , Jihyeon Lee , Jaegul Choo

Few-shot Continual Relation Extraction is a crucial challenge for enabling AI systems to identify and adapt to evolving relationships in dynamic real-world domains. Traditional memory-based approaches often overfit to limited samples,…

计算与语言 · 计算机科学 2025-03-03 Nguyen Xuan Thanh , Anh Duc Le , Quyen Tran , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

This paper describes a compact and effective model for low-latency passage retrieval in conversational search based on learned dense representations. Prior to our work, the state-of-the-art approach uses a multi-stage pipeline comprising…

信息检索 · 计算机科学 2021-11-30 Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin

Vision-language foundation models have been incredibly successful in a wide range of downstream computer vision tasks using adaptation methods. However, due to the high cost of obtaining pre-training datasets, pairs with weak image-text…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Wenshuo Peng , Kaipeng Zhang , Yue Yang , Hao Zhang , Yu Qiao

Unsupervised domain adaptation generalizes neural retrievers to an unseen domain by generating pseudo queries on target domain documents. The quality and efficiency of this adaptation critically depend on which documents are selected for…

信息检索 · 计算机科学 2026-04-29 Jongyoon Kim , Minseong Hwang , Seung-won Hwang

Recently, cross domain transfer has been applied for unsupervised image restoration tasks. However, directly applying existing frameworks would lead to domain-shift problems in translated images due to lack of effective supervision.…

计算机视觉与模式识别 · 计算机科学 2020-03-31 Wenchao Du , Hu Chen , Hongyu Yang

Retrieve-and-rerank is a prevalent framework in neural information retrieval, wherein a bi-encoder network initially retrieves a pre-defined number of candidates (e.g., K=100), which are then reranked by a more powerful cross-encoder model.…

While dense retrieval has been shown effective and efficient across tasks and languages, it remains difficult to create effective fully zero-shot dense retrieval systems when no relevance label is available. In this paper, we recognize the…

信息检索 · 计算机科学 2022-12-21 Luyu Gao , Xueguang Ma , Jimmy Lin , Jamie Callan

Semi-supervised learning (SSL) methods assume that labeled data, unlabeled data and test data are from the same distribution. Open-set semi-supervised learning (Open-set SSL) considers a more practical scenario, where unlabeled data and…

机器学习 · 计算机科学 2024-04-16 Yang Yu , Danruo Deng , Furui Liu , Yueming Jin , Qi Dou , Guangyong Chen , Pheng-Ann Heng

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

机器学习 · 计算机科学 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

This work addresses the unsupervised adaptation of an existing object detector to a new target domain. We assume that a large number of unlabeled videos from this domain are readily available. We automatically obtain labels on the target…

计算机视觉与模式识别 · 计算机科学 2019-04-17 Aruni RoyChowdhury , Prithvijit Chakrabarty , Ashish Singh , SouYoung Jin , Huaizu Jiang , Liangliang Cao , Erik Learned-Miller

Building dense retrievers requires a series of standard procedures, including training and validating neural models and creating indexes for efficient search. However, these procedures are often misaligned in that training objectives do not…

计算与语言 · 计算机科学 2022-10-26 Gyuwan Kim , Jinhyuk Lee , Barlas Oguz , Wenhan Xiong , Yizhe Zhang , Yashar Mehdad , William Yang Wang

Dense retrieval (DR) has the potential to resolve the query understanding challenge in conversational search by matching in the learned embedding space. However, this adaptation is challenging due to DR models' extra needs for supervision…

信息检索 · 计算机科学 2021-05-20 Shi Yu , Zhenghao Liu , Chenyan Xiong , Tao Feng , Zhiyuan Liu

Large amounts of labeled training data are one of the main contributors to the great success that deep models have achieved in the past. Label acquisition for tasks other than benchmarks can pose a challenge due to requirements of both…

计算机视觉与模式识别 · 计算机科学 2020-01-22 Clemens-Alexander Brust , Christoph Käding , Joachim Denzler

3D object detection networks tend to be biased towards the data they are trained on. Evaluation on datasets captured in different locations, conditions or sensors than that of the training (source) data results in a drop in model…

计算机视觉与模式识别 · 计算机科学 2021-12-02 Deepti Hegde , Vishal M. Patel

Basis pursuit is a compressed sensing optimization in which the l1-norm is minimized subject to model error constraints. Here we use a deep neural network prior instead of l1-regularization. Using known noise statistics, we jointly learn…

信号处理 · 电气工程与系统科学 2020-02-18 Jonathan I. Tamir , Stella X. Yu , Michael Lustig