English
Related papers

Related papers: Synthetic Target Domain Supervision for Open Retri…

200 papers

Semi-supervised domain adaptation (SSDA) aims to adapt models trained from a labeled source domain to a different but related target domain, from which unlabeled data and a small set of labeled data are provided. Current methods that treat…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Luyu Yang , Yan Wang , Mingfei Gao , Abhinav Shrivastava , Kilian Q. Weinberger , Wei-Lun Chao , Ser-Nam Lim

Multi-source domain adaptation (MDA) aims to transfer knowledge from multiple source domains to an unlabeled target domain. MDA is a challenging task due to the severe domain shift, which not only exists between target and source but also…

Machine Learning · Computer Science 2022-02-23 Ren Chuan-Xian , Liu Yong-Hui , Zhang Xi-Wen , Huang Ke-Kun

In real-world applications, deep learning models often run in non-stationary environments where the target data distribution continually shifts over time. There have been numerous domain adaptation (DA) methods in both online and offline…

Machine Learning · Computer Science 2023-03-13 Chenxi Liu , Lixu Wang , Lingjuan Lyu , Chen Sun , Xiao Wang , Qi Zhu

State-of-the-art neural rankers pre-trained on large task-specific training data such as MS-MARCO, have been shown to exhibit strong performance on various ranking tasks without domain adaptation, also called zero-shot. However, zero-shot…

Information Retrieval · Computer Science 2024-04-04 Ramraj Chandradevan , Kaustubh D. Dhole , Eugene Agichtein

Pre-trained language models have been successful in many knowledge-intensive NLP tasks. However, recent work has shown that models such as BERT are not ``structurally ready'' to aggregate textual information into a [CLS] vector for dense…

Information Retrieval · Computer Science 2023-05-26 Sheng-Chieh Lin , Minghan Li , Jimmy Lin

We introduce DAS (Domain Adaptation with Synthetic data), a novel domain adaptation framework for pre-trained ASR model, designed to efficiently adapt to various language-defined domains without requiring any real data. In particular, DAS…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Minh Tran , Yutong Pang , Debjyoti Paul , Laxmi Pandey , Kevin Jiang , Jinxi Guo , Ke Li , Shun Zhang , Xuedong Zhang , Xin Lei

In object detection, unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. However, UDA's reliance on labeled source data restricts its adaptability in privacy-related…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Trinh Le Ba Khanh , Huy-Hung Nguyen , Long Hoang Pham , Duong Nguyen-Ngoc Tran , Jae Wook Jeon

Continual Test-Time Adaptation (CTTA) seeks to adapt source pre-trained models to continually changing, unseen target domains. While existing CTTA methods assume structured domain changes with uniform durations, real-world environments…

Machine Learning · Computer Science 2025-06-09 Yunbei Zhang , Akshay Mehra , Shuaicheng Niu , Jihun Hamm

Large language models (LLMs) are highly sensitive to even small amounts of unsafe training data, making effective detection and filtering essential for trustworthy model development. Current state-of-the-art (SOTA) detection approaches…

Machine Learning · Computer Science 2025-10-13 Yijun Pan , Taiwei Shi , Jieyu Zhao , Jiaqi W. Ma

Retrieval-augmented models have proven to be effective in natural language processing tasks, yet there remains a lack of research on their optimization using variational inference. We introduce the Variational Open-Domain (VOD) framework…

Computation and Language · Computer Science 2023-06-01 Valentin Liévin , Andreas Geert Motzfeldt , Ida Riis Jensen , Ole Winther

Signal classification models based on deep neural networks are typically trained on datasets collected under controlled conditions, either simulated or over-the-air (OTA), which are constrained to specific channel environments with limited…

Computational Engineering, Finance, and Science · Computer Science 2025-10-02 Mohammad Ali , Fuhao Li , Jielun Zhang

The information retrieval community has recently witnessed a revolution due to large pretrained transformer models. Another key ingredient for this revolution was the MS MARCO dataset, whose scale and diversity has enabled zero-shot…

Computation and Language · Computer Science 2022-02-11 Luiz Bonifacio , Hugo Abonizio , Marzieh Fadaee , Rodrigo Nogueira

Unsupervised Domain Adaptation (UDA) can tackle the challenge that convolutional neural network(CNN)-based approaches for semantic segmentation heavily rely on the pixel-level annotated data, which is labor-intensive. However, existing UDA…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yuang Liu , Wei Zhang , Jun Wang

Neural information retrieval requires costly annotated data for each target domain to be competitive. Synthetic annotation by query generation using Large Language Models or rule-based string manipulation has been proposed as an…

Computation and Language · Computer Science 2023-10-17 Carlos Dominguez , Jon Ander Campos , Eneko Agirre , Gorka Azkune

Task-oriented semantic parsing is a critical component of virtual assistants, which is responsible for understanding the user's intents (set reminder, play music, etc.). Recent advances in deep learning have enabled several approaches to…

Computation and Language · Computer Science 2020-10-08 Xilun Chen , Asish Ghoshal , Yashar Mehdad , Luke Zettlemoyer , Sonal Gupta

Passage retrieval addresses the problem of locating relevant passages, usually from a large corpus, given a query. In practice, lexical term-matching algorithms like BM25 are popular choices for retrieval owing to their efficiency. However,…

Information Retrieval · Computer Science 2020-09-23 Davis Liang , Peng Xu , Siamak Shakeri , Cicero Nogueira dos Santos , Ramesh Nallapati , Zhiheng Huang , Bing Xiang

Deep learning models in computational pathology often fail to generalize across cohorts and institutions due to domain shift. Existing approaches either fail to leverage unlabeled data from the target domain or rely on image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tengyue Zhang , Ruiwen Ding , Luoting Zhuang , Yuxiao Wu , Erika F. Rodriguez , William Hsu

BERT-based re-ranking and dense retrieval (DR) systems have been shown to improve search effectiveness for spoken content retrieval (SCR). However, both methods can still show a reduction in effectiveness when using ASR transcripts in…

Information Retrieval · Computer Science 2023-01-18 Yasufumi Moriya , Gareth. J. F. Jones

This paper investigates synthetic data generation strategies in developing generative retrieval models for domain-specific corpora, thereby addressing the scalability challenges inherent in manually annotating in-domain queries. We study…

Computation and Language · Computer Science 2025-02-26 Haoyang Wen , Jiang Guo , Yi Zhang , Jiarong Jiang , Zhiguo Wang

Dialogue State Tracking (DST), a crucial component of task-oriented dialogue (ToD) systems, keeps track of all important information pertaining to dialogue history: filling slots with the most probable values throughout the conversation.…

Computation and Language · Computer Science 2023-02-28 Han Zhou , Ignacio Iacobacci , Pasquale Minervini