English
Related papers

Related papers: Dense Retrieval as Indirect Supervision for Large-…

200 papers

We propose a framework for learning calibrated uncertainties under domain shifts, where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts via a differentiable density ratio…

Machine Learning · Computer Science 2024-02-07 Haoxuan Wang , Zhiding Yu , Yisong Yue , Anima Anandkumar , Anqi Liu , Junchi Yan

Inverse reinforcement learning (IRL) and dynamic discrete choice (DDC) models explain sequential decision-making by recovering reward functions that rationalize observed behavior. Flexible IRL methods typically rely on machine learning but…

Machine Learning · Computer Science 2026-01-01 Lars van der Laan , Aurelien Bibaut , Nathan Kallus

The challenge in fine-grained visual categorization lies in how to explore the subtle differences between different subclasses and achieve accurate discrimination. Previous research has relied on large-scale annotated data and pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Tianxu Wu , Shuo Ye , Shuhuang Chen , Qinmu Peng , Xinge You

Data augmentation is an effective way to diversify corpora in machine translation, but previous methods may introduce semantic inconsistency between original and augmented data because of irreversible operations and random subword sampling…

Computation and Language · Computer Science 2025-02-21 Jiashu Yao , Heyan Huang , Zeming Liu , Yuhang Guo

Deep learning models for vision tasks are trained on large datasets under the assumption that there exists a universal representation that can be used to make predictions for all samples. Whereas high complexity models are proven to be…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Botos Csaba , Adel Bibi , Yanwei Li , Philip Torr , Ser-Nam Lim

Advancements in deep learning are revolutionizing science and engineering. The immense success of deep learning is largely due to its ability to extract essential high-dimensional (HD) features from input data and make inference decisions…

Machine Learning · Computer Science 2025-01-30 Md Tauhidul Islam , Lei Xing

Based on its great successes in inference and denosing tasks, Dictionary Learning (DL) and its related sparse optimization formulations have garnered a lot of research interest. While most solutions have focused on single layer…

Machine Learning · Computer Science 2021-04-22 Wen Tang , Emilie Chouzenoux , Jean-Christophe Pesquet , Hamid Krim

Large Language Models (LLMs) often generate inaccurate responses (hallucinations) when faced with questions beyond their knowledge scope. Retrieval-Augmented Generation (RAG) addresses this by leveraging external knowledge, but a critical…

Information Retrieval · Computer Science 2025-09-10 Haoxiang Jin , Ronghan Li , Zixiang Lu , Qiguang Miao

Reasoning tasks are crucial in many domains, especially in science and engineering. Although large language models (LLMs) have made progress in reasoning tasks using techniques such as chain-of-thought and least-to-most prompting, these…

Artificial Intelligence · Computer Science 2025-05-06 Sergio Hernández-Gutiérrez , Minttu Alakuijala , Alexander V. Nikitin , Pekka Marttinen

Neural Encoders are frequently used in the NLP domain to perform dense retrieval tasks, for instance, to generate the candidate documents for a given query in question-answering tasks. However, sparse annotation and label noise in the…

Machine Learning · Computer Science 2025-12-16 Arnab Sharma

Conventional feature selection algorithms applied to Pseudo Time-Series (PTS) data, which consists of observations arranged in sequential order without adhering to a conventional temporal dimension, often exhibit impractical computational…

Machine Learning · Computer Science 2024-03-14 Mohammad Rahman , Manzur Murshed , Shyh Wei Teng , Manoranjan Paul

Function calling agents powered by Large Language Models (LLMs) select external tools to automate complex tasks. On-device agents typically use a retrieval module to select relevant tools, improving performance and reducing context length.…

Machine Learning · Computer Science 2026-04-20 Bhrij Patel , Davide Belli , Amir Jalalirad , Maximilian Arnold , Aleksandr Ermolov , Bence Major

Passage retrieval and ranking is a key task in open-domain question answering and information retrieval. Current effective approaches mostly rely on pre-trained deep language model-based retrievers and rankers. These methods have been shown…

Information Retrieval · Computer Science 2021-09-14 Shengyao Zhuang , Guido Zuccon

Large language models (LLMs) have demonstrated significant potential in enhancing dense retrieval through query augmentation. However, most existing methods treat the LLM and the retriever as separate modules, overlooking the alignment…

Information Retrieval · Computer Science 2025-05-30 Sijia Yao , Pengcheng Huang , Zhenghao Liu , Yu Gu , Yukun Yan , Shi Yu , Ge Yu

Data dimension reduction (DDR) is all about mapping data from high dimensions to low dimensions, various techniques of DDR are being used for image dimension reduction like Random Projections, Principal Component Analysis (PCA), the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Wisal Khan , Muhammad Turab , Waqas Ahmad , Syed Hasnat Ahmad , Kelash Kumar , Bin Luo

This study addresses the hallucination problem in large language models (LLMs). We adopted Retrieval-Augmented Generation(RAG) (Lewis et al., 2020), a technique that involves embedding relevant information in the prompt to obtain accurate…

Computation and Language · Computer Science 2024-05-24 Juhwan Lee , Jisu Kim

Building dense retrievers requires a series of standard procedures, including training and validating neural models and creating indexes for efficient search. However, these procedures are often misaligned in that training objectives do not…

Computation and Language · Computer Science 2022-10-26 Gyuwan Kim , Jinhyuk Lee , Barlas Oguz , Wenhan Xiong , Yizhe Zhang , Yashar Mehdad , William Yang Wang

Deep neural networks (DNNs) have achieved remarkable success across diverse domains, but their performance can be severely degraded by noisy or corrupted training data. Conventional noise mitigation methods often rely on explicit…

Machine Learning · Computer Science 2025-06-16 Deliang Jin , Gang Chen , Shuo Feng , Yufeng Ling , Haoran Zhu

Uncertainty estimation is a crucial aspect of deploying dependable deep learning models in safety-critical systems. In this study, we introduce a novel and efficient method for deterministic uncertainty estimation called Discriminant…

Machine Learning · Computer Science 2024-02-21 Jiaxin Zhang , Kamalika Das , Sricharan Kumar

Retrieval-augmented in-context learning has emerged as a powerful approach for addressing knowledge-intensive tasks using frozen language models (LM) and retrieval models (RM). Existing work has combined these in simple "retrieve-then-read"…

Computation and Language · Computer Science 2023-01-24 Omar Khattab , Keshav Santhanam , Xiang Lisa Li , David Hall , Percy Liang , Christopher Potts , Matei Zaharia