English
Related papers

Related papers: Can Old TREC Collections Reliably Evaluate Modern …

200 papers

We introduce Train/Test-Time Adaptation with Retrieval (${\rm T^3AR}$), a method to adapt models both at train and test time by means of a retrieval module and a searchable pool of external samples. Before inference, ${\rm T^3AR}$ adapts a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Luca Zancato , Alessandro Achille , Tian Yu Liu , Matthew Trager , Pramuditha Perera , Stefano Soatto

Various work has suggested that the memorability of an image is consistent across people, and thus can be treated as an intrinsic property of an image. Using computer vision models, we can make specific predictions about what people will…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Coen D. Needell , Wilma A. Bainbridge

Much of the information processed by Information Retrieval (IR) systems is unreliable, biased, and generally untrustworthy [1], [2], [3]. Yet, factuality & objectivity detection is not a standard component of IR systems, even though it has…

Information Retrieval · Computer Science 2016-10-11 Christina Lioma , Birger Larsen , Wei Lu , Yong Huang

Reusing existing neural-network components is central to research efficiency, yet discovering, extracting, and validating such modules across thousands of open-source repositories remains difficult. We introduce NN-RAG, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Waleed Khalid , Dmitry Ignatov , Radu Timofte

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm to enhance large language models (LLMs) by conditioning generation on external evidence retrieved at inference time. While RAG addresses critical limitations of…

Information Retrieval · Computer Science 2025-06-03 Chaitanya Sharma

Research must be reproducible in order to make an impact on science and to contribute to the body of knowledge in our field. Yet studies have shown that 70% of research from academic labs cannot be reproduced. In software engineering, and…

Software Engineering · Computer Science 2018-04-10 Clinton Woodson , Jane Huffman Hayes , Sarah Griffioen

Multi-step reasoning remains a key challenge for Large Language Models (LLMs), particularly in complex domains such as mathematics and creative writing. While recent approaches including ReAct, Reflexion, and Self-Refine improve reasoning…

Artificial Intelligence · Computer Science 2026-01-07 Abhishek HS , Pavan C Shekar , Arpit Jain , Ashwanth Krishnan

Test-Time Scaling enhances the reasoning capabilities of Large Language Models by allocating additional inference compute to broaden the exploration of the solution space. However, existing search strategies typically treat rollouts as…

Computation and Language · Computer Science 2026-05-06 Xinglin Wang , Jiayi Shi , Shaoxiong Feng , Peiwen Yuan , Yiwei Li , Yueqi Zhang , Chuyi Tan , Ji Zhang , Boyuan Pan , Yao Hu , Kan Li

Measuring advances in retrieval requires test collections with relevance judgments that can faithfully distinguish systems. This paper presents NeuCLIRTech, an evaluation collection for cross-language retrieval over technical information.…

Information Retrieval · Computer Science 2026-02-06 Dawn Lawrie , James Mayfield , Eugene Yang , Andrew Yates , Sean MacAvaney , Ronak Pradeep , Scott Miller , Paul McNamee , Luca Soldaini

To address catastrophic forgetting in Continual Relation Extraction (CRE), many current approaches rely on memory buffers to rehearse previously learned knowledge while acquiring new tasks. Recently, prompt-based methods have emerged as…

Computation and Language · Computer Science 2025-01-22 Minh Le , Tien Ngoc Luu , An Nguyen The , Thanh-Thien Le , Trang Nguyen , Tung Thanh Nguyen , Linh Ngo Van , Thien Huu Nguyen

Neural collaborative filtering is the state of art field in the recommender systems area; it provides some models that obtain accurate predictions and recommendations. These models are regression-based, and they just return rating…

Information Retrieval · Computer Science 2024-10-28 Jesús Bobadilla , Abraham Gutiérrez , Santiago Alonso , Ángel González-Prieto

Large decoder-only language models (LMs) can be largely improved in terms of perplexity by retrieval (e.g., RETRO), but its impact on text generation quality and downstream task accuracy is unclear. Thus, it is still an open question: shall…

Computation and Language · Computer Science 2023-12-22 Boxin Wang , Wei Ping , Peng Xu , Lawrence McAfee , Zihan Liu , Mohammad Shoeybi , Yi Dong , Oleksii Kuchaiev , Bo Li , Chaowei Xiao , Anima Anandkumar , Bryan Catanzaro

Training autoregressive models to better predict under the test metric, instead of maximizing the likelihood, has been reported to be beneficial in several use cases but brings additional complications, which prevent wider adoption. In this…

Machine Learning · Computer Science 2019-12-10 Irina Saparina , Anton Osokin

Many modern sequential recommender systems use deep neural networks, which can effectively estimate the relevance of items but require a lot of time to train. Slow training increases expenses, hinders product development timescales and…

Information Retrieval · Computer Science 2022-07-18 Aleksandr Petrov , Craig Macdonald

As predictive models are increasingly being deployed in high-stakes decision making (e.g., loan approvals), there has been growing interest in post hoc techniques which provide recourse to affected individuals. These techniques generate…

Machine Learning · Computer Science 2021-07-14 Sohini Upadhyay , Shalmali Joshi , Himabindu Lakkaraju

Clarification questions help conversational search systems resolve ambiguous or underspecified user queries. While prior work has focused on fluency and alignment with user intent, especially through facet extraction, much less attention…

Computation and Language · Computer Science 2026-01-21 Ahmed Rayane Kebir , Vincent Guigue , Lynda Said Lhadj , Laure Soulier

Despite the success of large language models (LLMs) in various natural language processing (NLP) tasks, the stored knowledge in these models may inevitably be incomplete, out-of-date, or incorrect. This motivates the need to utilize…

Computation and Language · Computer Science 2023-01-03 Hangfeng He , Hongming Zhang , Dan Roth

Can we take a recurrent neural network (RNN) trained to translate between languages and augment it to support a new natural language without retraining the model from scratch? Can we fix the faulty behavior of the RNN by replacing portions…

Software Engineering · Computer Science 2023-02-10 Sayem Mohammad Imtiaz , Fraol Batole , Astha Singh , Rangeet Pan , Breno Dantas Cruz , Hridesh Rajan

The goal of data attribution is to trace model predictions back to training data. Despite a long line of work towards this goal, existing approaches to data attribution tend to force users to choose between computational tractability and…

Machine Learning · Statistics 2023-04-04 Sung Min Park , Kristian Georgiev , Andrew Ilyas , Guillaume Leclerc , Aleksander Madry

Deep Learning and Machine Learning based models have become extremely popular in text processing and information retrieval. However, the non-linear structures present inside the networks make these models largely inscrutable. A significant…

Information Retrieval · Computer Science 2026-03-12 Sourav Saha , Debapriyo Majumdar , Mandar Mitra