English
Related papers

Related papers: Beyond Prompting: An Efficient Embedding Framework…

200 papers

Open Domain Question Answering (ODQA) within natural language processing involves building systems that answer factual questions using large-scale knowledge corpora. Recent advances stem from the confluence of several factors, such as…

Computation and Language · Computer Science 2024-06-21 Akchay Srivastava , Atif Memon

Representation learning is a fundamental building block for analyzing entities in a database. While the existing embedding learning methods are effective in various data mining problems, their applicability is often limited because these…

Machine Learning · Computer Science 2020-09-24 Chin-Chia Michael Yeh , Dhruv Gelda , Zhongfang Zhuang , Yan Zheng , Liang Gou , Wei Zhang

In this work we leverage recent advances in context-sensitive language models to improve the task of query expansion. Contextualized word representation models, such as ELMo and BERT, are rapidly replacing static embedding models. We…

Information Retrieval · Computer Science 2021-03-10 Shahrzad Naseri , Jeffrey Dalton , Andrew Yates , James Allan

Embodied Question Answering (EQA) is a challenging task in embodied intelligence that requires agents to dynamically explore 3D environments, actively gather visual information, and perform multi-step reasoning to answer questions. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Kaixuan Jiang , Yang Liu , Weixing Chen , Jingzhou Luo , Ziliang Chen , Ling Pan , Guanbin Li , Liang Lin

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

Computation and Language · Computer Science 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

The rapid proliferation of Large Language Models (LLMs) has significantly contributed to the development of equitable AI systems capable of factual question-answering (QA). However, no known study tests the LLMs' robustness when presented…

Computation and Language · Computer Science 2026-03-05 Shubhra Ghosh , Abhilekh Borah , Aditya Kumar Guru , Kripabandhu Ghosh

We explore the effectiveness of an LLM-guided query refinement paradigm for extending the usability of embedding models to challenging zero-shot search and classification tasks. Our approach refines the embedding representation of a user…

Computation and Language · Computer Science 2026-05-13 Ariel Gera , Shir Ashury-Tahan , Gal Bloch , Ohad Eytan , Assaf Toledo

Open-domain complex Question Answering (QA) is a difficult task with challenges in evidence retrieval and reasoning. The complexity of such questions could stem from questions being compositional, hybrid evidence, or ambiguity in questions.…

Computation and Language · Computer Science 2024-06-26 Venktesh V. Deepali Prabhu , Avishek Anand

Open-domain question answering (OpenQA) represents a cornerstone in natural language processing (NLP), primarily focused on extracting answers from unstructured textual data. With the rapid advancements in Large Language Models (LLMs),…

Computation and Language · Computer Science 2025-10-28 Tingjia Shen , Hao Wang , Chuan Qin , Ruijun Sun , Yang Song , Defu Lian , Hengshu Zhu , Enhong Chen

Recently, there have been significant advances in neural methods for tackling knowledge-intensive tasks such as open domain question answering (QA). These advances are fueled by combining large pre-trained language models with learnable…

Computation and Language · Computer Science 2021-04-21 Hengxin Fun , Sunil Gandhi , Sujith Ravi

The performance of Open-Domain Question Answering (ODQA) retrieval systems can exhibit sub-optimal behavior, providing text excerpts with varying degrees of irrelevance. Unfortunately, many existing ODQA datasets lack examples specifically…

Computation and Language · Computer Science 2024-03-05 Rustam Abdumalikov , Pasquale Minervini , Yova Kementchedjhieva

This paper introduces a new framework for open-domain question answering in which the retriever and the reader iteratively interact with each other. The framework is agnostic to the architecture of the machine reading model, only requiring…

Computation and Language · Computer Science 2019-05-15 Rajarshi Das , Shehzaad Dhuliawala , Manzil Zaheer , Andrew McCallum

Large language models (LLMs) call for extension of context to handle many critical applications. However, the existing approaches are prone to expensive costs and inferior quality of context extension. In this work, we proposeExtensible…

Computation and Language · Computer Science 2024-02-20 Kun Luo , Zheng Liu , Shitao Xiao , Kang Liu

Open-domain Question Answering (ODQA) has achieved significant results in terms of supervised learning manner. However, data annotation cannot also be irresistible for its huge demand in an open domain. Though unsupervised QA or…

Computation and Language · Computer Science 2021-09-01 Pengfei Zhu , Xiaoguang Li , Jian Li , Hai Zhao

Despite their remarkable natural language understanding capabilities, Large Language Models (LLMs) have been underutilized for retrieval tasks. We present Search-R3, a novel framework that addresses this limitation by adapting LLMs to…

Computation and Language · Computer Science 2026-04-10 Yuntao Gui , James Cheng

Large language models (LLMs) are probabilistic in nature and perform more reliably when augmented with external information. As complex queries often require multi-step reasoning over the retrieved information, with no clear or…

Information Retrieval · Computer Science 2026-04-10 Roxana Petcu , Evangelos Kanoulas , Maarten de Rijke

This position paper proposes a systematic approach towards developing a framework to help select the most effective embedding models for natural language processing (NLP) tasks, addressing the challenge posed by the proliferation of both…

Computation and Language · Computer Science 2024-09-02 Vivek Khetan

Are traditional classification approaches irrelevant in this era of AI hype? We show that there are multiclass classification problems where predictive models holistically outperform LLM prompt-based frameworks. Given text and images from…

Machine Learning · Computer Science 2025-11-13 Marios Kokkodis , Richard Demsyn-Jones , Vijay Raghavan

Embodied Question Answering (EQA) connects perception, reasoning, and interaction within embodied environments. However, existing datasets and benchmarks remain fragmented, each focusing on a limited subset of reasoning skills such as…

Robotics · Computer Science 2026-05-26 Xicheng Gong , Qiwei Li , Peiran Xu , Yadong Mu

Large Language Models (LLMs) have demonstrated remarkable efficacy in text embedding, yet current adaptation methods like LoRA face significant bottlenecks in computational efficiency and cross-architecture transferability. Whenever a new…

Computation and Language · Computer Science 2026-05-28 Yu-Che Tsai , Kuan-Yu Chen , Yuan-Hao Chen , Yu-Han Chang , Ching-Yu Tsai , Yu-Hsiang Chuang , Shou-De Lin