English
Related papers

Related papers: No Dataset Needed for Downstream Knowledge Benchma…

200 papers

We explore the use of long-context capabilities in large language models to create synthetic reading comprehension data from entire books. Previous efforts to construct such datasets relied on crowd-sourcing, but the emergence of…

A plethora of sentence embedding models makes it challenging to choose one, especially for technical domains rich with specialized vocabulary. In this work, we domain adapt embeddings using telecom data for question answering. We evaluate…

The recent success of generative AI highlights the crucial role of high-quality human feedback in building trustworthy AI systems. However, the increasing use of large language models (LLMs) by crowdsourcing workers poses a significant…

Artificial Intelligence · Computer Science 2025-11-07 Yichi Zhang , Jinlong Pang , Zhaowei Zhu , Yang Liu

In the realm of Large Language Model (LLM) functionalities, providing reliable information is paramount, yet reports suggest that LLM outputs lack consistency. This inconsistency, often at-tributed to randomness in token sampling,…

Computation and Language · Computer Science 2024-10-22 Yanggyu Lee , Jihie Kim

Large language models (LLMs) have grown in popularity due to their natural language interface and pre trained knowledge, leading to rapidly increasing success in question-answering (QA) tasks. More recently, multi-agent systems with…

Machine Learning · Computer Science 2024-10-21 Bhrij Patel , Vishnu Sashank Dorbala , Amrit Singh Bedi , Dinesh Manocha

Multiple-choice question (MCQ) benchmarks have been a standard evaluation practice for measuring LLMs' ability to reason and answer knowledge-based questions. Through a synthetic NonsenseQA benchmark, we observe that different LLMs exhibit…

Computation and Language · Computer Science 2026-02-20 Mateusz Nowak , Xavier Cadet , Peter Chin

Reverse Dictionary (RD) is the task of obtaining the most relevant word or set of words given a textual description or dictionary definition. Effective RD methods have applications in accessibility, translation or writing support systems.…

Computation and Language · Computer Science 2024-12-10 Fatemah Almeman , Luis Espinosa-Anke

Large Language Models (LLMs) are increasingly deployed across edge and cloud platforms for real-time question-answering and retrieval-augmented generation. However, processing lengthy contexts in distributed systems incurs high…

Computation and Language · Computer Science 2025-05-19 Camille Couturier , Spyros Mastorakis , Haiying Shen , Saravan Rajmohan , Victor Rühle

Biomedical question answering (QA) poses significant challenges due to the need for precise interpretation of specialized knowledge drawn from a vast, complex, and rapidly evolving corpus. In this work, we explore how large language models…

Computation and Language · Computer Science 2025-09-11 Dima Galat , Diego Molla-Aliod

While Large Language Models (LLMs) achieve near-human performance on standard benchmarks, their capabilities often fail to generalize to complex, real-world problems. To bridge this gap, we introduce DeepQuestion, a scalable, automated…

Computation and Language · Computer Science 2026-03-02 Ali Khoramfar , Ali Ramezani , Mohammad Mahdi Mohajeri , Mohammad Javad Dousti , Majid Nili Ahmadabadi , Heshaam Faili

Large Language Models (LLMs) have achieved impressive progress in natural language processing, but their limited ability to retain long-term context constrains performance on document-level or multi-turn tasks. Retrieval-Augmented…

Computation and Language · Computer Science 2025-05-20 Zhangyu Wang , Siyuan Gao , Rong Zhou , Hao Wang , Li Ning

Aligning large language models (LLMs) to human preferences typically relies on aggregating pooled feedback into a single reward model. However, this standard approach assumes that all labelers share the same underlying preferences, ignoring…

Machine Learning · Computer Science 2026-05-11 Federico Echenique , Alireza Fallah , Baihe Huang , Michael I. Jordan

Generating diverse responses from large language models (LLMs) is crucial for applications such as planning/search and synthetic data generation, where diversity provides distinct answers across generations. Prior approaches rely on…

Computation and Language · Computer Science 2024-10-15 Justin Wong , Yury Orlovskiy , Michael Luo , Sanjit A. Seshia , Joseph E. Gonzalez

In this paper, we investigate Extractive Question Answering (EQA) with Large Language Models (LLMs) under domain drift, i.e., can LLMs generalize to domains that require specific knowledge such as medicine and law in a zero-shot fashion…

Computation and Language · Computer Science 2024-12-13 Saptarshi Sengupta , Wenpeng Yin , Preslav Nakov , Shreya Ghosh , Suhang Wang

Artificial intelligence (AI) systems hold great promise for advancing various scientific disciplines, and are increasingly used in real-world applications. Despite their remarkable progress, further capabilities are expected in order to…

Artificial Intelligence · Computer Science 2025-12-05 Drago Plecko , Patrik Okanovic , Shreyas Havaldar , Torsten Hoefler , Elias Bareinboim

Large language models (LLMs) are increasingly used to assign document relevance labels in information retrieval pipelines, especially in domains lacking human-labeled data. However, different models often disagree on borderline cases,…

Information Retrieval · Computer Science 2025-07-04 William A. Ingram , Bipasha Banerjee , Edward A. Fox

Question Answering (QA) accounts for a significant portion of LLM usage "in the wild". However, LLMs sometimes produce false or misleading responses, also known as "hallucinations". Therefore, grounding the generated answers in contextually…

Despite the advances in large language models (LLMs), how they use their knowledge for reasoning is not yet well understood. In this study, we propose a method that deconstructs complex real-world questions into a graph, representing each…

Computation and Language · Computer Science 2024-10-07 Miyoung Ko , Sue Hyun Park , Joonsuk Park , Minjoon Seo

As teachers increasingly turn to GenAI in their educational practice, we need robust methods to benchmark large language models (LLMs) for pedagogical purposes. This article presents an embedding-based benchmarking framework to detect bias…

Computation and Language · Computer Science 2026-04-02 Yishan Du , Conrad Borchers , Mutlu Cukurova

Large language models (LLMs) achieve strong average performance yet remain unreliable at the instance level, with frequent hallucinations, brittle failures, and poorly calibrated confidence. We study reliability through the lens of…

Artificial Intelligence · Computer Science 2026-01-13 Pranav Kallem