English
Related papers

Related papers: Query Circuits: Explaining How Language Models Ans…

200 papers

Causal reasoning is a cornerstone of how humans interpret the world. To model and reason about causality, causal graphs offer a concise yet effective solution. Given the impressive advancements in language models, a crucial question arises:…

Computation and Language · Computer Science 2024-06-25 Sirui Chen , Mengying Xu , Kun Wang , Xingyu Zeng , Rui Zhao , Shengjie Zhao , Chaochao Lu

Deep Learning and Machine Learning based models have become extremely popular in text processing and information retrieval. However, the non-linear structures present inside the networks make these models largely inscrutable. A significant…

Information Retrieval · Computer Science 2026-03-12 Sourav Saha , Debapriyo Majumdar , Mandar Mitra

Large Vision-Language Models (LVLMs) represent a significant leap towards empathetic agents, demonstrating remarkable capabilities in emotion understanding. However, the internal mechanisms governing how LVLMs translate abstract visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Chengsheng Zhang , Chenghao Sun , Zhining Xie , Xinmei Tian

Despite exceptional capabilities in knowledge-intensive tasks, Large Language Models (LLMs) face a critical gap in understanding how they internalize new knowledge, particularly how to structurally embed acquired knowledge in their neural…

Machine Learning · Computer Science 2025-06-03 Yixin Ou , Yunzhi Yao , Ningyu Zhang , Hui Jin , Jiacheng Sun , Shumin Deng , Zhenguo Li , Huajun Chen

Explainable question answering systems predict an answer together with an explanation showing why the answer has been selected. The goal is to enable users to assess the correctness of the system and understand its reasoning process.…

Computation and Language · Computer Science 2020-10-14 Hendrik Schuff , Heike Adel , Ngoc Thang Vu

We present a novel approach to pseudo-feedback-based ad hoc retrieval that uses language models induced from both documents and clusters. First, we treat the pseudo-feedback documents produced in response to the original query as a set of…

Information Retrieval · Computer Science 2007-05-23 Oren Kurland , Lillian Lee , Carmel Domshlak

In language model interpretability research, \textbf{circuit tracing} aims to identify which internal features causally contributed to a particular output and how they affected each other, with the goal of explaining the computations…

Computation and Language · Computer Science 2026-04-10 Aryaman Arora , Zhengxuan Wu , Jacob Steinhardt , Sarah Schwettmann

To build robust question answering systems, we need the ability to verify whether answers to questions are truly correct, not just "good enough" in the context of imperfect QA datasets. We explore the use of natural language inference (NLI)…

Computation and Language · Computer Science 2021-09-14 Jifan Chen , Eunsol Choi , Greg Durrett

Language model-based instruction-following systems have lately shown increasing performance on many benchmark tasks, demonstrating the capability of adapting to a broad variety of instructions. However, such systems are often not designed…

Computation and Language · Computer Science 2024-03-20 Rahul Nadkarni , Yizhong Wang , Noah A. Smith

The reasoning large language model (RLLM) has been proven competitive in solving complex reasoning tasks such as mathematics, coding, compared to general LLM. However, the serving performance and behavior of RLLM remains unexplored, which…

Machine Learning · Computer Science 2025-10-22 Qi Li , Junpan Wu , Xiang Liu , Yuxin Wang , Zeyu Li , Zhenheng Tang , Yuhan Chen , Shaohuai Shi , Xiaowen Chu

Organizations can benefit from the use of practices, techniques, and tools from the area of business process management. Through the focus on processes, they create process models that require management, including support for versioning,…

Programming Languages · Computer Science 2019-09-23 Artem Polyvyanyy , Arthur H. M. ter Hofstede , Marcello La Rosa , Chun Ouyang , Anastasiia Pika

In the context of knowledge-driven seq-to-seq generation tasks, such as document-based question answering and document summarization systems, two fundamental knowledge sources play crucial roles: the inherent knowledge embedded within model…

Computation and Language · Computer Science 2025-01-16 Han Cao , Zhaoyang Zhang , Xiangtian Li , Chufan Wu , Hansong Zhang , Wenqing Zhang

Question answering (QA) systems are among the most important and rapidly developing research topics in natural language processing (NLP). A reason, therefore, is that a QA system allows humans to interact more naturally with a machine,…

Computation and Language · Computer Science 2022-09-27 Amer Farea , Zhen Yang , Kien Duong , Nadeesha Perera , Frank Emmert-Streib

Existing techniques for training language models can be misaligned with the truth: if we train models with imitation learning, they may reproduce errors that humans make; if we train them to generate text that humans rate highly, they may…

Computation and Language · Computer Science 2024-03-05 Collin Burns , Haotian Ye , Dan Klein , Jacob Steinhardt

Many NLP applications require models to be interpretable. However, many successful neural architectures, including transformers, still lack effective interpretation methods. A possible solution could rely on building explanations from…

Computation and Language · Computer Science 2024-04-04 Federico Ruggeri , Marco Lippi , Paolo Torroni

Large Language Models (LLMs) can sometimes degrade into repetitive loops, persistently generating identical word sequences. Because repetition is rare in natural human language, its frequent occurrence across diverse tasks and contexts in…

Computation and Language · Computer Science 2025-11-05 Matéo Mahaut , Francesca Franzon

Current paradigms for code verification rely heavily on external mechanisms-such as execution-based unit tests or auxiliary LLM judges-which are often labor-intensive or limited by the judging model's own capabilities. This raises a…

Software Engineering · Computer Science 2026-02-10 Yicheng He , Zheng Zhao , Zhou Kaiyu , Bryan Dai , Jie Fu , Yonghui Yang

Large language models can produce creative and diverse responses. However, to integrate them into current developer workflows, it is essential to constrain their outputs to follow specific formats or standards. In this work, we surveyed 51…

Human-Computer Interaction · Computer Science 2024-04-12 Michael Xieyang Liu , Frederick Liu , Alexander J. Fiannaca , Terry Koo , Lucas Dixon , Michael Terry , Carrie J. Cai

Natural language question answering over knowledge graphs is an important and interesting task as it enables common users to gain accurate answers in an easy and intuitive manner. However, it remains a challenge to bridge the gap between…

Artificial Intelligence · Computer Science 2019-10-25 Weiguo Zheng , Mei Zhang

Pseudo-relevance feedback (PRF) is commonly used to boost the performance of traditional information retrieval (IR) models by using top-ranked documents to identify and weight new query terms, thereby reducing the effect of query-document…

Information Retrieval · Computer Science 2018-11-01 Canjia Li , Yingfei Sun , Ben He , Le Wang , Kai Hui , Andrew Yates , Le Sun , Jungang Xu