English
Related papers

Related papers: ITLC at SemEval-2026 Task 11: Normalization and De…

200 papers

Large language models (LLMs), when guided by explicit textual plans, can perform reliable step-by-step reasoning during problem-solving. However, generating accurate and effective textual plans remains challenging due to LLM hallucinations…

Computation and Language · Computer Science 2026-01-01 Sijia Chen , Di Niu

Critiques are important for enhancing the performance of Large Language Models (LLMs), enabling both self-improvement and constructive feedback for others by identifying flaws and suggesting improvements. However, evaluating the critique…

Computation and Language · Computer Science 2025-01-27 Zhengyang Tang , Ziniu Li , Zhenyang Xiao , Tian Ding , Ruoyu Sun , Benyou Wang , Dayiheng Liu , Fei Huang , Tianyu Liu , Bowen Yu , Junyang Lin

Transformer-based Large Language Models (LLMs) have revolutionized Natural Language Processing by demonstrating exceptional performance across diverse tasks. This study investigates the impact of the parameter initialization scale on the…

Computation and Language · Computer Science 2025-05-22 Junjie Yao , Zhongwang Zhang , Zhi-Qin John Xu

Reasoning is a key ability for an intelligent system. Large language models (LMs) achieve above-chance performance on abstract reasoning tasks, but exhibit many imperfections. However, human abstract reasoning is also imperfect. For…

Both humans and large language models (LLMs) exhibit content effects: biases in which the plausibility of the semantic content of a reasoning problem influences judgments regarding its logical validity. While this phenomenon in humans is…

Computation and Language · Computer Science 2026-04-21 Leonardo Bertolazzi , Sandro Pezzelle , Raffaella Bernardi

Reasoning and linguistic skills form the cornerstone of human intelligence, facilitating problem-solving and decision-making. Recent advances in Large Language Models (LLMs) have led to impressive linguistic capabilities and emergent…

Computation and Language · Computer Science 2025-12-18 Gaurav Arora , Srujana Merugu , Shreya Jain , Vaibhav Saxena

Following the success of Large Language Models (LLMs), Large Multimodal Models (LMMs), such as the Flamingo model and its subsequent competitors, have started to emerge as natural steps towards generalist agents. However, interacting with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Mustafa Shukor , Alexandre Rame , Corentin Dancette , Matthieu Cord

Large Language Models (LLMs) have shown remarkable performance in various basic natural language tasks. For completing the complex task, we still need a plan for the task to guide LLMs to generate the specific solutions step by step. LLMs…

Computation and Language · Computer Science 2023-12-14 Yiduo Guo , Yaobo Liang , Chenfei Wu , Wenshan Wu , Dongyan Zhao , Nan Duan

Semantic parsing aims at translating natural language (NL) utterances onto machine-interpretable programs, which can be executed against a real-world environment. The expensive annotation of utterance-program pairs has long been…

Computation and Language · Computer Science 2021-04-14 Bailin Wang , Mirella Lapata , Ivan Titov

Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance…

Computation and Language · Computer Science 2024-06-14 Bahare Fatemi , Mehran Kazemi , Anton Tsitsulin , Karishma Malkan , Jinyeong Yim , John Palowitch , Sungyong Seo , Jonathan Halcrow , Bryan Perozzi

Evaluating large language models (LLMs) is costly: it requires the generation and examination of LLM outputs on a large-scale benchmark of various tasks. This paper investigates how to efficiently reduce the tasks used to benchmark LLMs…

Computation and Language · Computer Science 2024-10-23 Hongyu Zhao , Ming Li , Lichao Sun , Tianyi Zhou

The performance of Large language models (LLMs) across a broad range of domains has been impressive but have been critiqued as not being able to reason about their process and conclusions derived. This is to explain the conclusions draw,…

Computation and Language · Computer Science 2024-10-30 Rob Sullivan , Nelly Elsayed

A key subtask in lexical substitution is ranking the given candidate words. A common approach is to replace the target word with a candidate in the original sentence and feed the modified sentence into a model to capture semantic…

Computation and Language · Computer Science 2025-09-16 Zhongyang Hu , Naijie Gu , Xiangzhi Tao , Tianhui Gu , Yibing Zhou

The ability to robustly identify causal relationships is essential for autonomous decision-making and adaptation to novel scenarios. However, accurately inferring causal structure requires integrating both world knowledge and abstract…

Machine Learning · Computer Science 2025-06-17 Khurram Yamin , Shantanu Gupta , Gaurav R. Ghosal , Zachary C. Lipton , Bryan Wilder

Large Language Models (LLMs) have demonstrated strong capabilities in natural language understanding and reasoning. However, their ability to perform exact, deterministic computation remains unclear. In this work, we systematically evaluate…

Artificial Intelligence · Computer Science 2026-05-08 Hongkun Yu

Despite recent success in large language model (LLM) reasoning, LLMs struggle with hierarchical multi-step reasoning tasks like generating complex programs. For these tasks, humans often start with a high-level algorithmic design and…

Computation and Language · Computer Science 2023-05-30 Eric Zelikman , Qian Huang , Gabriel Poesia , Noah D. Goodman , Nick Haber

Continual learning has become increasingly important as it enables NLP models to constantly learn and gain knowledge over time. Previous continual learning methods are mainly designed to preserve knowledge from previous tasks, without much…

Computation and Language · Computer Science 2021-06-14 Yufan Huang , Yanzhe Zhang , Jiaao Chen , Xuezhi Wang , Diyi Yang

While Large Language Models (LLMs) achieve near-human performance on standard benchmarks, their capabilities often fail to generalize to complex, real-world problems. To bridge this gap, we introduce DeepQuestion, a scalable, automated…

Computation and Language · Computer Science 2026-03-02 Ali Khoramfar , Ali Ramezani , Mohammad Mahdi Mohajeri , Mohammad Javad Dousti , Majid Nili Ahmadabadi , Heshaam Faili

While systems designed for solving planning tasks vastly outperform Large Language Models (LLMs) in this domain, they usually discard the rich semantic information embedded within task descriptions. In contrast, LLMs possess parametrised…

Computation and Language · Computer Science 2025-02-03 Andrey Borro , Patricia J Riddle , Michael W Barley , Michael J Witbrock

Prior research has demonstrated noticeable performance gains through the use of probabilistic tokenizations, an approach that involves employing multiple tokenizations of the same input string during the training phase of a language model.…

Computation and Language · Computer Science 2024-07-08 Ashutosh Sathe , Divyanshu Aggarwal , Sunayana Sitaram