English
Related papers

Related papers: Beyond Surface Structure: A Causal Assessment of L…

200 papers

Large Language Models (LLMs) show promise in biomedicine but lack true causal understanding, relying instead on correlations. This paper envisions causal LLM agents that integrate multimodal data (text, images, genomics, etc.) and perform…

Artificial Intelligence · Computer Science 2025-05-23 Adib Bazgir , Amir Habibdoust Lafmajani , Yuwen Zhang

Schema-guided reasoning pipelines ask LLMs to produce explicit intermediate structures -- rubrics, checklists, verification queries -- before committing to a final decision. But do these structures causally determine the output, or merely…

Artificial Intelligence · Computer Science 2026-03-18 Oleg Somov , Mikhail Chaichuk , Mikhail Seleznyov , Alexander Panchenko , Elena Tutubalina

Systematic reviews and meta-analyses rely on converting narrative articles into structured, numerically grounded study records. Despite rapid advances in large language models (LLMs), it remains unclear whether they can meet the structural…

Computation and Language · Computer Science 2026-02-12 Zhiyin Tan , Jennifer D'Souza

Large language models (LLMs) have shown remarkable capabilities in various natural language understanding tasks. With only a few demonstration examples, these LLMs can quickly adapt to target tasks without expensive gradient updates. Common…

Computation and Language · Computer Science 2023-11-14 Yue Yu , Jiaming Shen , Tianqi Liu , Zhen Qin , Jing Nathan Yan , Jialu Liu , Chao Zhang , Michael Bendersky

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

Automatic post-editing (APE) aims to refine machine translations by correcting residual errors. Although recent large language models (LLMs) demonstrate strong translation capabilities, their effectiveness for APE--especially under…

Computation and Language · Computer Science 2026-03-13 Ahrii Kim , Seong-heum Kim

Large language models (LLMs) have rapidly advanced and are increasingly capable of tackling complex scientific problems, including those in physics. Despite this progress, current LLMs often fail to emulate the concise, principle-based…

Machine Learning · Computer Science 2025-06-02 Yinggan Xu , Yue Liu , Zhiqiang Gao , Changnan Peng , Di Luo

LLMs are increasingly used as seq2seq translators from natural language utterances to structured programs, a process called semantic interpretation. Unlike atomic labels or token sequences, programs are naturally represented as abstract…

Computation and Language · Computer Science 2025-04-07 Mayank Kothyari , Sunita Sarawagi , Soumen Chakrabarti , Gaurav Arora , Srujana Merugu

Dead code introduces several challenges in software development, such as increased binary size and maintenance difficulties. It can also obscure logical errors and be exploited for obfuscation in malware. For LLM-based code-related tasks,…

Software Engineering · Computer Science 2025-06-16 Minyu Chen , Guoqiang Li , Ling-I Wu , Ruibang Liu

Numerous decision-making tasks require estimating causal effects under interventions on different parts of a system. As practitioners consider using large language models (LLMs) to automate decisions, studying their causal reasoning…

Machine Learning · Computer Science 2024-12-24 Tejas Kasetty , Divyat Mahajan , Gintare Karolina Dziugaite , Alexandre Drouin , Dhanya Sridhar

Inductive reasoning is a core problem-solving capacity: humans can identify underlying principles from a few examples, which robustly generalize to novel scenarios. Recent work evaluates large language models (LLMs) on inductive reasoning…

Machine Learning · Computer Science 2024-06-03 Ruocheng Wang , Eric Zelikman , Gabriel Poesia , Yewen Pu , Nick Haber , Noah D. Goodman

Recent studies have shown that large language models (LLMs) can assess relevance and support information retrieval (IR) tasks such as document ranking and relevance judgment generation. However, the internal mechanisms by which…

Information Retrieval · Computer Science 2025-04-11 Qi Liu , Jiaxin Mao , Ji-Rong Wen

Scaling laws have allowed Pre-trained Language Models (PLMs) into the field of causal reasoning. Causal reasoning of PLM relies solely on text-based descriptions, in contrast to causal discovery which aims to determine the causal…

While Large Language Models (LLMs) have found success in real-world applications, their underlying explanatory process is still poorly understood. This paper proposes IBE-Eval, a framework inspired by philosophical accounts on Inference to…

Computation and Language · Computer Science 2025-03-04 Dhairya Dalal , Marco Valentino , André Freitas , Paul Buitelaar

Large Language Models (LLMs) have demonstrated remarkable capabilities in various tasks, yet they often struggle with context-faithfulness generations that properly reflect contextual knowledge. While existing approaches focus on enhancing…

Computation and Language · Computer Science 2025-04-23 Xiaowei Yuan , Zhao Yang , Ziyang Huang , Yequan Wang , Siqi Fan , Yiming Ju , Jun Zhao , Kang Liu

Large Language Models (LLMs) demonstrate ever-increasing abilities in mathematical and algorithmic tasks, yet their geometric reasoning skills are underexplored. We investigate LLMs' abilities in constructive geometric problem-solving one…

Computation and Language · Computer Science 2024-09-23 Spyridon Mouselinos , Henryk Michalewski , Mateusz Malinowski

Large Language Models (LLMs) have emerged with many intellectual capacities. While numerous benchmarks assess their intelligence, limited attention has been given to their ability to explore--an essential capacity for discovering new…

Artificial Intelligence · Computer Science 2025-05-13 Lan Pan , Hanbo Xie , Robert C. Wilson

Objective: This study investigates the potential of Large Language Models (LLMs) as an alternative to human expert elicitation for extracting structured causal knowledge and facilitating causal modeling in biometric and healthcare…

Artificial Intelligence · Computer Science 2025-04-15 Olha Shaposhnyk , Daria Zahorska , Svetlana Yanushkevich

The opaque nature of Large Language Models (LLMs) has led to significant research efforts aimed at enhancing their interpretability, primarily through post-hoc methods. More recent in-hoc approaches, such as Concept Bottleneck Models…

Machine Learning · Computer Science 2025-02-20 Or Raphael Bidusa , Shaul Markovitch

Large Language Models (LLMs) have shown to be capable of various tasks, yet their capability in interpreting and reasoning over tabular data remains an underexplored area. In this context, this study investigates from three core…

Computation and Language · Computer Science 2023-12-29 Tianyang Liu , Fei Wang , Muhao Chen