English
Related papers

Related papers: SymBa: Symbolic Backward Chaining for Structured N…

200 papers

Large Language Models (LLMs) have demonstrated strong generalization across a wide range of tasks. Reasoning with LLMs is central to solving multi-step problems and complex decision-making. To support efficient reasoning, recent studies…

Computation and Language · Computer Science 2025-09-03 Jindong Li , Yali Fu , Li Fan , Jiahong Liu , Yao Shu , Chengwei Qin , Menglin Yang , Irwin King , Rex Ying

Prompting techniques such as chain-of-thought have established themselves as a popular vehicle for improving the outputs of large language models (LLMs). For code generation, however, their exact mechanics and efficacy are under-explored.…

Computation and Language · Computer Science 2025-04-09 Kunhao Zheng , Juliette Decugis , Jonas Gehring , Taco Cohen , Benjamin Negrevergne , Gabriel Synnaeve

Standard classification models often map inputs directly to labels without explicit reasoning, potentially limiting their performance, robustness, and interpretability. This paper introduces a novel two-stage approach to enhance text…

Computation and Language · Computer Science 2025-07-02 Mads Henrichsen , Rasmus Krebs

Large language models (LLMs) have achieved strong performance on complex reasoning tasks using techniques such as chain-of-thought and self-consistency. However, ensemble-based approaches, especially self-consistency which relies on…

Artificial Intelligence · Computer Science 2025-12-23 Qinglin Zeng , Jing Yang , Keze Wang

Formal verification via interactive theorem proving is increasingly used to ensure the correctness of critical systems, yet constructing large proof scripts remains highly manual and limits scalability. Advances in large language models…

Artificial Intelligence · Computer Science 2026-05-08 Baoding He , Zenan Li , Wei Sun , Yuan Yao , Taolue Chen , Xiaoxing Ma , Zhendong Su

Large language models (LLMs) open up new horizons for sequential recommendations, owing to their remarkable language comprehension and generation capabilities. However, there are still numerous challenges that should be addressed to…

Information Retrieval · Computer Science 2024-03-29 Yuling Wang , Changxin Tian , Binbin Hu , Yanhua Yu , Ziqi Liu , Zhiqiang Zhang , Jun Zhou , Liang Pang , Xiao Wang

Large Language Models (LLMs) have shown remarkable reasoning performance but struggle with multi-step deductive reasoning involving a series of rule application steps, especially when rules are presented non-sequentially. Our preliminary…

Computation and Language · Computer Science 2024-08-27 Siyuan Wang , Zhongyu Wei , Yejin Choi , Xiang Ren

Elucidating the reasoning process with structured explanations from question to answer is crucial, as it significantly enhances the interpretability, traceability, and trustworthiness of question-answering (QA) systems. However, structured…

Computation and Language · Computer Science 2024-09-30 Guoxin Chen , Kexin Tang , Chao Yang , Fuying Ye , Yu Qiao , Yiming Qian

The performance of Large language models (LLMs) across a broad range of domains has been impressive but have been critiqued as not being able to reason about their process and conclusions derived. This is to explain the conclusions draw,…

Computation and Language · Computer Science 2024-10-30 Rob Sullivan , Nelly Elsayed

Recent works have shown great potentials of Large Language Models (LLMs) in robot task and motion planning (TAMP). Current LLM approaches generate text- or code-based reasoning chains with sub-goals and action plans. However, they do not…

Robotics · Computer Science 2025-08-11 Yongchao Chen , Yilun Hao , Yang Zhang , Chuchu Fan

The success of large language models (LLMs) for time series has been demonstrated in previous work. Utilizing a symbolic time series representation, one can efficiently bridge the gap between LLMs and time series. However, the remaining…

Machine Learning · Computer Science 2026-02-05 Xinye Chen , Erin Carson , Cheng Kang

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

Computation and Language · Computer Science 2025-05-29 Avinash Patil , Aryan Jadon

The goal of neuro-symbolic AI is to integrate symbolic and subsymbolic AI approaches, to overcome the limitations of either. Prominent systems include Logic Tensor Networks (LTN) or DeepProbLog, which offer neural predicates and end-to-end…

Artificial Intelligence · Computer Science 2025-06-18 Stephen Roth , Lennart Baur , Derian Boer , Stefan Kramer

Large language models (LLMs) have demonstrated strong mathematical reasoning capabilities but remain susceptible to hallucinations producing plausible yet incorrect statements especially in theorem proving, symbolic manipulation, and…

Artificial Intelligence · Computer Science 2025-06-23 MingShan Liu , Jialing Fang

Ultra Strong Machine Learning (USML) refers to symbolic learning systems that not only improve their own performance but can also teach their acquired knowledge to quantifiably improve human performance. We introduce LENS (Logic Programming…

Artificial Intelligence · Computer Science 2026-01-28 Lun Ai , Johannes Langer , Ute Schmid , Stephen Muggleton

This paper describes our system submitted to SemEval-2026 Task 11: Disentangling Content and Formal Reasoning in Large Language Models. We present an efficient modular neuro-symbolic approach, combining a symbolic prover with small…

Computation and Language · Computer Science 2026-05-07 Ivan Kartáč , Kristýna Onderková , Jan Bronec , Zdeněk Kasner , Mateusz Lango , Ondřej Dušek

Large Language Models (LLMs) have shown promise in solving natural language-described planning tasks, but their direct use often leads to inconsistent reasoning and hallucination. While hybrid LLM-symbolic planning pipelines have emerged as…

Artificial Intelligence · Computer Science 2024-09-25 Sukai Huang , Nir Lipovetzky , Trevor Cohn

Prompt tuning for pre-trained masked language models (MLM) has shown promising performance in natural language processing tasks with few labeled examples. It tunes a prompt for the downstream task, and a verbalizer is used to bridge the…

Computation and Language · Computer Science 2024-03-22 Weisen Jiang , Yu Zhang , James T. Kwok

Large Language Models (LLMs) are transformer-based machine learning models that have shown remarkable performance in tasks for which they were not explicitly trained. Here, we explore the potential of LLMs to perform symbolic regression --…

Computation and Language · Computer Science 2026-04-17 Samiha Sharlin , Tyler R. Josephson

The complexities of table structures and question logic make table-based question answering (TQA) tasks challenging for Large Language Models (LLMs), often requiring task simplification before solving. This paper reveals that the reasoning…

Computation and Language · Computer Science 2025-04-22 Ruya Jiang , Chun Wang , Weihong Deng