English
Related papers

Related papers: Frugal LMs Trained to Invoke Symbolic Solvers Achi…

200 papers

Large Language Models prompting, such as using in-context demonstrations, is a mainstream technique for invoking LLMs to perform high-performance and solid complex reasoning (e.g., mathematical reasoning, commonsense reasoning), and has the…

Artificial Intelligence · Computer Science 2024-10-08 Zhicheng Yang , Yinya Huang , Jing Xiong , Liang Feng , Xiaodan Liang , Yiwei Wang , Jing Tang

Conditional layout generation aims to automatically generate visually appealing and semantically coherent layouts from user-defined constraints. While recent methods based on generative models have shown promising results, they typically…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Hengyu Shi , Junhao Su , Tianyang Han , Junfeng Luo , Jialin Gao

Large language models (LLMs) are capable of solving a wide range of tasks, yet they have struggled with reasoning. To address this, we propose $\textbf{Additional Logic Training (ALT)}$, which aims to enhance LLMs' reasoning capabilities by…

Machine Learning · Computer Science 2024-12-24 Terufumi Morishita , Gaku Morio , Atsuki Yamaguchi , Yasuhiro Sogawa

Large language models (LLMs) equipped with chain-of-thought (CoT) achieve strong performance and offer a window into LLM behavior. However, recent evidence suggests that improvements in CoT capabilities often come with redundant reasoning…

Computation and Language · Computer Science 2026-02-03 Yanrui Du , Sendong Zhao , Yibo Gao , Danyang Zhao , Qika Lin , Ming Ma , Jiayun Li , Yi Jiang , Kai He , Qianyi Xu , Bing Qin , Mengling Feng

Large language models (LLMs) open up new horizons for sequential recommendations, owing to their remarkable language comprehension and generation capabilities. However, there are still numerous challenges that should be addressed to…

Information Retrieval · Computer Science 2024-03-29 Yuling Wang , Changxin Tian , Binbin Hu , Yanhua Yu , Ziqi Liu , Zhiqiang Zhang , Jun Zhou , Liang Pang , Xiao Wang

Conventional mechanical design follows an iterative process in which initial concepts are refined through cycles of expert assessment and resource-intensive Finite Element Method (FEM) analysis to meet performance goals. While machine…

Machine Learning · Computer Science 2025-05-02 Yayati Jadhav , Amir Barati Farimani

In recent years, large language models (LLMs) have demonstrated significant potential in complex reasoning tasks like mathematical problem-solving. However, existing research predominantly relies on reinforcement learning (RL) frameworks…

Machine Learning · Computer Science 2026-01-12 ShaoZhen Liu , Xinting Huang , Houwen Peng , Xin Chen , Xinyang Song , Qi Li , Zhenan Sun

Structured representations, exemplified by Abstract Meaning Representation (AMR), have long been pivotal in computational linguistics. However, their role remains ambiguous in the Large Language Models (LLMs) era. Initial attempts to…

Computation and Language · Computer Science 2025-02-21 Jiahuan Zhang , Tianheng Wang , Hanqing Wu , Ziyi Huang , Yulong Wu , Dongbai Chen , Linfeng Song , Yue Zhang , Guozheng Rao , Kaicheng Yu

Large Language Models (LLMs) have rapidly transformed the landscape of artificial intelligence, enabling natural language interfaces and dynamic orchestration of software components. However, their reliance on probabilistic inference limits…

Machine Learning · Computer Science 2025-07-01 Claudionor Coelho , Yanen Li , Philip Tee

Large Language Models (LLMs) often struggle with mathematical reasoning tasks requiring precise, verifiable computation. While Reinforcement Learning (RL) from outcome-based rewards enhances text-based reasoning, understanding how agents…

Artificial Intelligence · Computer Science 2025-08-21 Xinji Mai , Haotian Xu , Zhong-Zhi Li , Xing W , Weinong Wang , Jian Hu , Yingying Zhang , Wenqiang Zhang

Large Reasoning Models (LRMs) solve complex tasks by generating long Chain-of-Thought (CoT) sequences; however, the emergent dynamics governing reasoning trajectories are not well understood and can lead to inconsistencies and reasoning…

Artificial Intelligence · Computer Science 2026-05-29 G M Shahariar , Erfan Shayegani , Ali Nazari , Nael Abu-Ghazaleh

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

Computation and Language · Computer Science 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

Neural-symbolic methods have demonstrated efficiency in enhancing the reasoning abilities of large language models (LLMs). However, existing methods mainly rely on syntactically mapping natural languages to complete formal languages like…

Computation and Language · Computer Science 2024-06-04 Yiming Wang , Zhuosheng Zhang , Pei Zhang , Baosong Yang , Rui Wang

Reasoning is a cognitive process of using evidence to reach a sound conclusion. The reasoning capability is essential for large language models (LLMs) to serve as the brain of the artificial general intelligence agent. Recent studies reveal…

Computation and Language · Computer Science 2023-09-06 Peiyi Wang , Lei Li , Liang Chen , Feifan Song , Binghuai Lin , Yunbo Cao , Tianyu Liu , Zhifang Sui

This work compares large language models (LLMs) and neuro-symbolic approaches in solving Raven's progressive matrices (RPM), a visual abstract reasoning test that involves the understanding of mathematical rules such as progression or…

Artificial Intelligence · Computer Science 2024-12-10 Michael Hersche , Giacomo Camposampiero , Roger Wattenhofer , Abu Sebastian , Abbas Rahimi

Navigating the complexities of physics reasoning has long been a difficult task for Large Language Models (LLMs), requiring a synthesis of profound conceptual understanding and adept problem-solving techniques. In this study, we investigate…

Computation and Language · Computer Science 2025-07-04 Nifu Dan , Yujun Cai , Yiwei Wang

Chain-of-Though (CoT) represents a common strategy for reasoning in Large Language Models (LLMs) by decomposing complex tasks into intermediate inference steps. However, explanations generated via CoT are susceptible to content biases that…

Computation and Language · Computer Science 2026-03-31 Leonardo Ranaldi , Marco Valentino , Andrè Freitas

Recent advancements in large language models have led to significant improvements across various tasks, including mathematical reasoning, which is used to assess models' intelligence in logical reasoning and problem-solving. Models are…

Artificial Intelligence · Computer Science 2026-04-27 Erez Yosef , Oron Anschel , Shunit Haviv Hakimi , Asaf Gendler , Adam Botach , Nimrod Berman , Igor Kviatkovsky

Integrating free-text explanations to in-context learning of large language models (LLM) is shown to elicit strong reasoning capabilities along with reasonable explanations. In this paper, we consider the problem of leveraging the…

Computation and Language · Computer Science 2022-10-14 Shiyang Li , Jianshu Chen , Yelong Shen , Zhiyu Chen , Xinlu Zhang , Zekun Li , Hong Wang , Jing Qian , Baolin Peng , Yi Mao , Wenhu Chen , Xifeng Yan

Mathematical reasoning in Large Language Models (LLMs) is often evaluated using benchmarks with limited numerical ranges, failing to reflect real-world problem-solving across diverse scales. Furthermore, most existing evaluation methods…

Machine Learning · Computer Science 2025-02-14 Safal Shrestha , Minwu Kim , Keith Ross