English
Related papers

Related papers: Learning by Analogy: Enhancing Few-Shot Prompting …

200 papers

Large language models (LLMs) have developed impressive performance and strong explainability across various reasoning scenarios, marking a significant stride towards mimicking human-like intelligence. Despite this, when tasked with several…

Computation and Language · Computer Science 2024-11-12 Kai Xiong , Xiao Ding , Ting Liu , Bing Qin , Dongliang Xu , Qing Yang , Hongtao Liu , Yixin Cao

Large Language Models (LLM) are a new class of computation engines, "programmed" via prompt engineering. We are still learning how to best "program" these LLMs to help developers. We start with the intuition that developers tend to…

Software Engineering · Computer Science 2024-01-15 Toufique Ahmed , Kunal Suresh Pai , Premkumar Devanbu , Earl T. Barr

Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. To tackle multi-step reasoning tasks, few-shot chain-of-thought (CoT) prompting includes a few manually crafted step-by-step…

Computation and Language · Computer Science 2023-05-29 Lei Wang , Wanyu Xu , Yihuai Lan , Zhiqiang Hu , Yunshi Lan , Roy Ka-Wei Lee , Ee-Peng Lim

Recent advancements in Large Language Models (LLMs) have brought them closer to matching human cognition across a variety of tasks. How well do these models align with human performance in detecting and mapping analogies? Prior research has…

Computation and Language · Computer Science 2025-07-16 Kalit Inani , Keshav Kabra , Vijay Marupudi , Sashank Varma

Math Word Problem (MWP) solving needs to discover the quantitative relationships over natural language narratives. Recent work shows that existing models memorize procedures from context and rely on shallow heuristics to solve MWPs. In this…

Computation and Language · Computer Science 2022-03-11 Zhongli Li , Wenxuan Zhang , Chao Yan , Qingyu Zhou , Chao Li , Hongzhi Liu , Yunbo Cao

Large Language Models (LLMs) have showcased impressive reasoning capabilities, particularly when guided by specifically designed prompts in complex reasoning tasks such as math word problems. These models typically solve tasks using a…

Artificial Intelligence · Computer Science 2024-04-23 Lang Cao

Large Language Models (LLMs) have demonstrated promising capabilities in solving mathematical reasoning tasks, leveraging Chain-of-Thought (CoT) data as a vital component in guiding answer generation. Current paradigms typically generate…

Computation and Language · Computer Science 2025-03-20 Honglin Lin , Zhuoshi Pan , Yu Li , Qizhi Pei , Xin Gao , Mengzhang Cai , Conghui He , Lijun Wu

The cognitive mechanism by which Large Language Models (LLMs) solve mathematical problems remains a widely debated and unresolved issue. Currently, there is little interpretable experimental evidence that connects LLMs' problem-solving with…

Artificial Intelligence · Computer Science 2025-09-23 Wei Xie , Shuoyoucheng Ma , Zhenhua Wang , Enze Wang , Kai Chen , Xiaobing Sun , Baosheng Wang

Large language models (LLMs) typically enhance their performance through either the retrieval of semantically similar information or the improvement of their reasoning capabilities. However, a significant challenge remains in effectively…

Artificial Intelligence · Computer Science 2026-01-05 Shuqi Liu , Bowei He , Chen Ma , Linqi Song

Large language models (LLMs) have exhibited remarkable few-shot learning capabilities and unified the paradigm of NLP tasks through the in-context learning (ICL) technique. Despite the success of ICL, the quality of the exemplar…

Computation and Language · Computer Science 2024-12-13 Yukang Lin , Bingchen Zhong , Shuoran Jiang , Joanna Siebert , Qingcai Chen

Large language models (LLMs) are increasingly adopted for a variety of tasks with implicit graphical structures, such as planning in robotics, multi-hop question answering or knowledge probing, structured commonsense reasoning, and more.…

Computation and Language · Computer Science 2024-01-09 Heng Wang , Shangbin Feng , Tianxing He , Zhaoxuan Tan , Xiaochuang Han , Yulia Tsvetkov

Large language models (LLMs) with billions of parameters exhibit in-context learning abilities, enabling few-shot learning on tasks that the model was not specifically trained for. Traditional models achieve breakthrough performance on…

Artificial Intelligence · Computer Science 2025-11-04 Aske Plaat , Annie Wong , Suzan Verberne , Joost Broekens , Niki van Stein , Thomas Back

Large Language Models (LLMs) have achieved remarkable success across various domains. However, they still face significant challenges, including high computational costs for training and limitations in solving complex reasoning problems.…

Machine Learning · Computer Science 2025-05-20 Hang Gao , Chenhao Zhang , Tie Wang , Junsuo Zhao , Fengge Wu , Changwen Zheng , Huaping Liu

Large language models (LLMs) are often equipped with multi-sample decoding strategies. An LLM implicitly defines an arithmetic code book, facilitating efficient and embarrassingly parallelizable \textbf{arithmetic sampling} to produce…

Artificial Intelligence · Computer Science 2025-04-29 Aditya Parashar , Aditya Vikram Singh , Avinash Amballa , Jinlin Lai , Benjamin Rozonoyer

Existing Math Word Problem (MWP) solvers have achieved high accuracy on benchmark datasets. However, prior works have shown that such solvers do not generalize well and rely on superficial cues to achieve high performance. In this paper, we…

Computation and Language · Computer Science 2022-05-03 Vivek Kumar , Rishabh Maheshwary , Vikram Pudi

Math word problems (MWPs) require analyzing text descriptions and generating mathematical equations to derive solutions. Existing works focus on solving MWPs with two types of solvers: tree-based solver and large language model (LLM)…

Computation and Language · Computer Science 2023-08-29 Jie Yao , Zihao Zhou , Qiufeng Wang

Large Language Models (LLMs) exhibit impressive performance across various domains but still struggle with arithmetic reasoning tasks. Recent work shows the effectiveness of prompt design methods in enhancing reasoning capabilities.…

Computation and Language · Computer Science 2024-10-11 Wenting Tan , Dongxiao Chen , Jieting Xue , Zihao Wang , Taijie Chen

Multimodal Large Language Models (MLLMs) excel in solving text-based mathematical problems, but they struggle with mathematical diagrams since they are primarily trained on natural scene images. For humans, visual aids generally enhance…

Computation and Language · Computer Science 2024-09-26 Wenwen Zhuang , Xin Huang , Xiantao Zhang , Jin Zeng

Large Language Models (LLMs) have been applied to Math Word Problems (MWPs) with transformative impacts, revolutionizing how these complex problems are approached and solved in various domains including educational settings. However, the…

Computation and Language · Computer Science 2024-06-18 Joykirat Singh , Akshay Nambi , Vibhav Vineet

Due to the remarkable language understanding and generation abilities of large language models (LLMs), their use in educational applications has been explored. However, little work has been done on investigating the pedagogical ability of…

Computation and Language · Computer Science 2023-10-23 An-Zi Yen , Wei-Ling Hsu