English
Related papers

Related papers: Large Language Models Are Also Good Prototypical C…

200 papers

Prompting techniques have significantly enhanced the capabilities of Large Language Models (LLMs) across various complex tasks, including reasoning, planning, and solving math word problems. However, most research has predominantly focused…

Computation and Language · Computer Science 2024-05-24 Neisarg Dave , Daniel Kifer , C. Lee Giles , Ankur Mali

Large language models (LLMs) have achieved substantial progress in processing long contexts but still struggle with long-context reasoning. Existing approaches typically involve fine-tuning LLMs with synthetic data, which depends on…

Computation and Language · Computer Science 2024-11-14 Siheng Li , Cheng Yang , Zesen Cheng , Lemao Liu , Mo Yu , Yujiu Yang , Wai Lam

Large language models excel on static benchmarks, but their ability as self-learning agents in dynamic environments remains unclear. We evaluate three prompting strategies: self-reflection, heuristic mutation, and planning across dynamic…

Artificial Intelligence · Computer Science 2025-08-12 Annie Wong , Thomas Bäck , Aske Plaat , Niki van Stein , Anna V. Kononova

Large Language Models, such as Generative Pre-trained Transformer 3 (aka. GPT-3), have been developed to understand language through the analysis of extensive text data, allowing them to identify patterns and connections between words.…

Computation and Language · Computer Science 2023-10-03 Baphumelele Masikisiki , Vukosi Marivate , Yvette Hlope

Large Language Models (LLMs) exhibit impressive performance across various domains but still struggle with arithmetic reasoning tasks. Recent work shows the effectiveness of prompt design methods in enhancing reasoning capabilities.…

Computation and Language · Computer Science 2024-10-11 Wenting Tan , Dongxiao Chen , Jieting Xue , Zihao Wang , Taijie Chen

Recent works on large language models (LLMs) have demonstrated the impact of prompting strategies and fine-tuning techniques on their reasoning capabilities. Yet, their effectiveness on clinical natural language inference (NLI) remains…

Computation and Language · Computer Science 2025-07-08 Mael Jullien , Marco Valentino , Leonardo Ranaldi , Andre Freitas

Large language models (LLMs) have achieved remarkable performance in generating human-like text and solving reasoning tasks of moderate complexity, such as question-answering and mathematical problem-solving. However, their capabilities in…

Computation and Language · Computer Science 2025-02-21 Cole Gawin , Yidan Sun , Mayank Kejriwal

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding, reasoning, and problem-solving across various domains. However, their ability to perform complex, multi-step reasoning task-essential…

Recent advances in reasoning with large language models (LLMs) have demonstrated strong performance on complex mathematical tasks, including combinatorial optimization. Techniques such as Chain-of-Thought and In-Context Learning have…

Artificial Intelligence · Computer Science 2025-09-17 Marylou Fauchard , Florian Carichon , Margarida Carvalho , Golnoosh Farnadi

Large Language Models (LLMs) are primarily trained on high-resource natural languages, limiting their effectiveness in low-resource settings and in tasks requiring deep logical reasoning. This research introduces Rosetta-PL, a benchmark…

Computation and Language · Computer Science 2025-05-06 Shaun Baek , Shaun Esua-Mensah , Cyrus Tsui , Sejan Vigneswaralingam , Abdullah Alali , Michael Lu , Vasu Sharma , Sean O'Brien , Kevin Zhu

While Chain of Thought (CoT) prompting approaches have significantly consolidated the reasoning capabilities of large language models (LLMs), they still face limitations that require extensive human effort or have performance needs to be…

Computation and Language · Computer Science 2025-06-02 Kangyang Luo , Zichen Ding , Zhenmin Weng , Lingfeng Qiao , Meng Zhao , Xiang Li , Di Yin , Jinlong Shu

Recent advancements in the field of large language models, particularly through the Chain of Thought (CoT) approach, have demonstrated significant improvements in solving complex problems. However, existing models either tend to sacrifice…

Computation and Language · Computer Science 2025-12-30 Yijiong Yu

With the Generative Pre-trained Transformer 3.5 (GPT-3.5) exhibiting remarkable reasoning and comprehension abilities in Natural Language Processing (NLP), most Question Answering (QA) research has primarily centered around general QA tasks…

Computation and Language · Computer Science 2023-12-20 Bowen Zhao , Changkai Ji , Yuejie Zhang , Wen He , Yingwen Wang , Qing Wang , Rui Feng , Xiaobo Zhang

Large Language Models (LLMs) have demonstrated remarkable proficiency across diverse tasks, exhibiting emergent properties such as semantic prompt comprehension, In-Context Learning (ICL), and Chain-of-Thought (CoT) reasoning. Despite their…

Computation and Language · Computer Science 2026-03-13 Yuling Jiao , Yanming Lai , Huazhen Lin , Wensen Ma , Houduo Qi , Defeng Sun

The large language models have achieved superior performance on various natural language tasks. One major drawback of such approaches is they are resource-intensive in fine-tuning new datasets. Soft-prompt tuning presents a…

Computation and Language · Computer Science 2023-10-30 Guoxin Chen , Yiming Qian , Bowen Wang , Liangzhi Li

Chain-of-thought (CoT) prompting for language models demonstrates impressive performance across reasoning tasks, but typically needs labeled exemplars of the reasoning process. In this work, we introduce a new prompting approach, analogical…

Machine Learning · Computer Science 2024-03-12 Michihiro Yasunaga , Xinyun Chen , Yujia Li , Panupong Pasupat , Jure Leskovec , Percy Liang , Ed H. Chi , Denny Zhou

We carry out a series of experiments to test large language models' multi-hop reasoning ability from three aspects: selecting and combining external knowledge, dealing with non-sequential reasoning tasks and generalising to data samples…

Computation and Language · Computer Science 2024-12-12 Haotong Zhang

Large language models (LLMs) have shown remarkable performance on many different Natural Language Processing (NLP) tasks. Prompt engineering plays a key role in adding more to the already existing abilities of LLMs to achieve significant…

Computation and Language · Computer Science 2024-07-25 Shubham Vatsal , Harsh Dubey

Fine-tuning of pre-trained transformer models has become the standard approach for solving common NLP tasks. Most of the existing approaches rely on a randomly initialized classifier on top of such networks. We argue that this fine-tuning…

Computation and Language · Computer Science 2020-04-30 Alexandre Tamborrino , Nicola Pellicano , Baptiste Pannier , Pascal Voitot , Louise Naudin

Large Language Models (LLMs) are often described as instances of foundation models that possess strong generalization obeying scaling laws, and therefore transfer robustly across various conditions in few- or zero-shot manner. Such claims…

Machine Learning · Computer Science 2025-03-06 Marianna Nezhurina , Lucia Cipolina-Kun , Mehdi Cherti , Jenia Jitsev