English
Related papers

Related papers: Select-Then-Decompose: From Empirical Analysis to …

200 papers

Large language models (LLMs) achieve remarkable generative performance, yet their output quality is dependent on the decoding strategy. While sampling-based methods (e.g., top-k, nucleus) and search-and-select based methods (e.g., beam…

Machine Learning · Computer Science 2026-05-12 Benjamin Patrick Evans , Sumitra Ganesh , Leo Ardon

As reasoning LLMs increasingly trade tokens for accuracy through deliberation, search, and self-correction, a single accuracy score can no longer tell whether those tokens buy useful reasoning, recovery from hard instances, or unnecessary…

Computation and Language · Computer Science 2026-05-19 Daniel Kaiser , Arnoldo Frigessi , Ali Ramezani-Kebrya , Benjamin Ricaud

Computationally intensive decoding procedures--including search, reranking, and self-critique--can improve the quality of language model (LM) outputs in problems spanning code generation, numerical reasoning, and dialog. Existing work…

Machine Learning · Computer Science 2024-10-08 Mehul Damani , Idan Shenfeld , Andi Peng , Andreea Bobu , Jacob Andreas

Large language models (LLMs) are rapidly replacing help forums like StackOverflow, and are especially helpful for non-professional programmers and end users. These users are often interested in data-centric tasks, such as spreadsheet…

In the industry, numerous tasks are deployed online. Traditional approaches often tackle each task separately by its own network, which leads to excessive costs for developing and scaling models, especially in the context of large language…

Computation and Language · Computer Science 2024-11-08 Yincen Qu , Chao Ma , Xiangying Dai , Hui Zhou , Yiting Wu , Hengyue Liu

Large language models (LLMs) are limited by substantial computational cost. We introduce a "computational economics" framework that treats an LLM as an internal economy of resource-constrained agents (attention heads and neuron blocks) that…

Computation and Language · Computer Science 2025-12-30 Sandeep Reddy , Kabir Khan , Rohit Patil , Ananya Chakraborty , Faizan A. Khan , Swati Kulkarni , Arjun Verma , Neha Singh

Recent advances in large language models (LLMs) have made reasoning a central benchmark for evaluating intelligence. While prior surveys focus on efficiency by examining how to shorten reasoning chains or reduce computation, this view…

Artificial Intelligence · Computer Science 2026-04-01 Chao Wu , Baoheng Li , Mingchen Gao , Yu Tian , Zhenyi Wang

Answering complex questions that require making latent decisions is a challenging task, especially when limited supervision is available. Recent works leverage the capabilities of large language models (LMs) to perform complex question…

Computation and Language · Computer Science 2022-12-09 Dheeru Dua , Shivanshu Gupta , Sameer Singh , Matt Gardner

The reasoning frontier of Large Language Models (LLMs) has advanced significantly through modern post-training paradigms (e.g., Reinforcement Learning from Verifiable Rewards (RLVR)). However, the efficacy of these methods remains…

Machine Learning · Computer Science 2026-05-13 Liqin Ye , Yanbin Yin , Michael Galarnyk , Yuzhao Heng , Sudheer Chava , Chao Zhang

Chain-of-thought (CoT), tree-of-thought (ToT), and related techniques work surprisingly well in practice for some complex reasoning tasks with Large Language Models (LLMs), but why? This work seeks the underlying reasons by conducting…

Artificial Intelligence · Computer Science 2024-06-19 Liwei Kang , Zirui Zhao , David Hsu , Wee Sun Lee

Few-shot prompting is a surprisingly powerful way to use Large Language Models (LLMs) to solve various tasks. However, this approach struggles as the task complexity increases or when the individual reasoning steps of the task themselves…

Computation and Language · Computer Science 2023-04-13 Tushar Khot , Harsh Trivedi , Matthew Finlayson , Yao Fu , Kyle Richardson , Peter Clark , Ashish Sabharwal

Large language models (LLMs) such as GPT-4o and Claude Sonnet 4.5 have demonstrated strong capabilities in open-ended reasoning and generative language tasks, leading to their widespread adoption across a broad range of NLP applications.…

Computation and Language · Computer Science 2026-02-09 Alberto Andres Valdes Gonzalez

Large Language Models (LLMs) are increasingly being used for interactive decision-making tasks requiring planning and adapting to the environment. Recent works employ LLMs-as-agents in broadly two ways: iteratively determining the next…

Artificial Intelligence · Computer Science 2024-04-10 Archiki Prasad , Alexander Koller , Mareike Hartmann , Peter Clark , Ashish Sabharwal , Mohit Bansal , Tushar Khot

Large Language Models (LLMs) have demonstrated strong capabilities in natural language understanding and reasoning. However, their ability to perform exact, deterministic computation remains unclear. In this work, we systematically evaluate…

Artificial Intelligence · Computer Science 2026-05-08 Hongkun Yu

Large Language Models (LLMs) demonstrate strong reasoning capabilities for many tasks, often by explicitly decomposing the task via Chain-of-Thought (CoT) reasoning. Recent work on LLM-based translation designs hand-crafted prompts to…

Computation and Language · Computer Science 2025-09-24 Di Wu , Seth Aycock , Christof Monz

Large Language Models (LLMs) have demonstrated remarkable capabilities across numerous tasks, yet they often rely on external context to handle complex tasks. While retrieval-augmented frameworks traditionally focus on selecting top-ranked…

Computation and Language · Computer Science 2025-04-16 Quanyu Long , Jianda Chen , Zhengyuan Liu , Nancy F. Chen , Wenya Wang , Sinno Jialin Pan

Recent large language models (LLMs) employ billions of parameters to enable broad problem-solving capabilities. Such language models also tend to be memory-bound because of the dominance of matrix-vector and matrix-matrix multiplications…

Machine Learning · Computer Science 2024-10-24 Chakshu Moar , Faraz Tahmasebi , Michael Pellauer , Hyoukjun Kwon

Structured Complex Task Decomposition (SCTD) is the problem of breaking down a complex real-world task (such as planning a wedding) into a directed acyclic graph over individual steps that contribute to achieving the task, with edges…

Computation and Language · Computer Science 2023-08-30 Quan Yuan , Mehran Kazemi , Xin Xu , Isaac Noble , Vaiva Imbrasaite , Deepak Ramachandran

The acceleration of Large Language Models (LLMs) research has opened up new possibilities for evaluating generated texts. They serve as scalable and economical evaluators, but the question of how reliable these evaluators are has emerged as…

Computation and Language · Computer Science 2024-12-10 Minzhi Li , Zhengyuan Liu , Shumin Deng , Shafiq Joty , Nancy F. Chen , Min-Yen Kan

In the realm of data-driven AI technology, the application of open-source large language models (LLMs) in robotic task planning represents a significant milestone. Recent robotic task planning methods based on open-source LLMs typically…

Robotics · Computer Science 2024-04-03 Yike Wu , Jiatao Zhang , Nan Hu , LanLing Tang , Guilin Qi , Jun Shao , Jie Ren , Wei Song