English
Related papers

Related papers: Thinking Aloud: Dynamic Context Generation Improve…

200 papers

Zero-shot text-to-speech (TTS) aims to synthesize voices with unseen speech prompts, which significantly reduces the data and computation requirements for voice cloning by skipping the fine-tuning process. However, the prompting mechanisms…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-11 Ziyue Jiang , Jinglin Liu , Yi Ren , Jinzheng He , Zhenhui Ye , Shengpeng Ji , Qian Yang , Chen Zhang , Pengfei Wei , Chunfeng Wang , Xiang Yin , Zejun Ma , Zhou Zhao

Modern large language models (LLMs) have demonstrated impressive capabilities at sophisticated tasks, often through step-by-step reasoning similar to humans. This is made possible by their strong few and zero-shot abilities -- they can…

Computation and Language · Computer Science 2023-05-24 Xingchen Wan , Ruoxi Sun , Hanjun Dai , Sercan O. Arik , Tomas Pfister

Despite their strengths, large language models (LLMs) often fail to communicate their confidence accurately, making it difficult to assess when they might be wrong and limiting their reliability. In this work, we demonstrate that reasoning…

Artificial Intelligence · Computer Science 2025-10-23 Dongkeun Yoon , Seungone Kim , Sohee Yang , Sunkyoung Kim , Soyeon Kim , Yongil Kim , Eunbi Choi , Yireun Kim , Minjoon Seo

End-to-end automatic speech recognition (ASR) and large language models, such as Whisper and GPT-2, have recently been scaled to use vast amounts of training data. Despite the large amount of training data, infrequent content words that…

Computation and Language · Computer Science 2023-06-06 Guangzhi Sun , Xianrui Zheng , Chao Zhang , Philip C. Woodland

Generative question answering (QA) models generate answers to questions either solely based on the parameters of the model (the closed-book setting) or additionally retrieving relevant evidence (the open-book setting). Generative QA models…

Computation and Language · Computer Science 2022-10-11 Zhengbao Jiang , Jun Araki , Haibo Ding , Graham Neubig

Recent advances in test-time scaling have led to the emergence of thinking LLMs that exhibit self-reflective behaviors and multi-step reasoning. While RL drives this self-improvement paradigm, a recent study (Gandhi et al., 2025) shows that…

Artificial Intelligence · Computer Science 2025-08-22 Aswin RRV , Jacob Dineen , Divij Handa , Md Nayem Uddin , Mihir Parmar , Chitta Baral , Ben Zhou

Language models can be prompted to perform a wide variety of zero- and few-shot learning problems. However, performance varies significantly with the choice of prompt, and we do not yet understand why this happens or how to pick the best…

Computation and Language · Computer Science 2024-09-16 Hila Gonen , Srini Iyer , Terra Blevins , Noah A. Smith , Luke Zettlemoyer

Recent works have shown that chain-of-thought (CoT) prompting can elicit language models to solve complex reasoning tasks, step-by-step. However, prompt-based CoT methods are dependent on very large models such as GPT-3 175B which are…

Computation and Language · Computer Science 2023-06-14 Namgyu Ho , Laura Schmid , Se-Young Yun

Large language models (LLMs) have demonstrated impressive performance on many tasks. However, to achieve optimal performance, specially designed prompting methods are still needed. These methods either rely on task-specific few-shot…

Computation and Language · Computer Science 2024-02-29 Haoxiang Guan , Jiyan He , Shuxin Zheng , En-Hong Chen , Weiming Zhang , Nenghai Yu

Conditional natural language generation methods often require either expensive fine-tuning or training a large language model from scratch. Both are unlikely to lead to good results without a substantial amount of data and computational…

Computation and Language · Computer Science 2023-08-10 Yarik Menchaca Resendiz , Roman Klinger

We investigate the effectiveness of large language models (LLMs), including reasoning-based and non-reasoning models, in performing zero-shot financial sentiment analysis. Using the Financial PhraseBank dataset annotated by domain experts,…

Computation and Language · Computer Science 2025-06-06 Dimitris Vamvourellis , Dhagash Mehta

Recent trends in test-time scaling for reasoning models (e.g., OpenAI o1, DeepSeek R1) have led to a popular belief that extending thinking traces using prompts like "Wait" or "Let me rethink" can improve performance. This raises a natural…

This paper presents a novel framework for enhancing reasoning capabilities in large language models (LLMs) by leveraging iterative reasoning and feedback-driven methodologies. Building on the limitations identified in the SimpleBench…

Computation and Language · Computer Science 2024-12-18 Soham Sane , Angus McLean

We present a framework for optimizing prompts in vision-language models to elicit multimodal reasoning without model retraining. Using an evolutionary algorithm to guide prompt updates downstream of visual tasks, our approach improves upon…

Computation and Language · Computer Science 2025-04-01 Sid Bharthulwar , John Rho , Katrina Brown

In this paper, we tackle the emerging challenge of unintended harmful content generation in Large Language Models (LLMs) with a novel dual-stage optimisation technique using adversarial fine-tuning. Our two-pronged approach employs an…

Computation and Language · Computer Science 2023-08-29 Charles O'Neill , Jack Miller , Ioana Ciuca , Yuan-Sen Ting , Thang Bui

Large language models (LLMs) such as GPT-3 have demonstrated a strong capability to generate coherent and contextually relevant text. However, amidst their successes, a crucial issue persists: their generated outputs still lack commonsense…

Computation and Language · Computer Science 2023-10-27 Yufei Tian , Felix Zhang , Nanyun Peng

Zero-shot Chain-of-Thought (CoT) prompting emerges as a simple and effective strategy for enhancing the performance of large language models (LLMs) in real-world reasoning tasks. Nonetheless, the efficacy of a singular, task-level prompt…

Computation and Language · Computer Science 2024-11-01 Xiaosong Yuan , Chen Shen , Shaotian Yan , Xiaofeng Zhang , Liang Xie , Wenxiao Wang , Renchu Guan , Ying Wang , Jieping Ye

Large reasoning models, such as OpenAI o1 and DeepSeek-R1, tend to become increasingly verbose as their reasoning capabilities improve. These inflated Chain-of-Thought (CoT) trajectories often exceed what the underlying problems require,…

Machine Learning · Computer Science 2026-05-12 Songtao Wei , Yi Li , Zhikai Li , Xu Hu , Yuede Ji , Guanpeng Li , Feng Chen , Carl Yang , Zhichun Guo , Bingzhe Li

Logical reasoning task involves diverse types of complex reasoning over text, based on the form of multiple-choice question answering. Given the context, question and a set of options as the input, previous methods achieve superior…

Artificial Intelligence · Computer Science 2023-01-10 Fangzhi Xu , Jun Liu , Qika Lin , Tianzhe Zhao , Jian Zhang , Lingling Zhang

Training on verifiable symbolic data is a promising way to expand the reasoning frontier of language models beyond what standard pre-training corpora provide. Yet existing procedural generators often rely on fixed puzzles or templates and…

Computation and Language · Computer Science 2026-03-03 Valentin Lacombe , Valentin Quesnel , Damien Sileo