English
Related papers

Related papers: Self-Control of LLM Behaviors by Compressing Suffi…

200 papers

The alignments of reasoning abilities between smaller and larger Language Models are largely conducted via Supervised Fine-Tuning (SFT) using demonstrations generated from robust Large Language Models (LLMs). Although these approaches…

Computation and Language · Computer Science 2025-01-28 Leonardo Ranaldi , Andrè Freitas

Prompts with different control signals (e.g., length, keywords, etc.) can be used to control text summarization. When control signals are available, they can control the properties of generated summaries and potentially improve…

Computation and Language · Computer Science 2022-12-20 Yubo Zhang , Xingxing Zhang , Xun Wang , Si-qing Chen , Furu Wei

In recent research advancements within the community, large language models (LLMs) have sparked great interest in creating autonomous agents. However, current prompt-based agents often heavily rely on large-scale LLMs. Meanwhile, although…

Computation and Language · Computer Science 2025-03-04 Xueyang Feng , Bo Lan , Quanyu Dai , Lei Wang , Jiakai Tang , Xu Chen , Zhenhua Dong , Ji-Rong Wen

Controlling emergent behavioral personas (e.g., sycophancy, hallucination) in Large Language Models (LLMs) is critical for AI safety, yet remains a persistent challenge. Existing solutions face a dilemma: manual prompt engineering is…

Machine Learning · Computer Science 2026-04-23 Harshvardhan Saini , Yiming Tang , Dianbo Liu

Finding an agreement among diverse opinions is a challenging topic in multiagent systems. Recently, large language models (LLMs) have shown great potential in addressing this challenge due to their remarkable capabilities in comprehending…

Computation and Language · Computer Science 2023-05-22 Shiyao Ding , Takayuki Ito

Parameter-efficient fine-tuning (PEFT) has emerged as a practical solution for adapting large language models (LLMs) to custom datasets with significantly reduced computational cost. When carrying out PEFT under collaborative learning…

Cryptography and Security · Computer Science 2025-04-30 Jin Xie , Ruishi He , Songze Li , Xiaojun Jia , Shouling Ji

Large Reasoning Models (LRMs) are powerful, but they still suffer from inefficient and off-target reasoning. Currently, training-free methods are limited to either rigid heuristics or descriptive, non-actionable analyses. In this paper, we…

Artificial Intelligence · Computer Science 2025-10-15 Sunzhu Li , Zhiyu Lin , Shuling Yang , Jiale Zhao , Wei Chen

The success of current Large-Language Models (LLMs) hinges on extensive training data that is collected and stored centrally, called Centralized Learning (CL). However, such a collection manner poses a privacy threat, and one potential…

Machine Learning · Computer Science 2025-11-18 Huiwen Wu , Xiaogang Xu , Deyi Zhang , Xiaohan Li , Jiafei Wu , Zhe Liu

Improving the reasoning capabilities of large language models (LLMs) typically requires supervised fine-tuning with labeled data or computationally expensive sampling. We introduce Unsupervised Prefix Fine-Tuning (UPFT), which leverages the…

Computation and Language · Computer Science 2025-03-05 Ke Ji , Jiahao Xu , Tian Liang , Qiuzhi Liu , Zhiwei He , Xingyu Chen , Xiaoyuan Liu , Zhijie Wang , Junying Chen , Benyou Wang , Zhaopeng Tu , Haitao Mi , Dong Yu

Controlling the behavior of large language models (LLMs) at inference time is essential for aligning outputs with human abilities and safety requirements. \emph{Activation steering} provides a lightweight alternative to prompt engineering…

Artificial Intelligence · Computer Science 2026-01-30 Diaoulé Diallo , Katharina Dworatzyk , Sophie Jentzsch , Peer Schütt , Sabine Theis , Tobias Hecking

Previous studies proposed that the reasoning capabilities of large language models (LLMs) can be improved through self-reflection, i.e., letting LLMs reflect on their own output to identify and correct mistakes in the initial responses.…

Computation and Language · Computer Science 2025-02-18 Fengyuan Liu , Nouar AlDahoul , Gregory Eady , Yasir Zaki , Talal Rahwan

Recent work in language modeling has raised the possibility of self-improvement, where a language models evaluates and refines its own generations to achieve higher performance without external feedback. It is impossible for this…

Artificial Intelligence · Computer Science 2024-12-05 Audrey Huang , Adam Block , Dylan J. Foster , Dhruv Rohatgi , Cyril Zhang , Max Simchowitz , Jordan T. Ash , Akshay Krishnamurthy

We propose a constraint learning schema for fine-tuning Large Language Models (LLMs) with attribute control. Given a training corpus and control criteria formulated as a sequence-level constraint on model outputs, our method fine-tunes the…

Computation and Language · Computer Science 2024-10-10 Tao Meng , Ninareh Mehrabi , Palash Goyal , Anil Ramakrishna , Aram Galstyan , Richard Zemel , Kai-Wei Chang , Rahul Gupta , Charith Peris

Controllable text generation is a growing field within natural language generation (NLG) that focuses on producing text that meets specific constraints in real-world applications. Previous approaches, such as plug-and-play controllers…

Computation and Language · Computer Science 2024-02-07 Hao Wang , Lei Sha

Transformer-based pre-trained language models boost the performance of open-domain dialogue systems. Prior works leverage Transformer-based pre-trained language models to generate texts with desired attributes in two general approaches: (1)…

Computation and Language · Computer Science 2022-09-27 Wanyu Du , Yangfeng Ji

Metacognition -- assessing the quality of one's own cognitive performance -- guides adaptive behavior across species. Substantial research demonstrates that confidence signals can be extracted from language model outputs, yet a fundamental…

Machine Learning · Computer Science 2026-05-20 Dharshan Kumaran , Nathaniel Daw , Simon Osindero , Petar Veličković , Viorica Patraucean

Pretrained Transformer-based language models (LMs) display remarkable natural language generation capabilities. With their immense potential, controlling text generation of such LMs is getting attention. While there are studies that seek to…

Computation and Language · Computer Science 2022-06-13 Alvin Chan , Yew-Soon Ong , Bill Pung , Aston Zhang , Jie Fu

In this article, we introduce 'Internalized Self-Correction' (InSeC) for large language models (LLMs). While many approaches exist for self-reflection at inference time, we propose a novel method that combines ideas from negative sampling,…

Artificial Intelligence · Computer Science 2024-12-24 Nishanth Upadhyaya , Raghavendra Sridharamurthy

Large language models (LLMs) can be controlled at inference time through prompts (in-context learning) and internal activations (activation steering). Different accounts have been proposed to explain these methods, yet their common goal of…

Machine Learning · Computer Science 2026-03-13 Eric Bigelow , Daniel Wurgaft , YingQiao Wang , Noah Goodman , Tomer Ullman , Hidenori Tanaka , Ekdeep Singh Lubana

How do large language models (LLMs) obtain their answers? The ability to explain and control an LLM's reasoning process is key for reliability, transparency, and future model developments. We propose SelfIE (Self-Interpretation of…

Computation and Language · Computer Science 2024-03-27 Haozhe Chen , Carl Vondrick , Chengzhi Mao