English
Related papers

Related papers: Task-driven Layerwise Additive Activation Interven…

200 papers

Parametric language models (LMs), which are trained on vast amounts of web data, exhibit remarkable flexibility and capability. However, they still face practical challenges such as hallucinations, difficulty in adapting to new data…

Computation and Language · Computer Science 2024-03-06 Akari Asai , Zexuan Zhong , Danqi Chen , Pang Wei Koh , Luke Zettlemoyer , Hannaneh Hajishirzi , Wen-tau Yih

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, single-model responses often exhibit inconsistencies, hallucinations, and varying quality across different…

Computation and Language · Computer Science 2025-12-25 Omer Jauhar Khan

We introduce Language Feedback Models (LFMs) that identify desirable behaviour - actions that help achieve tasks specified in the instruction - for imitation learning in instruction following. To train LFMs, we obtain feedback from Large…

Machine Learning · Computer Science 2024-10-11 Victor Zhong , Dipendra Misra , Xingdi Yuan , Marc-Alexandre Côté

The use of reinforcement learning (RL) methods to support health behavior change via personalized and just-in-time adaptive interventions is of significant interest to health and behavioral science researchers focused on problems such as…

Machine Learning · Computer Science 2025-07-08 Karine Karine , Benjamin M. Marlin

Large Language Models (LLMs) are trained and aligned to follow natural language instructions with only a handful of examples, and they are prompted as task-driven autonomous agents to adapt to various sources of execution environments.…

Computation and Language · Computer Science 2023-10-03 Yang Su

Training large language models is a computationally intensive process that often requires substantial resources to achieve state-of-the-art results. Incremental layer-wise training has been proposed as a potential strategy to optimize the…

Computation and Language · Computer Science 2024-12-02 Miles Q. Li , Benjamin C. M. Fung , Shih-Chia Huang

Since the advent of GPT, large language models (LLMs) have brought about revolutionary advancements in all walks of life. As a superior natural language processing (NLP) technology, LLMs have consistently achieved state-of-the-art…

Networking and Internet Architecture · Computer Science 2024-06-26 Danshi Wang , Yidi Wang , Xiaotian Jiang , Yao Zhang , Yue Pang , Min Zhang

Large Language Models (LLMs) achieve remarkable performance through pretraining on extensive data. This enables efficient adaptation to diverse downstream tasks. However, the lack of interpretability in their underlying mechanisms limits…

Computation and Language · Computer Science 2025-06-03 Xintong Wang , Jingheng Pan , Liang Ding , Longyue Wang , Longqin Jiang , Xingshan Li , Chris Biemann

Low resource automatic speech recognition (ASR) is a useful but thorny task, since deep learning ASR models usually need huge amounts of training data. The existing models mostly established a bottleneck (BN) layer by pre-training on a…

Computation and Language · Computer Science 2022-05-31 Jian Luo , Jianzong Wang , Ning Cheng , Zhenpeng Zheng , Jing Xiao

Particularly in low-data regimes, an outstanding challenge in machine learning is developing principled techniques for augmenting our models with suitable priors. This is to encourage them to learn in ways that are compatible with our…

Machine Learning · Computer Science 2022-10-25 Kristy Choi , Chris Cundy , Sanjari Srivastava , Stefano Ermon

Large Language Models (LLMs) encapsulate an extensive amount of world knowledge, and this has enabled their application in various domains to improve the performance of a variety of Natural Language Processing (NLP) tasks. This has also…

Artificial Intelligence · Computer Science 2024-04-30 Sina Gholamian , Domingo Huh

Inference-time LLM alignment methods, particularly activation steering, offer an alternative to fine-tuning by directly modifying activations during generation. Existing methods, however, often rely on non-anticipative interventions that…

Machine Learning · Computer Science 2026-04-22 Julian Skifstad , Xinyue Annie Yang , Glen Chou

Ensuring that Large Language Models (LLMs) generate text representative of diverse sub-populations is essential, particularly when key concepts related to under-represented groups are scarce in the training data. We address this challenge…

Computation and Language · Computer Science 2024-12-17 Sabit Hassan , Anthony Sicilia , Malihe Alikhani

Large language models (LLMs) are increasingly seen as assistants, copilots, and consultants, capable of supporting a wide range of tasks through natural conversation. However, most systems remain constrained by a linear request-response…

Computation and Language · Computer Science 2026-05-05 Jiaqi Chen , Yanzhe Zhang , Yutong Zhang , Yijia Shao , Diyi Yang

In modern industry, dynamic environments and the complexity of modular and reconfigurable resources require automated planning of process sequences. Capability-based planning approaches address this by automatically generating plans from…

Artificial Intelligence · Computer Science 2026-05-28 Luis Miguel Vieira da Silva , Nicolas König , Felix Gehlhoff

Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments…

Computation and Language · Computer Science 2024-05-29 Chuanhao Li , Runhan Yang , Tiankai Li , Milad Bafarassat , Kourosh Sharifi , Dirk Bergemann , Zhuoran Yang

In this article, we argue that understanding the collective behavior of agents based on large language models (LLMs) is an essential area of inquiry, with important implications in terms of risks and benefits, impacting us as a society at…

With the rapid development of natural language processing technology, large-scale language models (LLM) have achieved remarkable results in a variety of tasks. However, how to effectively train these huge models and improve their…

Artificial Intelligence · Computer Science 2024-12-09 Jiajing Chen , Bingying Liu , Xiaoxuan Liao , Jia Gao , Hongye Zheng , Yue Li

LLM-based agents have been extensively applied across various domains, where memory stands out as one of their most essential capabilities. Previous memory mechanisms of LLM-based agents are manually predefined by human experts, leading to…

Machine Learning · Computer Science 2025-08-26 Zeyu Zhang , Quanyu Dai , Rui Li , Xiaohe Bo , Xu Chen , Zhenhua Dong

Large Language Models (LLMs) have made progress in various real-world tasks, which stimulates requirements for the evaluation of LLMs. Existing LLM evaluation methods are mainly supervised signal-based which depends on static datasets and…

Computation and Language · Computer Science 2023-09-11 Jiatong Li , Rui Li , Qi Liu