English
Related papers

Related papers: A Lightweight Framework for Trigger-Guided LoRA-Ba…

200 papers

Low-rank adaptation (LoRA) is a widely used parameter-efficient fine-tuning method, yet its learned correction is static: the same low-rank update is applied to every input. This input-agnostic approach creates an inevitable compromise…

Machine Learning · Computer Science 2026-05-20 Ali Zindari , Xiaowen Jiang , Rotem Mulayoff , Sebastian U. Stich

Understanding the internal representations of large language models (LLMs) remains a central challenge for interpretability research. Sparse autoencoders (SAEs) offer a promising solution by decomposing activations into interpretable…

Machine Learning · Computer Science 2025-10-10 Yifei Yao , Mengnan Du

Large language models (LLMs) increasingly require mechanisms for continual adaptation without full retraining. However, sequential updates can lead to catastrophic forgetting, where new edits degrade previously acquired knowledge. This work…

Machine Learning · Computer Science 2025-10-21 William Hoy , Nurcin Celik

Large language models (LLMs) have recently shown strong progress on scientific reasoning, yet two major bottlenecks remain. First, explicit retrieval fragments reasoning, imposing a hidden "tool tax" of extra tokens and steps. Second,…

We introduce EncouRAGe, a comprehensive Python framework designed to streamline the development and evaluation of Retrieval-Augmented Generation (RAG) systems using Large Language Models (LLMs) and Embedding Models. EncouRAGe comprises five…

Computation and Language · Computer Science 2025-11-10 Jan Strich , Adeline Scharfenberg , Chris Biemann , Martin Semmann

Large Language Models (LLMs) exhibit strong potential in mathematical reasoning, yet their effectiveness is often limited by a shortage of high-quality queries. This limitation necessitates scaling up computational responses through…

Artificial Intelligence · Computer Science 2025-05-20 Jingyue Gao , Runji Lin , Keming Lu , Bowen Yu , Junyang Lin , Jianyu Chen

Continuous valence-arousal estimation in real-world environments is challenging due to inconsistent modality reliability and interaction-dependent variability in audio-visual signals. Existing approaches primarily focus on modeling temporal…

Multimedia · Computer Science 2026-03-13 Yubeen Lee , Sangeun Lee , Junyeop Cha , Eunil Park

Real-world data collection for embodied agents remains costly and unsafe, calling for scalable, realistic, and simulator-ready 3D environments. However, existing scene-generation systems often rely on rule-based or task-specific pipelines,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Hongchi Xia , Xuan Li , Zhaoshuo Li , Qianli Ma , Jiashu Xu , Ming-Yu Liu , Yin Cui , Tsung-Yi Lin , Wei-Chiu Ma , Shenlong Wang , Shuran Song , Fangyin Wei

Despite the rapid advancements in LLM agents, they still face the challenge of generating meaningful reflections due to inadequate error analysis and a reliance on rare successful trajectories, especially in complex tasks. In this work, we…

Artificial Intelligence · Computer Science 2025-09-26 Yubin Ge , Salvatore Romeo , Jason Cai , Monica Sunkara , Yi Zhang

Large language model (LLM) agents typically adopt a step-by-step reasoning framework, in which they interleave the processes of thinking and acting to accomplish the given task. However, this paradigm faces a deep-rooted one-pass issue…

Computation and Language · Computer Science 2025-09-29 Xingzuo Li , Kehai Chen , Yunfei Long , Xuefeng Bai , Yong Xu , Min Zhang

LLM agents with tool-calling capabilities often fail when user instructions are ambiguous or incomplete, leading to incorrect invocations and task failures. Existing approaches operate in unstructured language spaces, generating clarifying…

Computation and Language · Computer Science 2026-04-13 Manan Suri , Puneet Mathur , Nedim Lipka , Franck Dernoncourt , Ryan A. Rossi , Dinesh Manocha

Despite the significant improvements achieved by large language models (LLMs) in English reasoning tasks, these models continue to struggle with multilingual reasoning. Recent studies leverage a full-parameter and two-stage training…

Computation and Language · Computer Science 2025-01-08 Yuchun Fan , Yongyu Mu , Yilin Wang , Lei Huang , Junhao Ruan , Bei Li , Tong Xiao , Shujian Huang , Xiaocheng Feng , Jingbo Zhu

Large language models (LLMs) are powerful but static; they lack mechanisms to adapt their weights in response to new tasks, knowledge, or examples. We introduce Self-Adapting LLMs (SEAL), a framework that enables LLMs to self-adapt by…

Machine Learning · Computer Science 2025-09-19 Adam Zweiger , Jyothish Pari , Han Guo , Ekin Akyürek , Yoon Kim , Pulkit Agrawal

This paper presents SOLOMON, a novel Neuro-inspired Large Language Model (LLM) Reasoning Network architecture that enhances the adaptability of foundation models for domain-specific applications. Through a case study in semiconductor layout…

Computation and Language · Computer Science 2025-02-10 Bo Wen , Xin Zhang

In this paper, we introduce KAG-Thinker, which upgrade KAG to a multi-turn interactive thinking and deep reasoning framework powered by a dedicated parameter-light large language model (LLM). Our approach constructs a structured thinking…

Reasoning models have demonstrated remarkable capabilities in complex reasoning tasks. However, ensuring their safety against adversarial jailbreak prompts remains a critical challenge. Due to the covert and deceptive nature of such…

Computation and Language · Computer Science 2026-01-06 Yuhang Wang , Yanxu Zhu , Dongyuan Lu , Jitao Sang

Agentic search enables LLMs to solve complex multi-hop questions through iterative reasoning and external search. Despite the effectiveness, these systems often suffer from a critical limitation in practice: agents fail to recognize their…

Artificial Intelligence · Computer Science 2026-05-29 Yunbo Tang , Chengyi Yang , Shiyu Liu , Zhishang Xiang , Zerui Chen , Qinggang Zhang , Jinsong Su

LLMs are increasingly applied to recommendation, retrieval, and reasoning, yet deploying a single end-to-end model that can jointly support these behaviors over large, heterogeneous catalogs remains challenging. Such systems must generate…

Mental health issues significantly impact individuals' daily lives, yet many do not receive the help they need even with available online resources. This study aims to provide diverse, accessible, stigma-free, personalized, and real-time…

Computation and Language · Computer Science 2025-09-23 Qiming Guo , Jinwen Tang , Wenbo Sun , Haoteng Tang , Yi Shang , Wenlu Wang

Large Reasoning Models (LRMs) often suffer from computational inefficiency due to overthinking, where a fixed reasoning budget fails to match the varying complexity of tasks. To address this issue, we propose Adaptive Overclocking, a method…

Machine Learning · Computer Science 2025-09-23 Shuhao Jiang , Songbo Wang , Yang Qiao , Chun Xu , Chaoyang Zheng , Shengyi Zhou , Huanjun Wang , Fangming Li , Cong Zhang , Jiyu Wang