English
Related papers

Related papers: Neeko: Leveraging Dynamic LoRA for Efficient Multi…

200 papers

Large language models (LLMs) exhibit strong reasoning and conversational abilities, but ensuring reliable behavior in multi-turn interactions remains challenging. In many real-world applications, agents must succeed in one-shot settings…

Computation and Language · Computer Science 2026-04-02 Shuli Jiang , Zhaoyang Zhang , Yi Zhang , Shuo Yang , Wei Xia , Stefano Soatto

The advent of Large Language Models (LLMs) has paved the way for complex tasks such as role-playing, which enhances user interactions by enabling models to imitate various characters. However, the closed-source nature of state-of-the-art…

Large Language Models (LLMs) have shown great success as high-level planners for zero-shot game-playing agents. However, these agents are primarily evaluated on Minecraft, where long-term planning is relatively straightforward. In contrast,…

Artificial Intelligence · Computer Science 2024-03-04 Dominik Jeurissen , Diego Perez-Liebana , Jeremy Gow , Duygu Cakmak , James Kwan

The growing prevalence of artificial intelligence (AI) in various applications underscores the need for agents that can successfully navigate and adapt to an ever-changing, open-ended world. A key challenge is ensuring these AI agents are…

Machine Learning · Computer Science 2025-12-10 Mikayel Samvelyan

Large language model (LLM) agents have shown increasing promise for collaborative task completion. However, existing multi-agent frameworks often rely on static workflows, fixed roles, and limited inter-agent communication, reducing their…

Multiagent Systems · Computer Science 2026-02-13 Chengxuan Xia , Qianye Wu , Sixuan Tian , Yilun Hao

Role-playing is a crucial capability of Large Language Models (LLMs), enabling a wide range of practical applications, including intelligent non-player characters, digital twins, and emotional companions. Evaluating this capability in LLMs…

Computation and Language · Computer Science 2024-12-10 Lei Wang , Jianxun Lian , Yi Huang , Yanqi Dai , Haoxuan Li , Xu Chen , Xing Xie , Ji-Rong Wen

This paper investigates the use of Large Language Models (LLMs) to synthesize public opinion data, addressing challenges in traditional survey methods like declining response rates and non-response bias. We introduce a novel technique: role…

Computation and Language · Computer Science 2025-04-02 Rabimba Karanjai , Boris Shor , Amanda Austin , Ryan Kennedy , Yang Lu , Lei Xu , Weidong Shi

Low-Rank Adaptation (LoRA) is a popular technique for parameter-efficient fine-tuning of Large Language Models (LLMs). We study how different LoRA modules can be merged to achieve skill composition -- testing the performance of the merged…

Computation and Language · Computer Science 2024-12-03 Akshara Prabhakar , Yuanzhi Li , Karthik Narasimhan , Sham Kakade , Eran Malach , Samy Jelassi

Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of NLP tasks, but they remain fundamentally stateless, constrained by limited context windows that hinder long-horizon reasoning. Recent efforts to…

Low-rank adaptation (LoRA) has been prominently employed for parameter-efficient fine-tuning of large language models (LLMs). However, the limited expressive capacity of LoRA, stemming from the low-rank constraint, has been recognized as a…

Computation and Language · Computer Science 2025-03-18 Zhiwei He , Zhaopeng Tu , Xing Wang , Xingyu Chen , Zhijie Wang , Jiahao Xu , Tian Liang , Wenxiang Jiao , Zhuosheng Zhang , Rui Wang

We present a multi-expert system for creating Non-Player Characters (NPCs) capable of both natural dialogue and contextual action execution in interactive environments. Using Qwen3 as the base model and Low-Rank Adaptation (LoRA) adapters,…

Computation and Language · Computer Science 2025-11-04 Mahammad Nuriyev

While Large Language Models (LLMs) can serve as agents to simulate human behaviors (i.e., role-playing agents), we emphasize the importance of point-in-time role-playing. This situates characters at specific moments in the narrative…

Computation and Language · Computer Science 2024-05-29 Jaewoo Ahn , Taehyun Lee , Junyoung Lim , Jin-Hwa Kim , Sangdoo Yun , Hwaran Lee , Gunhee Kim

Multi-agent systems perform well on general reasoning tasks. However, the lack of training in specialized areas hinders their accuracy. Current training methods train a unified large language model (LLM) for all agents in the system. This…

Online recruitment platforms have reshaped job-seeking and recruiting processes, driving increased demand for applications that enhance person-job matching. Traditional methods generally rely on analyzing textual data from resumes and job…

Computation and Language · Computer Science 2025-06-27 Hongda Sun , Hongzhan Lin , Haiyu Yan , Yang Song , Xin Gao , Rui Yan

As large language models (LLMs) advance in role-playing (RP) tasks, existing benchmarks quickly become obsolete due to their narrow scope, outdated interaction paradigms, and limited adaptability across diverse application scenarios. To…

Computation and Language · Computer Science 2026-04-07 Haotian Wu , Shufan Jiang , Chios Chen , Yiyang Feng , Hehai Lin , Heqing Zou , Yao Shu , Chengwei Qin

Multi-agent systems can solve complex tasks through collaboration between multiple Large Language Model agents. Existing collaboration frameworks typically operate in either a parallel or a sequential mode. In the parallel mode, agents…

Computation and Language · Computer Science 2026-05-18 Nurbek Tastan , Alex Iacob , Lorenzo Sani , Meghdad Kurmanji , Nicholas D. Lane , Samuel Horvath , Karthik Nandakumar

Large Language Models (LLMs) have achieved remarkable advancements in natural language processing tasks, yet they encounter challenges in complex decision-making scenarios that require long-term reasoning and alignment with high-level…

Computation and Language · Computer Science 2025-06-10 Heng Dong , Kefei Duan , Chongjie Zhang

Recently, the advent of large language models (LLMs) has revolutionized generative agents. Among them, Role-Playing Conversational Agents (RPCAs) attract considerable attention due to their ability to emotionally engage users. However, the…

Computation and Language · Computer Science 2024-01-10 Quan Tu , Shilong Fan , Zihang Tian , Rui Yan

In recent years, large language models (LLMs) have shown significant advancements in natural language processing (NLP), with strong capa-bilities in generation, comprehension, and rea-soning. These models have found applications in…

Artificial Intelligence · Computer Science 2025-04-02 Hui Wang

Feature transformation enhances downstream task performance by generating informative features through mathematical feature crossing. Despite the advancements in deep learning, feature transformation remains essential for structured data,…

Machine Learning · Computer Science 2026-03-02 Tao Zhe , Huazhen Fang , Kunpeng Liu , Qian Lou , Tamzidul Hoque , Dongjie Wang