English

Model Fusion with Multi-LoRA Inference for Tool-Enhanced Game Dialogue Agents

Computation and Language 2025-09-30 v1

Abstract

This paper presents the opdainlp team's solution for the GPU track of the CPDC 2025 challenge. The challenge consists of three tasks, aiming to build an in-game conversational AI that adheres to character personas, aligns with the game's worldview, and supports function calling. Considering both effectiveness and resource/time constraints during inference, we synthesized data for some of the tasks based on the datasets provided by the competition organizers. We employed Qwen3-14B with LoRA fine-tuning and model fusion, and utilized a base model integrated with multiple LoRA adapters during inference. Specifically, in the competition, we used three distinct LoRA adapters to handle tool calling, response generation with tool call results, and response generation without tool call results, respectively. MultiLoRA inference was implemented using vLLM. Our solution achieved the first place in Task 1 and Task 3, and the second place in Task 2 of the GPU track.

Cite

@article{arxiv.2509.24229,
  title  = {Model Fusion with Multi-LoRA Inference for Tool-Enhanced Game Dialogue Agents},
  author = {Kangxu Wang and Ze Chen and Chengcheng Wei and Jiewen Zheng and Jiarong He and Max Gao},
  journal= {arXiv preprint arXiv:2509.24229},
  year   = {2025}
}

Comments

8 pages

R2 v1 2026-07-01T06:03:27.521Z