中文
相关论文

相关论文: DynSess: Dynamic Session-Level Evaluation and Opti…

200 篇论文

The utility of Role-Playing Language Agents in sociological research is growing alongside the adoption of Large Language Models. For realism in social simulation, these agents must adhere to their personas defined by character profiles, yet…

计算与语言 · 计算机科学 2026-03-03 Yuxin Liu , Mingye Zhu , Siyuan Liu , Bo Hu , Lei Zhang

To develop a reliable AI for psychological assessment, we introduce \texttt{PsychEval}, a multi-session, multi-therapy, and highly realistic benchmark designed to address three key challenges: \textbf{1) Can we train a highly realistic AI…

Chatbots are designed to carry out human-like conversations across different domains, such as general chit-chat, knowledge exchange, and persona-grounded conversations. To measure the quality of such conversational agents, a dialogue…

计算与语言 · 计算机科学 2022-01-19 Chen Zhang , Luis Fernando D'Haro , Thomas Friedrichs , Haizhou Li

Large language models have demonstrated their capabilities in storyline creation and human-like character role-playing. Current language model agents mainly focus on reasonable behaviors from the level of individuals, and their behaviors…

计算与语言 · 计算机科学 2024-07-02 Senyu Han , Lu Chen , Li-Min Lin , Zhengshan Xu , Kai Yu

Large language models (LLMs) are powerful dialogue agents, but specializing them towards fulfilling a specific function can be challenging. Instructing tuning, i.e. tuning models on instruction and sample responses generated by humans…

计算与语言 · 计算机科学 2024-01-11 Dennis Ulmer , Elman Mansimov , Kaixiang Lin , Justin Sun , Xibin Gao , Yi Zhang

Existing multimodal search agents process target entities sequentially, issuing one tool call per entity and accumulating redundant interaction rounds whenever a query decomposes into independent sub-retrievals. We argue that effective…

机器学习 · 计算机科学 2026-05-12 Guankai Li , Jiabin Chen , Yi Xu , Xichen Zhang , Yuan Lu

Agent applications are increasingly adopted to automate workflows across diverse tasks. However, due to the heterogeneous domains they operate in, it is challenging to create a scalable evaluation framework. Prior works each employ their…

人工智能 · 计算机科学 2026-03-17 Penny Chong , Harshavardhan Abichandani , Jiyuan Shen , Atin Ghosh , Min Pyae Moe , Yifan Mai , Daniel Dahlmeier

Recent advancements in Reinforcement Learning (RL), particularly Group Relative Policy Optimization (GRPO), have significantly enhanced the reasoning capabilities of Large Language Models. However, applying these problem-centric…

计算与语言 · 计算机科学 2026-05-26 Yihong Tang , Kehai Chen , Liang Yue , Benyou Wang , Min Zhang

Creating effective dialogue systems for mental health support requires high-quality multi-turn counseling dialogue data, yet collecting real counselor-client conversations presents significant challenges, including privacy concerns, high…

计算与语言 · 计算机科学 2026-05-27 Huachuan Qiu , Zhenzhong Lan

Large language models show potential in task-oriented dialogue systems, yet existing training methods often rely on token-level likelihood or preference optimization, which poorly align with long-horizon task success. To address this, we…

计算与语言 · 计算机科学 2026-02-23 Jingyi Xu , Xingyu Ren , Zhoupeng Shou , Yumeng Zhang , Zhiqiang You

Accurate dialogue description in audiovisual video captioning is crucial for downstream understanding and generation tasks. However, existing models generally struggle to produce faithful dialogue descriptions within audiovisual captions.…

Reproducing cognitive development, group interaction, and long-term evolution in virtual classrooms remains a core challenge for educational AI, as real classrooms integrate open-ended cognition, dynamic social interaction, affective…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Yiping Ma , Shiyu Hu , Buyuan Zhu , Yipei Wang , Yaxuan Kang , Shiqing Liu , Kang Hao Cheong

As agent systems powered by large language models (LLMs) advance, improving performance in context understanding, tool usage, and long-horizon execution has become critical. However, existing agent frameworks and benchmarks provide limited…

人工智能 · 计算机科学 2026-01-28 Defei Xia , Bingfeng Pi , Shenbin Zhang , Song Hua , Yunfei Wei , Lei Zuo

Most popular goal-oriented dialogue agents are capable of understanding the conversational context. However, with the surge of virtual assistants with screen, the next generation of agents are required to also understand screen context in…

机器学习 · 计算机科学 2021-11-26 Sanchit Agarwal , Jan Jezabek , Arijit Biswas , Emre Barut , Shuyang Gao , Tagyoung Chung

This paper introduces a novel Self-supervised Fine-grained Dialogue Evaluation framework (SelF-Eval). The core idea is to model the correlation between turn quality and the entire dialogue quality. We first propose a novel automatic data…

计算与语言 · 计算机科学 2022-09-19 Longxuan Ma , Ziyu Zhuang , Weinan Zhang , Mingda Li , Ting Liu

Large Language Models (LLMs) demonstrate strong performance but often lack interpretable reasoning. This paper introduces the Multi-Agent Collaboration Framework for Diverse Thinking Modes (DiMo), which enhances both performance and…

计算与语言 · 计算机科学 2025-10-21 Zhixuan He , Yue Feng

Role-playing is important for Large Language Models (LLMs) to follow diverse instructions while maintaining role identity and the role's pre-defined ability limits. Existing role-playing datasets mostly contribute to controlling role style…

计算与语言 · 计算机科学 2025-02-18 Junru Lu , Jiazheng Li , Guodong Shen , Lin Gui , Siyu An , Yulan He , Di Yin , Xing Sun

Reward-driven proactive dialogue agents require precise estimation of user satisfaction as an intrinsic reward signal to determine optimal interaction strategies. Specifically, this framework triggers clarification questions when detecting…

机器学习 · 计算机科学 2025-05-27 Wei Shen , Xiaonan He , Chuheng Zhang , Xuyun Zhang , Xiaolong Xu , Wanchun Dou

We propose a recommendation system that suggests treatment strategies to a therapist during the psychotherapy session in real-time. Our system uses a turn-level rating mechanism that predicts the therapeutic outcome by computing a…

计算与语言 · 计算机科学 2022-11-01 Baihan Lin , Guillermo Cecchi , Djallel Bouneffouf

Existing methods for AI psychological counselors predominantly rely on supervised fine-tuning using static dialogue datasets. However, this contrasts with human experts, who continuously refine their proficiency through clinical practice…

人工智能 · 计算机科学 2026-04-29 Yutao Yang , Junsong Li , Qianjun Pan , Jie Zhou , Kai Chen , Qin Chen , Jingyuan Zhao , Ningning Zhou , Xin Li , Liang He