中文
相关论文

相关论文: Test-Time Policy Adaptation for Enhanced Multi-Tur…

200 篇论文

Test-Time Scaling (TTS) is an important method for improving the performance of Large Language Models (LLMs) by using additional computation during the inference phase. However, current studies do not systematically analyze how policy…

计算与语言 · 计算机科学 2025-02-11 Runze Liu , Junqi Gao , Jian Zhao , Kaiyan Zhang , Xiu Li , Biqing Qi , Wanli Ouyang , Bowen Zhou

Large language models (LLMs) have recently advanced in reasoning when optimized with reinforcement learning (RL) under verifiable rewards. Existing methods primarily rely on outcome-based supervision to strengthen internal LLM reasoning,…

人工智能 · 计算机科学 2026-05-29 Siyao Song , Cong Ma , Zhihao Cheng , Shiye Lei , Minghao Li , Ying Zeng , Huaixiao Tou , Kai Jia

Small language models (SLMs) are more efficient, cost-effective, and customizable than large language models (LLMs), though they often underperform in specific areas like reasoning. Past methods for enhancing SLMs' reasoning, such as…

计算与语言 · 计算机科学 2024-12-12 Kaiyuan Chen , Jin Wang , Xuejie Zhang

Large language models (LLMs), optimized through human feedback, have rapidly emerged as a leading paradigm for developing intelligent conversational assistants. However, despite their strong performance across many benchmarks, LLM-based…

计算与语言 · 计算机科学 2025-07-29 Maximillian Chen , Ruoxi Sun , Tomas Pfister , Sercan Ö. Arık

Recommender and search systems commonly rely on Learning To Rank models trained on logged user interactions to order items by predicted relevance. However, such interaction data is often subject to position bias, as users are more likely to…

信息检索 · 计算机科学 2025-09-05 Aleksandr V. Petrov , Michael Murtagh , Karthik Nagesh

Bootstrapping large language models (LLMs) through preference-based policy optimization offers a promising direction for aligning model behavior with human preferences without relying on extensive manual annotations. In this work, we…

人工智能 · 计算机科学 2025-12-25 Chen Jia

The effectiveness of large language models (LLMs) in conversational AI is hindered by their reliance on single-turn supervised fine-tuning (SFT) data, which limits contextual coherence in multi-turn dialogues. Existing methods for…

计算与语言 · 计算机科学 2025-07-08 Jiangxu Wu , Cong Wang , TianHuang Su , Jun Yang , Haozhi Lin , Chao Zhang , Ming Peng , Kai Shi , SongPan Yang , BinQing Pan , ZiXian Li , Ni Yang , ZhenYu Yang

Large Language Models (LLMs) exhibit world knowledge and inference capabilities, making them powerful tools for various applications. This paper proposes a feedback loop mechanism that leverages these capabilities to tune Evolution…

机器学习 · 计算机科学 2024-05-21 Oliver Kramer

Large Vision-Language Models (LVLMs) or multimodal large language models represent a significant advancement in artificial intelligence, enabling systems to understand and generate content across both visual and textual modalities. While…

机器学习 · 计算机科学 2025-09-09 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Accurate multi-turn intent classification is essential for advancing conversational AI systems. However, challenges such as the scarcity of comprehensive datasets and the complexity of contextual dependencies across dialogue turns hinder…

计算与语言 · 计算机科学 2024-11-20 Junhua Liu , Yong Keat Tan , Bin Fu , Kwan Hui Lim

Large Language Model (LLM) based agents have demonstrated proficiency in multi-step interactions with graphical user interfaces (GUIs). While most research focuses on improving single-task performance, practical scenarios often involve…

人工智能 · 计算机科学 2026-05-21 Minghao Chen , Xinyi Hu , Zhou Yu , Yufei Yin

Large Language Models (LLMs) exhibit impressive capabilities but require careful alignment with human preferences. Traditional training-time methods finetune LLMs using human preference datasets but incur significant training costs and…

计算与语言 · 计算机科学 2025-07-16 Yuancheng Xu , Udari Madhushani Sehwag , Alec Koppel , Sicheng Zhu , Bang An , Furong Huang , Sumitra Ganesh

The rapid evolution of e-commerce has exposed the limitations of traditional product retrieval systems in managing complex, multi-turn user interactions. Recent advances in multimodal generative retrieval -- particularly those leveraging…

The rapid evolution of Large Language Models (LLMs) has accelerated the transition from conversational chatbots to general agents. However, effectively balancing empathetic communication with budget-aware decision-making remains an open…

计算与语言 · 计算机科学 2026-02-27 Ning Gao , Wei Zhang , Yuqin Dai , Ling Shi , Ziyin Wang , Yujie Wang , Wei He , Jinpeng Wang , Chaozheng Wang

Recent advances in Large Language Models (LLMs) have transformed text-to-speech (TTS) synthesis, inspiring autoregressive frameworks that represent speech as sequences of discrete codec tokens. Among them, single-codebook TTS LLMs have…

声音 · 计算机科学 2025-11-27 Yicheng Zhong , Peiji Yang , Zhisheng Wang

When fine-tuning pre-trained Language Models (LMs) to exhibit desired behaviors, maintaining control over risk is critical for ensuring both safety and trustworthiness. Most existing safety alignment methods, such as Safe RLHF and SACPO,…

人工智能 · 计算机科学 2026-01-01 Lijun Zhang , Lin Li , Wei Wei , Yajie Qi , Huizhong Song , Jun Wang , Yaodong Yang , Jiye Liang

In the field of large language models (LLMs), aligning models with the diverse preferences of users is a critical challenge. Direct Preference Optimization (DPO) has played a key role in this area. It works by using pairs of preferences…

计算与语言 · 计算机科学 2024-05-29 Yueqin Yin , Zhendong Wang , Yi Gu , Hai Huang , Weizhu Chen , Mingyuan Zhou

Conversational recommender systems (CRS) based on Large Language Models (LLMs) need to constantly be aligned to the user preferences to provide satisfying and context-relevant item recommendations. The traditional supervised fine-tuning…

机器学习 · 计算机科学 2025-08-08 Zhongheng Yang , Aijia Sun , Yushang Zhao , Yinuo Yang , Dannier Li , Chengrui Zhou

Fine-tuning Multimodal Large Language Models (MLLMs) with parameter-efficient methods like Low-Rank Adaptation (LoRA) is crucial for task adaptation. However, imbalanced training dynamics across modalities often lead to suboptimal accuracy…

机器学习 · 计算机科学 2026-03-03 Minkyoung Cho , Insu Jang , Shuowei Jin , Zesen Zhao , Adityan Jothi , Ethem F. Can , Min-Hung Chen , Z. Morley Mao

Recently, Large Language Models (LLMs) have introduced a novel paradigm in Time Series Analysis (TSA), leveraging strong language capabilities to support tasks such as forecasting and anomaly detection. However, these analysis tasks cannot…

机器学习 · 计算机科学 2026-05-11 Wei Li , Zhe Xie , Yuxuan Liang , Xinli Hao , Yunyao Cheng , Dan Pei , Xiaofeng Meng