中文
相关论文

相关论文: Arch-Router: Aligning LLM Routing with Human Prefe…

200 篇论文

Recent progress in Language Models (LMs) has dramatically advanced the field of natural language processing (NLP), excelling at tasks like text generation, summarization, and question answering. However, their inference remains…

机器学习 · 计算机科学 2025-06-10 Adarsh Prasad Behera , Jaya Prakash Champati , Roberto Morabito , Sasu Tarkoma , James Gross

With the rapid development of Large Language Models (LLMs), aligning these models with human preferences and values is critical to ensuring ethical and safe applications. However, existing alignment techniques such as RLHF or DPO often…

计算与语言 · 计算机科学 2025-08-19 Yang Zhang , Yu Yu , Bo Tang , Yu Zhu , Chuxiong Sun , Wenqiang Wei , Jie Hu , Zipeng Xie , Zhiyu Li , Feiyu Xiong , Edward Chung

Large language models (LLMs) have shown impressive capabilities in natural language understanding and generation. Their potential for deeper user understanding and improved personalized user experience on recommendation platforms is,…

Large Language Models (LLMs) have experienced widespread adoption across scientific and industrial domains due to their versatility and utility for diverse tasks. Nevertheless, deploying and serving these models at scale with optimal…

计算与语言 · 计算机科学 2024-10-10 Josef Pichlmeier , Philipp Ross , Andre Luckow

Ensuring that large language models (LLMs) are both helpful and harmless is a critical challenge, as overly strict constraints can lead to excessive refusals, while permissive models risk generating harmful content. Existing approaches,…

Large language model (LLM) routing assigns each query to the most suitable model from an ensemble. We introduce LLMRouterBench, a large-scale benchmark and unified framework for LLM routing. It comprises over 400K instances from 21 datasets…

人工智能 · 计算机科学 2026-01-13 Hao Li , Yiqun Zhang , Zhaoyan Guo , Chenxu Wang , Shengji Tang , Qiaosheng Zhang , Yang Chen , Biqing Qi , Peng Ye , Lei Bai , Zhen Wang , Shuyue Hu

The alignment of large language models (LLMs) with human values increasingly relies on using other LLMs as automated judges, or ``autoraters''. However, their reliability is limited by a foundational issue: they are trained on discrete…

Large language models (LLMs) are used to generate content for a wide range of tasks, and are set to reach a growing audience in coming years due to integration in product interfaces like ChatGPT or search engines like Bing. This intensifies…

计算与语言 · 计算机科学 2023-03-10 Hannah Rose Kirk , Bertie Vidgen , Paul Röttger , Scott A. Hale

Preference alignment methods are increasingly critical for steering large language models (LLMs) to generate outputs consistent with human values. While recent approaches often rely on synthetic data generated by LLMs for scalability and…

计算与语言 · 计算机科学 2025-10-21 Mingye Zhu , Yi Liu , Zheren Fu , Yongdong Zhang , Zhendong Mao

The rise of Large Language Models (LLMs) has driven progress in reasoning tasks -- from program synthesis to scientific hypothesis generation -- yet their ability to handle ranked preferences and structured algorithms in combinatorial…

人工智能 · 计算机科学 2025-12-09 Hadi Hosseini , Samarth Khanna , Ronak Singh

Large Language Models (LLMs) have recently demonstrated impressive capabilities across various real-world applications. However, due to the current text-in-text-out paradigm, it remains challenging for LLMs to handle dynamic and complex…

人工智能 · 计算机科学 2024-10-25 Timothy Wei , Annabelle Miin , Anastasia Miin

Large Language Models (LLMs) are increasingly expected to handle complex decision-making tasks, yet their ability to perform structured resource allocation remains underexplored. Evaluating their reasoning is also difficult due to data…

人工智能 · 计算机科学 2025-08-11 Sankarshan Damle , Boi Faltings

Evaluating recommender systems remains challenging due to the gap between offline metrics and real user behavior, as well as the scarcity of interaction data. Recent work explores large language model (LLM) agents as synthetic users, yet…

信息检索 · 计算机科学 2026-01-06 Nicolas Bougie , Gian Maria Marconi , Tony Yip , Narimasa Watanabe

Trained on vast corpora, Large Language Models (LLMs) have the potential to encode visualization design knowledge and best practices. However, if they fail to do so, they might provide unreliable visualization recommendations. What…

人机交互 · 计算机科学 2024-10-22 Huichen Will Wang , Mitchell Gordon , Leilani Battle , Jeffrey Heer

Reranking is a critical component in recommender systems, playing an essential role in refining the output of recommendation algorithms. Traditional reranking models have focused predominantly on accuracy, but modern applications demand…

信息检索 · 计算机科学 2025-02-04 Jingtong Gao , Bo Chen , Weiwen Liu , Xiangyang Li , Yichao Wang , Wanyu Wang , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

As personalized recommendation systems become vital in the age of information overload, traditional methods relying solely on historical user interactions often fail to fully capture the multifaceted nature of human interests. To enable…

信息检索 · 计算机科学 2024-04-01 Zhixuan Chu , Yan Wang , Qing Cui , Longfei Li , Wenqing Chen , Zhan Qin , Kui Ren

Robots operating in human-shared environments must not only achieve task-level navigation objectives such as safety and efficiency, but also adapt their behavior to human preferences. However, as human preferences are typically expressed in…

机器人学 · 计算机科学 2026-05-13 Tharun Sethuraman , Subham Agrawal , Nils Dengler , Jorge de Heuvel , Teena Hassan , Maren Bennewitz

The availability of a wide range of large language models (LLMs) embedded in various agentic systems has significantly increased the potential of model selection strategies to improve the cost-performance tradeoff. Existing strategies…

计算与语言 · 计算机科学 2025-05-23 Jasper Dekoninck , Maximilian Baader , Martin Vechev

Personalization in social robotics is critical for fostering effective human-robot interactions, yet systems often face the cold start problem, where initial user preferences or characteristics are unavailable. This paper proposes a novel…

Large language models (LLMs) demonstrate remarkable performance across diverse tasks, yet their effectiveness frequently depends on costly commercial APIs or cloud services. Model selection thus entails a critical trade-off between…

分布式、并行与集群计算 · 计算机科学 2025-10-08 Yuanzhe Shen , Yide Liu , Zisu Huang , Ruicheng Yin , Xiaoqing Zheng , Xuanjing Huang