English
Related papers

Related papers: Truthful Online Preference Aggregation for LLM Fin…

200 papers

Reinforcement learning from human feedback (RLHF) has demonstrated remarkable effectiveness in aligning large language models (LLMs) with human preferences. Many existing alignment approaches rely on the Bradley-Terry (BT) model assumption,…

Machine Learning · Computer Science 2025-02-25 Yuheng Zhang , Dian Yu , Tao Ge , Linfeng Song , Zhichen Zeng , Haitao Mi , Nan Jiang , Dong Yu

Advertising text plays a critical role in determining click-through rates (CTR) in online advertising. Large Language Models (LLMs) offer significant efficiency advantages over manual ad text creation. However, LLM-generated ad texts do not…

Information Retrieval · Computer Science 2025-08-05 Yanda Chen , Zihui Ren , Qixiang Gao , Jiale Chen , Si Chen , Xubin Li , Tiezheng Ge , Bo Zheng

Data curation is a critical yet under-explored area in large language model (LLM) training. Existing methods, such as data selection and mixing, operate in an offline paradigm, detaching themselves from training. This separation introduces…

Machine Learning · Computer Science 2026-05-08 Wanru Zhao , Yihong Chen , Yuzhi Tang , Wentao Ma , Shengchao Hu , Shell Xu Hu , Alex Iacob , Abhinav Mehrotra , Nicholas D. Lane

The growing spread of online misinformation has created an urgent need for scalable, reliable fact-checking solutions. Crowdsourced fact-checking - where non-experts evaluate claim veracity - offers a cost-effective alternative to expert…

Computation and Language · Computer Science 2025-10-28 Luigia Costabile , Gian Marco Orlando , Valerio La Gatta , Vincenzo Moscato

We study online alignment of large language models under misspecified preference feedback, where the observed preference oracle deviates from an ideal but unknown ground-truth oracle. The online LLM alignment problem is a bi-level…

Machine Learning · Computer Science 2026-02-25 Zimeng Li , Mudit Gaur , Vaneet Aggarwal

While machine learning (ML) technology affects diverse stakeholders, there is no one-size-fits-all metric to evaluate the quality of outputs, including performance and fairness. Using predetermined metrics without soliciting stakeholder…

Computers and Society · Computer Science 2025-03-11 Takuya Yokota , Yuri Nakao

The rapid advancement of large language models (LLMs) has facilitated their transformation into conversational chatbots that can grasp contextual nuances and generate pertinent sentences, closely mirroring human values through advanced…

Computation and Language · Computer Science 2024-07-19 Janghwan Lee , Seongmin Park , Sukjin Hong , Minsoo Kim , Du-Seong Chang , Jungwook Choi

Recent LLMs have enabled significant advancements for conversational agents. However, they are also well known to hallucinate, producing responses that seem plausible but are factually incorrect. On the other hand, users tend to over-rely…

Computation and Language · Computer Science 2025-07-01 Suvodip Dey , Yi-Jyun Sun , Gokhan Tur , Dilek Hakkani-Tur

In this paper, we propose a learning approach to analyze dynamic systems with asymmetric information structure. Instead of adopting a game theoretic setting, we investigate an online quadratic optimization problem driven by system noises…

Optimization and Control · Mathematics 2018-11-05 Cheng Tan , Wing Shing Wong

We study online fair allocation of $T$ sequentially arriving items among $n$ agents with heterogeneous preferences, with the objective of maximizing generalized-mean welfare, defined as the $p$-mean of agents' time-averaged utilities, with…

Computer Science and Game Theory · Computer Science 2026-02-12 Zongjun Yang , Rachitesh Kumar , Christian Kroer

We consider the problem of online combinatorial optimization under semi-bandit feedback. The goal of the learner is to sequentially select its actions from a combinatorial decision set so as to minimize its cumulative loss. We propose a…

Machine Learning · Computer Science 2013-05-14 Gergely Neu , Gábor Bartók

Large language models (LLMs) are currently aligned using techniques such as reinforcement learning from human feedback (RLHF). However, these methods use scalar rewards that can only reflect user preferences on average. Pluralistic…

Computation and Language · Computer Science 2025-08-13 Jadie Adams , Brian Hu , Emily Veenhuis , David Joy , Bharadwaj Ravichandran , Aaron Bray , Anthony Hoogs , Arslan Basharat

User simulation is increasingly vital to develop and evaluate recommender systems (RSs). While Large Language Models (LLMs) offer promising avenues to simulate user behavior, they often struggle with the absence of specific task alignment…

Human-Computer Interaction · Computer Science 2026-04-20 Tianjun Wei , Huizhong Guo , Yingpeng Du , Zhu Sun , Huang Chen , Dongxia Wang , Jie Zhang

Mainstream approaches to aligning large language models (LLMs) heavily rely on human preference data, particularly when models require periodic updates. The standard process for iterative alignment of LLMs involves collecting new human…

Computation and Language · Computer Science 2024-10-01 Chen Zhang , Chengguang Tang , Dading Chong , Ke Shi , Guohua Tang , Feng Jiang , Haizhou Li

Reinforcement Learning algorithms that learn from human feedback (RLHF) need to be efficient in terms of statistical complexity, computational complexity, and query complexity. In this work, we consider the RLHF setting where the feedback…

Machine Learning · Computer Science 2024-03-14 Runzhe Wu , Wen Sun

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with…

Computation and Language · Computer Science 2025-05-06 Jian Guan , Junfei Wu , Jia-Nan Li , Chuanqi Cheng , Wei Wu

This paper addresses the scheduling problem in mobile social networks. We begin by proving that the approximation ratio analysis presented in the paper by Zhang \textit{et al.} (IEEE Transactions on Mobile Computing, 2025) is incorrect, and…

Data Structures and Algorithms · Computer Science 2025-12-24 Chi-Yeh Chen

We investigate machine learning approaches for optimizing real-time staffing decisions in semi-automated warehouse sortation systems. Operational decision-making can be supported at different levels of abstraction, with different…

Machine Learning · Computer Science 2026-03-27 Kalle Kujanpää , Yuying Zhu , Kristina Klinkner , Shervin Malmasi

Large language models (LLMs) achieve strong average performance yet remain unreliable at the instance level, with frequent hallucinations, brittle failures, and poorly calibrated confidence. We study reliability through the lens of…

Artificial Intelligence · Computer Science 2026-01-13 Pranav Kallem

Large language models (LLMs) remain unreliable for global enterprise applications due to substantial performance gaps between high-resource and mid/low-resource languages, driven by English-centric pretraining and internal reasoning biases.…

Computation and Language · Computer Science 2025-10-28 Amit Agarwal , Hansa Meghwani , Hitesh Laxmichand Patel , Tao Sheng , Sujith Ravi , Dan Roth