English
Related papers

Related papers: Dual Optimal: Make Your LLM Peer-like with Dignity

200 papers

Recent advances in large vision-language models (LVLMs) have shown promise for embodied task planning, yet they struggle with fundamental challenges like dependency constraints and efficiency. Existing approaches either solely optimize…

Computation and Language · Computer Science 2025-03-14 Siyin Wang , Zhaoye Fei , Qinyuan Cheng , Shiduo Zhang , Panpan Cai , Jinlan Fu , Xipeng Qiu

LLM-as-Judge has emerged as a scalable alternative to human evaluation, enabling large language models (LLMs) to provide reward signals in trainings. While recent work has explored multi-agent extensions such as multi-agent debate and…

Artificial Intelligence · Computer Science 2025-09-19 Chiyu Ma , Enpei Zhang , Yilun Zhao , Wenjun Liu , Yaning Jia , Peijun Qing , Lin Shi , Arman Cohan , Yujun Yan , Soroush Vosoughi

The rapidly increasing capabilities of large language models (LLMs) raise an urgent need to align AI systems with diverse human preferences to simultaneously enhance their usefulness and safety, despite the often conflicting nature of these…

Machine Learning · Computer Science 2024-03-06 Zixuan Liu , Xiaolin Sun , Zizhan Zheng

While astonishingly capable, large Language Models (LLM) can sometimes produce outputs that deviate from human expectations. Such deviations necessitate an alignment phase to prevent disseminating untruthful, toxic, or biased information.…

Artificial Intelligence · Computer Science 2024-10-30 Long Tan Le , Han Shu , Tung-Anh Nguyen , Choong Seon Hong , Nguyen H. Tran

Large language models (LLMs) have achieved promising results in tabular data generation. However, inherent historical biases in tabular datasets often cause LLMs to exacerbate fairness issues, particularly when multiple advantaged and…

Machine Learning · Computer Science 2025-09-23 Tianchun Li , Tianci Liu , Xingchen Wang , Rongzhe Wei , Pan Li , Lu Su , Jing Gao

LLM agents increasingly have access to private user data and act on the user's behalf when interacting with third-party systems. The user defines what may and must not be shared, and the agent must robustly follow that intent even when…

Artificial Intelligence · Computer Science 2026-05-20 Qiaoyuan Zheng , Yiqu Yang , Qi Gao , Imanol Schlag

Inference-time alignment provides an efficient alternative for aligning LLMs with humans. However, these approaches still face challenges, such as limited scalability due to policy-specific value functions and latency during the inference…

Computation and Language · Computer Science 2025-05-27 Ruizhe Chen , Wenhao Chai , Zhifei Yang , Xiaotian Zhang , Joey Tianyi Zhou , Tony Quek , Soujanya Poria , Zuozhu Liu

Direct Preference Optimization (DPO) has emerged as a promising approach for aligning large language models with human preferences. While prior work mainly extends DPO from the aspect of the objective function, we instead improve DPO from…

Machine Learning · Computer Science 2026-02-17 Xun Deng , Han Zhong , Rui Ai , Fuli Feng , Zheng Wang , Xiangnan He

Sycophancy (overly agreeable or flattering behavior) poses a fundamental challenge for human-AI collaboration, particularly in high-stakes decision-making domains such as health, law, and education. A central difficulty in studying…

Artificial Intelligence · Computer Science 2026-05-05 Katherine Atwell , Pedram Heydari , Anthony Sicilia , Malihe Alikhani

Explaining black-box model behavior with natural language has achieved impressive results in various NLP tasks. Recent research has explored the utilization of subsequences from the input text as a rationale, providing users with evidence…

Computation and Language · Computer Science 2023-10-23 Yanrui Du , Sendong Zhao , Haochun Wang , Yuhan Chen , Rui Bai , Zewen Qiang , Muzhen Cai , Bing Qin

LLMs are increasingly used as third-party judges, yet their reliability when evaluating speakers in dialogue remains poorly understood. We show that LLMs judge identical claims differently depending on framing: the same content elicits…

Computation and Language · Computer Science 2026-01-19 Parisa Rabbani , Priyam Sahoo , Ruben Mathew , Aishee Mondal , Harshita Ketharaman , Nimet Beyza Bozdag , Dilek Hakkani-Tür

Large Language Models (LLMs) have demonstrated remarkable performance across various domains, motivating researchers to investigate their potential use in recommendation systems. However, directly applying LLMs to recommendation tasks has…

Information Retrieval · Computer Science 2024-06-21 Zhuoxi Bai , Ning Wu , Fengyu Cai , Xinyi Zhu , Yun Xiong

Large Language Model (LLM) agents have demonstrated impressive capabilities in handling complex interactive problems. Existing LLM agents mainly generate natural language plans to guide reasoning, which is verbose and inefficient. NL plans…

Artificial Intelligence · Computer Science 2025-06-03 Zouying Cao , Runze Wang , Yifei Yang , Xinbei Ma , Xiaoyong Zhu , Bo Zheng , Hai Zhao

Mental health disorders affect over 1 billion people worldwide, yet access to care remains limited by workforce shortages and cost constraints. While AI systems show therapeutic promise, current alignment approaches optimize objectives…

The rapid expansion of AI research has intensified the Reviewer Gap, threatening the peer-review sustainability and perpetuating a cycle of low-quality evaluations. This position paper critiques existing LLM approaches that automatically…

Artificial Intelligence · Computer Science 2026-01-15 JungMin Yun , JuneHyoung Kwon , MiHyeon Kim , YoungBin Kim

Large Language Model (LLM)-based multi-agent systems are increasingly used to simulate human interactions and solve collaborative tasks. A common practice is to assign agents with personas to encourage behavioral diversity. However, this…

Multiagent Systems · Computer Science 2025-11-18 Jiayi Li , Xiao Liu , Yansong Feng

Though reasoning abilities are considered language-agnostic, existing LLMs exhibit inconsistent reasoning abilities across different languages, e.g., reasoning in the dominant language like English is superior to other languages due to the…

Computation and Language · Computer Science 2024-04-16 Shuaijie She , Wei Zou , Shujian Huang , Wenhao Zhu , Xiang Liu , Xiang Geng , Jiajun Chen

The integration of large language models (LLMs) into intelligent tutoring systems offers transformative potential for personalized learning in higher education. However, most existing learning path planning approaches lack transparency,…

Artificial Intelligence · Computer Science 2026-01-27 Haoxin Xu , Changyong Qi , Tong Liu , Bohao Zhang , Anna He , Bingqian Jiang , Longwei Zheng , Xiaoqing Gu

Since the advent of large language models, prompt engineering now enables the rapid, low-effort creation of diverse autonomous agents that are already in widespread use. Yet this convenience raises urgent concerns about the safety,…

Artificial Intelligence · Computer Science 2025-06-27 Daewon Kang , YeongHwan Shin , Doyeon Kim , Kyu-Hwan Jung , Meong Hi Son

Despite the success of Vision-Language Models (VLMs), misleading charts remain a significant challenge due to their deceptive visual structures and distorted data representations. We present ChartCynics, an agentic dual-path framework…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yanjie Zhang , Yafei Li , Rui Sheng , Zixin Chen , Yanna Lin , Huamin Qu , Lei Chen , Yushi Sun