English
Related papers

Related papers: ZEBRA: Leveraging Model-Behavioral Knowledge for Z…

200 papers

Instruction-based Large Language Models (LLMs) have proven effective in numerous few-shot or zero-shot Natural Language Processing (NLP) tasks. However, creating human-annotated instruction data is time-consuming, expensive, and often…

Computation and Language · Computer Science 2025-05-13 Aniruddha Roy , Pretam Ray , Abhilash Nandy , Somak Aditya , Pawan Goyal

Direct alignment methods are increasingly used for aligning large language models (LLMs) with human preferences. However, these methods suffer from the issues of verbosity and likelihood displacement, which can be driven by the noisy…

Computation and Language · Computer Science 2025-10-28 Peter Chen , Xi Chen , Wotao Yin , Tianyi Lin

With the rapid development of Large Language Models (LLMs), aligning these models with human preferences and values is critical to ensuring ethical and safe applications. However, existing alignment techniques such as RLHF or DPO often…

Computation and Language · Computer Science 2025-08-19 Yang Zhang , Yu Yu , Bo Tang , Yu Zhu , Chuxiong Sun , Wenqiang Wei , Jie Hu , Zipeng Xie , Zhiyu Li , Feiyu Xiong , Edward Chung

Although the annotation paradigm based on Large Language Models (LLMs) has made significant breakthroughs in recent years, its actual deployment still has two core bottlenecks: first, the cost of calling commercial APIs in large-scale…

Computation and Language · Computer Science 2025-06-23 Yao Lu , Zhaiyuan Ji , Jiawei Du , Yu Shanqing , Qi Xuan , Tianyi Zhou

In aligning large language models (LLMs), utilizing feedback from existing advanced AI rather than humans is an important method to scale supervisory signals. However, it is highly challenging for AI to understand human intentions and…

Computation and Language · Computer Science 2024-06-18 Rong Bao , Rui Zheng , Shihan Dou , Xiao Wang , Enyu Zhou , Bo Wang , Qi Zhang , Liang Ding , Dacheng Tao

Preference-based reinforcement learning (RL) has emerged as a new field in robot learning, where humans play a pivotal role in shaping robot behavior by expressing preferences on different sequences of state-action pairs. However,…

Robotics · Computer Science 2024-02-26 Simon Holk , Daniel Marta , Iolanda Leite

While textless Spoken Language Models (SLMs) have shown potential in end-to-end speech-to-speech modeling, they still lag behind text-based Large Language Models (LLMs) in terms of semantic coherence and relevance. This work introduces the…

Computation and Language · Computer Science 2025-05-28 Guan-Ting Lin , Prashanth Gurunath Shivakumar , Aditya Gourav , Yile Gu , Ankur Gandhe , Hung-yi Lee , Ivan Bulyko

Public health researchers are increasingly interested in using social media data to study health-related behaviors, but manually labeling this data can be labor-intensive and costly. This study explores whether zero-shot labeling using…

Computation and Language · Computer Science 2025-02-11 Kamyar Kazari , Yong Chen , Zahra Shakeri

Preference learning is critical for aligning large language models (LLMs) with human values, yet its success hinges on high-quality datasets comprising three core components: Preference \textbf{A}nnotations, \textbf{I}nstructions, and…

Computation and Language · Computer Science 2025-09-03 Bingxiang He , Wenbin Zhang , Jiaxi Song , Cheng Qian , Zixuan Fu , Bowen Sun , Ning Ding , Haiwen Hong , Longtao Huang , Hui Xue , Ganqu Cui , Wanxiang Che , Zhiyuan Liu , Maosong Sun

The success of the reward model in distinguishing between responses with subtle safety differences depends critically on the high-quality preference dataset, which should capture the fine-grained nuances of harmful and harmless responses.…

Computation and Language · Computer Science 2024-12-19 Duanyu Feng , Bowen Qin , Chen Huang , Youcheng Huang , Zheng Zhang , Wenqiang Lei

Offline preference-based reinforcement learning (PbRL) provides an effective way to overcome the challenges of designing reward and the high costs of online interaction. However, since labeling preference needs real-time human feedback,…

Machine Learning · Computer Science 2026-02-10 Xiao-Yin Liu , Guotao Li , Xiao-Hu Zhou , Zeng-Guang Hou

When aligning large language models (LLMs), their performance on various tasks (such as being helpful, harmless, and honest) depends heavily on the composition of their training data. However, selecting a data mixture that achieves strong…

Machine Learning · Computer Science 2025-06-03 Nicholas E. Corrado , Julian Katz-Samuels , Adithya Devraj , Hyokun Yun , Chao Zhang , Yi Xu , Yi Pan , Bing Yin , Trishul Chilimbi

Preference learning is critical for aligning large language models (LLMs) with human values, with the quality of preference datasets playing a crucial role in this process. While existing metrics primarily assess data quality based on…

Machine Learning · Computer Science 2025-03-05 Kexin Huang , Junkang Wu , Ziqian Chen , Xue Wang , Jinyang Gao , Bolin Ding , Jiancan Wu , Xiangnan He , Xiang Wang

Token-level attention tuning, a class of training-free methods including Post-hoc Attention Steering (PASTA) and Attention Calibration (ACT), has emerged as a promising approach for improving frozen LLMs via interpretable interventions.…

Computation and Language · Computer Science 2026-02-12 Feijiang Han , Xiaodong Yu , Jianheng Tang , Delip Rao , Weihua Du , Lyle Ungar

Human feedback plays a pivotal role in aligning large language models (LLMs) with human preferences. However, such feedback is often noisy or inconsistent, which can degrade the quality of reward models and hinder alignment. While various…

Artificial Intelligence · Computer Science 2025-10-15 Samuel Yeh , Sharon Li

Recent advances in neural decoding have enabled the reconstruction of visual experiences from brain activity, positioning fMRI-to-image reconstruction as a promising bridge between neuroscience and computer vision. However, current methods…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Haonan Wang , Jingyu Lu , Hongrui Li , Xiaomeng Li

Large Language Models (LLMs) have improved substantially alignment, yet their behavior remains highly sensitive to prompt phrasing. This brittleness has motivated automated prompt engineering, but most existing methods (i) require a…

Computation and Language · Computer Science 2026-03-05 Bartosz Dziuba , Kacper Kuchta , Paweł Batorski , Przemysław Spurek , Paul Swoboda

In the context of text classification, the financial burden of annotation exercises for creating training data is a critical issue. Active learning techniques, particularly those rooted in uncertainty sampling, offer a cost-effective…

Computation and Language · Computer Science 2024-06-19 Hamidreza Rouzegar , Masoud Makrehchi

Training models for Aspect-Based Sentiment Analysis (ABSA) tasks requires manually annotated data, which is expensive and time-consuming to obtain. This paper introduces LA-ABSA, a novel approach that leverages Large Language Model…

Computation and Language · Computer Science 2026-03-03 Nils Constantin Hellwig , Jakob Fehle , Udo Kruschwitz , Christian Wolff

Large Language Models (LLMs) are increasingly used as automated annotators to scale dataset creation, yet their reliability as unbiased annotators--especially for low-resource and identity-sensitive settings--remains poorly understood. In…

Computation and Language · Computer Science 2026-03-03 Md. Najib Hasan , Touseef Hasan , Souvika Sarkar