English
Related papers

Related papers: Training Stratigraphy: Persistent Behavioral Artif…

200 papers

Large Language Models (LLMs) have revolutionized conversational AI, yet their robustness in extended multi-turn dialogues remains poorly understood. Existing evaluation frameworks focus on static benchmarks and single-turn assessments,…

Computation and Language · Computer Science 2026-02-05 Yubo Li , Ramayya Krishnan , Rema Padman

The outstanding performance capabilities of large language model have driven the evolution of current AI system interaction patterns. This has led to considerable discussion within the Human-AI Interaction (HAII) community. Numerous studies…

Human-Computer Interaction · Computer Science 2026-04-02 Jiayang Li , Jiale Li

Reinforcement learning from human feedback (RLHF) has emerged as a powerful technique to make large language models (LLMs) more capable in complex settings. RLHF proceeds as collecting human preference data, training a reward model on said…

Machine Learning · Computer Science 2024-02-05 Nathan Lambert , Roberto Calandra

Reinforcement learning from human feedback (RLHF) is a variant of reinforcement learning (RL) that learns from human feedback instead of relying on an engineered reward function. Building on prior work on the related setting of…

Machine Learning · Computer Science 2025-12-30 Timo Kaufmann , Paul Weng , Viktor Bengs , Eyke Hüllermeier

We deploy the methods of controlled psycholinguistic experimentation to shed light on the extent to which the behavior of neural network language models reflects incremental representations of syntactic state. To do so, we examine model…

Computation and Language · Computer Science 2019-03-11 Richard Futrell , Ethan Wilcox , Takashi Morita , Peng Qian , Miguel Ballesteros , Roger Levy

AI agents are commonly aligned with "human values" through reinforcement learning from human feedback (RLHF), where a single reward model is learned from aggregated human feedback and used to align an agent's behavior. However, human values…

Artificial Intelligence · Computer Science 2025-06-24 Carter Blair , Kate Larson , Edith Law

Student engagement with large language models (LLMs) in academic writing is not a stable trait, an adoption decision, or a competency level; it is a continuously negotiated process that existing frameworks cannot adequately theorize.…

Computers and Society · Computer Science 2026-04-21 Shahin Hossain

This paper examines a critical yet unexplored dimension of the AI alignment problem: the potential for Large Language Models (LLMs) to inherit and amplify existing misalignments between human espoused theories and theories-in-use. Drawing…

Human-Computer Interaction · Computer Science 2025-07-04 Tim Rogers , Ben Teehankee

Predicting human interaction is challenging as the on-going activity has to be inferred based on a partially observed video. Essentially, a good algorithm should effectively model the mutual influence between the two interacting subjects.…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Yichao Yan , Bingbing Ni , Xiaokang Yang

Collaboration literacy requires adapting to the evolving demands of group work within complex discussions, making it difficult to develop and assess. Traditional analytics metrics capture behavioral signals while missing the semantic…

Human-Computer Interaction · Computer Science 2026-05-19 Dawei Xie , Khalil Anderson , Tochukwu Eze , Chenghong Lin , Bookyung Shin , Marcelo Worsley

Machine learning models can reach high performance on benchmark natural language processing (NLP) datasets but fail in more challenging settings. We study this issue when a pre-trained model learns dataset artifacts in natural language…

Computation and Language · Computer Science 2023-03-20 Zhenyuan Lu

Reinforcement Learning from Human Feedback (RLHF) is a pivotal technique that aligns language models closely with human-centric values. The initial phase of RLHF involves learning human values using a reward model from ranking data. It is…

Machine Learning · Computer Science 2024-01-30 Banghua Zhu , Michael I. Jordan , Jiantao Jiao

Despite the strong performance of Large Language Models (LLMs) on complex instruction-following tasks, precise control of output length remains a persistent challenge. Existing methods primarily attempt to enforce length constraints by…

Computation and Language · Computer Science 2026-03-23 Wei Zhang , Lintong Du , Yuanhe Zhang , Zhenhong Zhou , Kun Wang , Li Sun , Sen Su

Differentiating generated and human-written content is increasingly difficult. We examine how an incentive to convey humanness and task characteristics shape this human vs AI race across five studies. In Study 1-2 (n=530 and n=610) humans…

Computation and Language · Computer Science 2026-01-26 Bennett Kleinberg , Jari Zegers , Jonas Festor , Stefana Vida , Julian Präsent , Riccardo Loconte , Sanne Peereboom

A centerpiece of the ever-popular reinforcement learning from human feedback (RLHF) approach to fine-tuning autoregressive language models is the explicit training of a reward model to emulate human feedback, distinct from the language…

Computation and Language · Computer Science 2023-05-22 Wanqiao Xu , Shi Dong , Dilip Arumugam , Benjamin Van Roy

Behavioral annotation using signal processing and machine learning is highly dependent on training data and manual annotations of behavioral labels. Previous studies have shown that speech information encodes significant behavioral…

Machine Learning · Computer Science 2017-01-13 Haoqi Li , Brian Baucom , Panayiotis Georgiou

Traditional Large Language Model (LLM) pretraining relies on autoregressive language modeling with randomly sampled data from web-scale datasets. Inspired by human learning techniques like spaced repetition, we hypothesize that random…

Computation and Language · Computer Science 2025-01-30 Neha Prakriya , Jui-Nan Yen , Cho-Jui Hsieh , Jason Cong

Devising intelligent agents able to live in an environment and learn by observing the surroundings is a longstanding goal of Artificial Intelligence. From a bare Machine Learning perspective, challenges arise when the agent is prevented…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Matteo Tiezzi , Simone Marullo , Lapo Faggi , Enrico Meloni , Alessandro Betti , Stefano Melacci

We investigate whether Large Language Models (LLMs) exhibit human-like cognitive patterns under four established frameworks from psychology: Thematic Apperception Test (TAT), Framing Bias, Moral Foundations Theory (MFT), and Cognitive…

Artificial Intelligence · Computer Science 2025-12-12 Akash Kundu , Rishika Goswami

Human-AI interactions are increasingly part of everyday life, yet the interpersonal dynamics that unfold during such exchanges remain underexplored. This study investigates how emotional alignment, semantic exploration, and linguistic…

Human-Computer Interaction · Computer Science 2025-12-22 Halfdan Nordahl Fundal , Johannes Eide Rambøll , Karsten Olsen
‹ Prev 1 3 4 5 6 7 10 Next ›