English
Related papers

Related papers: Temporal Preferences in Language Models for Long-H…

200 papers

In day-to-day communication, people often approximate the truth - for example, rounding the time or omitting details - in order to be maximally helpful to the listener. How do large language models (LLMs) handle such nuanced trade-offs? To…

Computation and Language · Computer Science 2024-02-14 Ryan Liu , Theodore R. Sumers , Ishita Dasgupta , Thomas L. Griffiths

The language generation and reasoning capabilities of large language models (LLMs) have enabled conversational systems with impressive performance in a variety of tasks, from code generation, to composing essays, to passing STEM and legal…

Artificial Intelligence · Computer Science 2025-02-28 Konstantina Christakopoulou , Iris Qu , John Canny , Andrew Goodridge , Cj Adams , Minmin Chen , Maja Matarić

Aligning the output of Large Language Models (LLMs) with human preferences (e.g., by means of reinforcement learning with human feedback, or RLHF) is essential for ensuring their effectiveness in real-world scenarios. Despite significant…

Artificial Intelligence · Computer Science 2024-10-23 Pietro Bernardelle , Gianluca Demartini

Robots operating in human-shared environments must not only achieve task-level navigation objectives such as safety and efficiency, but also adapt their behavior to human preferences. However, as human preferences are typically expressed in…

Robotics · Computer Science 2026-05-13 Tharun Sethuraman , Subham Agrawal , Nils Dengler , Jorge de Heuvel , Teena Hassan , Maren Bennewitz

Aligning Large Language Models (LLMs) with human preferences is critical, yet traditional fine-tuning methods are computationally expensive and inflexible. While test-time alignment offers a promising alternative, existing approaches often…

Artificial Intelligence · Computer Science 2026-01-16 Tiesunlong Shen , Rui Mao , Jin Wang , Heming Sun , Jian Zhang , Xuejie Zhang , Erik Cambria

In recent years, text-to-speech (TTS) has seen impressive advancements through large-scale language models, achieving human-level speech quality. Integrating human feedback has proven effective for enhancing robustness in these systems.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Kangxiang Xia , Xinfa Zhu , Jixun Yao , Lei Xie

Despite significant advancements in video large multimodal models (video-LMMs), achieving effective temporal grounding in long-form videos remains a challenge for existing models. To address this limitation, we propose Temporal Preference…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Rui Li , Xiaohan Wang , Yuhui Zhang , Orr Zohar , Zeyu Wang , Serena Yeung-Levy

This paper investigates real-time decision support systems that leverage low-latency AI models, bringing together recent progress in holistic AI-driven decision tools, integration with Edge-IoT technologies, and approaches for effective…

Artificial Intelligence · Computer Science 2025-12-12 Zechun Deng , Ziwei Liu , Ziqian Bi , Junhao Song , Chia Xin Liang , Joe Yeong , Xinyuan Song , Junfeng Hao

As a relative quality comparison of model responses, human and Large Language Model (LLM) preferences serve as common alignment goals in model fine-tuning and criteria in evaluation. Yet, these preferences merely reflect broad tendencies,…

Computation and Language · Computer Science 2024-02-20 Junlong Li , Fan Zhou , Shichao Sun , Yikai Zhang , Hai Zhao , Pengfei Liu

Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning and prediction across different domains. Yet, their ability to infer temporal regularities from structured behavioral data remains underexplored. This paper…

Preferences play a key role in determining what goals/constraints to satisfy when not all constraints can be satisfied simultaneously. In this work, we study preference-based planning in a stochastic system modeled as a Markov decision…

Formal Languages and Automata Theory · Computer Science 2022-03-28 Abhishek Ninad Kulkarni , Jie Fu

Large language models (LLMs) have shown great potential in natural language processing tasks, but their application to machine translation (MT) remains challenging due to pretraining on English-centric data and the complexity of…

Computation and Language · Computer Science 2025-01-24 Guofeng Cui , Pichao Wang , Yang Liu , Zemian Ke , Zhu Liu , Vimal Bhat

Alignment with human preferences is an important step in developing accurate and safe large language models. This is no exception in machine translation (MT), where better handling of language nuances and context-specific variations leads…

The use of large language models either as decision support systems, or in agentic workflows, is rapidly transforming the digital ecosystem. However, the understanding of LLM decision-making under uncertainty remains limited. We study LLM…

Artificial Intelligence · Computer Science 2026-04-22 Luise Ge , Yongyan Zhang , Yevgeniy Vorobeychik

In autoregressive large language models (LLMs), temporal straightening offers an account of how the next-token prediction objective shapes representations. Models learn to progressively straighten the representational trajectory of input…

Artificial Intelligence · Computer Science 2026-04-28 Jack King , Evelina Fedorenko , Eghbal A. Hosseini

Researchers have been studying approaches to steer the behavior of Large Language Models (LLMs) and build personalized LLMs tailored for various applications. While fine-tuning seems to be a direct solution, it requires substantial…

Computation and Language · Computer Science 2024-07-31 Yuanpu Cao , Tianrong Zhang , Bochuan Cao , Ziyi Yin , Lu Lin , Fenglong Ma , Jinghui Chen

Large language models (LLMs) are often trained on extensive, temporally indiscriminate text corpora, reflecting the lack of datasets with temporal metadata. This approach is not aligned with the evolving nature of language. Conventional…

Computation and Language · Computer Science 2024-04-30 Felix Drinkall , Eghbal Rahimikia , Janet B. Pierrehumbert , Stefan Zohren

Large Language Models (LLMs) are transforming human decision-making by acting as cognitive collaborators. Yet, this promise comes with a paradox: while LLMs can improve accuracy, they may also erode independent reasoning, promote…

Cryptography and Security · Computer Science 2025-09-09 Irdin Pekaric , Philipp Zech , Tom Mattson

Recent studies have shown that large language models' (LLMs) mathematical problem-solving capabilities can be enhanced by integrating external tools, such as code interpreters, and employing multi-turn Chain-of-Thought (CoT) reasoning.…

Traditional time series analysis has long relied on pattern recognition, trained on static and well-established benchmarks. However, in real-world settings -- where policies shift, human behavior adapts, and unexpected events unfold --…

Artificial Intelligence · Computer Science 2025-10-16 Xinlei Wang , Mingtian Tan , Jing Qiu , Junhua Zhao , Jinjin Gu