English
Related papers

Related papers: EvoNav: Evolutionary Reward Function Design for Ro…

200 papers

Reward-based alignment methods for large language models (LLMs) face two key limitations: vulnerability to reward hacking, where models exploit flaws in the reward signal; and reliance on brittle, labor-intensive prompt engineering when…

Computation and Language · Computer Science 2025-05-20 Zae Myung Kim , Chanwoo Park , Vipul Raheja , Suin Kim , Dongyeop Kang

Scientific idea generation is a cornerstone of autonomous knowledge discovery, yet the iterative evolution required to transform initial concepts into high-quality research proposals remains a formidable challenge for Large Language Models…

Artificial Intelligence · Computer Science 2026-03-24 Andreas Sauter , Yuyue Zhao , Jacopo Urbani , Wenxiang Hu , Zaiqiao Meng , Lun Zhou , Xiaohui Yan , Yougang Lyu

Automating optimization modeling with LLMs is a promising path toward scalable decision intelligence, but existing approaches either rely on agentic pipelines built on closed-source LLMs with high inference latency, or fine-tune smaller…

Artificial Intelligence · Computer Science 2026-04-02 Runda Guan , Xiangqing Shen , Jiajun Zhang , Yifan Zhang , Jian Cheng , Rui Xia

Reinforcement learning (RL) faces challenges in evaluating policy trajectories within intricate game tasks due to the difficulty in designing comprehensive and precise reward functions. This inherent difficulty curtails the broader…

Artificial Intelligence · Computer Science 2024-07-02 Zichao Shen , Tianchen Zhu , Qingyun Sun , Shiqi Gao , Jianxin Li

When robots enter everyday human environments, they need to understand their tasks and how they should perform those tasks. To encode these, reward functions, which specify the objective of a robot, are employed. However, designing reward…

Robotics · Computer Science 2022-10-21 Erdem Bıyık

Recent high-capacity vision-language-action (VLA) models have demonstrated impressive performance on a range of robotic manipulation tasks by imitating human demonstrations. However, exploiting offline data with limited visited states will…

Robotics · Computer Science 2025-05-27 Guanxing Lu , Wenkai Guo , Chubin Zhang , Yuheng Zhou , Haonan Jiang , Zifeng Gao , Yansong Tang , Ziwei Wang

Visual navigation is an essential skill for home-assistance robots, providing the object-searching ability to accomplish long-horizon daily tasks. Many recent approaches use Large Language Models (LLMs) for commonsense inference to improve…

Robotics · Computer Science 2024-10-15 Xinxin Zhao , Wenzhe Cai , Likun Tang , Teng Wang

Natural and formal languages provide an effective mechanism for humans to specify instructions and reward functions. We investigate how to generate policies via RL when reward functions are specified in a symbolic language captured by…

Machine Learning · Computer Science 2022-11-24 Andrew C. Li , Zizhao Chen , Pashootan Vaezipoor , Toryn Q. Klassen , Rodrigo Toro Icarte , Sheila A. McIlraith

Automatically generating training supervision for embodied tasks is crucial, as manual designing is tedious and not scalable. While prior works use large language models (LLMs) or vision-language models (VLMs) to generate rewards, these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Xiaowen Qiu , Yian Wang , Jiting Cai , Zhehuan Chen , Chunru Lin , Tsun-Hsuan Wang , Chuang Gan

Reinforcement Learning (RL) in environments with complex, history-dependent reward structures poses significant challenges for traditional methods. In this work, we introduce a novel approach that leverages automaton-based feedback to guide…

Machine Learning · Computer Science 2025-10-20 Mahyar Alinejad , Alvaro Velasquez , Yue Wang , George Atia

Space exploration missions have seen use of increasingly sophisticated robotic systems with ever more autonomy. Deep learning promises to take this even a step further, and has applications for high-level tasks, like path planning, as well…

Machine Learning · Computer Science 2019-09-16 Tamir Blum , William Jones , Kazuya Yoshida

Reward models are central to large language model (LLM) post-training. However, past work has shown that they can reward spurious or undesirable attributes such as length, format, hallucinations, and sycophancy. In this work, we introduce…

Machine Learning · Computer Science 2026-02-18 Atticus Wang , Iván Arcuschin , Arthur Conmy

Reinforcement Learning (RL) plays an important role in the robotic manipulation domain since it allows self-learning from trial-and-error interactions with the environment. Still, sample efficiency and reward specification seriously limit…

Robotics · Computer Science 2023-11-07 Kun Chu , Xufeng Zhao , Cornelius Weber , Mengdi Li , Stefan Wermter

Techniques based on Reinforcement Learning (RL) are increasingly being used to design control policies for robotic systems. RL fundamentally relies on state-based reward functions to encode desired behavior of the robot and bad reward…

Robotics · Computer Science 2020-11-11 Parv Kapoor , Anand Balakrishnan , Jyotirmoy V. Deshmukh

Reward design plays a pivotal role in aligning large language models (LLMs) with human values, serving as the bridge between feedback signals and model optimization. This survey provides a structured organization of reward modeling and…

Computation and Language · Computer Science 2025-09-03 Miaomiao Ji , Yanqiu Wu , Zhibin Wu , Shoujin Wang , Jian Yang , Mark Dras , Usman Naseem

Large language model alignment via reinforcement learning depends critically on reward function quality. However, static, domain-specific reward models are often costly to train and exhibit poor generalization in out-of-distribution…

Computation and Language · Computer Science 2026-03-03 Andrew Zhuoer Feng , Cunxiang Wang , Bosi Wen , Yidong Wang , Yu Luo , Hongning Wang , Minlie Huang

The reasoning frontier of Large Language Models (LLMs) has advanced significantly through modern post-training paradigms (e.g., Reinforcement Learning from Verifiable Rewards (RLVR)). However, the efficacy of these methods remains…

Machine Learning · Computer Science 2026-05-13 Liqin Ye , Yanbin Yin , Michael Galarnyk , Yuzhao Heng , Sudheer Chava , Chao Zhang

Vision-Language-Action (VLA) models have become a prominent paradigm for embodied intelligence, yet further performance improvements typically rely on scaling up training data and model size -- an approach that is prohibitively expensive…

Robotics · Computer Science 2025-10-15 Mingtong Dai , Lingbo Liu , Yongjie Bai , Yang Liu , Zhouxia Wang , Rui SU , Chunjie Chen , Liang Lin , Xinyu Wu

Language models (LMs) are increasingly applied to robotic navigation; however, existing benchmarks primarily emphasize navigation success rates while paying limited attention to social compliance. Moreover, relying on large-scale LMs can…

Robotics · Computer Science 2026-03-24 Ling Xiao , Daeun Song , Xuesu Xiao , Toshihiko Yamasaki

Embodied navigation presents a core challenge for intelligent robots, requiring the comprehension of visual environments, natural language instructions, and autonomous exploration. Existing models often fall short in offering a unified…

Robotics · Computer Science 2026-01-08 Xinda Xue , Junjun Hu , Minghua Luo , Shichao Xie , Jintao Chen , Zixun Xie , Kuichen Quan , Wei Guo , Mu Xu , Zedong Chu