English
Related papers

Related papers: RoboEvolve: Co-Evolving Planner-Simulator for Robo…

200 papers

Recent advances in LLM-guided evolutionary computation, particularly AlphaEvolve (Novikov et al., 2025; Georgiev et al., 2025), have demonstrated remarkable success in discovering novel mathematical constructions and solving challenging…

Neural and Evolutionary Computing · Computer Science 2025-11-25 Valentin Khrulkov , Andrey Galichin , Denis Bashkirov , Dmitry Vinichenko , Oleg Travkin , Roman Alferov , Andrey Kuznetsov , Ivan Oseledets

Constructing controllable visual data is a major bottleneck for image editing and multimodal understanding. Useful supervision is rarely produced by a single rendering pass; instead it emerges through iterative generation, inspection,…

Artificial Intelligence · Computer Science 2026-05-05 Qisong Zhang , Wenzhuo Wu , Zhuangzhuang Jia , Yunhao Yang , Huayu Zhang , Xianghao Zang , Zhixiang He , Zhongjiang He , Kongming Liang , Zhanyu Ma

Recent advancements in prompt engineering strategies, such as Chain-of-Thought (CoT) and Self-Discover, have demonstrated significant potential in improving the reasoning abilities of Large Language Models (LLMs). However, these…

Computation and Language · Computer Science 2024-10-15 Krishna Aswani , Huilin Lu , Pranav Patankar , Priya Dhalwani , Iris Tan , Jayant Ganeshmohan , Simon Lacasse

Reinforcement learning for LLM agents is typically conducted on a static data distribution, which fails to adapt to the agent's evolving behavior and leads to poor coverage of complex environment interactions. To address these challenges,…

Computation and Language · Computer Science 2026-04-20 Shidong Yang , Ziyu Ma , Tongwen Huang , Yiming Hu , Yong Wang , Xiangxiang Chu

Designing dense reward functions is pivotal for efficient robotic Reinforcement Learning (RL). However, most dense rewards rely on manual engineering, which fundamentally limits the scalability and automation of reinforcement learning.…

Robotics · Computer Science 2026-05-08 Xunlan Zhou , Xuanlin Chen , Shaowei Zhang , ShengHua Wan , Xiaohai Hu , Lei Yuan , De-chuan Zhan

Robust robotic manipulation requires reliable failure detection and recovery. Although recent Vision-Language Models (VLMs) show promise in robot failure detection, their generalization is severely limited by the scarcity and narrow…

Robotics · Computer Science 2026-04-01 Paul Pacaud , Ricardo Garcia , Shizhe Chen , Cordelia Schmid

In this work, we focus on unsupervised vision-language-action mapping in the area of robotic manipulation. Recently, multiple approaches employing pre-trained large language and vision models have been proposed for this task. However, they…

Robotics · Computer Science 2025-05-29 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova

Large vision-language models (LVLMs) often fail to align with human preferences, leading to issues like generating misleading content without proper visual context (also known as hallucination). A promising solution to this problem is using…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Chenglong Wang , Yang Gan , Yifu Huo , Yongyu Mu , Murun Yang , Qiaozhi He , Tong Xiao , Chunliang Zhang , Tongran Liu , Quan Du , Di Yang , Jingbo Zhu

Crop monitoring is essential for precision agriculture, but current systems lack high-level reasoning. We introduce a novel, modular framework that uses a Visual Language Model (VLM) to guide robotic task planning, interleaving input…

Robotics · Computer Science 2026-01-21 Jose Cuaran , Kendall Koe , Aditya Potnis , Naveen Kumar Uppalapati , Girish Chowdhary

Advancements in large language models (LLMs) have demonstrated their potential in facilitating high-level reasoning, logical reasoning and robotics planning. Recently, LLMs have also been able to generate reward functions for low-level…

Robotics · Computer Science 2024-02-21 Marta Skreta , Zihan Zhou , Jia Lin Yuan , Kourosh Darvish , Alán Aspuru-Guzik , Animesh Garg

Scalable Embodied AI faces fundamental constraints due to prohibitive costs and safety risks of real-world interaction. While Embodied World Models (EWMs) offer promise through imagined rollouts, existing approaches suffer from geometric…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ruicheng Zhang , Guangyu Chen , Zunnan Xu , Zihao Liu , Zhizhou Zhong , Mingyang Zhang , Jun Zhou , Xiu Li

From rearranging objects on a table to putting groceries into shelves, robots must plan precise action points to perform tasks accurately and reliably. In spite of the recent adoption of vision language models (VLMs) to control robot…

Synthetic data generated by video generative models has shown promise for robot learning as a scalable pipeline, but it often suffers from inconsistent action quality due to imperfectly generated videos. Recently, vision-language models…

Robotics · Computer Science 2026-02-24 Seungku Kim , Suhyeok Jang , Byungjun Yoon , Dongyoung Kim , John Won , Jinwoo Shin

In this white paper, we present AlphaEvolve, an evolutionary coding agent that substantially enhances capabilities of state-of-the-art LLMs on highly challenging tasks such as tackling open scientific problems or optimizing critical pieces…

With Transformers achieving outstanding performance on individual remote sensing (RS) tasks, we are now approaching the realization of a unified model that excels across multiple tasks through multi-task learning (MTL). Compared to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Qingyun Li , Shuran Ma , Junwei Luo , Yi Yu , Yue Zhou , Fengxiang Wang , Xudong Lu , Xiaoxing Wang , Xin He , Yushi Chen , Xue Yang

Code LLMs have shown promising results with converting tasks in natural language to programs that can be executed by service robots. We are interested in finetuning small, specialized LLMs for this purpose, but collecting datasets of…

Computation and Language · Computer Science 2025-10-13 Zichao Hu , Junyi Jessy Li , Arjun Guha , Joydeep Biswas

Recent advancements in large language models (LLMs) have significantly enhanced the ability of LLM-based systems to perform complex tasks through natural language processing and tool interaction. However, optimizing these LLM-based systems…

Computation and Language · Computer Science 2025-06-19 Peiyan Zhang , Haibo Jin , Leyang Hu , Xinnuo Li , Liying Kang , Man Luo , Yangqiu Song , Haohan Wang

Self-evolving has emerged as a key paradigm for improving foundational models such as Large Language Models (LLMs) and Vision Language Models (VLMs) with minimal human intervention. While recent approaches have demonstrated that LLM agents…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Zongxia Li , Hongyang Du , Chengsong Huang , Xiyang Wu , Lantao Yu , Yicheng He , Jing Xie , Xiaomin Wu , Zhichao Liu , Jiarui Zhang , Fuxiao Liu

LLM-driven program evolution can discover high-quality programs, but its cost and run-to-run variance hinder reliable progress. We propose TurboEvolve, a multi-island evolutionary framework that improves sample efficiency and robustness…

Neural and Evolutionary Computing · Computer Science 2026-04-22 Yang Yang , Zining Zhong , Jindong Li , Jiemin Wu , Kaishen Yuan , Wenshuo Chen , Menglin Yang , Yutao Yue

LLM-driven evolutionary systems have shown promise for automated science discovery, yet existing approaches such as AlphaEvolve rely on full-code histories that are context-inefficient and potentially provide weak evolutionary guidance. In…

Artificial Intelligence · Computer Science 2026-02-04 Jiachen Jiang , Tianyu Ding , Zhihui Zhu