English
Related papers

Related papers: CORE: Code-based Inverse Self-Training Framework w…

200 papers

This work introduces a novel generative continual learning framework based on self-organizing maps (SOMs) and variational autoencoders (VAEs) to enable memory-efficient replay, eliminating the need to store raw data samples or task labels.…

Machine Learning · Computer Science 2025-09-01 Pujan Thapa , Alexander Ororbia , Travis Desell

Large language models show strong potential for automated code generation, but lack guarantees for correctness, quality, safety, and domain-specific constraints. For instance in robotics, where code generation is increasingly being used for…

Machine Learning · Computer Science 2026-05-21 Erfan Aghadavoodi Jolfaei , Daniel Maninger , Abhinav Anand , Mert Tiftikci , Mira Mezini

Vision-Language-Action (VLA) models have demonstrated potential in autonomous driving. However, two critical challenges hinder their development: (1) Existing VLA architectures are typically based on imitation learning in open-loop setup…

Artificial Intelligence · Computer Science 2025-08-18 Anqing Jiang , Yu Gao , Yiru Wang , Zhigang Sun , Shuo Wang , Yuwen Heng , Hao Sun , Shichen Tang , Lijuan Zhu , Jinhao Chai , Jijun Wang , Zichong Gu , Hao Jiang , Li Sun

This paper introduces a learning-based visual planner for agile drone flight in cluttered environments. The proposed planner generates collision-free waypoints in milliseconds, enabling drones to perform agile maneuvers in complex…

Robotics · Computer Science 2025-11-21 Minwoo Kim , Geunsik Bae , Jinwoo Lee , Woojae Shin , Changseung Kim , Myong-Yol Choi , Heejung Shin , Hyondong Oh

Extrapolating beyond-demonstrator (BD) performance through the imitation learning (IL) algorithm aims to learn from and subsequently outperform the demonstrator. To that end, a representative approach is to leverage inverse reinforcement…

Machine Learning · Computer Science 2022-02-28 Mingqi Yuan , Mao-on Pun

Multi-Agent Reinforcement Learning can lead to the development of collaborative agent behaviors that show similarities with organizational concepts. Pushing forward this perspective, we introduce a novel framework that explicitly…

Artificial Intelligence · Computer Science 2025-04-01 Julien Soulé , Jean-Paul Jamont , Michel Occello , Louis-Marie Traonouez , Paul Théron

Code-generating tools are increasingly used in software development, yet experience reports on conversational "vibe coding" under production constraints remain limited. This paper presents an experience report from a small full-stack team…

Software Engineering · Computer Science 2026-03-13 Md Nasir Uddin Shuvo , Md Aidul Islam , Md Mahade Hasan , Muhammad Waseem , Pekka Abrahamsson

The emergence of Multimodal Large Language Models (MLLMs) has driven significant advances in Graphical User Interface (GUI) agent capabilities. Nevertheless, existing GUI agent training and inference techniques still suffer from a dilemma…

Artificial Intelligence · Computer Science 2026-04-09 Shuquan Lian , Yuhang Wu , Jia Ma , Yifan Ding , Zihan Song , Bingqi Chen , Xiawu Zheng , Hui Li , Rongrong Ji

"Code-as-Policy" considers how executable code can complement data-intensive Vision-Language-Action (VLA) methods, yet their effectiveness as autonomous controllers for embodied manipulation remains underexplored. We present CaP-X, an…

Recommender systems trained on offline historical user behaviors are embracing conversational techniques to online query user preference. Unlike prior conversational recommendation approaches that systemically combine conversational and…

Information Retrieval · Computer Science 2023-10-09 Jiarui Jin , Xianyu Chen , Fanghua Ye , Mengyue Yang , Yue Feng , Weinan Zhang , Yong Yu , Jun Wang

Multi-agent learning is a promising method to simulate aggregate competitive behaviour in finance. Learning expert agents' reward functions through their external demonstrations is hence particularly relevant for subsequent design of…

Machine Learning · Computer Science 2019-06-13 Jacobo Roa-Vicens , Cyrine Chtourou , Angelos Filos , Francisco Rullan , Yarin Gal , Ricardo Silva

We propose a novel method that leverages sparse autoencoders (SAEs) and clustering techniques to analyze the internal token representations of large language models (LLMs) and guide generations in mathematical reasoning tasks. Our approach…

Artificial Intelligence · Computer Science 2025-10-03 Daniel Zhao , Abhilash Shankarampeta , Lanxiang Hu , Tajana Rosing , Hao Zhang

Long Chain-of-Thought (LCoT), achieved by Reinforcement Learning with Verifiable Rewards (RLVR), has proven effective in enhancing the reasoning capabilities of Large Language Models (LLMs). However, reasoning in current LLMs is primarily…

In the realm of computational knowledge representation, Knowledge Graph Reasoning (KG-R) stands at the forefront of facilitating sophisticated inferential capabilities across multifarious domains. The quintessence of this research…

Artificial Intelligence · Computer Science 2024-03-12 Chen Li , Haotian Zheng , Yiping Sun , Cangqing Wang , Liqiang Yu , Che Chang , Xinyu Tian , Bo Liu

Imitation learning, followed by reinforcement learning algorithms, is a promising paradigm to solve complex control tasks sample-efficiently. However, learning from demonstrations often suffers from the covariate shift problem, which…

Machine Learning · Computer Science 2019-10-14 Yuping Luo , Huazhe Xu , Tengyu Ma

Recent advances in Vision-Language-Action (VLA) models have shown promise for robot control, but their dependence on action supervision limits scalability and generalization. To address this challenge, we introduce CARE, a novel framework…

Robotics · Computer Science 2026-02-02 Jiaqi Shi , Xulong Zhang , Xiaoyang Qu , Jianzong Wang

Traditional multi-agent reinforcement learning (MARL) algorithms, such as independent Q-learning, struggle when presented with partially observable scenarios, and where agents are required to develop delicate action sequences. This is often…

Machine Learning · Computer Science 2022-11-21 F. Bredell , H. A. Engelbrecht , J. C. Schoeman

Agents that can learn to imitate given video observation -- \emph{without direct access to state or action information} are more applicable to learning in the natural world. However, formulating a reinforcement learning (RL) agent that…

Machine Learning · Computer Science 2023-07-14 Glen Berseth , Florian Golemo , Christopher Pal

Augmented reality applications have rapidly spread across online platforms, allowing consumers to virtually try-on a variety of products, such as makeup, hair dying, or shoes. However, parametrizing a renderer to synthesize realistic images…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Robin Kips , Ruowei Jiang , Sileye Ba , Brendan Duke , Matthieu Perrot , Pietro Gori , Isabelle Bloch

Exploration in an unknown environment is the core functionality for mobile robots. Learning-based exploration methods, including convolutional neural networks, provide excellent strategies without human-designed logic for the feature…

Robotics · Computer Science 2016-10-10 Lei Tai , Ming Liu