English
Related papers

Related papers: Zero-Shot Generalization of Vision-Based RL Withou…

200 papers

Reasoning-based image quality assessment (IQA) models trained through reinforcement learning (RL) exhibit exceptional generalization, yet the underlying mechanisms and critical factors driving this capability remain underexplored in current…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Shijie Zhao , Xuanyu Zhang , Weiqi Li , Junlin Li , Li Zhang , Tianfan Xue , Jian Zhang

Recent studies have successfully integrated large vision-language models (VLMs) into low-level robotic control by supervised fine-tuning (SFT) with expert robotic datasets, resulting in what we term vision-language-action (VLA) models.…

Robotics · Computer Science 2025-01-29 Yanjiang Guo , Jianke Zhang , Xiaoyu Chen , Xiang Ji , Yen-Jen Wang , Yucheng Hu , Jianyu Chen

Despite the recent success of deep reinforcement learning (RL), domain adaptation remains an open problem. Although the generalization ability of RL agents is critical for the real-world applicability of Deep RL, zero-shot policy transfer…

Machine Learning · Computer Science 2021-09-06 Jinwei Xing , Takashi Nagata , Kexin Chen , Xinyun Zou , Emre Neftci , Jeffrey L. Krichmar

Data augmentation reduces the generalization error by forcing a model to learn invariant representations given different transformations of the input image. In computer vision, on top of the standard image processing functions, data…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Rowel Atienza

This paper establishes directionality reinforcement learning (DRL) technique to propose the complete decentralized multi-agent reinforcement learning method which can achieve cooperation based on each agent's learning: no communication and…

Multiagent Systems · Computer Science 2021-10-13 Fumito Uwano , Keiki Takadama

Convolutional neural networks have been widely applied to medical image segmentation and have achieved considerable performance. However, the performance may be significantly affected by the domain gap between training data (source domain)…

Image and Video Processing · Electrical Eng. & Systems 2022-07-28 Junyan Lyu , Yiqi Zhang , Yijin Huang , Li Lin , Pujin Cheng , Xiaoying Tang

Reinforcement learning (RL) agents are widely used for solving complex sequential decision making tasks, but still exhibit difficulty in generalizing to scenarios not seen during training. While prior online approaches demonstrated that…

Machine Learning · Computer Science 2021-11-30 Bogdan Mazoure , Ilya Kostrikov , Ofir Nachum , Jonathan Tompson

Autonomous agents trained using deep reinforcement learning (RL) often lack the ability to successfully generalise to new environments, even when these environments share characteristics with the ones they have encountered during training.…

Machine Learning · Computer Science 2024-06-17 Samuel Garcin , James Doran , Shangmin Guo , Christopher G. Lucas , Stefano V. Albrecht

Supervised fine-tuning (SFT) has become the de facto post-training strategy for large vision-language-action (VLA) models, but its reliance on costly human demonstrations limits scalability and generalization. We propose Probe, Learn,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Wenli Xiao , Haotian Lin , Andy Peng , Haoru Xue , Tairan He , Yuqi Xie , Fengyuan Hu , Jimmy Wu , Zhengyi Luo , Linxi "Jim" Fan , Guanya Shi , Yuke Zhu

We propose Disentanglement based Active Learning (DAL), a new active learning technique based on self-supervision which leverages the concept of disentanglement. Instead of requesting labels from human oracle, our method automatically…

Machine Learning · Computer Science 2021-09-28 Silpa Vadakkeeveetil Sreelatha , Adarsh Kappiyath , Sumitra S

Data augmentation (DA) plays a critical role in improving the generalization of deep learning models. Recent works on automatically searching for DA policies from data have achieved great success. However, existing automated DA methods…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Shiqi Lin , Tao Yu , Ruoyu Feng , Xin Li , Xin Jin , Zhibo Chen

Disentangled representation learning has been proposed as an approach to learning general representations even in the absence of, or with limited, supervision. A good general representation can be fine-tuned for new target tasks using…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Xiao Liu , Pedro Sanchez , Spyridon Thermos , Alison Q. O'Neil , Sotirios A. Tsaftaris

Vision-language-action (VLA) models finetuned from vision-language models (VLMs) hold the promise of leveraging rich pretrained representations to build generalist robots across diverse tasks and environments. However, direct fine-tuning on…

Robotics · Computer Science 2025-09-18 Shresth Grover , Akshay Gopalkrishnan , Bo Ai , Henrik I. Christensen , Hao Su , Xuanlin Li

Deep neural networks have achieved promising progress in remote sensing (RS) image classification, for which the training process requires abundant samples for each class. However, it is time-consuming and unrealistic to annotate labels for…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Wenjia Xu , Jiuniu Wang , Zhiwei Wei , Mugen Peng , Yirong Wu

Large-scale pre-trained Vision-Language Models (VLMs) have demonstrated strong few-shot learning capabilities. However, these methods typically learn holistic representations where an image's domain-invariant structure is implicitly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hieu Dinh Trung Pham , Huy Minh Nhat Nguyen , Cuong Tuan Nguyen

Visual Reinforcement Learning (RL) methods often require extensive amounts of data. As opposed to model-free RL, model-based RL (MBRL) offers a potential solution with efficient data utilization through planning. Additionally, RL lacks…

Machine Learning · Computer Science 2025-01-16 Moritz Schneider , Robert Krug , Narunas Vaskevicius , Luigi Palmieri , Joschka Boedecker

Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically requires to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Adria Ruiz , Oriol Martinez , Xavier Binefa , Jakob Verbeek

Learning to classify video data from classes not included in the training data, i.e. video-based zero-shot learning, is challenging. We conjecture that the natural alignment between the audio and visual modalities in video data provides a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Otniel-Bogdan Mercea , Lukas Riesch , A. Sophia Koepke , Zeynep Akata

In zero-shot learning (ZSL), the samples to be classified are usually projected into side information templates such as attributes. However, the irregular distribution of templates makes classification results confused. To alleviate this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Fuzhen Li , Zhenfeng Zhu , Xingxing Zhang , Jian Cheng , Yao Zhao

The recently proposed panoptic segmentation task presents a significant challenge of image understanding with computer vision by unifying semantic segmentation and instance segmentation tasks. In this paper we present an efficient and novel…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Yang Liu , Pietro Perona , Markus Meister