English
Related papers

Related papers: Exploring Visual Prompting: Robustness Inheritance…

200 papers

Compared to the wide array of advanced Monte Carlo methods supported by modern probabilistic programming languages (PPLs), PPL support for variational inference (VI) is less developed: users are typically limited to a predefined selection…

Programming Languages · Computer Science 2024-06-25 McCoy R. Becker , Alexander K. Lew , Xiaoyan Wang , Matin Ghavami , Mathieu Huot , Martin C. Rinard , Vikash K. Mansinghka

A recent trend in deep learning algorithms has been towards training large scale models, having high parameter count and trained on big dataset. However, robustness of such large scale models towards real-world settings is still a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Nishant Jain , Harkirat Behl , Yogesh Singh Rawat , Vibhav Vineet

Visual model-based RL methods typically encode image observations into low-dimensional representations in a manner that does not eliminate redundant information. This leaves them susceptible to spurious variations -- changes in…

Machine Learning · Computer Science 2023-10-26 Chuning Zhu , Max Simchowitz , Siri Gadipudi , Abhishek Gupta

As the scale of vision models continues to grow, the emergence of Visual Prompt Tuning (VPT) as a parameter-efficient transfer learning technique has gained attention due to its superior performance compared to traditional full-finetuning.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Cheng Han , Qifan Wang , Yiming Cui , Wenguan Wang , Lifu Huang , Siyuan Qi , Dongfang Liu

Many real-world sequential decision making problems are partially observable by nature, and the environment model is typically unknown. Consequently, there is great need for reinforcement learning methods that can tackle such problems given…

Machine Learning · Computer Science 2018-06-08 Maximilian Igl , Luisa Zintgraf , Tuan Anh Le , Frank Wood , Shimon Whiteson

Reinforcement Learning with Verifiable Rewards (RLVR) enhances Large Language Model (LLM) reasoning but suffers from advantage collapse on ``hard samples'' where all rollouts fail. This lack of variance eliminates crucial learning signals.…

Machine Learning · Computer Science 2026-05-08 Xinyu Lu , Kaiqi Zhang , Jinglin Yang , Boxi Cao , Yaojie Lu , Hongyu Lin , Min He , Xianpei Han , Le Sun

Weakly-supervised learning (WSL) has shown promising results in addressing label scarcity on many NLP tasks, but manually designing a comprehensive, high-quality labeling rule set is tedious and difficult. We study interactive…

Computation and Language · Computer Science 2022-03-21 Rongzhi Zhang , Yue Yu , Pranav Shetty , Le Song , Chao Zhang

Adversarial learning methods have been proposed for a wide range of applications, but the training of adversarial models can be notoriously unstable. Effectively balancing the performance of the generator and discriminator is critical,…

Machine Learning · Computer Science 2020-08-26 Xue Bin Peng , Angjoo Kanazawa , Sam Toyer , Pieter Abbeel , Sergey Levine

Multi-vehicle pursuit (MVP) such as autonomous police vehicles pursuing suspects is important but very challenging due to its mission and safety critical nature. While multi-agent reinforcement learning (MARL) algorithms have been proposed…

Artificial Intelligence · Computer Science 2023-06-09 Xinhang Li , Yiying Yang , Zheng Yuan , Zhe Wang , Qinwen Wang , Chen Xu , Lei Li , Jianhua He , Lin Zhang

This paper investigates model robustness in reinforcement learning (RL) to reduce the sim-to-real gap in practice. We adopt the framework of distributionally robust Markov decision processes (RMDPs), aimed at learning a policy that…

Machine Learning · Computer Science 2025-09-09 Laixi Shi , Gen Li , Yuting Wei , Yuxin Chen , Matthieu Geist , Yuejie Chi

Visual explanation (attention)-guided learning uses not only labels but also explanations to guide model reasoning process. While visual attention-guided learning has shown promising results, it requires a large number of explanation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Yifei Zhang , Siyi Gu , Bo Pan , Guangji Bai , Meikang Qiu , Xiaofeng Yang , Liang Zhao

Visual imitation learning frameworks allow robots to learn manipulation skills from expert demonstrations. While existing approaches mainly focus on policy design, they often neglect the structure and capacity of visual encoders, limiting…

Robotics · Computer Science 2025-09-24 Shijia Ge , Yinxin Zhang , Shuzhao Xie , Weixiang Zhang , Mingcai Zhou , Zhi Wang

In Reinforcement Learning with Verifiable Rewards (RLVR), constructing a robust advantage baseline is critical for policy gradients, effectively guiding the policy model to reinforce desired behaviors. Recent research has introduced…

Machine Learning · Computer Science 2026-03-12 Yi-Kai Zhang , Yueqing Sun , Hongyan Hao , Qi Gu , Xunliang Cai , De-Chuan Zhan , Han-Jia Ye

Vision-language (VL) models, pretrained on colossal image-text datasets, have attained broad VL competence that is difficult to evaluate. A common belief is that a small number of VL skills underlie the variety of VL tests. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Anthony Meng Huat Tiong , Junqi Zhao , Boyang Li , Junnan Li , Steven C. H. Hoi , Caiming Xiong

Visual Prompt Tuning (VPT) has become a promising solution for Parameter-Efficient Fine-Tuning (PEFT) approach for Vision Transformer (ViT) models by partially fine-tuning learnable tokens while keeping most model parameters frozen. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Li Ren , Chen Chen , Liqiang Wang , Kien Hua

In this paper, we investigate the problem of offline Preference-based Reinforcement Learning (PbRL) with human feedback where feedback is available in the form of preference between trajectory pairs rather than explicit rewards. Our…

Machine Learning · Computer Science 2023-10-03 Wenhao Zhan , Masatoshi Uehara , Nathan Kallus , Jason D. Lee , Wen Sun

A common assumption in machine learning is that samples are independently and identically distributed (i.i.d). However, the contributions of different samples are not identical in training. Some samples are difficult to learn and some…

Machine Learning · Computer Science 2021-11-23 Ou Wu , Weiyao Zhu , Yingjun Deng , Haixiang Zhang , Qinghu Hou

Reinforcement Learning (RL) algorithms suffer from the dependency on accurately engineered reward functions to properly guide the learning agents to do the required tasks. Preference-based reinforcement learning (PbRL) addresses that by…

Artificial Intelligence · Computer Science 2024-08-23 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

In real-world deployment, vision-language models often encounter disturbances such as weather, occlusion, and camera motion. Under such conditions, their understanding and reasoning degrade substantially, revealing a gap between clean,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yangfan He , Changgyu Boo , Jaehong Yoon

Vision-Language-Action (VLA) models map multimodal inputs directly to robot actions and are typically trained through large-scale imitation learning. While this paradigm has shown strong performance, prevailing VLA training procedures do…

Machine Learning · Computer Science 2026-05-06 Yubai Wei , Chen Wu , Hashem Haghbayan