English
Related papers

Related papers: Self-Consistent Model-based Adaptation for Visual …

200 papers

Recent advances in end-to-end video compression have shown promising results owing to their unified end-to-end learning optimization. However, such generalized frameworks often lack content-specific adaptation, leading to suboptimal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Tiange Zhang , Xiandong Meng , Siwei Ma

Vision-based reinforcement learning requires efficient and robust representations of image-based observations, especially when the images contain distracting (task-irrelevant) elements such as shadows, clouds, and light. It becomes more…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Kyungsoo Kim , Jeongsoo Ha , Yusung Kim

At the core of self-supervised learning for vision is the idea of learning invariant or equivariant representations with respect to a set of data transformations. This approach, however, introduces strong inductive biases, which can render…

Machine Learning · Computer Science 2024-05-29 Sharut Gupta , Chenyu Wang , Yifei Wang , Tommi Jaakkola , Stefanie Jegelka

Continual learning in large language models (LLMs) is prone to catastrophic forgetting, where adapting to new tasks significantly degrades performance on previously learned ones. Existing methods typically rely on low-rank,…

Vision-Language Models (VLMs) have achieved remarkable success in visual question answering tasks, but their reliance on large numbers of visual tokens introduces significant computational overhead. While existing efficient VLM approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zichuan Lin , Yicheng Liu , Yang Yang , Lvfang Tao , Deheng Ye

Domain adaptation (DA) paves the way for label annotation and dataset bias issues by the knowledge transfer from a label-rich source domain to a related but unlabeled target domain. A mainstream of DA methods is to align the feature…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Shuang Li , Mixue Xie , Fangrui Lv , Chi Harold Liu , Jian Liang , Chen Qin , Wei Li

Under certain statistical assumptions of noise, recent self-supervised approaches for denoising have been introduced to learn network parameters without true clean images, and these methods can restore an image by exploiting information…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Seunghwan Lee , Donghyeon Cho , Jiwon Kim , Tae Hyun Kim

Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation, but their reliance on expert demonstrations limits their ability to learn from failures and perform self-corrections. Reinforcement…

Robotics · Computer Science 2025-11-13 Fangqi Zhu , Zhengyang Yan , Zicong Hong , Quanxin Shou , Xiao Ma , Song Guo

Foundation models have advanced computer vision by enabling strong performance across diverse tasks through large-scale pretraining and supervised fine-tuning. However, they may underperform in domains with distribution shifts and scarce…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Jesimon Barreto , Carlos Caetano , André Araujo , William Robson Schwartz

Attention within windows has been widely explored in vision transformers to balance the performance, computation complexity, and memory footprint. However, current models adopt a hand-crafted fixed-size window design, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Qiming Zhang , Yufei Xu , Jing Zhang , Dacheng Tao

Reinforcement learning algorithms require a large amount of samples; this often limits their real-world applications on even simple tasks. Such a challenge is more outstanding in multi-agent tasks, as each step of operation is more costly…

Machine Learning · Computer Science 2022-09-05 Yali Du , Chengdong Ma , Yuchen Liu , Runji Lin , Hao Dong , Jun Wang , Yaodong Yang

Low-Rank Adaptation (LoRA) has emerged as one of the most effective, computationally tractable fine-tuning approaches for training Vision-Language Models (VLMs) and Large Language Models (LLMs). LoRA accomplishes this by freezing the…

Machine Learning · Computer Science 2025-05-28 Nastaran Saadati , Zhanhong Jiang , Joshua R. Waite , Shreyan Ganguly , Aditya Balu , Chinmay Hegde , Soumik Sarkar

A self-learning adaptive system (SLAS) uses machine learning to enable and enhance its adaptability. Such systems are expected to perform well in dynamic situations. For learning high-performance adaptation policy, some assumptions must be…

Software Engineering · Computer Science 2021-05-12 Mingyue Zhang , Jialong Li , Haiyan Zhao , Kenji Tei , Shinichi Honiden , Zhi Jin

Current methods for end-to-end constructive neural combinatorial optimization usually train a policy using behavior cloning from expert solutions or policy gradient methods from reinforcement learning. While behavior cloning is…

Machine Learning · Computer Science 2024-11-05 Jonathan Pirnay , Dominik G. Grimm

Recently, some studies have integrated Multimodal Large Language Models into robotic manipulation, constructing vision-language-action models (VLAs) to interpret multimodal information and predict SE(3) poses. While VLAs have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Chenxuan Li , Jiaming Liu , Guanqun Wang , Xiaoqi Li , Sixiang Chen , Liang Heng , Chuyan Xiong , Jiaxin Ge , Renrui Zhang , Kaichen Zhou , Shanghang Zhang

Real-world visual search systems involve deployments on multiple platforms with different computing and storage resources. Deploying a unified model that suits the minimal-constrain platforms leads to limited accuracy. It is expected to…

Artificial Intelligence · Computer Science 2023-03-24 Shengsen Wu , Yan Bai , Yihang Lou , Xiongkun Linghu , Jianzhong He , Ling-Yu Duan

In few-shot learning, a machine learning system learns from a small set of labelled examples relating to a specific task, such that it can generalize to new examples of the same task. Given the limited availability of labelled examples in…

Machine Learning · Computer Science 2020-01-31 Antreas Antoniou , Amos Storkey

The high sample complexity of reinforcement learning challenges its use in practice. A promising approach is to quickly adapt pre-trained policies to new environments. Existing methods for this policy adaptation problem typically rely on…

Machine Learning · Computer Science 2020-06-16 Yuda Song , Aditi Mavalankar , Wen Sun , Sicun Gao

In this paper, we leverage ideas from model-based control to address the sample efficiency problem of reinforcement learning (RL) algorithms. Accelerating learning is an active field of RL highly relevant in the context of time-varying…

Systems and Control · Electrical Eng. & Systems 2023-05-23 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

In this paper, we propose a model-free adaptive learning solution for a model-following control problem. This approach employs policy iteration, to find an optimal adaptive control solution. It utilizes a moving finite-horizon of…

Systems and Control · Electrical Eng. & Systems 2023-02-07 Mohammed I. Abouheaf , Hashim A. Hashim , Mohammad A. Mayyas , Kyriakos G. Vamvoudakis