English
Related papers

Related papers: Generalizable Visual Reinforcement Learning with S…

200 papers

In the domain of large foundation models, the Segment Anything Model (SAM) has gained notable recognition for its exceptional performance in image segmentation. However, tackling the video camouflage object detection (VCOD) task presents a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Muhammad Nawfal Meeran , Gokul Adethya T , Bhanu Pratyush Mantha

An excellent representation is crucial for reinforcement learning (RL) performance, especially in vision-based reinforcement learning tasks. The quality of the environment representation directly influences the achievement of the learning…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Jiaxu Wang , Qiang Zhang , Jingkai Sun , Jiahang Cao , Gang Han , Wen Zhao , Weining Zhang , Yecheng Shao , Yijie Guo , Renjing Xu

Text-prompted image segmentation enables fine-grained visual understanding and is critical for applications such as human-computer interaction and robotics. However, existing supervised fine-tuning methods typically ignore explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Lianghui Zhu , Bin Ouyang , Yuxuan Zhang , Tianheng Cheng , Rui Hu , Haocheng Shen , Longjin Ran , Xiaoxin Chen , Li Yu , Wenyu Liu , Xinggang Wang

The Segment Anything Model (SAM) is a widely used vision foundation model with diverse applications, including image segmentation, detection, and tracking. Given SAM's wide applications, understanding its robustness against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jiahuan Long , Zhengqin Xu , Tingsong Jiang , Wen Yao , Shuai Jia , Chao Ma , Xiaoqian Chen

Visual model-based reinforcement learning (RL) has the potential to enable sample-efficient robot learning from visual observations. Yet the current approaches typically train a single model end-to-end for learning both visual…

Robotics · Computer Science 2023-05-30 Younggyo Seo , Danijar Hafner , Hao Liu , Fangchen Liu , Stephen James , Kimin Lee , Pieter Abbeel

This paper introduces a new Segment Anything Model (SAM) that leverages reverse parameter configuration and test-time training to enhance its performance on Camouflaged Object Detection (COD), named SAM-TTT. While most existing SAM-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Zhenni Yu , Li Zhao , Guobao Xiao , Xiaoqin Zhang

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Domain-generalized retinal vessel segmentation is critical for automated ophthalmic diagnosis, yet faces significant challenges from domain shift induced by non-uniform illumination and varying contrast, compounded by the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Chanchan Wang , Yuanfang Wang , Qing Xu , Guanxin Chen

Medical image segmentation is an important analysis task in clinical practice and research. Deep learning has massively advanced the field, but current approaches are mostly based on models trained for a specific task. Training such models…

Image and Video Processing · Electrical Eng. & Systems 2025-12-18 Anwai Archit , Luca Freckmann , Constantin Pape

Segmentation in medical imaging is a critical component for the diagnosis, monitoring, and treatment of various diseases and medical conditions. Presently, the medical segmentation landscape is dominated by numerous specialized deep…

Segment anything model (SAM) addresses two practical yet challenging segmentation tasks: \textbf{segment anything (SegAny)}, which utilizes a certain point to predict the mask for a single object of interest, and \textbf{segment everything…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Chaoning Zhang , Dongshen Han , Sheng Zheng , Jinwoo Choi , Tae-Ho Kim , Choong Seon Hong

While visual autoregressive modeling (VAR) strategies have shed light on image generation with the autoregressive models, their potential for segmentation, a task that requires precise low-level spatial perception, remains unexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Hengshuang Zhao

In contrast to the human vision that mainly depends on the shape for recognizing the objects, deep image recognition models are widely known to be biased toward texture. Recently, Meta research team has released the first foundation model…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Chaoning Zhang , Yu Qiao , Shehbaz Tariq , Sheng Zheng , Chenshuang Zhang , Chenghao Li , Hyundong Shin , Choong Seon Hong

Video Object Segmentation and Tracking (VOST) presents a complex yet critical challenge in computer vision, requiring robust integration of segmentation and tracking across temporally dynamic frames. Traditional methods have struggled with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Guoping Xu , Jayaram K. Udupa , Yajun Yu , Hua-Chieh Shao , Songlin Zhao , Wei Liu , You Zhang

Radiographic testing is a fundamental non-destructive evaluation technique for identifying weld defects and assessing quality in industrial applications due to its high-resolution imaging capabilities. Over the past decade, deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yunyi Zhou , Kun Shi , Gang Hao

Image segmentation is a crucial task in computer vision, with wide-ranging applications in industry. The Segment Anything Model (SAM) has recently attracted intensive attention; however, its application in industrial inspection,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zheming Zuo , Joseph Smith , Jonathan Stonehouse , Boguslaw Obara

Unifying diverse image generation tasks within a single framework remains a fundamental challenge in visual generation. While large language models (LLMs) achieve unification through task-agnostic data and generation, existing visual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yijing Lin , Mengqi Huang , Shuhan Zhuang , Zhendong Mao

The interactive segmentation task consists in the creation of object segmentation masks based on user interactions. The most common way to guide a model towards producing a correct segmentation consists in clicks on the object and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Robin Schön , Julian Lorenz , Katja Ludwig , Rainer Lienhart

Learning generalist embodied agents, able to solve multitudes of tasks in different domains is a long-standing problem. Reinforcement learning (RL) is hard to scale up as it requires a complex reward design for each task. In contrast,…

Artificial Intelligence · Computer Science 2024-11-01 Pietro Mazzaglia , Tim Verbelen , Bart Dhoedt , Aaron Courville , Sai Rajeswar

Graphical user interface (GUI)-based mobile agents automate digital tasks on mobile devices by interpreting natural-language instructions and interacting with the screen. While recent methods apply reinforcement learning (RL) to train…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Li Gu , Zihuan Jiang , Zhixiang Chi , Huan Liu , Ziqiang Wang , Yuanhao Yu , Glen Berseth , Yang Wang