English
Related papers

Related papers: DINO-MX: A Modular & Flexible Framework for Self-S…

200 papers

In this paper, we introduce a self-supervised deep SLAM method that robustly operates in dynamic scenes while accurately identifying dynamic components. Our method leverages a dual-flow representation for static flow and dynamic flow,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Xingyuan Yu , Weicai Ye , Xiyue Guo , Yuhang Ming , Jinyu Li , Hujun Bao , Zhaopeng Cui , Guofeng Zhang

With the rapid evolution of the Internet of Things, many real-world applications utilize heterogeneously connected sensors to capture time-series information. Edge-based machine learning (ML) methodologies are often employed to analyze…

Machine Learning · Computer Science 2023-08-21 Junyao Wang , Luke Chen , Mohammad Abdullah Al Faruque

Advances in multimodal pre-training have propelled object-level foundation models, such as Grounding DINO and Florence-2, in tasks like visual grounding and object detection. However, interpreting these models' decisions has grown…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Ruoyu Chen , Siyuan Liang , Jingzhi Li , Shiming Liu , Maosen Li , Zhen Huang , Hua Zhang , Xiaochun Cao

Precise shape control of Deformable Linear Objects (DLOs) is crucial in robotic applications such as industrial and medical fields. However, existing methods face challenges in handling complex large deformation tasks, especially those…

Robotics · Computer Science 2026-02-26 Zhaowei Liang , Song Wang , Zhao Jin , Shirui Wu , Dan Wu

Visual Foundation Models (VFMs) are becoming ubiquitous in computer vision, powering systems for diverse tasks such as object detection, image classification, segmentation, pose estimation, and motion tracking. VFMs are capitalizing on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Sandeep Gupta , Roberto Passerone

Humanoid loco-manipulation requires coordinated high-level motion plans with stable, low-level whole-body execution under complex robot-environment dynamics and long-horizon tasks. While diffusion policies (DPs) show promise for learning…

Large Language Models (LLMs) are increasingly aligned with human preferences through Reinforcement Learning from Human Feedback (RLHF). Among RLHF methods, Group Relative Policy Optimization (GRPO) has gained attention for its simplicity…

Computation and Language · Computer Science 2025-09-25 Yuhang Zhou , Jing Zhu , Shengyi Qian , Zhuokai Zhao , Xiyao Wang , Xiaoyu Liu , Ming Li , Paiheng Xu , Wei Ai , Furong Huang

End-to-end autonomous driving systems based on vision-language-action (VLA) models integrate multimodal sensor inputs and language instructions to generate planning and control signals. While autoregressive large language models and…

Robotics · Computer Science 2025-12-17 Mingwang Xu , Jiahao Cui , Feipeng Cai , Hanlin Shang , Zhihao Zhu , Shan Luan , Yifang Xu , Neng Zhang , Yaoyi Li , Jia Cai , Siyu Zhu

Large Vision-Language Foundation Models (VLFM), such as CLIP, ALIGN and Florence, are trained on large-scale datasets of image-caption pairs and achieve superior transferability and robustness on downstream tasks, but they are difficult to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Ximeng Sun , Pengchuan Zhang , Peizhao Zhang , Hardik Shah , Kate Saenko , Xide Xia

Vision-language models (VLMs) serve as general-purpose end-to-end models in autonomous driving, performing subtasks such as prediction, planning, and perception through question-and-answer interactions. However, most existing methods rely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Enming Zhang , Xingyuan Dai , Min Huang , Yisheng Lv , Qinghai Miao

What does it mean for a visual system to truly understand affordance? We argue that this understanding hinges on two complementary capacities: geometric perception, which identifies the structural parts of objects that enable interaction,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Qing Zhang , Xuesong Li , Jing Zhang

Video diffusion alignment has been heavily relied on scalar rewards. These rewards are typically derived from learned reward models in human preference datasets, requiring additional training and extensive collection. Moreover, scalar…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yifan Wang , Yanyu Li , Gordon Guocheng Qian , Sergey Tulyakov , Yun Fu , Anil Kag

We propose DistillNeRF, a self-supervised learning framework addressing the challenge of understanding 3D environments from limited 2D observations in outdoor autonomous driving scenes. Our method is a generalizable feedforward model that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Letian Wang , Seung Wook Kim , Jiawei Yang , Cunjun Yu , Boris Ivanovic , Steven L. Waslander , Yue Wang , Sanja Fidler , Marco Pavone , Peter Karkus

Face anti-spoofing (FAS) aims to construct a robust system that can withstand diverse attacks. While recent efforts have concentrated mainly on cross-domain generalization, two significant challenges persist: limited semantic understanding…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Kun-Hsiang Lin , Yu-Wen Tseng , Kang-Yang Huang , Jhih-Ciang Wu , Wen-Huang Cheng

To make sense of their surroundings, intelligent systems must transform complex sensory inputs to structured codes that are reduced to task-relevant information such as object category. Biological agents achieve this in a largely autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Robin Weiler , Matthias Brucklacher , Cyriel M. A. Pennartz , Sander M. Bohté

Complex design problems are common in the scientific and industrial fields. In practice, objective functions or constraints of these problems often do not have explicit formulas, and can be estimated only at a set of sampling points through…

Optimization and Control · Mathematics 2022-10-12 Lulu Zhang , Zhi-Qin John Xu , Yaoyu Zhang

In-context segmentation (ICS) aims to segment arbitrary concepts, e.g., objects, parts, or personalized instances, given one annotated visual examples. Existing work relies on (i) fine-tuning vision foundation models (VFMs), which improves…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Claudia Cuttano , Gabriele Trivigno , Christoph Reich , Daniel Cremers , Carlo Masone , Stefan Roth

Adapting foundation models to medical segmentation typically requires either backbone fine-tuning or high-capacity task-specific decoders, both of which are difficult to fit reliably when annotations are scarce. We show that frozen DINOv3…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Wei Jiang , Feng Liu , Nan Ye , Hongfu Sun

Camera traps are revolutionising wildlife monitoring by capturing vast amounts of visual data; however, the manual identification of individual animals remains a significant bottleneck. This study introduces a fully self-supervised approach…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Vladimir Iashin , Horace Lee , Dan Schofield , Andrew Zisserman

Unsupervised semantic segmentation aims to categorize each pixel in an image into a corresponding class without the use of annotated data. It is a widely researched area as obtaining labeled datasets is expensive. While previous works in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Yau Shing Jonathan Cheung , Xi Chen , Lihe Yang , Hengshuang Zhao