中文
相关论文

相关论文: DINOv3-Diffusion Policy: Self-Supervised Large Vis…

200 篇论文

Vision-transformers (ViTs) and large-scale convolution-neural-networks (CNNs) have reshaped computer vision through pretrained feature representations that enable strong transfer learning for diverse tasks. However, their efficiency as…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Alon Kaya , Igal Bilik , Inna Stainvas

Recent advances in self-supervised learning (SSL) have made it possible to learn general-purpose visual features that capture both the high-level semantics and the fine-grained spatial structure of images. Most notably, the recent DINOv2…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Mattia Scardecchia

The integration of deep learning systems into healthcare has been hindered by the resource-intensive process of data annotation and the inability of these systems to generalize to different data distributions. Foundation models, which are…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Mohammed Baharoon , Waseem Qureshi , Jiahong Ouyang , Yanwu Xu , Abdulrhman Aljouie , Wei Peng

Fine-tuning Diffusion Models remains an underexplored frontier in generative artificial intelligence (GenAI), especially when compared with the remarkable progress made in fine-tuning Large Language Models (LLMs). While cutting-edge…

机器学习 · 计算机科学 2024-02-16 Huizhuo Yuan , Zixiang Chen , Kaixuan Ji , Quanquan Gu

While autoregressive Large Vision-Language Models (VLMs) have achieved remarkable success, their sequential generation often limits their efficacy in complex visual planning and dynamic robotic control. In this work, we investigate the…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Jiacheng Ye , Shansan Gong , Jiahui Gao , Junming Fan , Shuang Wu , Wei Bi , Haoli Bai , Lifeng Shang , Lingpeng Kong

Deep learning-based automatic medical image segmentation plays a critical role in clinical diagnosis and treatment planning but remains challenging in few-shot scenarios due to the scarcity of annotated training data. Recently,…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Guoping Xu , Jayaram K. Udupa , Weiguo Lu , You Zhang

Video Frame Interpolation (VFI) remains a cornerstone in video enhancement, enabling temporal upscaling for tasks like slow-motion rendering, frame rate conversion, and video restoration. While classical methods rely on optical flow and…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Priyansh Srivastava , Romit Chatterjee , Abir Sen , Aradhana Behura , Ratnakar Dash

Robotic manipulation requires understanding both the 3D spatial structure of the environment and its temporal evolution, yet most existing policies overlook one or both. They typically rely on 2D visual observations and backbones pretrained…

Purpose: This study provides the first comprehensive evaluation of foundation models in fetal ultrasound (US) imaging under low inter-class variability conditions. While recent vision foundation models such as DINOv3 have shown remarkable…

计算机视觉与模式识别 · 计算机科学 2025-11-05 Edoardo Conti , Riccardo Rosati , Lorenzo Federici , Adriano Mancini , Maria Chiara Fiorentin

The growing interest in novel view synthesis, driven by Neural Radiance Field (NeRF) models, is hindered by scalability issues due to their reliance on precisely annotated multi-view images. Recent models address this by fine-tuning large…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Llukman Cerkezi , Aram Davtyan , Sepehr Sameni , Paolo Favaro

Visuomotor imitation learning policies enable robots to efficiently acquire manipulation skills from visual demonstrations. However, as scene complexity and visual distractions increase, policies that perform well in simple settings often…

Diffusion models have shown exceptional performance in visual generation tasks. Recently, these models have shifted from traditional U-Shaped CNN-Attention hybrid structures to fully transformer-based isotropic architectures. While these…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Yuchuan Tian , Jing Han , Chengcheng Wang , Yuchen Liang , Chao Xu , Hanting Chen

Imitation learning, particularly Diffusion Policies based methods, has recently gained significant traction in embodied AI as a powerful approach to action policy generation. These models efficiently generate action policies by learning to…

机器人学 · 计算机科学 2025-04-15 Haiyong Yu , Yanqiong Jin , Yonghao He , Wei Sui

Recent advances in robot imitation learning have yielded powerful visuomotor policies capable of manipulating a wide variety of objects directly from monocular visual inputs. However, monocular observations inherently lack reliable depth…

机器人学 · 计算机科学 2026-05-12 Evans Han , Yunfan Jiang , Yingke Wang , Haoyue Xiao , Huang Huang , Jianwen Xie , Jiajun Wu , Li Fei-Fei , Ruohan Zhang

In this paper, we present DiffusionVLA, a novel framework that seamlessly combines the autoregression model with the diffusion model for learning visuomotor policy. Central to our approach is a next-token prediction objective, enabling the…

While deep learning has had significant successes in computer vision thanks to the abundance of visual data, collecting sufficiently large real-world datasets for robot learning can be costly. To increase the practicality of these…

机器人学 · 计算机科学 2017-12-20 Fangyi Zhang , Jürgen Leitner , Michael Milford , Peter Corke

Without using explicit reward, direct preference optimization (DPO) employs paired human preference data to fine-tune generative models, a method that has garnered considerable attention in large language models (LLMs). However, exploration…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Yunhong Lu , Qichao Wang , Hengyuan Cao , Xierui Wang , Xiaoyin Xu , Min Zhang

Developing robust autonomous loco-manipulation skills for humanoids remains an open problem in robotics. While RL has been applied successfully to legged locomotion, applying it to complex, interaction-rich manipulation tasks is harder…

Frozen pretrained models have become a viable alternative to the pretraining-then-finetuning paradigm for transfer learning. However, with frozen models there are relatively few parameters available for adapting to downstream tasks, which…

计算机视觉与模式识别 · 计算机科学 2022-11-04 Yutong Lin , Ze Liu , Zheng Zhang , Han Hu , Nanning Zheng , Stephen Lin , Yue Cao

Diffusion policies have shown impressive results in robot imitation learning, even for tasks that require satisfaction of kinematic equality constraints. However, task performance alone is not a reliable indicator of the policy's ability to…

机器人学 · 计算机科学 2025-10-03 Lexi Foland , Thomas Cohn , Adam Wei , Nicholas Pfaff , Boyuan Chen , Russ Tedrake