中文
相关论文

相关论文: E-MD3C: Taming Masked Diffusion Transformers for E…

200 篇论文

Stable diffusion networks have emerged as a groundbreaking development for their ability to produce realistic and detailed visual content. This characteristic renders them ideal decoders, capable of producing high-quality and aesthetically…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Kai Liu , Kang You , Pan Gao

We present a mask-piloted Transformer which improves masked-attention in Mask2Former for image segmentation. The improvement is based on our observation that Mask2Former suffers from inconsistent mask predictions between consecutive decoder…

计算机视觉与模式识别 · 计算机科学 2023-03-16 Hao Zhang , Feng Li , Huaizhe Xu , Shijia Huang , Shilong Liu , Lionel M. Ni , Lei Zhang

With abundant, unlabeled real faces, how can we learn robust and transferable facial representations to boost generalization across various face security tasks? We make the first attempt and propose FS-VFM, a scalable self-supervised…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Gaojian Wang , Feng Lin , Tong Wu , Zhisheng Yan , Kui Ren

Recent advancements in diffusion models revolutionize image generation but pose risks of misuse, such as replicating artworks or generating deepfakes. Existing image protection methods, though effective, struggle to balance protection…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Namhyuk Ahn , KiYoon Yoo , Wonhyuk Ahn , Daesik Kim , Seung-Hun Nam

In-context segmentation has drawn increasing attention with the advent of vision foundation models. Its goal is to segment objects using given reference images. Most existing approaches adopt metric learning or masked image modeling to…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Chaoyang Wang , Xiangtai Li , Henghui Ding , Lu Qi , Jiangning Zhang , Yunhai Tong , Chen Change Loy , Shuicheng Yan

We introduce a new general-purpose approach to deep learning on 3D surfaces, based on the insight that a simple diffusion layer is highly effective for spatial communication. The resulting networks are automatically robust to changes in…

计算机视觉与模式识别 · 计算机科学 2022-01-10 Nicholas Sharp , Souhaib Attaiki , Keenan Crane , Maks Ovsjanikov

To reconstruct the 3D geometry from calibrated images, learning-based multi-view stereo (MVS) methods typically perform multi-view depth estimation and then fuse depth maps into a mesh or point cloud. To improve the computational…

计算机视觉与模式识别 · 计算机科学 2025-09-19 Fangjinhua Wang , Qingshan Xu , Yew-Soon Ong , Marc Pollefeys

Synthesizing novel 3D models that resemble the input example has long been pursued by graphics artists and machine learning researchers. In this paper, we present Sin3DM, a diffusion model that learns the internal patch distribution from a…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Rundi Wu , Ruoshi Liu , Carl Vondrick , Changxi Zheng

Diffusion Probabilistic Models (DPMs) suffer from inefficient inference due to their slow sampling and high memory consumption, which limits their applicability to various medical imaging applications. In this work, we propose a novel…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Fahim Ahmed Zaman , Mathews Jacob , Amanda Chang , Kan Liu , Milan Sonka , Xiaodong Wu

Diffusion models have become a leading approach for high-fidelity medical image synthesis. However, most existing methods for 3D medical image generation rely on convolutional U-Net backbones within latent diffusion frameworks. While…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Marvin Seyfarth , Salman Ul Hassan Dar , Yannik Frisch , Philipp Wild , Norbert Frey , Florian André , Sandy Engelhardt

State-of-the-art vessel segmentation methods typically require large-scale annotated datasets and suffer from severe performance degradation under domain shifts. In clinical practice, however, acquiring extensive annotations for every new…

图像与视频处理 · 电气工程与系统科学 2026-03-02 Kirato Yoshihara , Yohei Sugawara , Yuta Tokuoka , Lihang Hong

Wireless Capsule Endoscopy (WCE) is highly valued for its non-invasive and painless approach, though its effectiveness is compromised by uneven illumination from hardware constraints and complex internal dynamics, leading to overexposed or…

图像与视频处理 · 电气工程与系统科学 2024-07-09 Long Bai , Tong Chen , Qiaozhi Tan , Wan Jun Nah , Yanheng Li , Zhicheng He , Sishen Yuan , Zhen Chen , Jinlin Wu , Mobarakol Islam , Zhen Li , Hongbin Liu , Hongliang Ren

Diffusion models have advanced from text-to-image (T2I) to image-to-image (I2I) generation by incorporating structured inputs such as depth maps, enabling fine-grained spatial control. However, existing methods either train separate models…

计算机视觉与模式识别 · 计算机科学 2025-08-01 Yucheng Xie , Fu Feng , Ruixiao Shi , Jing Wang , Yong Rui , Xin Geng

We introduce MDSGen, a novel framework for vision-guided open-domain sound generation optimized for model parameter size, memory consumption, and inference speed. This framework incorporates two key innovations: (1) a redundant video…

声音 · 计算机科学 2025-02-14 Trung X. Pham , Tri Ton , Chang D. Yoo

Conditional generative models of high-dimensional images have many applications, but supervision signals from conditions to images can be expensive to acquire. This paper describes Diffusion-Decoding models with Contrastive representations…

机器学习 · 计算机科学 2021-06-15 Abhishek Sinha , Jiaming Song , Chenlin Meng , Stefano Ermon

The Segment Anything Model 3 (SAM3) advances visual understanding with Promptable Concept Segmentation (PCS) across images and videos, but its unified architecture (shared vision backbone, DETR-style detector, dense-memory tracker) remains…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Chengxi Zeng , Yuxuan Jiang , Aaron Zhang

Recent advances indicate that diffusion models hold great promise in image super-resolution. While the latest methods are primarily based on latent diffusion models with convolutional neural networks, there are few attempts to explore…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Kun Cheng , Lei Yu , Zhijun Tu , Xiao He , Liyu Chen , Yong Guo , Mingrui Zhu , Nannan Wang , Xinbo Gao , Jie Hu

Deploying large-scale transformer models on edge devices presents significant challenges due to strict constraints on memory, compute, and latency. In this work, we propose a lightweight yet effective multi-stage optimization pipeline…

机器学习 · 计算机科学 2025-12-24 Shoaib Mohammad , Guanqun Song , Ting Zhu

While real-time image generation using diffusion models has advanced rapidly on NVIDIA GPUs, systematic optimization research on non-CUDA platforms such as Apple Silicon remains extremely limited. In this study, we conducted comprehensive…

机器学习 · 计算机科学 2026-05-19 Yoichi Ochiai

Federated learning research has recently shifted from Convolutional Neural Networks (CNNs) to Vision Transformers (ViTs) due to their superior capacity. ViTs training demands higher computational resources due to the lack of 2D inductive…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Meihan Wu , Tao Chang , Cui Miao , Jie Zhou , Chun Li , Xiangyu Xu , Ming Li , Xiaodong Wang