English
Related papers

Related papers: Diff-Mosaic: Augmenting Realistic Representations …

200 papers

Diffusion models recently have been successfully applied for the visual synthesis of strikingly realistic appearing images. This raises strong concerns about their potential for malicious purposes. In this paper, we propose using the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Peter Lorenz , Ricard Durall , Janis Keuper

We propose Diff-Shadow, a global-guided diffusion model for shadow removal. Previous transformer-based approaches can utilize global information to relate shadow and non-shadow regions but are limited in their synthesis ability and recover…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jinting Luo , Ru Li , Chengzhi Jiang , Xiaoming Zhang , Mingyan Han , Ting Jiang , Haoqiang Fan , Shuaicheng Liu

Images produced by diffusion models are increasingly popular in digital artwork and visual marketing. However, such generated images might replicate content from existing ones and pose the challenge of content originality. Existing Image…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Wenhao Wang , Yifan Sun , Zhentao Tan , Yi Yang

Domain generalization (DG) for object detection aims to enhance detectors' performance in unseen scenarios. This task remains challenging due to complex variations in real-world applications. Recently, diffusion models have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Boyong He , Yuxiang Ji , Qianwen Ye , Zhuoyue Tan , Liaoni Wu

Image generative models, particularly diffusion-based models, have surged in popularity due to their remarkable ability to synthesize highly realistic images. However, since these models are data-driven, they inherit biases from the…

Machine Learning · Computer Science 2025-03-18 Lin-Chun Huang , Ching Chieh Tsao , Fang-Yi Su , Jung-Hsien Chiang

Visuomotor imitation learning policies enable robots to efficiently acquire manipulation skills from visual demonstrations. However, as scene complexity and visual distractions increase, policies that perform well in simple settings often…

Artificial Intelligence · Computer Science 2025-11-11 Yuhang Dong , Haizhou Ge , Yupei Zeng , Jiangning Zhang , Beiwen Tian , Hongrui Zhu , Yufei Jia , Ruixiang Wang , Zhucun Xue , Guyue Zhou , Longhua Ma , Guanzhong Tian

Recent advancements in image synthesis are fueled by the advent of large-scale diffusion models. Yet, integrating realistic object visualizations seamlessly into new or existing backgrounds without extensive training remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Phillip Mueller , Jannik Wiese , Ioan Craciun , Lars Mikelsons

Augmentation for dense prediction typically relies on either sample mixing or generative synthesis. Mixing improves robustness but misaligned masks yield soft label ambiguity. Diffusion synthesis increases apparent diversity but, when…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Pengyu Jie , Wanquan Liu , Rui He , Yihui Wen , Deyu Meng , Chenqiang Gao

Unsupervised Contrastive learning has gained prominence in fields such as vision, and biology, leveraging predefined positive/negative samples for representation learning. Data augmentation, categorized into hand-designed and model-based…

Machine Learning · Computer Science 2024-05-28 Zelin Zang , Hao Luo , Kai Wang , Panpan Zhang , Fan Wang , Stan. Z Li , Yang You

Denoising Diffusion models have shown remarkable performance in generating diverse, high quality images from text. Numerous techniques have been proposed on top of or in alignment with models like Stable Diffusion and Imagen that generate…

Inverting visual representations within deep neural networks (DNNs) presents a challenging and important problem in the field of security and privacy for deep learning. The main goal is to invert the features of an unidentified target image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sai Qian Zhang , Ziyun Li , Chuan Guo , Saeed Mahloujifar , Deeksha Dangwal , Edward Suh , Barbara De Salvo , Chiao Liu

We explore the problem of computationally generating special `prime' images that produce optical illusions when physically arranged and viewed in a certain way. First, we propose a formal definition for this problem. Next, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Ryan Burgert , Xiang Li , Abe Leite , Kanchana Ranasinghe , Michael S. Ryoo

Diffusion models face significant challenges when employed for large-scale medical image reconstruction in real practice such as 3D Computed Tomography (CT). Due to the demanding memory, time, and data requirements, it is difficult to train…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Bowen Song , Jason Hu , Zhaoxu Luo , Jeffrey A. Fessler , Liyue Shen

High dynamic range (HDR) video reconstruction aims to generate HDR videos from low dynamic range (LDR) frames captured with alternating exposures. Most existing works solely rely on the regression-based paradigm, leading to adverse effects…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Yuanshen Guan , Ruikang Xu , Mingde Yao , Ruisheng Gao , Lizhi Wang , Zhiwei Xiong

Image deblurring aims to remove undesired blurs from an image captured in a dynamic scene. Much research has been dedicated to improving deblurring performance through model architectural designs. However, there is little work on data…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Jia-Hao Wu , Fu-Jen Tsai , Yan-Tsung Peng , Chung-Chi Tsai , Chia-Wen Lin , Yen-Yu Lin

We study the problem of generating intermediate images from image pairs with large motion while maintaining semantic consistency. Due to the large motion, the intermediate semantic information may be absent in input images. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Liao Shen , Tianqi Liu , Huiqiang Sun , Xinyi Ye , Baopu Li , Jianming Zhang , Zhiguo Cao

Volumetric optical microscopy using non-diffracting beams enables rapid imaging of 3D volumes by projecting them axially to 2D images but lacks crucial depth information. Addressing this, we introduce MicroDiffusion, a pioneering tool…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Mude Hui , Zihao Wei , Hongru Zhu , Fei Xia , Yuyin Zhou

Due to the high complexity and technical requirements of industrial production processes, surface defects will inevitably appear, which seriously affects the quality of products. Although existing lightweight detection networks are highly…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xuyi Yu

Dataset expansion can effectively alleviate the problem of data scarcity for medical image segmentation, due to privacy concerns and labeling difficulties. However, existing expansion algorithms still face great challenges due to their…

Image and Video Processing · Electrical Eng. & Systems 2023-06-07 Shitong Shao , Xiaohan Yuan , Zhen Huang , Ziming Qiu , Shuai Wang , Kevin Zhou

In this work, we address a challenge in video inpainting: reconstructing occluded regions in dynamic, real-world scenarios. Motivated by the need for continuous human motion monitoring in healthcare settings, where facial features are…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zheyan Zhang , Diego Klabjan , Renee CB Manworren