English
Related papers

Related papers: DifuzCam: Replacing Camera Lens with a Mask and a …

200 papers

Mask-based lensless cameras offer a novel design for imaging systems by replacing the lens in a conventional camera with a layer of coded mask. Each pixel of the lensless camera encodes the information of the entire 3D scene. Existing…

Image and Video Processing · Electrical Eng. & Systems 2022-12-23 Yucheng Zheng , M. Salman Asif

In this work, we rethink the approach to video super-resolution by introducing a method based on the Diffusion Posterior Sampling framework, combined with an unconditional video diffusion transformer operating in latent space. The video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Zhihao Zhan , Wang Pang , Xiang Zhu , Yechao Bai

Capturing images is a key part of automation for high-level tasks such as scene text recognition. Low-light conditions pose a challenge for high-level perception stacks, which are often optimized on well-lit, artifact-free images.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-01 Cindy M. Nguyen , Eric R. Chan , Alexander W. Bergman , Gordon Wetzstein

Previous raw image-based low-light image enhancement methods predominantly relied on feed-forward neural networks to learn deterministic mappings from low-light to normally-exposed images. However, they failed to capture critical…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yufei Wang , Yi Yu , Wenhan Yang , Lanqing Guo , Lap-Pui Chau , Alex C. Kot , Bihan Wen

Despite diffusion models' superior capabilities in modeling complex distributions, there are still non-trivial distributional discrepancies between generated and ground-truth images, which has resulted in several notable problems in image…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yujian Liu , Yang Zhang , Tommi Jaakkola , Shiyu Chang

High-quality photography in extreme low-light conditions is challenging but impactful for digital cameras. With advanced computing hardware, traditional camera image signal processor (ISP) algorithms are gradually being replaced by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Amber Yijia Zheng , Yu Zhang , Jun Hu , Raymond A. Yeh , Chen Chen

Diffusion models have achieved promising results in image restoration tasks, yet suffer from time-consuming, excessive computational resource consumption, and unstable restoration. To address these issues, we propose a robust and efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Hai Jiang , Ao Luo , Songchen Han , Haoqiang Fan , Shuaicheng Liu

Blind face restoration methods have shown remarkable performance, particularly when trained on large-scale synthetic datasets with supervised learning. These datasets are often generated by simulating low-quality face images with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tianshu Kuai , Sina Honari , Igor Gilitschenski , Alex Levinshtein

Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and non-uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuhong Zhang , Hengsheng Zhang , Xinning Chai , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang

Limited-Angle Computed Tomography (LACT) is a challenging inverse problem where missing angular projections lead to incomplete sinograms and severe artifacts in the reconstructed images. While recent learning-based methods have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-07-09 Jiaqi Guo , Santiago López-Tapia

We introduce a novel diffusion transformer, LazyDiffusion, that generates partial image updates efficiently. Our approach targets interactive image editing applications in which, starting from a blank canvas or an image, a user specifies a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yotam Nitzan , Zongze Wu , Richard Zhang , Eli Shechtman , Daniel Cohen-Or , Taesung Park , Michaël Gharbi

The field of computational imaging has witnessed a promising paradigm shift with the emergence of untrained neural networks, offering novel solutions to inverse computational imaging problems. While existing techniques have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2024-11-28 Abeer Banerjee , Sanjay Singh

We present a learning-based approach for removing unwanted obstructions, such as window reflections, fence occlusions, or adherent raindrops, from a short sequence of images captured by a moving camera. Our method leverages motion…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Yu-Lun Liu , Wei-Sheng Lai , Ming-Hsuan Yang , Yung-Yu Chuang , Jia-Bin Huang

We offer a novel approach to image composition, which integrates multiple input images into a single, coherent image. Rather than concentrating on specific use cases such as appearance editing (image harmonization) or semantic editing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zhekai Chen , Wen Wang , Zhen Yang , Zeqing Yuan , Hao Chen , Chunhua Shen

Recovering textures under shadows has remained a challenging problem due to the difficulty of inferring shadow-free scenes from shadow images. In this paper, we propose the use of diffusion models as they offer a promising approach to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Kangfu Mei , Luis Figueroa , Zhe Lin , Zhihong Ding , Scott Cohen , Vishal M. Patel

We propose Diff-Shadow, a global-guided diffusion model for shadow removal. Previous transformer-based approaches can utilize global information to relate shadow and non-shadow regions but are limited in their synthesis ability and recover…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jinting Luo , Ru Li , Chengzhi Jiang , Xiaoming Zhang , Mingyan Han , Ting Jiang , Haoqiang Fan , Shuaicheng Liu

In this paper, we propose a diffusion-based unsupervised framework that incorporates physically explainable Retinex theory with diffusion models for low-light image enhancement, named LightenDiffusion. Specifically, we present a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Hai Jiang , Ao Luo , Xiaohong Liu , Songchen Han , Shuaicheng Liu

Microstructure reconstruction, a major component of inverse computational materials engineering, is currently advancing at an unprecedented rate. While various training-based and training-free approaches are developed, the majority of…

Materials Science · Physics 2022-11-28 Christian Düreth , Paul Seibert , Dennis Rücker , Stephanie Handford , Markus Kästner , Maik Gude

In recent years, deep learning-based image compression, particularly through generative models, has emerged as a pivotal area of research. Despite significant advancements, challenges such as diminished sharpness and quality in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Ryugo Morita , Hitoshi Nishimura , Ko Watanabe , Andreas Dengel , Jinjia Zhou

In this paper, we present a modular approach for reconstructing lensless measurements. It consists of three components: a newly-proposed pre-processor, a physics-based camera inverter to undo the multiplexing of lensless imaging, and a…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Yohann Perron , Eric Bezzam , Martin Vetterli