English
Related papers

Related papers: Reconstruct Anything Model: a lightweight general …

200 papers

We propose a novel method to accurately reconstruct a set of images representing a single scene from few linear multi-view measurements. Each observed image is modeled as the sum of a background image and a foreground one. The background…

Computer Vision and Pattern Recognition · Computer Science 2013-09-19 Gilles Puy , Pierre Vandergheynst

Diffusion models are now the undisputed state-of-the-art for image generation and image restoration. However, they require large amounts of computational power for training and inference. In this paper, we propose lightweight diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Nicolas Cherel , Andrés Almansa , Yann Gousseau , Alasdair Newson

We present Large Inverse Rendering Model (LIRM), a transformer architecture that jointly reconstructs high-quality shape, materials, and radiance fields with view-dependent effects in less than a second. Our model builds upon the recent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Zhengqin Li , Dilin Wang , Ka Chen , Zhaoyang Lv , Thu Nguyen-Phuoc , Milim Lee , Jia-Bin Huang , Lei Xiao , Cheng Zhang , Yufeng Zhu , Carl S. Marshall , Yufeng Ren , Richard Newcombe , Zhao Dong

The high complexity of various inverse problems poses a significant challenge to model-based reconstruction schemes, which in such situations often reach their limits. At the same time, we witness an exceptional success of data-based…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 T. A. Bubba , G. Kutyniok , M. Lassas , M. März , W. Samek , S. Siltanen , V. Srinivasan

Diffusion models have found phenomenal success as expressive priors for solving inverse problems, but their extension beyond natural images to more structured scientific domains remains limited. Motivated by applications in materials…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Timofey Efimov , Harry Dong , Megna Shah , Jeff Simmons , Sean Donegan , Yuejie Chi

Deep convolutional neural networks trained on large datsets have emerged as an intriguing alternative for compressing images and solving inverse problems such as denoising and compressive sensing. However, it has only recently been realized…

Machine Learning · Computer Science 2019-07-09 Reinhard Heckel

We introduce a method for fast estimation of data-adapted, spatio-temporally dependent regularization parameter-maps for variational image reconstruction, focusing on total variation (TV)-minimization. Our approach is inspired by recent…

Accelerating magnetic resonance image (MRI) reconstruction process is a challenging ill-posed inverse problem due to the excessive under-sampling operation in k-space. In this paper, we propose a recurrent transformer model, namely…

Image and Video Processing · Electrical Eng. & Systems 2022-01-31 Pengfei Guo , Yiqun Mei , Jinyuan Zhou , Shanshan Jiang , Vishal M. Patel

Low level image restoration is an integral component of modern artificial intelligence (AI) driven camera pipelines. Most of these frameworks are based on deep neural networks which present a massive computational overhead on resource…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Avisek Lahiri , Sourav Bairagya , Sutanu Bera , Siddhant Haldar , Prabir Kumar Biswas

Medical imaging is an invaluable resource in medicine as it enables to peer inside the human body and provides scientists and physicians with a wealth of information indispensable for understanding, modelling, diagnosis, and treatment of…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Hanene Ben Yedder , Ben Cardoen , Ghassan Hamarneh

In the last years, the design of image reconstruction methods in the field of quantitative Magnetic Resonance Imaging (qMRI) has experienced a paradigm shift. Often, when dealing with (quantitative) MR image reconstruction problems, one is…

Optimization and Control · Mathematics 2024-03-01 Andreas Kofler , Felix Frederik Zimmermann , Kostas Papafitsoros

In recent literature there are plenty of works that combine handcrafted and learnable regularizers to solve inverse imaging problems. While this hybrid approach has demonstrated promising results, the motivation for combining handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Alexandros Gkillas , Dimitris Ampeliotis , Kostas Berberidis

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Medical imaging is playing a more and more important role in clinics. However, there are several issues in different imaging modalities such as slow imaging speed in MRI, radiation injury in CT and PET. Therefore, accelerating MRI, reducing…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Jing Cheng , Haifeng Wang , Yanjie Zhu , Qiegen Liu , Qiyang Zhang , Ting Su , Jianwei Chen , Yongshuai Ge , Zhanli Hu , Xin Liu , Hairong Zheng , Leslie Ying , Dong Liang

Ground-based solar image restoration is a computationally expensive procedure that involves nonlinear optimization techniques. The presence of atmospheric turbulence produces perturbations in individual images that make it necessary to…

Instrumentation and Methods for Astrophysics · Physics 2023-07-26 A. Asensio Ramos , S. Esteban Pozuelo , C. Kuckein

The majority of model-based learned image reconstruction methods in medical imaging have been limited to uniform domains, such as pixelated images. If the underlying model is solved on nonuniform meshes, arising from a finite element method…

Image and Video Processing · Electrical Eng. & Systems 2021-07-12 William Herzberg , Daniel B. Rowe , Andreas Hauptmann , Sarah J. Hamilton

Image rescaling is a commonly used bidirectional operation, which first downscales high-resolution images to fit various display screens or to be storage- and bandwidth-friendly, and afterward upscales the corresponding low-resolution…

Image and Video Processing · Electrical Eng. & Systems 2022-10-11 Mingqing Xiao , Shuxin Zheng , Chang Liu , Zhouchen Lin , Tie-Yan Liu

Recent diffusion models provide a promising zero-shot solution to noisy linear inverse problems without retraining for specific inverse problems. In this paper, we reveal that recent methods can be uniformly interpreted as employing a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Xinyu Peng , Ziyang Zheng , Wenrui Dai , Nuoqian Xiao , Chenglin Li , Junni Zou , Hongkai Xiong

Many challenging image processing tasks can be described by an ill-posed linear inverse problem: deblurring, deconvolution, inpainting, compressed sensing, and superresolution all lie in this framework. Traditional inverse problem solvers…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Davis Gilton , Greg Ongie , Rebecca Willett

Phase retrieval is a nonlinear inverse problem that arises in a wide range of imaging modalities, from electron microscopy to Fourier ptychography. In particular, the reconstruction is facilitated when the sensing matrix is i.i.d. random,…