English
Related papers

Related papers: Hybrid deep learning and physics-based neural netw…

200 papers

We introduce Intrinsic Image Fusion, a method that reconstructs high-quality physically based materials from multi-view images. Material reconstruction is highly underconstrained and typically relies on analysis-by-synthesis, which requires…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Peter Kocsis , Lukas Höllein , Matthias Nießner

From higher computational efficiency to enabling the discovery of novel and complex structures, deep learning has emerged as a powerful framework for the design and optimization of nanophotonic circuits and components. However, both…

Machine Learning · Computer Science 2022-09-13 Christopher Yeung , Benjamin Pham , Zihan Zhang , Katherine T. Fountaine , Aaswath P. Raman

Magnetic resonance imaging (MRI) is known to be a slow imaging modality and undersampling in k-space has been used to increase the imaging speed. However, image reconstruction from undersampled k-space data is an ill-posed inverse problem.…

Image and Video Processing · Electrical Eng. & Systems 2019-08-08 Jing Cheng , Haifeng Wang , Leslie Ying , Dong Liang

Spectral unmixing is one of the most important quantitative analysis tasks in hyperspectral data processing. Conventional physics-based models are characterized by clear interpretation. However they may not be suitable for analyzing scenes…

Signal Processing · Electrical Eng. & Systems 2023-03-22 Jie Chen , Min Zhao , Xiuheng Wang , Cédric Richard , Susanto Rahardja

Multi-contrast MRI images provide complementary contrast information about the characteristics of anatomical structures and are commonly used in clinical practice. Recently, a multi-flip-angle (FA) and multi-echo GRE method (MULTIPLEX MRI)…

Image and Video Processing · Electrical Eng. & Systems 2021-05-19 Eric Z. Chen , Yongquan Ye , Xiao Chen , Jingyuan Lyu , Zhongqi Zhang , Yichen Hu , Terrence Chen , Jian Xu , Shanhui Sun

Image relighting has emerged as a problem of significant research interest inspired by augmented reality applications. Physics-based traditional methods, as well as black box deep learning models, have been developed. The existing deep…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Amirsaeed Yazdani , Tiantong Guo , Vishal Monga

In recent years there has been great interest in using deep neural networks (DNN) for super-resolution image reconstruction including for structured illumination microscopy (SIM). While these methods have shown very promising results, they…

Image and Video Processing · Electrical Eng. & Systems 2023-03-22 Zachary Burns , Zhaowei Liu

Critical aspects of computational imaging systems, such as experimental design and image priors, can be optimized through deep networks formed by the unrolled iterations of classical model-based reconstructions (termed physics-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Michael Kellman , Kevin Zhang , Jon Tamir , Emrah Bostan , Michael Lustig , Laura Waller

Delicate cloth simulations have long been desired in computer graphics. Various methods were proposed to improve engaged force interactions, collision handling, and numerical integrations. Deep learning has the potential to achieve fast and…

Graphics · Computer Science 2025-01-20 Zhiwei Zhao

Model-based learned iterative reconstruction methods have recently been shown to outperform classical reconstruction algorithms. Applicability of these methods to large scale inverse problems is however limited by the available memory for…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Andreas Hauptmann , Jonas Adler , Simon Arridge , Ozan Öktem

Recent advances in meta-optics have enabled diverse functionalities in compact optical devices; however, conventional forward design approaches become inadequate as device complexity and scale grow. Inverse design offers a powerful…

The microstructure analyses of porous media have considerable research value for the study of macroscopic properties. As the premise of conducting these analyses, the accurate reconstruction of microstructure digital model is also an…

Image and Video Processing · Electrical Eng. & Systems 2023-04-26 Zhenchuan Ma , Xiaohai He , Pengcheng Yan , Fan Zhang , Qizhi Teng

In this work, we investigate the application of deep learning methods for computed tomography in the context of having a low-data regime. As motivation, we review some of the existing approaches and obtain quantitative results after…

Image and Video Processing · Electrical Eng. & Systems 2021-04-20 Daniel Otero Baguer , Johannes Leuschner , Maximilian Schmidt

Recent work showed neural-network-based approaches to reconstructing images from compressively sensed measurements offer significant improvements in accuracy and signal compression. Such methods can dramatically boost the capability of…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Fangliang Bai , Jinchao Liu , Xiaojuan Liu , Margarita Osadchy , Chao Wang , Stuart J. Gibson

While deep learning methods have achieved state-of-the-art performance in many challenging inverse problems like image inpainting and super-resolution, they invariably involve problem-specific training of the networks. Under this approach,…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 J. H. Rick Chang , Chun-Liang Li , Barnabas Poczos , B. V. K. Vijaya Kumar , Aswin C. Sankaranarayanan

In multi-contrast magnetic resonance imaging (MRI), compressed sensing theory can accelerate imaging by sampling fewer measurements within each contrast. The conventional optimization-based models suffer several limitations: strict…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Liyan Sun , Zhiwen Fan , Yue Huang , Xinghao Ding , John Paisley

We present scalable hybrid-parallel algorithms for training large-scale 3D convolutional neural networks. Deep learning-based emerging scientific workflows often require model training with large, high-dimensional samples, which can make…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-28 Yosuke Oyama , Naoya Maruyama , Nikoli Dryden , Erin McCarthy , Peter Harrington , Jan Balewski , Satoshi Matsuoka , Peter Nugent , Brian Van Essen

The current deep neural network algorithm still stays in the end-to-end training supervision method like Image-Label pairs, which makes traditional algorithm is difficult to explain the reason for the results, and the prediction logic is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yishuang Tian , Ning Wang , Liang Zhang

As a concrete application of multi-view learning, multi-view classification improves the traditional classification methods significantly by integrating various views optimally. Although most of the previous efforts have been demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jinglin Xu , Wenbin Li , Jiantao Shen , Xinwang Liu , Peicheng Zhou , Xiangsen Zhang , Xiwen Yao , Junwei Han

Computer-aided diagnosis (CAD) systems play a crucial role in analyzing neuroimaging data for neurological and psychiatric disorders. However, small-sample studies suffer from low reproducibility, while large-scale datasets introduce…

Machine Learning · Computer Science 2025-08-12 Xinglin Zhao , Yanwen Wang , Xiaobo Liu , Yanrong Hao , Rui Cao , Xin Wen