English
Related papers

Related papers: Second Order Differences of Cyclic Data and Applic…

200 papers

Low-rank approximation of images via singular value decomposition is well-received in the era of big data. However, singular value decomposition (SVD) is only for order-two data, i.e., matrices. It is necessary to flatten a higher order…

Machine Learning · Computer Science 2022-08-26 Liang Liao , Sen Lin , Lun Li , Xiuwei Zhang , Song Zhao , Yan Wang , Xinqiang Wang , Qi Gao , Jingyu Wang

Second-order optimization uses curvature information about the objective function, which can help in faster convergence. However, such methods typically require expensive computation of the Hessian matrix, preventing their usage in a…

Machine Learning · Computer Science 2022-11-03 Mohamed Elsayed , A. Rupam Mahmood

Trust region and cubic regularization methods have demonstrated good performance in small scale non-convex optimization, showing the ability to escape from saddle points. Each iteration of these methods involves computation of gradient,…

Optimization and Control · Mathematics 2018-09-27 Liu Liu , Xuanqing Liu , Cho-Jui Hsieh , Dacheng Tao

While variational methods have been among the most powerful tools for solving linear inverse problems in imaging, deep (convolutional) neural networks have recently taken the lead in many challenging benchmarks. A remaining drawback of deep…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tim Meinhardt , Michael Moeller , Caner Hazirbas , Daniel Cremers

This paper introduces the new and powerful image patch descriptor based on second order image statistics/derivatives. Here, the image patch is treated as a 3D surface with intensity being the 3rd dimension. The considered 3D surface has a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Darshan Venkatrayappa , Philippe Montesinos , Daniel Diep , Baptiste Magnier

We introduce a finite-difference framework for curvature regularization in neural signed distance field (SDF) learning. Existing approaches enforce curvature priors using full Hessian information obtained via second-order automatic…

Graphics · Computer Science 2025-11-13 Haotian Yin , Aleksander Plocharski , Michal Jan Wlodarczyk , Przemyslaw Musialski

Purpose: To develop a general phase regularized image reconstruction method, with applications to partial Fourier imaging, water-fat imaging and flow imaging. Theory and Methods: The problem of enforcing phase constraints in reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Frank Ong , Joseph Cheng , Michael Lustig

Over the last decade or so, reconstruction methods using $\ell_1$ regularization, often categorized as compressed sensing (CS) algorithms, have significantly improved the capabilities of high fidelity imaging in electron tomography. The…

Numerical Analysis · Mathematics 2017-03-07 Toby Sanders , Anne Gelb , Rodrigo Platte , Ilke Arslan , Kai Landskron

In this work, we propose a new discretization for second-order total generalized variation (TGV) with some distinct properties compared to existing discrete formulations. The introduced model is based on same design principles as Condat's…

Numerical Analysis · Mathematics 2025-04-14 Alireza Hosseini , Kristian Bredies

The objectives of this chapter are: (i) to introduce a concise overview of regularization; (ii) to define and to explain the role of a particular type of regularization called total variation norm (TV-norm) in computer vision tasks; (iii)…

Computer Vision and Pattern Recognition · Computer Science 2016-04-01 Vania V. Estrela , Hermes Aguiar Magalhaes , Osamu Saotome

Applications such as unbalanced and fully shuffled regression can be approached by optimizing regularized optimal transport (OT) distances, such as the entropic OT and Sinkhorn distances. A common approach for this optimization is to use a…

Numerical Analysis · Mathematics 2024-10-22 Xingjie Li , Fei Lu , Molei Tao , Felix X. -F. Ye

While the superior performance of second-order optimization methods such as Newton's method is well known, they are hardly used in practice for deep learning because neither assembling the Hessian matrix nor calculating its inverse is…

Machine Learning · Computer Science 2020-09-16 Siyuan Shen , Tianjia Shao , Kun Zhou , Chenfanfu Jiang , Feng Luo , Yin Yang

Higher-order tensor methods were recently proposed for minimizing smooth convex and nonconvex functions. Higher-order algorithms accelerate the convergence of the classical first-order methods thanks to the higher-order derivatives used in…

Optimization and Control · Mathematics 2024-01-11 Ion Necoara

Images of near-field SAR contains spatial-variant sidelobes and clutter, subduing the image quality. Current image restoration methods are only suitable for small observation angle, due to their assumption of 2D spatial-invariant…

Signal Processing · Electrical Eng. & Systems 2022-10-06 Wensi Zhang , Xiaoling Zhang , Xu Zhan , Yuetonghui Xu , Jun Shi , Shunjun Wei

This study introduces an order-lifted inversion/retrieval method for implementing high-order schemes within the framework of an unstructured-mesh-based finite-volume method. This method defines a special representation called the data…

Fluid Dynamics · Physics 2025-01-20 Hao Guo , Peixue Jiang , Xiaofeng Ma , Boxing Hu , Yinhai Zhu

In the realm of medical 3D data, such as CT and MRI images, prevalent anisotropic resolution is characterized by high intra-slice but diminished inter-slice resolution. The lowered resolution between adjacent slices poses challenges,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-09 Wei Fang , Yuxing Tang , Heng Guo , Mingze Yuan , Tony C. W. Mok , Ke Yan , Jiawen Yao , Xin Chen , Zaiyi Liu , Le Lu , Ling Zhang , Minfeng Xu

A cornerstone of geometric reconstruction, rotation averaging seeks the set of absolute rotations that optimally explains a set of measured relative orientations between them. In spite of being an integral part of bundle adjustment and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Gabriel Moreira , Manuel Marques , João Paulo Costeira

Denoising is of utmost importance for the visualization and processing of images featuring low signal-to-noise ratio. Total variation methods are among the most popular techniques to perform this task improving the signal-to-noise ratio…

Signal Processing · Electrical Eng. & Systems 2022-01-24 Gonzalo D. Maso Talou , Pablo J. Blanco

Optical analog circuits have attracted attention as promising alternatives to traditional electronic circuits for signal processing tasks due to their potential for low-latency and low-power computations. However, implementing iterative…

Image and Video Processing · Electrical Eng. & Systems 2025-06-18 Taisei Kato , Ryo Hayakawa , Soma Furusawa , Kazunori Hayashi , Youji Iiguni

Deep learning has been widely used for solving image reconstruction tasks but its deployability has been held back due to the shortage of high-quality training data. Unsupervised learning methods, such as the deep image prior (DIP),…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Riccardo Barbano , Javier Antorán , Johannes Leuschner , José Miguel Hernández-Lobato , Bangti Jin , Željko Kereta