English
Related papers

Related papers: Robust Phase Retrieval via Reverse Kullback-Leible…

200 papers

Regularization schemes for regression have been widely studied in learning theory and inverse problems. In this paper, we study distribution regression (DR) which involves two stages of sampling, and aims at regressing from probability…

Machine Learning · Computer Science 2021-10-27 Zhan Yu , Daniel W. C. Ho , Ding-Xuan Zhou

In the compressive phase retrieval problem, or phaseless compressed sensing, or compressed sensing from intensity only measurements, the goal is to reconstruct a sparse or approximately $k$-sparse vector $x \in \mathbb{R}^n$ given access to…

Data Structures and Algorithms · Computer Science 2020-03-03 Yi Li , Vasileios Nakos

Phase retrieval refers to a classical nonconvex problem of recovering a signal from its Fourier magnitude measurements. Inspired by the compressed sensing technique, signal sparsity is exploited in recent studies of phase retrieval to…

Computational Physics · Physics 2013-02-04 Zai Yang , Cishen Zhang , Lihua Xie

Recovering a sparse signal from outlier-contaminated measurements is a fundamental challenge in many applications. While existing algorithms predominantly address scenarios with bounded noise or assume known signal sparsity, few methods…

Information Theory · Computer Science 2026-03-09 Jiao Xu , Peng Li , Bing Zheng

Explicit latent variable models provide a flexible yet powerful framework for data synthesis, enabling controlled manipulation of generative factors. With latent variables drawn from a tractable probability density function that can be…

Machine Learning · Computer Science 2025-11-11 Matteo Pettenó , Alessandro Ilic Mezza , Alberto Bernardini

In this work, we propose a novel method for robust single rotation averaging that can efficiently handle an extremely large fraction of outliers. Our approach is to minimize the total truncated least unsquared deviations (TLUD) cost of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Seong Hun Lee , Javier Civera

A phase retrieval technique using a spatial light modulator (SLM) and a phase diffuser for a fast reconstruction of smooth wave fronts is demonstrated experimentally. Diffuse illumination of a smooth test object with the aid of a phase…

Optics · Physics 2015-06-11 Mostafa Agour , Percival F. Almoro , Claas Falldorf

\emph{Kullback-Leibler} (KL) regularization is ubiquitous in reinforcement learning algorithms in the form of \emph{reverse} or \emph{forward} KL. Recent studies have demonstrated $\epsilon^{-1}$-type fast rates for decision making under…

Machine Learning · Computer Science 2026-05-12 Qingyue Zhao , Kaixuan Ji , Heyang Zhao , Quanquan Gu

We address the problem of signal reconstruction from intensity measurements with respect to a measurement frame. This non-convex inverse problem is known as phase retrieval. The case considered in this paper concerns phaseless measurements…

Functional Analysis · Mathematics 2019-02-13 Goetz E. Pfander , Palina Salanevich

We present Re-weighted Gradient Descent (RGD), a novel optimization technique that improves the performance of deep neural networks through dynamic sample re-weighting. Leveraging insights from distributionally robust optimization (DRO)…

Machine Learning · Computer Science 2024-10-15 Ramnath Kumar , Kushal Majmundar , Dheeraj Nagaraj , Arun Sai Suggala

In many supervised learning applications, the response consists of both continuous and binary outcomes. Studies have shown that jointly modeling such mixed-type responses can substantially improve predictive performance compared to separate…

Methodology · Statistics 2026-03-13 Yu Wang , Ran Jin , Lulu Kang

High-throughput computational imaging requires efficient processing algorithms to retrieve multi-dimensional and multi-scale information. In computational phase imaging, phase retrieval (PR) is required to reconstruct both amplitude and…

Image and Video Processing · Electrical Eng. & Systems 2021-09-15 Xuyang Chang , Liheng Bian , Jun Zhang

We present a method to probe rare molecular dynamics trajectories directly using reinforcement learning. We consider trajectories that are conditioned to transition between regions of configuration space in finite time, like those relevant…

Statistical Mechanics · Physics 2022-01-07 Avishek Das , Dominic C. Rose , Juan P. Garrahan , David T. Limmer

We propose a novel and unsupervised representation learning model, i.e., Robust Block-Diagonal Adaptive Locality-constrained Latent Representation (rBDLR). rBDLR is able to recover multi-subspace structures and extract the adaptive…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Zhao Zhang , Jiahuan Ren , Sheng Li , Richang Hong , Zhengjun Zha , Meng Wang

This paper addresses a new interpretation of the traditional optimization method in reinforcement learning (RL) as optimization problems using reverse Kullback-Leibler (KL) divergence, and derives a new optimization method using forward KL…

Machine Learning · Computer Science 2022-04-25 Taisuke Kobayashi

Sparse modeling is one of the efficient techniques for imaging that allows recovering lost information. In this paper, we present a novel iterative phase-retrieval algorithm using a sparse representation of the object amplitude and phase.…

Computer Vision and Pattern Recognition · Computer Science 2011-08-17 Artem Migukin , Vladimir Katkovnik , Jaakko Astola

A novel phase retrieval algorithm for broadband hyperspectral phase imaging from noisy intensity observations is proposed. It utilizes advantages of the Fourier Transform spectroscopy in the self-referencing optical setup and provides,…

Image and Video Processing · Electrical Eng. & Systems 2020-06-03 Igor Shevkunov , Vladimir Katkovnik , Karen Egiazarian

We consider the nonlinear Kalman filtering problem using Kullback-Leibler (KL) and $\alpha$-divergence measures as optimization criteria. Unlike linear Kalman filters, nonlinear Kalman filters do not have closed form Gaussian posteriors…

Optimization and Control · Mathematics 2017-11-22 San Gultekin , John Paisley

We develop a recursive total least-squares (RTLS) algorithm for errors-in-variables system identification utilizing the inverse power method and the dichotomous coordinate-descent (DCD) iterations. The proposed algorithm, called DCD-RTLS,…

Systems and Control · Computer Science 2015-06-22 Reza Arablouei , Kutluyıl Doğançay , Stefan Werner

Dynamic time warping (DTW) is an effective dissimilarity measure in many time series applications. Despite its popularity, it is prone to noises and outliers, which leads to singularity problem and bias in the measurement. The time…

Machine Learning · Computer Science 2022-08-04 Xiaomin Song , Qingsong Wen , Yan Li , Liang Sun