English
Related papers

Related papers: Algorithms for ridge estimation with convergence g…

200 papers

Although semi-dense Simultaneous Localization and Mapping (SLAM) has been becoming more popular over the last few years, there is a lack of efficient methods for representing and processing their large scale point clouds. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Shida He , Xuebin Qin , Zichen Zhang , Martin Jagersand

To solve distributed optimization efficiently with various constraints and nonsmooth functions, we propose a distributed mirror descent algorithm with embedded Bregman damping, as a generalization of conventional distributed…

Optimization and Control · Mathematics 2021-08-30 Guanpu Chen , Weijian Li , Gehui Xu , Yiguang Hong

There is a growing number of tasks that work directly on point clouds. As the size of the point cloud grows, so do the computational demands of these tasks. A possible solution is to sample the point cloud first. Classic sampling…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Itai Lang , Asaf Manor , Shai Avidan

Stochastic computation graphs (SCGs) provide a formalism to represent structured optimization problems arising in artificial intelligence, including supervised, unsupervised, and reinforcement learning. Previous work has shown that an…

Machine Learning · Computer Science 2019-01-08 Théophane Weber , Nicolas Heess , Lars Buesing , David Silver

We prove novel convergence results for a stochastic proximal gradient algorithm suitable for solving a large class of convex optimization problems, where a convex objective function is given by the sum of a smooth and a possibly non-smooth…

Optimization and Control · Mathematics 2016-08-11 Lorenzo Rosasco , Silvia Villa , Bang Công Vũ

We develop a new estimation technique for recovering depth-of-field from multiple stereo images. Depth-of-field is estimated by determining the shift in image location resulting from different camera viewpoints. When this shift is not…

Applications · Statistics 2009-10-07 E. Anderes , B. Yu , V. Jovanovic , C. Moroney , M. Garay , A. Braverman , E. Clothiaux

Consider convex optimization problems subject to a large number of constraints. We focus on stochastic problems in which the objective takes the form of expected values and the feasible set is the intersection of a large number of convex…

Machine Learning · Statistics 2015-11-13 Mengdi Wang , Yichen Chen , Jialin Liu , Yuantao Gu

In this work, we estimate the number of randomly selected elements of a tensor that with high probability guarantees local convergence of Riemannian gradient descent for tensor train completion. We derive a new bound for the orthogonal…

Numerical Analysis · Mathematics 2025-04-09 Stanislav Budzinskiy , Nikolai Zamarashkin

Metric magnitude is a measure of the "size" of point clouds with many desirable geometric properties. It has been adapted to various mathematical contexts and recent work suggests that it can enhance machine learning and optimization…

Machine Learning · Computer Science 2024-09-09 Rayna Andreeva , James Ward , Primoz Skraba , Jie Gao , Rik Sarkar

Inexpensive surrogates are useful for reducing the cost of science and engineering studies involving large-scale, complex computational models with many input parameters. A ridge approximation is one class of surrogate that models a…

Numerical Analysis · Mathematics 2019-03-01 Jeffrey M. Hokanson , Paul G. Constantine

We focus on the distribution regression problem: regressing to vector-valued outputs from probability measures. Many important machine learning and statistical tasks fit into this framework, including multi-instance learning and point…

Statistics Theory · Mathematics 2016-10-24 Zoltan Szabo , Bharath Sriperumbudur , Barnabas Poczos , Arthur Gretton

Gradient schemes is a framework which enables the unified convergence analysis of many different methods -- such as finite elements (conforming, non-conforming and mixed) and finite volumes methods -- for $2^{\rm nd}$ order diffusion…

Numerical Analysis · Mathematics 2018-10-09 Yahya Alnashri , Jerome Droniou

Point cloud filtering, the main bottleneck of which is removing noise (outliers) while preserving geometric features, is a fundamental problem in 3D field. The two-step schemes involving normal estimation and position update have been shown…

Graphics · Computer Science 2020-04-27 Dening Lu , Xuequan Lu , Yangxing Sun , Jun Wang

This letter investigates the convergence and concentration properties of the Stochastic Mirror Descent (SMD) algorithm utilizing biased stochastic subgradients. We establish the almost sure convergence of the algorithm's iterates under the…

Optimization and Control · Mathematics 2024-07-09 Anik Kumar Paul , Arun D Mahindrakar , Rachel K Kalaimani

We establish optimal convergence rates for a decomposition-based scalable approach to kernel ridge regression. The method is simple to describe: it randomly partitions a dataset of size N into m subsets of equal size, computes an…

Statistics Theory · Mathematics 2014-05-01 Yuchen Zhang , John C. Duchi , Martin J. Wainwright

We propose a precise and efficient normal estimation method that can deal with noise and nonuniform density for unstructured 3D point clouds. Unlike existing approaches that directly take patches and ignore the local neighborhood…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Keqiang Li , Mingyang Zhao , Huaiyu Wu , Dong-Ming Yan , Zhen Shen , Fei-Yue Wang , Gang Xiong

We investigate a novel non-parametric regression-based clustering algorithm for longitudinal data analysis. Combining natural cubic splines with Gaussian mixture models (GMM), the algorithm can produce smooth cluster means that describe the…

Methodology · Statistics 2022-09-20 Peter Mlakar , Tapio Nummi , Polona Oblak , Jana Faganeli Pucer

High quality upsampling of sparse 3D point clouds is critically useful for a wide range of geometric operations such as reconstruction, rendering, meshing, and analysis. In this paper, we propose a data-driven algorithm that enables an…

Computer Vision and Pattern Recognition · Computer Science 2019-06-24 Wentai Zhang , Haoliang Jiang , Zhangsihao Yang , Soji Yamakawa , Kenji Shimada , Levent Burak Kara

We study a ridge estimator for the high-dimensional two-way fixed effect regression model with a sparse bipartite network. We develop concentration inequalities showing that when the ridge parameters increase as the log of the network size,…

Econometrics · Economics 2026-01-08 Junnan He , Jean-Marc Robin

This paper develops a general asymptotic theory of series estimators for spatial data collected at irregularly spaced locations within a sampling region $R_n \subset \mathbb{R}^d$. We employ a stochastic sampling design that can flexibly…

Statistics Theory · Mathematics 2025-03-03 Daisuke Kurisu , Yasumasa Matsuda