English
Related papers

Related papers: Nonlinear approximation in bounded orthonormal pro…

200 papers

This paper concerns identification of uncontrolled or closed loop nonlinear systems using a set of trajectories that are generated by the system in a domain of attraction. The objective is to ensure that the trajectories of the identified…

Systems and Control · Electrical Eng. & Systems 2022-10-25 Moad Abudia , Joel A. Rosenfeld , Rushikesh Kamalapurkar

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

An algorithm of searching a zero of an unknown undimensional function is considered, measured at a point x with some error. The step sizes are random positive values and are calculated according to the rule: if two consecutive iterations…

Statistics Theory · Mathematics 2007-06-13 Alexander Plakhov , Pedro Cruz

Spatial approximations have been traditionally used in spatial databases to accelerate the processing of complex geometric operations. However, approximations are typically only used in a first filtering step to determine a set of candidate…

In this paper, we consider a finite-dimensional optimization problem minimizing a continuous objective on a compact domain subject to a multi-dimensional constraint function. For the latter, we assume the availability of a global Lipschitz…

Optimization and Control · Mathematics 2026-02-11 Adrian Göß , Alexander Martin , Sebastian Pokutta , Kartikey Sharma

We propose and analyse numerical algorithms based on weighted least squares for the approximation of a real-valued function on a general bounded domain $\Omega \subset \mathbb{R}^d$. Given any $n$-dimensional approximation space $V_n…

Numerical Analysis · Mathematics 2020-04-06 Giovanni Migliorati

The objective of ordinal embedding is to find a Euclidean representation of a set of abstract items, using only answers to triplet comparisons of the form "Is item $i$ closer to the item $j$ or item $k$?". In recent years, numerous…

Machine Learning · Computer Science 2021-10-22 Leena Chennuru Vankadara , Siavash Haghiri , Michael Lohaus , Faiz Ul Wahab , Ulrike von Luxburg

We study unconstrained optimization problems with nonsmooth and convex objective function in the form of a mathematical expectation. The proposed method approximates the expected objective function with a sample average function using…

Optimization and Control · Mathematics 2022-11-03 Natasa Krejic , Natasa Krklec Jerinkic , Tijana Ostojic

In this paper, we introduce a method for approximating the solution to inference and optimization tasks in uncertain and deterministic reasoning. Such tasks are in general intractable for exact algorithms because of the large number of…

Artificial Intelligence · Computer Science 2012-12-12 David Ephraim Larkin

Distributed optimization algorithms have been studied extensively in the literature; however, underlying most algorithms is a linear consensus scheme, i.e. averaging variables from neighbors via doubly stochastic matrices. We consider…

Optimization and Control · Mathematics 2023-03-14 Hsu Kao , Vijay Subramanian

In this paper we propose an improved approximation scheme for the Vector Bin Packing problem (VBP), based on the combination of (near-)optimal solution of the Linear Programming (LP) relaxation and a greedy (modified first-fit) heuristic.…

Data Structures and Algorithms · Computer Science 2010-07-09 Chetan S Rao , Jeffrey John Geevarghese , Karthik Rajan

Deep Neural Networks (DNNs) have already become a crucial computational approach to revealing the spatial patterns in the human brain; however, there are three major shortcomings in utilizing DNNs to detect the spatial patterns in…

Machine Learning · Computer Science 2022-05-26 Wei Zhang , Yu Bao

The objective of this paper is to design an embedding method that maps local features describing an image (e.g. SIFT) to a higher dimensional representation useful for the image retrieval problem. First, motivated by the relationship…

Computer Vision and Pattern Recognition · Computer Science 2017-04-05 Thanh-Toan Do , Ngai-Man Cheung

One-dimensional function approximation is a fundamental problem in scientific computing and engineering applications. While neural networks possess powerful universal approximation capabilities, their optimization process is often hindered…

Machine Learning · Computer Science 2026-02-23 Hu Lou , Yin-Jun Gao , Dong-Xiao Zhang , Tai-Jiao Du , Jun-Jie Zhang , Jia-Rui Zhang

Nonparametric maximum likelihood estimation is intended to infer the unknown density distribution while making as few assumptions as possible. To alleviate the over parameterization in nonparametric data fitting, smoothing assumptions are…

Machine Learning · Statistics 2021-04-21 YunPeng Li , ZhaoHui Ye

The paper explores the differential inclusion of a special form. It is supposed that the support function of the set in the right-hand side of an inclusion may contain the maximum of the finite number of continuously differentiable (in…

Optimization and Control · Mathematics 2023-05-04 Alexander Fominyh

In this paper we consider functions in the Hardy space $\mathbf{H}_2^{p\times q}$ defined in the unit disc of matrix-valued. We show that it is possible, as in the scalar case, to decompose those functions as linear combinations of suitably…

Complex Variables · Mathematics 2015-11-25 D. Alpay , F. Colombo , T. Qian , I. Sabadini

This paper proposes a novel orthogonal-by-construction parametrization for augmenting physics-based input-output models with a learning component in an additive sense. The parametrization allows to jointly optimize the parameters of the…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Bendegúz M. Györök , Maarten Schoukens , Tamás Péni , Roland Tóth

Nonlinear state estimation under noisy observations is rapidly intractable as system dimension increases. We introduce an improved Yau-Yau filtering framework that breaks the curse of dimensionality and extends real-time nonlinear filtering…

Optimization and Control · Mathematics 2026-04-08 Shing-Tung Yau , Yi-Shuai Niu

The standard greedy algorithm has been recently shown to enjoy approximation guarantees for constrained non-submodular nondecreasing set function maximization. While these recent results allow to better characterize the empirical success of…

Social and Information Networks · Computer Science 2019-10-09 Khashayar Gatmiry , Manuel Gomez-Rodriguez