English
Related papers

Related papers: The Natural Greedy Algorithm for reduced bases in …

200 papers

Novel vision sensors such as thermal, hyperspectral, polarization, and event cameras provide information that is not available from conventional intensity cameras. An obstacle to using these sensors with current powerful deep neural…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Yuhuang Hu , Tobi Delbruck , Shih-Chii Liu

The method of alternating projections involves projecting an element of a Hilbert space cyclically onto a collection of closed subspaces. It is known that the resulting sequence always converges in norm and that one can obtain estimates for…

Numerical Analysis · Mathematics 2019-02-14 Oscar Darwin , Aashraya Jha , Souktik Roy , David Seifert , Rhys Steele , Liam Stigant

Gradient regularization (GR) has been shown to improve the generalizability of trained models. While Natural Gradient Descent has been shown to accelerate optimization in the initial phase of training, little attention has been paid to how…

Machine Learning · Computer Science 2026-03-27 Satya Prakash Dash , Hossein Abdi , Wei Pan , Samuel Kaski , Mingfei Sun

Natural gradient descent (NGD) is a powerful optimization technique for machine learning, but the computational complexity of the inverse Fisher information matrix limits its application in training deep neural networks. To overcome this…

Machine Learning · Computer Science 2024-12-11 Weihua Liu , Said Boumaraf , Jianwu Li , Chaochao Lin , Xiabi Liu , Lijuan Niu , Naoufel Werghi

This paper investigates unmanned aerial vehicle (UAV) data collection systems with different multiple access schemes, where a rotary-wing UAV is dispatched to collect data from multiple ground nodes (GNs). Our goal is to maximize the…

Information Theory · Computer Science 2021-08-03 Xidong Mu , Yuanwei Liu , Li Guo , Jiaru Lin , Zhiguo Ding

We shall present a new characterization of greedy bases and 1-greedy bases in terms of certain functionals defined using distances to one dimensional subspaces generated by the basis. We also introduce a new property that unifies the…

Functional Analysis · Mathematics 2016-04-26 Pablo M. Berná , Óscar Blasco

We carefully investigate the on-line version of PCA, where in each trial a learning algorithm plays a k-dimensional subspace, and suffers the compression loss on the next instance when projected into the chosen subspace. In this setting, we…

Machine Learning · Computer Science 2014-05-12 Jiazhong Nie , Wojciech Kotlowski , Manfred K. Warmuth

Ensembles of independently trained neural networks are a state-of-the-art approach to estimate predictive uncertainty in Deep Learning, and can be interpreted as an approximation of the posterior distribution via a mixture of delta…

Machine Learning · Computer Science 2022-07-11 Aleksei Tiulpin , Matthew B. Blaschko

The Maximum Common Edge Subgraph (MCES) problem is a crucial challenge with significant implications in domains such as biology and chemistry. Traditional approaches, which include transformations into max-clique and search-based…

Machine Learning · Computer Science 2026-04-01 Chaolong Ying , Yingqi Ruan , Xuemin Chen , Yaomin Wang , Tianshu Yu

Genetic algorithm (GA) is typically used to solve nonlinear model predictive control's optimization problem. However, the size of the search space in which the GA searches for the optimal control inputs is crucial for its applicability to…

Optimization and Control · Mathematics 2025-01-22 Eslam Mostafa , Hussein A. Aly , Ahmed Elliethy

Contracting tensor networks is often computationally demanding. Well-designed contraction sequences can dramatically reduce the contraction cost. We explore the performance of simulated annealing and genetic algorithms, two common discrete…

Neural and Evolutionary Computing · Computer Science 2021-03-10 Frank Schindler , Adam S. Jermyn

In this article, we derive a novel convergence estimate for the weak POD-Greedy method with multiple POD modes and variable greedy thresholds in terms of the entropy numbers of the parametric solution manifold. Combining the POD with the…

Numerical Analysis · Mathematics 2025-01-15 Yuwen Li , Yupeng Wang

In this work, we propose to employ information-geometric tools to optimize a graph neural network architecture such as the graph convolutional networks. More specifically, we develop optimization algorithms for the graph-based…

Machine Learning · Computer Science 2020-08-25 Mohammad Rasool Izadi , Yihao Fang , Robert Stevenson , Lizhen Lin

This work deals with tailored reduced order models for bifurcating nonlinear parametric partial differential equations, where multiple coexisting solutions arise for a given parametric instance. Approaches based on proper orthogonal…

Numerical Analysis · Mathematics 2025-05-14 Federico Pichi , Maria Strazzullo

The compact Genetic Algorithm (cGA) is an Estimation of Distribution Algorithm that generates offspring population according to the estimated probabilistic model of the parent population instead of using traditional recombination and…

Neural and Evolutionary Computing · Computer Science 2009-01-07 Reza Rastegar , Arash Hariri

The purpose of this paper is to quantify the size of the Lebesgue constants $(L_m)_{m=1}^{\infty}$ associated with the thresholding greedy algorithm in terms of a new generation of parameters that modulate accurately some features of a…

Functional Analysis · Mathematics 2021-04-23 Fernando Albiac , Jose L. Ansorena , Pablo M. Berna

Generative adversarial networks (GANs) have been recently applied as a novel emulation technique for large scale structure simulations. Recent results show that GANs can be used as a fast, efficient and computationally cheap emulator for…

Cosmology and Nongalactic Astrophysics · Physics 2021-07-06 Andrius Tamosiunas , Hans A. Winther , Kazuya Koyama , David J. Bacon , Robert C. Nichol , Ben Mawdsley

Genetic Algorithms (GAs) are known for their efficiency in solving combinatorial optimization problems, thanks to their ability to explore diverse solution spaces, handle various representations, exploit parallelism, preserve good…

Neural and Evolutionary Computing · Computer Science 2023-09-29 Majid Sohrabi , Amir M. Fathollahi-Fard , Vasilii A. Gromov

We prove an $\Omega(d \lg n/ (\lg\lg n)^2)$ lower bound on the dynamic cell-probe complexity of statistically $\mathit{oblivious}$ approximate-near-neighbor search ($\mathsf{ANN}$) over the $d$-dimensional Hamming cube. For the natural…

Data Structures and Algorithms · Computer Science 2019-04-11 Kasper Green Larsen , Tal Malkin , Omri Weinstein , Kevin Yeo

Intelligent techniques are urged to achieve automatic allocation of the computing resource in Open Radio Access Network (O-RAN), to save computing resource, increase utilization rate of them and decrease the delay. However, the existing…

Neural and Evolutionary Computing · Computer Science 2022-01-13 Gan Ruan , Leandro L. Minku , Zhao Xu , Xin Yao