English
Related papers

Related papers: Solving Time of Least Square Systems in Sigma-Pi U…

200 papers

We train a small message-passing graph neural network to predict Hamiltonian cycles on Erd\H{o}s-R\'enyi random graphs in a critical regime. It outperforms existing hand-crafted heuristics after about 2.5 hours of training on a single GPU.…

Machine Learning · Computer Science 2023-06-13 Filip Bosnić , Mile Šikić

Solving inverse problems with iterative algorithms is popular, especially for large data. Due to time constraints, the number of possible iterations is usually limited, potentially affecting the achievable accuracy. Given an error one is…

Numerical Analysis · Computer Science 2018-02-16 Raja Giryes , Yonina C. Eldar , Alex M. Bronstein , Guillermo Sapiro

Simulation speed matters for neuroscientific research: this includes not only how quickly the simulated model time of a large-scale spiking neuronal network progresses, but also how long it takes to instantiate the network model in computer…

Physics-informed neural networks (PINN) is a extremely powerful paradigm used to solve equations encountered in scientific computing applications. An important part of the procedure is the minimization of the equation residual which…

Machine Learning · Computer Science 2024-12-03 Gabriel Turinici

We present a new algorithm for exactly solving decision making problems represented as influence diagrams. We do not require the usual assumptions of no forgetting and regularity; this allows us to solve problems with simultaneous decisions…

Artificial Intelligence · Computer Science 2015-03-19 Denis Deratani Mauá , Cassio Polpo de Campos , Marco Zaffalon

In this work we study biological neural networks from an algorithmic perspective, focusing on understanding tradeoffs between computation time and network complexity. Our goal is to abstract real neural networks in a way that, while not…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-30 Nancy Lynch , Cameron Musco , Merav Parter

Bayesian online algorithms for Sum-Product Networks (SPNs) need to update their posterior distribution after seeing one single additional instance. To do so, they must compute moments of the model parameters under this distribution. The…

Machine Learning · Computer Science 2017-11-07 Han Zhao , Geoff Gordon

Partial least squares regression (PLSR) has been a popular technique to explore the linear relationship between two datasets. However, most of algorithm implementations of PLSR may only achieve a suboptimal solution through an optimization…

Computer Vision and Pattern Recognition · Computer Science 2016-09-22 Haoran Chen , Yanfeng Sun , Junbin Gao , Yongli Hu , Baocai Yin

As the scale of problems and data used for experimental design, signal processing and data assimilation grow, the oft-occuring least squares subproblems are correspondingly growing in size. As the scale of these least squares problems…

Computation · Statistics 2023-02-09 Nathaniel Pritchard , Vivak Patel

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms,…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Alessandro Rudi , Lorenzo Rosasco , Volkan Cevher

We consider the fundamental problem of solving quadratic systems of equations in $n$ variables, where $y_i = |\langle \boldsymbol{a}_i, \boldsymbol{x} \rangle|^2$, $i = 1, \ldots, m$ and $\boldsymbol{x} \in \mathbb{R}^n$ is unknown. We…

Information Theory · Computer Science 2016-03-23 Yuxin Chen , Emmanuel J. Candes

We present an algorithm based on continuation techniques that can be applied to solve numerically minimization problems with equality constraints. We focus on problems with a great number of local minima which are hard to obtain by local…

Numerical Analysis · Mathematics 2019-09-17 Elisabete Alberdi , Mikel Antoñana , Joseba Makazaga , Ander Murua

Solving a linear system $Ax=b$ is a fundamental scientific computing primitive for which numerous solvers and preconditioners have been developed. These come with parameters whose optimal values depend on the system being solved and are…

Machine Learning · Computer Science 2024-05-03 Mikhail Khodak , Edmond Chow , Maria-Florina Balcan , Ameet Talwalkar

In this paper, we study the problem of multipath channel estimation for direct sequence spread spectrum signals. To resolve multipath components arriving within a short interval, we propose a new algorithm called the least-squares based…

Information Theory · Computer Science 2015-03-19 Wooseok Nam , Seung-Hyun Kong

Recurrent Neural Networks (RNNs) were recently successfully used to model the way neural activity drives task-related behavior in animals, operating under the implicit assumption that the obtained solutions are universal. Observations in…

Neurons and Cognition · Quantitative Biology 2021-11-19 Elia Turner , Kabir Dabholkar , Omri Barak

Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing…

Neural and Evolutionary Computing · Computer Science 2020-05-05 Qiang Yu , Shenglan Li , Huajin Tang , Longbiao Wang , Jianwu Dang , Kay Chen Tan

Neural networks (NNs) struggle to efficiently solve certain problems, such as learning parities, even when there are simple learning algorithms for those problems. Can NNs discover learning algorithms on their own? We exhibit a NN…

Machine Learning · Computer Science 2023-01-18 Surbhi Goel , Sham Kakade , Adam Tauman Kalai , Cyril Zhang

The Shortest Paths Problem (SPP) is no longer unresolved. Just for a large scalar of instance on this problem, even we cannot know if an algorithm achieves the computing. Those cutting-edge methods are still in the low performance. If we go…

Data Structures and Algorithms · Computer Science 2019-01-23 Yong Tan

The quantum statistics mechanism is very powerful for investigating the equilibrium states and the phase transitions in complex spin disorder systems. The spin disorder systems act as an interdisciplinary platform for solving the optimum…

General Physics · Physics 2025-06-17 Zhidong Zhang

Diverse scientific and engineering research areas deal with discrete, time-stamped changes in large systems of interacting delay differential equations. Simulating such complex systems at scale on high-performance computing clusters demands…