English
Related papers

Related papers: An efficient algorithm for positive realizations

200 papers

The aim of this paper is to introduce a new learning procedure for neural networks and to demonstrate that it works well enough on a few small problems to be worth further investigation. The Forward-Forward algorithm replaces the forward…

Machine Learning · Computer Science 2022-12-29 Geoffrey Hinton

We make the interprecision transfers explicit in an algorithmic description of iterative refinement and obtain new insights into the algorithm. One example is the classic variant of iterative refinement where the matrix and the…

Numerical Analysis · Mathematics 2024-07-02 C. T. Kelley

Reinforcement learning agents have demonstrated remarkable achievements in simulated environments. Data efficiency poses an impediment to carrying this success over to real environments. The design of data-efficient agents calls for a…

Machine Learning · Computer Science 2023-05-09 Xiuyuan Lu , Benjamin Van Roy , Vikranth Dwaracherla , Morteza Ibrahimi , Ian Osband , Zheng Wen

Algorithms can be used to prove and to discover new theorems. This paper shows how algorithmic skills in general, and the notion of invariance in particular, can be used to derive many results from Euclid's algorithm. We illustrate how to…

Data Structures and Algorithms · Computer Science 2023-08-21 Roland Backhouse , João F. Ferreira

The era of huge data necessitates highly efficient machine learning algorithms. Many common machine learning algorithms, however, rely on computationally intensive subroutines that are prohibitively expensive on large datasets. Oftentimes,…

Machine Learning · Computer Science 2023-09-26 Mo Tiwari

Most systems and learning algorithms optimize average performance or average loss -- one reason being computational complexity. However, many objectives of practical interest are more complex than simply average loss. This arises, for…

Machine Learning · Computer Science 2018-06-05 Daniel Alabi , Nicole Immorlica , Adam Tauman Kalai

The idea of iterative process optimization based on collected output measurements, or "real-time optimization" (RTO), has gained much prominence in recent decades, with many RTO algorithms being proposed, researched, and developed. While…

Optimization and Control · Mathematics 2013-08-14 Gene A. Bunin , Grégory François , Dominique Bonvin

We observe standard transfer learning can improve prediction accuracies of target tasks at the cost of lowering their prediction fairness -- a phenomenon we named discriminatory transfer. We examine prediction fairness of a standard…

Computers and Society · Computer Science 2017-08-09 Chao Lan , Jun Huan

We describe an efficient Monte Carlo algorithm for a restricted class of scattering problems in radiation transfer. This class includes many astrophysically interesting problems, including the scattering of ultraviolet and visible light by…

Astrophysics · Physics 2007-05-23 Alan M. Watson , William J. Henney

We bring forward a logical system of transition algebras that enhances many-sorted first-order logic using features from dynamic logics. The sentences we consider include compositions, unions, and transitive closures of transition…

Logic in Computer Science · Computer Science 2024-04-26 Hashimoto Go , Daniel Găină , Ionuţ Ţuţu

The book gives a detailed exposition of basic concepts and results of a theory of processes. The presentation of theoretical concepts and results is accompanied with illustrations of their application to solving various problems of…

Logic in Computer Science · Computer Science 2010-09-14 Andrew M. Mironov

We consider the problem of approximating a given element $f$ from a Hilbert space $\mathcal{H}$ by means of greedy algorithms and the application of such procedures to the regression problem in statistical learning theory. We improve on the…

Statistics Theory · Mathematics 2009-09-29 Andrew R. Barron , Albert Cohen , Wolfgang Dahmen , Ronald A. DeVore

A method is presented which allows for a tremendous speed-up of computer simulations of statistical systems by orders of magnitude. This speed-up is achieved by means of a new observable, while the algorithm of the simulation remains…

Statistical Mechanics · Physics 2013-05-29 M. Kastner , J. D. Munoz , M. Promberger

We propose an efficient algorithm for estimation of possibility based qualitative expected utility. It is useful for decision making mechanisms where each possible decision is assigned a multi-attribute possibility distribution. The…

Artificial Intelligence · Computer Science 2012-07-09 Jakub Brzostowski , Ryszard Kowalczyk

Quantum computer algorithms can exploit the structure of random satisfiability problems. This paper extends a previous empirical evaluation of such an algorithm and gives an approximate asymptotic analysis accounting for both the average…

Quantum Physics · Physics 2007-05-23 Tad Hogg

We present new results on the classical algorithm of variable elimination, which underlies many algorithms including for probabilistic inference. The results relate to exploiting functional dependencies, allowing one to perform inference…

Artificial Intelligence · Computer Science 2020-04-21 Adnan Darwiche

Sharing knowledge between tasks is vital for efficient learning in a multi-task setting. However, most research so far has focused on the easier case where knowledge transfer is not harmful, i.e., where knowledge from one task cannot…

Machine Learning · Computer Science 2019-07-08 Timo Bram , Gino Brunner , Oliver Richter , Roger Wattenhofer

Real life signals are in general non--stationary and non--linear. The development of methods able to extract their hidden features in a fast and reliable way is of high importance in many research fields. In this work we tackle the problem…

Numerical Analysis · Mathematics 2018-10-26 Antonio Cicone , Haomin Zhou

Although membership inference attacks (MIAs) and machine-generated text detection target different goals, their methods often exploit similar signals based on a language model's probability distribution, and the two tasks have been studied…

Computation and Language · Computer Science 2026-02-11 Ryuto Koike , Liam Dugan , Masahiro Kaneko , Chris Callison-Burch , Naoaki Okazaki

State-of-the-art machine learning algorithms demonstrate close to absolute performance in selected challenges. We provide arguments that the reason can be in low variability of the samples and high effectiveness in learning typical…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Egor Illarionov , Roman Khudorozhkov