English
Related papers

Related papers: A Fast Algorithm for Selective Signal Extrapolatio…

200 papers

The notion of interpolation and extrapolation is fundamental in various fields from deep learning to function approximation. Interpolation occurs for a sample $x$ whenever this sample falls inside or on the boundary of the given dataset's…

Machine Learning · Computer Science 2021-11-02 Randall Balestriero , Jerome Pesenti , Yann LeCun

This paper investigates the active sampling for estimation of approximately bandlimited graph signals. With the assistance of a graph filter, an approximately bandlimited graph signal can be formulated by a Gaussian random field over the…

Signal Processing · Electrical Eng. & Systems 2019-02-19 Sijie Lin , Xuan Xie , Hui Feng , Bo Hu

Canonical work handling distribution shifts typically necessitates an entire target distribution that lands inside the training distribution. However, practical scenarios often involve only a handful of target samples, potentially lying…

Machine Learning · Computer Science 2025-01-17 Lingjing Kong , Guangyi Chen , Petar Stojanov , Haoxuan Li , Eric P. Xing , Kun Zhang

An efficient proximal-gradient-based method, called proximal extrapolated gradient method, is designed for solving monotone variational inequality in Hilbert space. The proposed method extends the acceptable range of parameters to obtain…

Optimization and Control · Mathematics 2019-12-05 Xiaokai Chang , Sanyang Liu , Jianchao Bai , Jun Yang

The recursive Neville algorithm allows one to calculate interpolating functions recursively. Upon a judicious choice of the abscissas used for the interpolation (and extrapolation), this algorithm leads to a method for convergence…

Numerical Analysis · Mathematics 2024-07-11 U. D. Jentschura , L. T. Giorgini

The problem of computing functions of values at the nodes in a network in a totally distributed manner, where nodes do not have unique identities and make decisions based only on local information, has applications in sensor, peer-to-peer,…

Networking and Internet Architecture · Computer Science 2007-05-23 Damon Mosk-Aoyama , Devavrat Shah

This paper presents a novel boundary-optimized fast Fourier extension algorithm for efficient approximation of non-periodic functions. The proposed methodology constructs periodic extensions through strategic utilization of boundary…

Numerical Analysis · Mathematics 2025-08-27 Z. Y. Zhao , Y. F Wang , A. G. Yagola

An algorithm for sampling exactly from the normal distribution is given. The algorithm reads some number of uniformly distributed random digits in a given base and generates an initial portion of the representation of a normal deviate in…

Computational Physics · Physics 2016-02-01 Charles F. F. Karney

Mathematical reasoning recently has been shown as a hard challenge for neural systems. Abilities including expression translation, logical reasoning, and mathematics knowledge acquiring appear to be essential to overcome the challenge. This…

Machine Learning · Computer Science 2022-03-29 Yangyang Hu , Yang Yu

Probabilistic programming is a growing area that strives to make statistical analysis more accessible, by separating probabilistic modelling from probabilistic inference. In practice this decoupling is difficult. No single inference…

Programming Languages · Computer Science 2022-04-15 Maria I. Gorinova

Distributed signal processing has attracted widespread attention in the scientific community due to its several advantages over centralized approaches. Recently, graph signal processing has risen to prominence, and adaptive distributed…

Signal Processing · Electrical Eng. & Systems 2020-08-07 Daniel G. Tiglea , Renato Candido , Magno T. M. Silva

We propose an iterative algorithm to interpolate graph signals from only a partial set of samples. Our method is derived from the well known Papoulis-Gerchberg algorithm by considering the optimal value of a constant involved in the…

Numerical Analysis · Mathematics 2020-02-19 Emanuele Brugnoli , Elena Toscano , Calogero Vetro

Speculative sampling is a popular technique for accelerating inference in Large Language Models by generating candidate tokens using a fast draft model and accepting or rejecting them based on the target model's distribution. While…

Machine Learning · Computer Science 2025-07-08 Valentin De Bortoli , Alexandre Galashov , Arthur Gretton , Arnaud Doucet

This paper considers the problem of interpolating signals defined on graphs. A major presumption considered by many previous approaches to this problem has been lowpass/ band-limitedness of the underlying graph signal. However, inspired by…

Information Theory · Computer Science 2017-05-09 Mahdi Boloursaz Mashhadi , Maryam Fallah , Farokh Marvasti

Sampling is a fundamental technique, and sampling without replacement is often desirable when duplicate samples are not beneficial. Within machine learning, sampling is useful for generating diverse outputs from a trained model. We present…

Machine Learning · Computer Science 2021-07-21 Kensen Shi , David Bieber , Charles Sutton

The paper suggests a method of extrapolation of notion of one-sided semi-infinite sequences representing traces of two-sided band-limited sequences; this features ensure uniqueness of this extrapolation and possibility to use this for…

Optimization and Control · Mathematics 2018-02-08 Nikolai Dokuchaev

Derivatives play a critical role in computational statistics, examples being Bayesian inference using Hamiltonian Monte Carlo sampling and the training of neural networks. Automatic differentiation is a powerful tool to automate the…

Mathematical Software · Computer Science 2019-03-27 Charles C. Margossian

We study the problem of interpolating a noisy Fourier-sparse signal in the time duration $[0, T]$ from noisy samples in the same range, where the ground truth signal can be any $k$-Fourier-sparse signal with band-limit $[-F, F]$. Our main…

Data Structures and Algorithms · Computer Science 2023-02-09 Zhao Song , Baocheng Sun , Omri Weinstein , Ruizhe Zhang

We present a novel method for controlling extrapolation in the prediction profiler in the JMP software. The prediction profiler is a graphical tool for exploring high dimensional prediction surfaces for statistical and machine learning…

Machine Learning · Statistics 2022-01-17 Jeremy Ash , Laura Lancaster , Chris Gotwalt

Machine learning systems, especially with overparameterized deep neural networks, can generalize to novel test instances drawn from the same distribution as the training data. However, they fare poorly when evaluated on out-of-support test…

Machine Learning · Computer Science 2023-04-28 Aviv Netanyahu , Abhishek Gupta , Max Simchowitz , Kaiqing Zhang , Pulkit Agrawal