English
Related papers

Related papers: Anytime Tail Averaging

200 papers

We introduce Tiered Sampling, a novel technique for approximate counting sparse motifs in massive graphs whose edges are observed in a stream. Our technique requires only a single pass on the data and uses a memory of fixed size $M$, which…

Data Structures and Algorithms · Computer Science 2017-10-06 Lorenzo De Stefani , Erisa Terolli , Eli Upfal

To consider a high-dimensional random process, we propose a notion about stochastic tensor-valued random process (TRP). In this work, we first attempt to apply a generic chaining method to derive tail bounds for all p-th moments of the…

Probability · Mathematics 2023-02-02 Shih-Yu Chang

In evolutionary optimization, it is important to understand how fast evolutionary algorithms converge to the optimum per generation, or their convergence rate. This paper proposes a new measure of the convergence rate, called average…

Neural and Evolutionary Computing · Computer Science 2019-11-11 Jun He , Guangming Lin

Forecast combination has been proven to be a very important technique to obtain accurate predictions. In many applications, forecast errors exhibit heavy tail behaviors for various reasons. Unfortunately, to our knowledge, little has been…

Methodology · Statistics 2015-08-27 Gang Cheng , Sicong Wang , Yuhong Yang

Understanding the shape of a distribution of data is of interest to people in a great variety of fields, as it may affect the types of algorithms used for that data. We study one such problem in the framework of distribution property…

Machine Learning · Computer Science 2022-12-06 Maryam Aliakbarpour , Amartya Shankha Biswas , Kavya Ravichandran , Ronitt Rubinfeld

An autoregressive-moving average model in which all roots of the autoregressive polynomial are reciprocals of roots of the moving average polynomial and vice versa is called an all-pass time series model. All-pass models are useful for…

Statistics Theory · Mathematics 2007-08-22 Beth Andrews , Richard A. Davis , F. Jay Breidt

Continual learning aims to enable models to adapt to new datasets without losing performance on previously learned data, often assuming that prior data is no longer available. However, in many practical scenarios, both old and new data are…

Machine Learning · Computer Science 2025-03-03 Eli Verwimp , Guy Hacohen , Tinne Tuytelaars

In continual learning, where task data arrives in a sequence, fine-tuning on later tasks will often lead to performance degradation on earlier tasks. This is especially pronounced when these tasks come from diverse domains. In this setting,…

Machine Learning · Computer Science 2025-01-13 Anat Kleiman , Gintare Karolina Dziugaite , Jonathan Frankle , Sham Kakade , Mansheej Paul

For statistical inference of means of stationary processes, one needs to estimate their time-average variance constants (TAVC) or long-run variances. For a stationary process, its TAVC is the sum of all its covariances and it is a multiple…

Probability · Mathematics 2009-09-01 Wei Biao Wu

In a number of applications, particularly in financial and actuarial mathematics, it is of interest to characterize the tail distribution of a random variable $V$ satisfying the distributional equation $V\stackrel{\mathcal{D}}{=}f(V)$,…

Probability · Mathematics 2014-07-04 Jeffrey F. Collamore , Guoqing Diao , Anand N. Vidyashankar

We construct a new tail bound for the sum of independent random variables for situations in which the expected value of the sum is known and each random variable lies within a specified interval, which may be different for each variable.…

Probability · Mathematics 2025-03-25 Jackson Loper , Jeffrey Regier

Time series data can be subject to changes in the underlying process that generates them and, because of these changes, models built on old samples can become obsolete or perform poorly. In this work, we present a way to incorporate…

Machine Learning · Computer Science 2021-08-27 Jesus Antonanzas , Marta Arias , Albert Bifet

Assessing dependence within co-movements of financial instruments has been of much interest in risk management. Typically, indices of tail dependence are used to quantify the strength of such dependence, although many of the indices…

Methodology · Statistics 2022-09-21 Ning Sun , Chen Yang , Ričardas Zitikis

The extremal tail probabilities of moving sums in a marked Poisson random field is examined here. These sums are computed by adding up the weighted occurrences of events lying within a scanning set of fixed shape and size. Change of measure…

Probability · Mathematics 2007-08-22 Hock Peng Chan

The extreme value dependence of regularly varying stationary time series can be described by the spectral tail process. Drees, Segers and Warchol [Extremes 18(3): 369--402, 2015] proposed estimators of the marginal distributions of this…

Statistics Theory · Mathematics 2019-07-23 Holger Drees , Miran Knezevic

Long-tailed data is a special type of multi-class imbalanced data with a very large amount of minority/tail classes that have a very significant combined influence. Long-tailed learning aims to build high-performance models on datasets with…

Machine Learning · Computer Science 2024-08-02 Chongsheng Zhang , George Almpanidis , Gaojuan Fan , Binquan Deng , Yanbo Zhang , Ji Liu , Aouaidjia Kamel , Paolo Soda , João Gama

We propose GradTail, an algorithm that uses gradients to improve model performance on the fly in the face of long-tailed training data distributions. Unlike conventional long-tail classifiers which operate on converged - and possibly…

Machine Learning · Computer Science 2022-01-20 Zhao Chen , Vincent Casser , Henrik Kretzschmar , Dragomir Anguelov

Given a collection of computational models that all estimate values of the same natural process, we compare the performance of the average of the collection to the individual member whose estimates are nearest a given set of observations.…

Statistics Theory · Mathematics 2008-07-10 C. L. Winter , D. Nychka

In the world of multivariate extremes, estimation of the dependence structure still presents a challenge and an interesting problem. A procedure for the bivariate case is presented that opens the road to a similar way of handling the…

Statistics Theory · Mathematics 2008-11-14 John H. J. Einmahl , Andrea Krajina , Johan Segers

We introduce a new computational model for data streams: asymptotically exact streaming algorithms. These algorithms have an approximation ratio that tends to one as the length of the stream goes to infinity while the memory used by the…

Data Structures and Algorithms · Computer Science 2014-08-11 Marc Heinrich , Alexander Munteanu , Christian Sohler