English
Related papers

Related papers: Selecting time-series hyperparameters with the art…

200 papers

Conformal prediction methods enjoy strong theoretical and empirical predictive inference performance, provided the data is exchangeable, and predictors are trained in a memoryless fashion. However, these assumptions and constraints are…

Machine Learning · Statistics 2026-05-29 Hanyang Jiang , Rina Foygel Barber , Ashwin Pananjady , Yao Xie

The error or variability of machine learning algorithms is often assessed by repeatedly re-fitting a model with different weighted versions of the observed data. The ubiquitous tools of cross-validation (CV) and the bootstrap are examples…

Methodology · Statistics 2020-02-10 Ryan Giordano , Will Stephenson , Runjing Liu , Michael I. Jordan , Tamara Broderick

In this article I recommend a better point estimator for Krippendorff's Alpha agreement coefficient, and develop a jackknife variance estimator that leads to much better interval estimation than does the customary bootstrap procedure or an…

Methodology · Statistics 2022-10-25 John Hughes

There has been increasing interest in modelling survival data using deep learning methods in medical research. Current approaches have focused on designing special cost functions to handle censored survival data. We propose a very different…

Machine Learning · Statistics 2020-03-12 Lili Zhao , Dai Feng

Ensemble learning is widely used in applications to make predictions in complex decision problems---for example, averaging models fitted to a sequence of samples bootstrapped from the available training data. While such methods offer more…

Methodology · Statistics 2020-11-13 Byol Kim , Chen Xu , Rina Foygel Barber

The selection of algorithms is a crucial step in designing AI services for real-world time series classification use cases. Traditional methods such as neural architecture search, automated machine learning, combined algorithm selection,…

Machine Learning · Computer Science 2024-10-02 Lars Böcking , Leopold Müller , Niklas Kühl

Fault detection is crucial to ensure the reliability of navigation systems. However, mainstream fault detection methods are developed based on Gaussian assumptions on nominal errors, while current attempts at non-Gaussian fault detection…

Signal Processing · Electrical Eng. & Systems 2026-01-01 Penggao Yan , Baoshan Song , Xiao Xia , Weisong Wen , Li-Ta Hsu

In this era of big data, feature selection techniques, which have long been proven to simplify the model, makes the model more comprehensible, speed up the process of learning, have become more and more important. Among many developed…

Machine Learning · Statistics 2019-11-20 Thu Nguyen

In the big data era researchers face a series of problems. Even standard approaches/methodologies, like linear regression, can be difficult or problematic with huge volumes of data. Traditional approaches for regression in big datasets may…

Methodology · Statistics 2024-11-13 Vasilis Chasiotis , Dimitris Karlis

We develop a novel, general and computationally efficient framework, called Divide and Conquer Dynamic Programming (DCDP), for localizing change points in time series data with high-dimensional features. DCDP deploys a class of greedy…

Methodology · Statistics 2023-06-05 Wanshan Li , Daren Wang , Alessandro Rinaldo

Time series data account for a major part of data supply available today. Time series mining handles several tasks such as classification, clustering, query-by-content, prediction, and others. Performing data mining tasks on raw time series…

Neural and Evolutionary Computing · Computer Science 2018-12-11 Muhammad Marwan Muhammad Fuad

Classical reverse-mode automatic differentiation (AD) imposes only a small constant-factor overhead in operation count over the original computation, but has storage requirements that grow, in the worst case, in proportion to the time…

Programming Languages · Computer Science 2018-07-18 Jeffrey Mark Siskind , Barak A. Pearlmutter

Obtaining reliable inferences with traditional difference-in-differences (DiD) methods can be difficult. Problems can arise when both outcomes and errors are serially correlated, when there are few clusters or few treated clusters, when…

Econometrics · Economics 2026-02-13 Sunny R. Karim , Morten Ørregaard Nielsen , James G. MacKinnon , Matthew D. Webb

All known elimination techniques for (first-order) algorithmic differentiation (AD) rely on Jacobians to be given for a set of relevant elemental functions. Realistically, elemental tangents and adjoints are given instead. They can be…

Optimization and Control · Mathematics 2023-03-29 Uwe Naumann , Erik Schneidereit , Simon Maertens , Markus Towara

Selective forgetting or removing information from deep neural networks (DNNs) is essential for continual learning and is challenging in controlling the DNNs. Such forgetting is crucial also in a practical sense since the deployed DNNs may…

Machine Learning · Statistics 2021-01-01 Tomohiro Hayase , Suguru Yasutomi , Takashi Katoh

Time series classification stands as a pivotal and intricate challenge across various domains, including finance, healthcare, and industrial systems. In contemporary research, there has been a notable upsurge in exploring feature extraction…

Machine Learning · Computer Science 2024-07-24 Alireza Keshavarzian , Shahrokh Valaee

Purpose: Machine learning is broadly used for clinical data analysis. Before training a model, a machine learning algorithm must be selected. Also, the values of one or more model parameters termed hyper-parameters must be set. Selecting…

Machine Learning · Computer Science 2018-12-10 Xueqiang Zeng , Gang Luo

An increasingly common setting in machine learning involves multiple parties, each with their own data, who want to jointly make predictions on future test points. Agents wish to benefit from the collective expertise of the full set of…

Machine Learning · Computer Science 2021-06-24 Celestine Mendler-Dünner , Wenshuo Guo , Stephen Bates , Michael I. Jordan

Deleting data from a trained machine learning (ML) model is a critical task in many applications. For example, we may want to remove the influence of training points that might be out of date or outliers. Regulations such as EU's General…

Machine Learning · Computer Science 2021-02-24 Zachary Izzo , Mary Anne Smart , Kamalika Chaudhuri , James Zou

We address the challenge of constructing valid confidence intervals and sets in problems of prediction across multiple environments. We investigate two types of coverage suitable for these problems, extending the jackknife and…

Machine Learning · Statistics 2024-11-14 John C. Duchi , Suyash Gupta , Kuanhao Jiang , Pragya Sur