English
Related papers

Related papers: On Selecting Stable Predictors in Time Series Mode…

200 papers

Sparse linear models are one of several core tools for interpretable machine learning, a field of emerging importance as predictive models permeate decision-making in many domains. Unfortunately, sparse linear models are far less flexible…

Machine Learning · Statistics 2024-01-03 Ryan Thompson , Amir Dezfouli , Robert Kohn

Time-series classification is an important domain of machine learning and a plethora of methods have been developed for the task. In comparison to existing approaches, this study presents a novel method which decomposes a time-series…

Machine Learning · Computer Science 2015-03-12 Josif Grabocka , Lars Schmidt-Thieme

In economics and many other forecasting domains, the real world problems are too complex for a single model that assumes a specific data generation process. The forecasting performance of different methods changes depending on the nature of…

Machine Learning · Computer Science 2023-09-26 Li Li , Feng Li , Yanfei Kang

By treating intervals as inseparable sets, this paper proposes sparse machine learning regressions for high-dimensional interval-valued time series. With LASSO or adaptive LASSO techniques, we develop a penalized minimum distance…

Econometrics · Economics 2024-11-15 Haowen Bao , Yongmiao Hong , Yuying Sun , Shouyang Wang

Performance estimation aims at estimating the loss that a predictive model will incur on unseen data. These procedures are part of the pipeline in every machine learning project and are used for assessing the overall generalisation ability…

Machine Learning · Computer Science 2021-08-31 Vitor Cerqueira , Luis Torgo , Igor Mozetic

Impulsive systems are a very flexible class of systems that can be used to represent switched and sampled-data systems. We propose to extend here the previously obtained results on deterministic impulsive systems to the stochastic setting.…

Optimization and Control · Mathematics 2016-08-02 Corentin Briat

Recent work shows that post-training datasets for LLMs can be substantially downsampled without noticeably deteriorating performance. However, data selection often incurs high computational costs or is limited to narrow domains. In this…

Computation and Language · Computer Science 2025-09-25 Paramita Mirza , Lucas Weber , Fabian Küch

The proposed feature selection method builds a histogram of the most stable features from random subsets of a training set and ranks the features based on a classifier based cross-validation. This approach reduces the instability of…

Artificial Intelligence · Computer Science 2012-02-07 Alex Pappachen James , Akshay Maan

This paper introduces a new framework for analyzing the stability of discrete-time model predictive controllers acting on continuous-time systems. The proposed framework introduces the distinction between discretization time (used to…

Systems and Control · Electrical Eng. & Systems 2023-10-05 Yaashia Gautam , Marco M. Nicotra

Shapelet-based algorithms are widely used for time series classification because of their ease of interpretation, but they are currently outperformed by recent state-of-the-art approaches. We present a new formulation of time series…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Antoine Guillaume , Christel Vrain , Elloumi Wael

In many areas of decision-making, forecasting is an essential pillar. Consequently, many different forecasting methods have been proposed. From our experience, recently presented forecasting methods are computationally intensive, poorly…

Machine Learning · Computer Science 2023-09-29 André Bauer , Mark Leznik , Michael Stenger , Robert Leppich , Nikolas Herbst , Samuel Kounev , Ian Foster

Delay embedding methods are a staple tool in the field of time series analysis and prediction. However, the selection of embedding parameters can have a big impact on the resulting analysis. This has led to the creation of a large number of…

Dynamical Systems · Mathematics 2025-08-29 Eugene Tan , Shannon Algar , Débora Corrêa , Michael Small , Thomas Stemler , David Walker

We consider estimation and inference in panel data models with additive unobserved individual specific heterogeneity in a high dimensional setting. The setting allows the number of time varying regressors to be larger than the sample size.…

Methodology · Statistics 2017-10-05 Alexandre Belloni , Victor Chernozhukov , Christian Hansen , Damian Kozbur

Conformal prediction is a general method that converts almost any point predictor to a prediction set. The resulting set keeps good statistical properties of the original estimator under standard assumptions, and guarantees valid average…

Methodology · Statistics 2017-08-02 Jing Lei

The tuning parameter selection strategy for penalized estimation is crucial to identify a model that is both interpretable and predictive. However, popular strategies (e.g., minimizing average squared prediction error via cross-validation)…

Methodology · Statistics 2022-11-10 Julia Holter , Jonathan Stallrich

For consistency (even oracle properties) of estimation and model prediction, almost all existing methods of variable/feature selection critically depend on sparsity of models. However, for ``large $p$ and small $n$" models sparsity…

Methodology · Statistics 2010-08-10 Lu Lin , Lixing Zhu , Yujie Gai

Bayesian change-point detection, together with latent variable models, allows to perform segmentation over high-dimensional time-series. We assume that change-points lie on a lower-dimensional manifold where we aim to infer subsets of…

Machine Learning · Statistics 2020-11-04 Lorena Romero-Medrano , Pablo Moreno-Muñoz , Antonio Artés-Rodríguez

In many problem settings, parameter vectors are not merely sparse but dependent in such a way that non-zero coefficients tend to cluster together. We refer to this form of dependency as "region sparsity." Classical sparse regression…

Machine Learning · Statistics 2019-01-28 Anqi Wu , Oluwasanmi Koyejo , Jonathan W. Pillow

We consider the problem of model selection and estimation in sparse high dimensional linear regression models with strongly correlated variables. First, we study the theoretical properties of the dual Lasso solution, and we show that joint…

Applications · Statistics 2017-03-21 Niharika Gauraha

Accurate wind power forecasts depend on reliable wind speed forecasts. Numerical Weather Predictions (NWPs) utilize huge amounts of computing time, but still have rather low spatial and temporal resolution. However, stochastic wind speed…

Applications · Statistics 2015-09-10 Daniel Ambach , Carsten Croonenbroeck