English
Related papers

Related papers: Model Assessment and Selection under Temporal Dist…

200 papers

Extracted event data from information systems often contain a variety of process executions making the data complex and difficult to comprehend. Unlike current research which only identifies the variability over time, we focus on other…

Software Engineering · Computer Science 2024-06-10 Ali Norouzifar , Majid Rafiei , Marcus Dees , Wil van der Aalst

We consider the fundamental problem of matching a template to a signal. We do so by M-estimation, which encompasses procedures that are robust to gross errors (i.e., outliers). Using standard results from empirical process theory, we derive…

Statistics Theory · Mathematics 2020-09-10 Ery Arias-Castro , Lin Zheng

This paper proposes new parametric model adequacy tests for possibly nonlinear and nonstationary time series models with noncontinuous data distribution, which is often the case in applied work. In particular, we consider the correct…

Statistics Theory · Mathematics 2021-08-10 Igor Kheifets , Carlos Velasco

Temporal distribution shifts pose a key challenge for machine learning models trained and deployed in dynamically evolving environments. This paper introduces RIDER (RIsk minimization under Dynamically Evolving Regimes) which derives…

Methodology · Statistics 2025-07-18 Yujin Jeong , Ramesh Johari , Dominik Rothenhäusler , Emily Fox

Performative learning addresses the increasingly pervasive situations in which algorithmic decisions may induce changes in the data distribution as a consequence of their public deployment. We propose a novel view in which these…

Machine Learning · Computer Science 2024-11-05 Edwige Cyffers , Muni Sreenivas Pydi , Jamal Atif , Olivier Cappé

Regression models are essential for a wide range of real-world applications. However, in practice, target values are not always precisely known; instead, they may be represented as intervals of acceptable values. This challenge has led to…

Machine Learning · Computer Science 2025-12-08 Tung L Nguyen , Toby Dylan Hocking

Forecasting the evolution of complex systems is one of the grand challenges of modern data science. The fundamental difficulty lies in understanding the structure of the observed stochastic process. In this paper, we show that every…

Statistics Theory · Mathematics 2020-01-01 Xiucai Ding , Zhou Zhou

Besides the classical offline setup of machine learning, stream learning constitutes a well-established setup where data arrives over time in potentially non-stationary environments. Concept drift, the phenomenon that the underlying…

Machine Learning · Computer Science 2024-12-13 Fabian Hinder , Valerie Vaquet , David Komnick , Barbara Hammer

We review the application of Statistical Mechanics methods to the study of online learning of a drifting concept in the limit of large systems. The model where a feed-forward network learns from examples generated by a time dependent…

Disordered Systems and Neural Networks · Physics 2007-05-23 Renato Vicente , Osame Kinouchi , Nestor Caticha

Temporal networks are ubiquitous and evolve over time by the addition, deletion, and changing of links, nodes, and attributes. Although many relational datasets contain temporal information, the majority of existing techniques in relational…

Artificial Intelligence · Computer Science 2011-11-23 Ryan A. Rossi , Jennifer Neville

Data in the real world often has an evolving distribution. Thus, machine learning models trained on such data get outdated over time. This phenomenon is called model drift. Knowledge of this drift serves two purposes: (i) Retain an accurate…

Machine Learning · Computer Science 2025-03-11 Pranoy Panda , Kancheti Sai Srinivas , Vineeth N Balasubramanian , Gaurav Sinha

In many open environment applications, data are collected in the form of a stream, which exhibits an evolving distribution over time. How to design algorithms to track these evolving data distributions with provable guarantees, particularly…

Machine Learning · Computer Science 2024-11-06 Chao Xu , Xijia Tang , Guoqing Liu , Yuhua Qian , Chenping Hou

As a highly expressive generative model, diffusion models have demonstrated exceptional success across various domains, including image generation, natural language processing, and combinatorial optimization. However, as data distributions…

Machine Learning · Computer Science 2025-10-27 Myunsoo Kim , Donghyeon Ki , Seong-Woong Shim , Byung-Jun Lee

Explanation faithfulness of model predictions in natural language processing is typically evaluated on held-out data from the same temporal distribution as the training data (i.e. synchronous settings). While model performance often…

Computation and Language · Computer Science 2022-10-18 Zhixue Zhao , George Chrysostomou , Kalina Bontcheva , Nikolaos Aletras

Time series classification is an important problem in real world. Due to its non-stationary property that the distribution changes over time, it remains challenging to build models for generalization to unseen distributions. In this paper,…

Machine Learning · Computer Science 2023-03-01 Wang Lu , Jindong Wang , Xinwei Sun , Yiqiang Chen , Xing Xie

Machine learning methods strive to acquire a robust model during the training process that can effectively generalize to test samples, even in the presence of distribution shifts. However, these methods often suffer from performance…

Machine Learning · Computer Science 2024-12-13 Jian Liang , Ran He , Tieniu Tan

We are concerned with the vulnerability of computer vision models to distributional shifts. We formulate a combinatorial optimization problem that allows evaluating the regions in the image space where a given model is more vulnerable, in…

Machine Learning · Computer Science 2019-08-21 Riccardo Volpi , Vittorio Murino

This paper is concerned with the detection of multiple change-points in the joint distribution of independent categorical variables. The procedures introduced rely on model selection and are based on a penalized least-squares criterion.…

Statistics Theory · Mathematics 2008-01-08 Nathalie Akakpo

Time-to-event outcomes are commonly used as primary endpoints in randomized clinical trials. Despite this, relatively little work incorporates baseline covariate information while also accounting for stratified randomization, a common form…

Methodology · Statistics 2026-05-01 Raphael C. Kim , Brian Gilbert , Ramin Zabih , Michele Santacatterina , Ivan Diaz

There are many time series in the literature with high dimension yet limited sample sizes, such as macroeconomic variables, and it is almost impossible to obtain efficient estimation and accurate prediction by using the corresponding…

Methodology · Statistics 2025-10-30 Yuchang Lin , Qianqian Zhu , Guodong Li