中文
相关论文

相关论文: How good is the Electricity benchmark for evaluati…

200 篇论文

Generalization under distribution shift remains a core challenge in modern machine learning, yet existing learning bound theory is limited to narrow, idealized settings and is non-estimable from samples. In this paper, we bridge the gap…

机器学习 · 统计学 2025-08-25 Hongbo Chen , Li Charlie Xia

Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conformal prediction has…

机器学习 · 计算机科学 2024-11-07 Erfan Hajihashemi , Yanning Shen

Dynamic benchmarks interweave model fitting and data collection in an attempt to mitigate the limitations of static benchmarks. In contrast to an extensive theoretical and empirical study of the static setting, the dynamic counterpart lags…

机器学习 · 计算机科学 2023-03-03 Ali Shirali , Rediet Abebe , Moritz Hardt

We consider a semi-supervised classification problem with non-stationary label-shift in which we observe a labelled data set followed by a sequence of unlabelled covariate vectors in which the marginal probabilities of the class labels may…

统计理论 · 数学 2024-05-29 Henry W J Reeve

Recent advances in domain adaptation establish that requiring a low risk on the source domain and equal feature marginals degrade the adaptation's performance. At the same time, empirical evidence shows that incorporating an unsupervised…

机器学习 · 计算机科学 2022-03-11 Sofien Dhouib , Setareh Maghsudi

Many modern machine learning models are trained to achieve zero or near-zero training error in order to obtain near-optimal (but non-zero) test error. This phenomenon of strong generalization performance for "overfitted" / interpolated…

机器学习 · 统计学 2018-10-29 Mikhail Belkin , Daniel Hsu , Partha Mitra

The notion of concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models can become inaccurate and need adjustment. While there do exist methods…

机器学习 · 计算机科学 2023-03-17 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

Proper quantification of predictive uncertainty is essential for the use of machine learning in safety-critical applications. Various uncertainty measures have been proposed for this purpose, typically claiming superiority over other…

机器学习 · 计算机科学 2025-12-16 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

In this paper we consider estimation of sparse covariance matrices and propose a thresholding procedure which is adaptive to the variability of individual entries. The estimators are fully data driven and enjoy excellent performance both…

统计方法学 · 统计学 2011-02-14 Tony Cai , Weidong Liu

When training automated systems, it has been shown to be beneficial to adapt the representation of data by learning a problem-specific metric. This metric is global. We extend this idea and, for the widely used family of k nearest neighbors…

机器学习 · 计算机科学 2021-09-30 Jan Philip Göpfert , Heiko Wersing , Barbara Hammer

Many real-world classification problems are significantly class-imbalanced to detriment of the class of interest. The standard set of proper evaluation metrics is well-known but the usual assumption is that the test dataset imbalance equals…

机器学习 · 计算机科学 2020-04-16 Jan Brabec , Tomáš Komárek , Vojtěch Franc , Lukáš Machlica

Urban time series data forecasting featuring significant contributions to sustainable development is widely studied as an essential task of the smart city. However, with the dramatic and rapid changes in the world environment, the…

机器学习 · 计算机科学 2023-11-27 Zekun Cai , Renhe Jiang , Xinyu Yang , Zhaonan Wang , Diansheng Guo , Hiroki Kobayashi , Xuan Song , Ryosuke Shibasaki

Machine learning models are omnipresent for predictions on big data. One challenge of deployed models is the change of the data over time, a phenomenon called concept drift. If not handled correctly, a concept drift can lead to significant…

机器学习 · 计算机科学 2020-04-02 Lucas Baier , Marcel Hofmann , Niklas Kühl , Marisa Mohr , Gerhard Satzger

Many 'interesting; correlated electron materials exhibit an unusual sensitivity of measured properties to external perturbations, and in particular to imperfections in the sample being measured. It is argued that in addition to its…

强关联电子 · 物理学 2009-11-10 A. J. Millis

Despite continued efforts to improve classification accuracy, it has been reported that offline accuracy is a poor indicator of the usability of pattern recognition-based myoelectric control. One potential source of this disparity is the…

信号处理 · 电气工程与系统科学 2024-11-15 Shriram Tallam Puranam Raghu , Dawn T. MacIsaac , Erik J. Scheme

Soft robots manufactured with flexible materials can be highly compliant and adaptive to their surroundings, which facilitates their application in areas such as dexterous manipulation and environmental exploration. This paper aims at…

系统与控制 · 电气工程与系统科学 2025-07-01 Renjie Ma , Ziyao Qu , Zhijian Hu , Dong Zhao , Marios M. Polycarpou

This paper proposes a novel test-time adaptation strategy that adjusts the model pre-trained on the source domain using only unlabeled online data from the target domain to alleviate the performance degradation due to the distribution shift…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Sungha Choi , Seunghan Yang , Seokeon Choi , Sungrack Yun

We investigate how to improve efficiency using regression adjustments with covariates in covariate-adaptive randomizations (CARs) with imperfect subject compliance. Our regression-adjusted estimators, which are based on the doubly robust…

计量经济学 · 经济学 2023-06-19 Liang Jiang , Oliver B. Linton , Haihan Tang , Yichong Zhang

In many real-world applications, data are often collected in the form of stream, and thus the distribution usually changes in nature, which is referred as concept drift in literature. We propose a novel and effective approach to handle…

机器学习 · 计算机科学 2020-07-07 Peng Zhao , Le-Wen Cai , Zhi-Hua Zhou

Machine learning systems must adapt to data distributions that evolve over time, in applications ranging from sensor networks and self-driving car perception modules to brain-machine interfaces. We consider gradual domain adaptation, where…

机器学习 · 计算机科学 2020-02-27 Ananya Kumar , Tengyu Ma , Percy Liang