中文
相关论文

相关论文: Signature-Kernel Based Evaluation Metrics for Robu…

200 篇论文

Kendall's tau is frequently used to meta-evaluate how well machine translation (MT) evaluation metrics score individual translations. Its focus on pairwise score comparisons is intuitive but raises the question of how ties should be…

计算与语言 · 计算机科学 2023-10-18 Daniel Deutsch , George Foster , Markus Freitag

Much of machine learning relies on comparing distributions with discrepancy measures. Stein's method creates discrepancy measures between two distributions that require only the unnormalized density of one and samples from the other. Stein…

机器学习 · 统计学 2020-07-21 Raghav Singhal , Xintian Han , Saad Lahlou , Rajesh Ranganath

A reliable representation of uncertainty is essential for the application of modern machine learning methods in safety-critical settings. In this regard, the use of credal sets (i.e., convex sets of probability distributions) has recently…

机器学习 · 计算机科学 2026-03-10 Paul Hofman , Timo Löhr , Maximilian Muschalik , Yusuf Sale , Eyke Hüllermeier

Ensuring the reliability and safety of automated decision-making is crucial. It is well-known that data distribution shifts in machine learning can produce unreliable outcomes. This paper proposes a new approach for measuring the…

机器学习 · 计算机科学 2024-08-14 Daniel Sikar , Artur Garcez , Tillman Weyde , Robin Bloomfield , Kaleem Peeroo

Time Series Anomaly Detection metrics serve as crucial tools for model evaluation. However, existing metrics suffer from several limitations: insufficient discriminative power, strong hyperparameter dependency, sensitivity to perturbations,…

机器学习 · 计算机科学 2025-09-03 Zhijie Zhong , Zhiwen Yu , Yiu-ming Cheung , Kaixiang Yang

Kernel change-point detection (KCPD) has become a widely used tool for identifying structural changes in complex data. While existing theory establishes consistency under independence assumptions, real-world sequential data such as text…

机器学习 · 计算机科学 2026-01-27 Jairo Diaz-Rodriguez , Mumin Jia

Building on the functional-analytic framework of operator-valued kernels and un-truncated signature kernels, we propose a scalable, provably convergent signature-based algorithm for a broad class of high-dimensional, path-dependent hedging…

泛函分析 · 数学 2025-02-06 Nicola Muca Cirone , Cristopher Salvi

We study algorithms for online change-point detection (OCPD), where samples that are potentially heavy-tailed, are presented one at a time and a change in the underlying mean must be detected as early as possible. We present an algorithm…

机器学习 · 统计学 2023-07-04 Abishek Sankararaman , Balakrishnan , Narayanaswamy

Variable screening has been a useful research area that deals with ultrahigh-dimensional data. When there exist both marginally and jointly dependent predictors to the response, existing methods such as conditional screening or iterative…

统计方法学 · 统计学 2023-07-10 Lei Fang , Qingcong Yuan , Xiangrong Yin , Chenglong Ye

Maximum mean discrepancy (MMD) has been widely adopted in domain adaptation to measure the discrepancy between the source and target domain distributions. Many existing domain adaptation approaches are based on the joint MMD, which is…

机器学习 · 计算机科学 2020-04-13 Wen Zhang , Dongrui Wu

Various gradient compression schemes have been proposed to mitigate the communication cost in distributed training of large scale machine learning models. Sign-based methods, such as signSGD, have recently been gaining popularity because of…

最优化与控制 · 数学 2021-06-25 Mher Safaryan , Peter Richtárik

Standard inference about a scalar parameter estimated via GMM amounts to applying a t-test to a particular set of observations. If the number of observations is not very large, then moderately heavy tails can lead to poor behavior of the…

计量经济学 · 经济学 2020-07-15 Ulrich K. Mueller

Handwritten signature verification, crucial for legal and financial institutions, faces challenges including inter-writer similarity, intra-writer variations, and limited signature samples. To address these, we introduce the MultiScale…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Fu-Hsien Huang , Hsin-Min Lu

Recent advances such as self-consistency and test-time reinforcement learning (TTRL) improve the reliability of large language models (LLMs) without additional supervision, yet their underlying mechanisms and statistical guarantees remain…

机器学习 · 统计学 2025-10-24 Paula Cordero-Encinar , Andrew B. Duncan

While machine-generated texts (MGTs) offer great convenience, they also pose risks such as disinformation and phishing, highlighting the need for reliable detection. Metric-based methods, which extract statistically distinguishable features…

计算与语言 · 计算机科学 2026-02-10 Chenwang Wu , Yiu-ming Cheung , Shuhai Zhang , Bo Han , Defu Lian

Evaluating and validating the performance of prediction models is a fundamental task in statistics, machine learning, and their diverse applications. However, developing robust performance metrics for competing risks time-to-event data…

统计方法学 · 统计学 2025-07-22 Zian Zhuang , Wen Su , Eric Kawaguchi , Gang Li

The deployment of safe and trustworthy machine learning systems, and particularly complex black box neural networks, in real-world applications requires reliable and certified guarantees on their performance. The conformal prediction…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Paul Melki , Lionel Bombrun , Boubacar Diallo , Jérôme Dias , Jean-Pierre da Costa

Moment restrictions and their conditional counterparts emerge in many areas of machine learning and statistics ranging from causal inference to reinforcement learning. Estimators for these tasks, generally called methods of moments, include…

机器学习 · 计算机科学 2023-06-14 Heiner Kremer , Yassine Nemmour , Bernhard Schölkopf , Jia-Jie Zhu

Minimizing prediction uncertainty on unlabeled data is a key factor to achieve good performance in semi-supervised learning (SSL). The prediction uncertainty is typically expressed as the \emph{entropy} computed by the transformed…

机器学习 · 计算机科学 2021-12-16 Jing Li , Yuangang Pan , Ivor W. Tsang

For large model spaces, the potential entrapment of Markov chain Monte Carlo (MCMC) based methods with spike-and-slab priors poses significant challenges in posterior computation in regression models. On the other hand, maximum a posteriori…

统计方法学 · 统计学 2026-02-25 Shamriddha De , Joyee Ghosh