English
Related papers

Related papers: Distributional Spectral Diagnostics for Localizing…

200 papers

Recently, an interesting phenomenon called grokking has gained much attention, where generalization occurs long after the models have initially overfitted the training data. We try to understand this seemingly strange phenomenon through the…

Machine Learning · Computer Science 2024-02-05 Zhiquan Tan , Weiran Huang

Real-world clinical data is inherently multimodal, providing complementary evidence that mirrors the practical necessity of jointly assessing multiple related outcomes. Although multi-task learning can improve efficiency by sharing…

Machine Learning · Computer Science 2026-05-06 He Lyu , Huolin Zeng , Junren Wang , Huazhen Yang , Linchao He , Yong Chen , Zhirui Li , Andreas Maier , Siming Bayer , Huan Song

This paper considers deployment problems where a mobile robotic network must optimize its configuration in a distributed way in order to minimize a steady-state cost function that depends on the spatial distribution of certain probabilistic…

Optimization and Control · Mathematics 2012-08-20 Jerome Le Ny , George J. Pappas

Learning from weak, proxy, or relative supervision is common when ground-truth labels are unavailable, but robustness under distribution shift remains poorly understood because the supervision mechanism itself may change across…

Machine Learning · Computer Science 2026-05-20 Mehrdad Shoeibi , Elias Hossain , Ivan Garibay , Niloofar Yousefi

We consider random walks evolving on two models of connected and undirected graphs and study the exact large deviations of a local dynamical observable. We prove, in the thermodynamic limit, that this observable undergoes a first-order…

Statistical Mechanics · Physics 2024-09-09 Giorgio Carugno , Pierpaolo Vivo , Francesco Coghi

In some settings neural networks exhibit a phenomenon known as \textit{grokking}, where they achieve perfect or near-perfect accuracy on the validation set long after the same performance has been achieved on the training set. In this…

Machine Learning · Computer Science 2024-04-02 Jack Miller , Charles O'Neill , Thang Bui

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

Anomaly detection plays a crucial role in quality control for industrial applications. However, ensuring robustness under unseen domain shifts such as lighting variations or sensor drift remains a significant challenge. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jingyi Liao , Xun Xu , Yongyi Su , Rong-Cheng Tu , Yifan Liu , Dacheng Tao , Xulei Yang

We consider the setting where a master wants to run a distributed stochastic gradient descent (SGD) algorithm on $n$ workers, each having a subset of the data. Distributed SGD may suffer from the effect of stragglers, i.e., slow or…

Machine Learning · Computer Science 2022-08-08 Serge Kas Hanna , Rawad Bitar , Parimal Parag , Venkat Dasari , Salim El Rouayheb

Closed-loop control of nonlinear dynamical systems with partial-state observability demands expert knowledge of a diverse, less standardized set of theoretical tools. Moreover, it requires a delicate integration of controller and estimator…

Systems and Control · Electrical Eng. & Systems 2024-04-04 Xiangyuan Zhang , Weichao Mao , Haoran Qiu , Tamer Başar

A novel approach is suggested for improving the accuracy of fault detection in distribution networks. This technique combines adaptive probability learning and waveform decomposition to optimize the similarity of features. Its objective is…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Xinliang Ma , Weihua Liu , Bingying Jin

We establish the large deviations asymptotic performance (error exponent) of consensus+innovations distributed detection over random networks with generic (non-Gaussian) sensor observations. At each time instant, sensors 1) combine theirs…

Information Theory · Computer Science 2015-06-03 Dragana Bajovic , Dusan Jakovetic , Jose M. F. Moura , Joao Xavier , Bruno Sinopoli

Modern deep generative models can assign high likelihood to inputs drawn from outside the training distribution, posing threats to models in open-world deployments. While much research attention has been placed on defining new test-time…

Machine Learning · Computer Science 2022-08-22 Mu Cai , Yixuan Li

In contemporary data analysis, it is increasingly common to work with non-stationary complex data sets. These data sets typically extend beyond the classical low-dimensional Euclidean space, making it challenging to detect shifts in their…

Methodology · Statistics 2025-07-29 Rohit Kanrar , Feiyu Jiang , Zhanrui Cai

Fast scrambling of quantum correlations, reflected by the exponential growth of Out-of-Time-Order Correlators (OTOCs) on short pre-Ehrenfest time scales, is commonly considered as a major quantum signature of unstable dynamics in quantum…

Quantum Physics · Physics 2023-08-22 Mathias Steinhuber , Peter Schlagheck , Juan-Diego Urbina , Klaus Richter

We consider the problem of robustly detecting changepoints in the variability of a sequence of independent multivariate functions. We develop a novel changepoint procedure, called the functional Kruskal--Wallis for covariance (FKWC)…

Methodology · Statistics 2024-08-08 Kelly Ramsay , Shoja'eddin Chenouri

Out-of-distribution generalization (OODG) is a longstanding challenge for neural networks. This challenge is quite apparent in tasks with well-defined variables and rules, where explicit use of the rules could solve problems independently…

Machine Learning · Computer Science 2022-12-14 Andrew J. Nam , Mustafa Abdool , Trevor Maxfield , James L. McClelland

Ultra-wideband (UWB) time difference of arrival(TDOA)-based localization has emerged as a low-cost and scalable indoor positioning solution. However, in cluttered environments, the performance of UWB TDOA-based localization deteriorates due…

Robotics · Computer Science 2023-08-01 Wenda Zhao , Abhishek Goudar , Mingliang Tang , Xinyuan Qiao , Angela P. Schoellig

Object detectors often perform well in-distribution, yet degrade sharply on a different benchmark. We study cross-dataset object detection (CD-OD) through a lens of setting specificity. We group benchmarks into setting-agnostic datasets…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Ritabrata Chakraborty , Hrishit Mitra , Shivakumara Palaiahnakote , Umapada Pal

Recent work has shown that Transformers' compositional generalization is governed by \emph{complexity control}, initialization scale and weight decay, which steers training toward low-complexity reasoning solutions rather than…

Machine Learning · Computer Science 2026-05-07 Sarwan Ali