English
Related papers

Related papers: Dimension-Free Multimodal Sampling via Preconditio…

200 papers

Stochastic Gradient Langevin Dynamics (SGLD) ensures strong guarantees with regards to convergence in measure for sampling log-concave posterior distributions by adding noise to stochastic gradient iterates. Given the size of many practical…

Machine Learning · Computer Science 2020-06-15 Vyacheslav Kungurtsev , Bapi Chatterjee , Dan Alistarh

In this paper, we design constant modulus probing waveforms with good correlation properties for collocated multi-input multi-output (MIMO) radar systems. The main content is as follows: first, we formulate the design problem as a fourth…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Jiangtao Wang , Yongchao Wang

Mainstream unsupervised anomaly detection algorithms often excel in academic datasets, yet their real-world performance is restricted due to the controlled experimental conditions involving clean training data. Addressing the challenge of…

Machine Learning · Computer Science 2025-05-13 Thi Kieu Khanh Ho , Narges Armanfard

Anomaly detection (AD) plays a vital role across a wide range of real-world domains by identifying data instances that deviate from expected patterns, potentially signaling critical events such as system failures, fraudulent activities, or…

Machine Learning · Computer Science 2025-07-11 Amirhossein Sadough , Mahyar Shahsavari , Mark Wijtvliet , Marcel van Gerven

Anomaly detection (AD) is a crucial machine learning task that aims to learn patterns from a set of normal training samples to identify abnormal samples in test data. Most existing AD studies assume that the training and test data are drawn…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Tri Cao , Jiawen Zhu , Guansong Pang

Large Language Models (LLMs) exhibit strong but shallow alignment: they directly refuse harmful queries when a refusal is expected at the very start of an assistant turn, yet this protection collapses once a harmful continuation is underway…

Machine Learning · Computer Science 2025-10-22 Jiawei Zhang , Andrew Estornell , David D. Baek , Bo Li , Xiaojun Xu

It has been shown that the nonreversible overdamped Langevin dynamics enjoy better convergence properties in terms of spectral gap and asymptotic variance than the reversible one. In this article we propose a variance reduction method for…

Probability · Mathematics 2017-01-23 Romain Poncet

Dynamic mode decomposition (DMD) is a data-driven method of extracting spatial-temporal coherent modes from complex systems and providing an equation-free architecture to model and predict systems. However, in practical applications, the…

Systems and Control · Electrical Eng. & Systems 2024-10-07 Ningxin Liu , Shuigen Liu , Xin T. Tong , Lijian Jiang

With the widespread availability of sensor data across industrial and operational systems, we frequently encounter heterogeneous time series from multiple systems. Anomaly detection is crucial for such systems to facilitate predictive…

Machine Learning · Computer Science 2025-04-22 Sarah Alnegheimish , Zelin He , Matthew Reimherr , Akash Chandrayan , Abhinav Pradhan , Luca D'Angelo

The problem of sampling a target probability distribution on a constrained domain arises in many applications including machine learning. For constrained sampling, various Langevin algorithms such as projected Langevin Monte Carlo (PLMC),…

Machine Learning · Statistics 2026-04-07 Yingli Wang , Changwei Tu , Xiaoyu Wang , Lingjiong Zhu

This paper discusses the adaptive sampling problem in a nonholonomic mobile robotic sensor network for efficiently monitoring a spatial field. It is proposed to employ Gaussian process to model a spatial phenomenon and predict it at…

Robotics · Computer Science 2021-03-23 Viet-Anh Le , Linh Nguyen , Truong X. Nghiem

Stochastic gradient decent~(SGD) and its variants, including some accelerated variants, have become popular for training in machine learning. However, in all existing SGD and its variants, the sample size in each iteration~(epoch) of…

Machine Learning · Statistics 2019-09-18 Shen-Yi Zhao , Hao Gao , Wu-Jun Li

Continuous efforts are being made to advance anomaly detection in various manufacturing processes to increase the productivity and safety of industrial sites. Deep learning replaced rule-based methods and recently emerged as a promising…

Machine Learning · Computer Science 2024-06-28 Kukjin Choi , Jihun Yi , Jisoo Mok , Sungroh Yoon

Sampling from the full posterior distribution of high-dimensional non-linear, non-Gaussian latent dynamical models presents significant computational challenges. While Particle Gibbs (also known as conditional sequential Monte Carlo) is…

Computation · Statistics 2025-03-05 Adrien Corenflos , Simo Särkkä

We have deluge of data in time series format for numerous phenomena. The number of snapshots, resolution and many other factors come into play as we look to identify the dynamics in a given problem. The pre-processing and post-processing…

Signal Processing · Electrical Eng. & Systems 2020-01-13 Mohammad N. Murshed , M. Monir Uddin

We propose Annealed Langevin Monte Carlo for Flow ODE Sampling (ALMC-ODE), a method for generating samples from unnormalized target distributions, with a particular emphasis on multimodal densities that are challenging for standard Markov…

Computation · Statistics 2026-05-01 Hanwen Huang

Approximate Thompson sampling with Langevin Monte Carlo broadens its reach from Gaussian posterior sampling to encompass more general smooth posteriors. However, it still encounters scalability issues in high-dimensional problems when…

Machine Learning · Statistics 2024-06-24 Haoyang Zheng , Wei Deng , Christian Moya , Guang Lin

Domain shift poses a fundamental challenge in time series analysis, where models trained on source domain often fail dramatically when applied in target domain with different yet similar distributions. While current unsupervised domain…

Machine Learning · Computer Science 2025-08-07 Rongyao Cai , Ming Jin , Qingsong Wen , Kexin Zhang

We propose and analyze a class of adaptive sampling algorithms for multimodal distributions on a bounded domain, which share a structural resemblance to the classic overdamped Langevin dynamics. We first demonstrate that this class of…

Machine Learning · Computer Science 2024-11-26 Björn Engquist , Kui Ren , Yunan Yang

The parallel alternating direction method of multipliers (ADMM) algorithm is widely recognized for its effectiveness in handling large-scale datasets stored in a distributed manner, making it a popular choice for solving statistical…

Machine Learning · Statistics 2023-11-22 Xiaofei Wu , Zhimin Zhang , Zhenyu Cui