English
Related papers

Related papers: Optimal Set-Membership Smoothing

200 papers

We present a framework for smooth optimization of explicitly regularized objectives for (structured) sparsity. These non-smooth and possibly non-convex problems typically rely on solvers tailored to specific models and regularizers. In…

Machine Learning · Computer Science 2026-04-09 Chris Kolb , Christian L. Müller , Bernd Bischl , David Rügamer

We present a meta-method for initializing (seeding) the $k$-means clustering algorithm called PNN-smoothing. It consists in splitting a given dataset into $J$ random subsets, clustering each of them individually, and merging the resulting…

Machine Learning · Computer Science 2022-12-12 Carlo Baldassi

This paper analyzes the performance of a single-input multiple-output (SIMO) wireless communication system employing one- and two-sided amplitude shift keying (ASK) modulation schemes for data transmission and operating under correlated…

Signal Processing · Electrical Eng. & Systems 2025-03-27 Badri Ramanjaneya Reddy , Soumya P. Dash , George C. Alexandropoulos

We consider the approximation of expectations with respect to the distribution of a latent Markov process given noisy measurements. This is known as the smoothing problem and is often approached with particle and Markov chain Monte Carlo…

Computation · Statistics 2019-02-06 Lawrence Middleton , George Deligiannidis , Arnaud Doucet , Pierre E. Jacob

Lately, a novel swarm intelligence model, namely the consensus-based optimization (CBO) algorithm, was introduced to deal with the global optimization problems. Limited by the conditions of Ito's formula, the convergence analysis of the…

Optimization and Control · Mathematics 2025-01-14 Jiazhen Wei , Wei Bian

In this paper, we develop a novel {\bf ho}moto{\bf p}y {\bf s}moothing (HOPS) algorithm for solving a family of non-smooth problems that is composed of a non-smooth term with an explicit max-structure and a smooth term or a simple…

Optimization and Control · Mathematics 2016-11-04 Yi Xu , Yan Yan , Qihang Lin , Tianbao Yang

This paper examines a variety of classical optimization problems, including well-known minimization tasks and more general variational inequalities. We consider a stochastic formulation of these problems, and unlike most previous work, we…

Optimization and Control · Mathematics 2025-11-11 Vladimir Solodkin , Andrew Veprikov , Aleksandr Beznosikov

We address the task of estimating multiple trajectories from unlabeled data. This problem arises in many settings, one could think of the construction of maps of transport networks from passive observation of travellers, or the…

Statistics Theory · Mathematics 2016-11-07 Matthew Thorpe , Adam M. Johansen

Distributed optimization has a rich history. It has demonstrated its effectiveness in many machine learning applications, etc. In this paper we study a subclass of distributed optimization, namely decentralized optimization in a non-smooth…

Optimization and Control · Mathematics 2023-12-05 Aleksandr Lobanov , Andrew Veprikov , Georgiy Konin , Aleksandr Beznosikov , Alexander Gasnikov , Dmitry Kovalev

We consider approximate maximum likelihood parameter estimation in nonlinear state-space models. We discuss both direct optimization of the likelihood and expectation--maximization (EM). For EM, we also give closed-form expressions for the…

Methodology · Statistics 2015-11-03 Juho Kokkala , Arno Solin , Simo Särkkä

We study the problem of sampling from a target distribution in $\mathbb{R}^d$ whose potential is not smooth. Compared with the sampling problem with smooth potentials, this problem is much less well-understood due to the lack of smoothness.…

Computation · Statistics 2023-07-25 Jiaojiao Fan , Bo Yuan , Jiaming Liang , Yongxin Chen

Unsupervised Semantic Segmentation (USS) involves segmenting images without relying on predefined labels, aiming to alleviate the burden of extensive human labeling. Existing methods utilize features generated by self-supervised models and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Baran Ozaydin , Tong Zhang , Deblina Bhattacharjee , Sabine Süsstrunk , Mathieu Salzmann

In this work we consider the stochastic minimization of nonsmooth convex loss functions, a central problem in machine learning. We propose a novel algorithm called Accelerated Nonsmooth Stochastic Gradient Descent (ANSGD), which exploits…

Machine Learning · Computer Science 2012-10-02 Hua Ouyang , Alexander Gray

In this paper, we propose an interesting semi-sparsity smoothing algorithm based on a novel sparsity-inducing optimization framework. This method is derived from the multiple observations that semi-sparsity prior knowledge is more…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Junqing Huang , Haihui Wang , Xuechao Wang , Michael Ruzhansky

Smoothing is essential to many oceanographic, meteorological and hydrological applications. The interval smoothing problem updates all desired states within a time interval using all available observations. The fixed-lag smoothing problem…

Chaotic Dynamics · Physics 2015-06-26 S. Ravela , D. McLaughlin

The purpose of this paper is to review and highlight some connections between the problem of nonlinear smoothing and optimal control of the Liouville equation. The latter has been an active area of recent research interest owing to work in…

Optimization and Control · Mathematics 2023-03-23 Jin W. Kim , Prashant G. Mehta

This paper presents a method for calculating the smoothed state distribution for Jump Markov Linear Systems. More specifically, the paper details a novel two-filter smoother that provides closed-form expressions for the smoothed hybrid…

Methodology · Statistics 2020-04-21 Mark P. Balenzuela , Adrian G. Wills , Christopher Renton , Brett Ninness

Simulated Moving Bed (SMB) chromatography is a well-known technique for the resolution of several high-value-added compounds. Parameters identification and model topology definition are arduous when one is dealing with complex systems such…

Unsupervised semantic segmentation is a challenging task that segments images into semantic groups without manual annotation. Prior works have primarily focused on leveraging prior knowledge of semantic consistency or priori concepts from…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Mengcheng Lan , Xinjiang Wang , Yiping Ke , Jiaxing Xu , Litong Feng , Wayne Zhang

Nonlinear model predictive control (NMPC) is a popular strategy for solving motion planning problems, including obstacle avoidance constraints, in autonomous driving applications. Non-smooth obstacle shapes, such as rectangles, introduce…

Systems and Control · Electrical Eng. & Systems 2024-03-05 Rudolf Reiter , Katrin Baumgärtner , Rien Quirynen , Moritz Diehl