English
Related papers

Related papers: A Bi-level Nonlinear Eigenvector Algorithm for Was…

200 papers

We develop a unified theoretical framework for data-free one-step sampling from unnormalized target distributions based on Wasserstein gradient flows. For a broad class of standard f-divergence objectives, we show that the induced velocity…

Machine Learning · Computer Science 2026-05-19 Chenguang Wang , Tianshu Yu

Classification is an important tool with many useful applications. Among the many classification methods, Fisher's Linear Discriminant Analysis (LDA) is a traditional model-based approach which makes use of the covariance information.…

Machine Learning · Statistics 2015-09-21 Qiyi Lu , Xingye Qiao

In this work, we introduce a novel framework for privately optimizing objectives that rely on Wasserstein distances between data-dependent empirical measures. Our main theoretical contribution is, based on an explicit formulation of the…

Machine Learning · Computer Science 2025-05-22 David Rodríguez-Vítores , Clément Lalanne , Jean-Michel Loubes

Linear Discriminant Analysis (LDA) is a widely-used supervised dimensionality reduction method in computer vision and pattern recognition. In null space based LDA (NLDA), a well-known LDA extension, between-class distance is maximized in…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Shuai Zheng , Feiping Nie , Chris Ding , Heng Huang

Distance weighted discrimination (DWD) is a linear discrimination method that is particularly well-suited for classification tasks with high-dimensional data. The DWD coefficients minimize an intuitive objective function, which can solved…

Methodology · Statistics 2020-10-08 Eric F. Lock

We present a novel universal gradient method for solving convex optimization problems. Our algorithm, Dual Averaging with Distance Adaptation (DADA), is based on the classical scheme of dual averaging and dynamically adjusts its…

Optimization and Control · Mathematics 2026-04-22 Mohammad Moshtaghifar , Anton Rodomanov , Daniil Vankov , Sebastian Stich

Particle-based variational inference offers a flexible way of approximating complex posterior distributions with a set of particles. In this paper we introduce a new particle-based variational inference method based on the theory of…

Machine Learning · Statistics 2019-05-16 Luca Ambrogioni , Umut Guclu , Marcel van Gerven

Evolutionary algorithms (EAs) serve as powerful black-box optimizers inspired by biological evolution. However, most existing EAs predominantly focus on heuristic operators such as crossover and mutation, while usually overlooking…

Neural and Evolutionary Computing · Computer Science 2026-01-21 Kaichen Ouyang , Mingyang Yu , Zong Ke , Junbo Jacob Lian , Shengwei Fu , Xiaoyang Hao , Shengju Yu , Dayu Hu

Nonlinear eigenvalue problems with eigenvector nonlinearities (NEPv) are algebraic eigenvalue problems whose matrix depends on the eigenvector. Applications range from computational quantum mechanics to machine learning. Due to its…

Numerical Analysis · Mathematics 2025-10-06 Victor Janssens , Karl Meerbergen , Wim Michiels

Fitting a function by using linear combinations of a large number $N$ of `simple' components is one of the most fruitful ideas in statistical learning. This idea lies at the core of a variety of methods, from two-layer neural networks to…

Statistics Theory · Mathematics 2019-08-20 Adel Javanmard , Marco Mondelli , Andrea Montanari

In response to the challenges of data mining, discriminant analysis continues to evolve as a vital branch of statistics. Our recently introduced method of vertex discriminant analysis (VDA) is ideally suited to handle multiple categories…

Applications · Statistics 2011-01-06 Tong Tong Wu , Kenneth Lange

We present a distributionally robust formulation of a stochastic optimization problem for non-i.i.d vector autoregressive data. We use the Wasserstein distance to define robustness in the space of distributions and we show, using duality…

Optimization and Control · Mathematics 2019-09-10 Xialiang Dou , Mihai Anitescu

We address the optimization problem of simultaneously minimizing multiple objective functionals over a family of probability distributions. This type of Multi-Objective Distributional Optimization commonly arises in machine learning and…

Machine Learning · Computer Science 2025-05-27 Dai Hai Nguyen , Hiroshi Mamitsuka , Atsuyoshi Nakamura

Semantic segmentation is important for many real-world systems, e.g., autonomous vehicles, which predict the class of each pixel. Recently, deep networks achieved significant progress w.r.t. the mean Intersection-over Union (mIoU) with the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Xiaofeng Liu , Yimeng Zhang , Xiongchang Liu , Song Bai , Site Li , Jane You

VAE, or variational auto-encoder, compresses data into latent attributes, and generates new data of different varieties. VAE based on KL divergence has been considered as an effective technique for data augmentation. In this paper, we…

Machine Learning · Computer Science 2022-08-17 Zichuan Chen , Peng Liu

We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal…

Machine Learning · Statistics 2018-05-25 Mevlana Gemici , Zeynep Akata , Max Welling

We study multi-objective optimization over probability distributions in Wasserstein space. Recently, Nguyen et al. (2025) introduced Multiple Wasserstein Gradient Descent (MWGraD) algorithm, which exploits the geometric structure of…

Machine Learning · Computer Science 2026-01-28 Dai Hai Nguyen , Duc Dung Nguyen , Atsuyoshi Nakamura , Hiroshi Mamitsuka

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally…

Systems and Control · Electrical Eng. & Systems 2024-03-22 Himanshu Prabhat , Raktim Bhattacharya

Worst-case generation plays a critical role in evaluating robustness and stress-testing systems under distribution shifts, in applications ranging from machine learning models to power grids and medical prediction systems. We develop a…

Machine Learning · Statistics 2025-12-10 Xiuyuan Cheng , Yao Xie , Linglingzhi Zhu , Yunqin Zhu