中文
相关论文

相关论文: A Bi-level Nonlinear Eigenvector Algorithm for Was…

200 篇论文

We develop a unified theoretical framework for data-free one-step sampling from unnormalized target distributions based on Wasserstein gradient flows. For a broad class of standard f-divergence objectives, we show that the induced velocity…

机器学习 · 计算机科学 2026-05-19 Chenguang Wang , Tianshu Yu

Classification is an important tool with many useful applications. Among the many classification methods, Fisher's Linear Discriminant Analysis (LDA) is a traditional model-based approach which makes use of the covariance information.…

机器学习 · 统计学 2015-09-21 Qiyi Lu , Xingye Qiao

In this work, we introduce a novel framework for privately optimizing objectives that rely on Wasserstein distances between data-dependent empirical measures. Our main theoretical contribution is, based on an explicit formulation of the…

机器学习 · 计算机科学 2025-05-22 David Rodríguez-Vítores , Clément Lalanne , Jean-Michel Loubes

Linear Discriminant Analysis (LDA) is a widely-used supervised dimensionality reduction method in computer vision and pattern recognition. In null space based LDA (NLDA), a well-known LDA extension, between-class distance is maximized in…

计算机视觉与模式识别 · 计算机科学 2016-10-25 Shuai Zheng , Feiping Nie , Chris Ding , Heng Huang

Distance weighted discrimination (DWD) is a linear discrimination method that is particularly well-suited for classification tasks with high-dimensional data. The DWD coefficients minimize an intuitive objective function, which can solved…

统计方法学 · 统计学 2020-10-08 Eric F. Lock

We present a novel universal gradient method for solving convex optimization problems. Our algorithm, Dual Averaging with Distance Adaptation (DADA), is based on the classical scheme of dual averaging and dynamically adjusts its…

最优化与控制 · 数学 2026-04-22 Mohammad Moshtaghifar , Anton Rodomanov , Daniil Vankov , Sebastian Stich

Particle-based variational inference offers a flexible way of approximating complex posterior distributions with a set of particles. In this paper we introduce a new particle-based variational inference method based on the theory of…

机器学习 · 统计学 2019-05-16 Luca Ambrogioni , Umut Guclu , Marcel van Gerven

Evolutionary algorithms (EAs) serve as powerful black-box optimizers inspired by biological evolution. However, most existing EAs predominantly focus on heuristic operators such as crossover and mutation, while usually overlooking…

神经与进化计算 · 计算机科学 2026-01-21 Kaichen Ouyang , Mingyang Yu , Zong Ke , Junbo Jacob Lian , Shengwei Fu , Xiaoyang Hao , Shengju Yu , Dayu Hu

Nonlinear eigenvalue problems with eigenvector nonlinearities (NEPv) are algebraic eigenvalue problems whose matrix depends on the eigenvector. Applications range from computational quantum mechanics to machine learning. Due to its…

数值分析 · 数学 2025-10-06 Victor Janssens , Karl Meerbergen , Wim Michiels

Fitting a function by using linear combinations of a large number $N$ of `simple' components is one of the most fruitful ideas in statistical learning. This idea lies at the core of a variety of methods, from two-layer neural networks to…

统计理论 · 数学 2019-08-20 Adel Javanmard , Marco Mondelli , Andrea Montanari

In response to the challenges of data mining, discriminant analysis continues to evolve as a vital branch of statistics. Our recently introduced method of vertex discriminant analysis (VDA) is ideally suited to handle multiple categories…

应用统计 · 统计学 2011-01-06 Tong Tong Wu , Kenneth Lange

We present a distributionally robust formulation of a stochastic optimization problem for non-i.i.d vector autoregressive data. We use the Wasserstein distance to define robustness in the space of distributions and we show, using duality…

最优化与控制 · 数学 2019-09-10 Xialiang Dou , Mihai Anitescu

We address the optimization problem of simultaneously minimizing multiple objective functionals over a family of probability distributions. This type of Multi-Objective Distributional Optimization commonly arises in machine learning and…

机器学习 · 计算机科学 2025-05-27 Dai Hai Nguyen , Hiroshi Mamitsuka , Atsuyoshi Nakamura

Semantic segmentation is important for many real-world systems, e.g., autonomous vehicles, which predict the class of each pixel. Recently, deep networks achieved significant progress w.r.t. the mean Intersection-over Union (mIoU) with the…

计算机视觉与模式识别 · 计算机科学 2020-08-12 Xiaofeng Liu , Yimeng Zhang , Xiongchang Liu , Song Bai , Site Li , Jane You

VAE, or variational auto-encoder, compresses data into latent attributes, and generates new data of different varieties. VAE based on KL divergence has been considered as an effective technique for data augmentation. In this paper, we…

机器学习 · 计算机科学 2022-08-17 Zichuan Chen , Peng Liu

We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal…

机器学习 · 统计学 2018-05-25 Mevlana Gemici , Zeynep Akata , Max Welling

We study multi-objective optimization over probability distributions in Wasserstein space. Recently, Nguyen et al. (2025) introduced Multiple Wasserstein Gradient Descent (MWGraD) algorithm, which exploits the geometric structure of…

机器学习 · 计算机科学 2026-01-28 Dai Hai Nguyen , Duc Dung Nguyen , Atsuyoshi Nakamura , Hiroshi Mamitsuka

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

机器学习 · 计算机科学 2016-06-13 Furong Huang

This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally…

系统与控制 · 电气工程与系统科学 2024-03-22 Himanshu Prabhat , Raktim Bhattacharya

Worst-case generation plays a critical role in evaluating robustness and stress-testing systems under distribution shifts, in applications ranging from machine learning models to power grids and medical prediction systems. We develop a…

机器学习 · 统计学 2025-12-10 Xiuyuan Cheng , Yao Xie , Linglingzhi Zhu , Yunqin Zhu