中文
相关论文

相关论文: Regression via Implicit Models and Optimal Transpo…

200 篇论文

We present a novel method and analysis to train generative adversarial networks (GAN) in a stable manner. As shown in recent analysis, training is often undermined by the probability distribution of the data being zero on neighborhoods of…

计算机视觉与模式识别 · 计算机科学 2019-09-18 Simon Jenni , Paolo Favaro

Motivated by the computational difficulties incurred by popular deep learning algorithms for the generative modeling of temporal densities, we propose a cheap alternative which requires minimal hyperparameter tuning and scales favorably to…

机器学习 · 统计学 2023-10-13 Jonah Botvinick-Greenhouse , Yunan Yang , Romit Maulik

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently,…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Jiachen Lei , Julius Berner , Jiongxiao Wang , Zhongzhu Chen , Zhongjia Ba , Kui Ren , Jun Zhu , Anima Anandkumar

We investigate the optimal transport problem between probability measures when the underlying cost function is understood to satisfy a least action principle, also known as a Lagrangian cost. These generalizations are useful when connecting…

机器学习 · 计算机科学 2024-06-04 Aram-Alexandre Pooladian , Carles Domingo-Enrich , Ricky T. Q. Chen , Brandon Amos

Gradient descent can be surprisingly good at optimizing deep neural networks without overfitting and without explicit regularization. We find that the discrete steps of gradient descent implicitly regularize models by penalizing gradient…

机器学习 · 计算机科学 2022-07-20 David G. T. Barrett , Benoit Dherin

We have developed a new data-driven paradigm for the rapid inference, modeling and simulation of the physics of transport phenomena by deep learning. Using conditional generative adversarial networks (cGAN), we train models for the direct…

机器学习 · 计算机科学 2017-09-11 Amir Barati Farimani , Joseph Gomes , Vijay S. Pande

We propose an efficient optimization algorithm for selecting a subset of training data to induce sparsity for Gaussian process regression. The algorithm estimates an inducing set and the hyperparameters using a single objective, either the…

机器学习 · 计算机科学 2013-11-12 Yanshuai Cao , Marcus A. Brubaker , David J. Fleet , Aaron Hertzmann

This paper considers the problem of multi-agent distributed linear regression in the presence of system noises. In this problem, the system comprises multiple agents wherein each agent locally observes a set of data points, and the agents'…

最优化与控制 · 数学 2024-10-29 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

This paper deals with sparse feature selection and grouping for classification and regression. The classification or regression problems under consideration consists in minimizing a convex empirical risk function subject to an $\ell^1$…

统计理论 · 数学 2017-03-27 Michel Barlaud , Wafa Belhajali , Patrick L. Combettes , Lionel Fillatre

This work proposes a machine-learning framework for constructing statistical models of errors incurred by approximate solutions to parameterized systems of nonlinear equations. These approximate solutions may arise from early termination of…

数值分析 · 计算机科学 2019-02-18 Brian A. Freno , Kevin T. Carlberg

We use Generative Adversarial Networks (GANs) to design a class conditional label noise (CCN) robust scheme for binary classification. It first generates a set of correctly labelled data points from noisy labelled data and 0.1% or 1% clean…

机器学习 · 计算机科学 2020-10-20 Sandhya Tripathi , N Hemachandra

We present a new transport-based approach to efficiently perform sequential Bayesian inference of static model parameters. The strategy is based on the extraction of conditional distribution from the joint distribution of parameters and…

统计方法学 · 统计学 2023-08-29 Paul-Baptiste Rubio , Youssef Marzouk , Matthew Parno

We demonstrate the first algorithms for the problem of regression for generalized linear models (GLMs) in the presence of additive oblivious noise. We assume we have sample access to examples $(x, y)$ where $y$ is a noisy measurement of…

数据结构与算法 · 计算机科学 2023-09-29 Ilias Diakonikolas , Sushrut Karmalkar , Jongho Park , Christos Tzamos

This article investigates the use of a model-based neural-network for the traffic reconstruction problem using noisy measurements coming from probe vehicles. The traffic state is assumed to be the density only, modeled by a partial…

最优化与控制 · 数学 2020-11-18 John Liu , Matthieu Barreau , Mladen Cicic , Karl H. Johansson

We propose and study a method for learning interpretable representations for the task of regression. Features are represented as networks of multi-type expression trees comprised of activation functions common in neural networks in addition…

神经与进化计算 · 计算机科学 2019-03-26 William La Cava , Tilak Raj Singh , James Taggart , Srinivas Suri , Jason H. Moore

The existing machine learning algorithms for minimizing the convex function over a closed convex set suffer from slow convergence because their learning rates must be determined before running them. This paper proposes two machine learning…

最优化与控制 · 数学 2019-09-02 Kazuhiro Hishinuma , Hideaki Iiduka

We introduce a novel gene regulatory network (GRN) inference method that integrates optimal transport (OT) with a deep-learning structural inference model. Advances in next-generation sequencing enable detailed yet destructive gene…

计算工程、金融与科学 · 计算机科学 2024-09-24 Tsz Pan Tong , Aoran Wang , George Panagopoulos , Jun Pang

In this paper, we provide a mathematical framework for improving generalization in a class of learning problems which is related to point estimations for modeling of high-dimensional nonlinear functions. In particular, we consider a…

最优化与控制 · 数学 2024-12-13 Getachew K. Befekadu

This paper presents uniform-in-time finite-sample bounds for regularized linear regression with vector-valued outputs and conditionally zero-mean subgaussian noise. By revisiting classical self-normalized martingale arguments, we obtain…

统计理论 · 数学 2026-03-20 Léo Simpson , Katrin Baumgärtner , Johannes Köhler , Moritz Diehl

Causal Optimal Transport (COT) results from imposing a temporal causality constraint on classic optimal transport problems, which naturally generates a new concept of distances between distributions on path spaces. The first application of…

机器学习 · 统计学 2022-01-31 Tianlin Xu , Beatrice Acciaio