中文
相关论文

相关论文: Out-of-distribution Generalization for Total Varia…

200 篇论文

Machine learning algorithms with empirical risk minimization usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts.…

机器学习 · 计算机科学 2021-06-18 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

Maximum Probability Framework, powered by Maximum Probability Theorem, is a recent theoretical development in artificial intelligence, aiming to formally define probabilistic models, guiding development of objective functions, and…

机器学习 · 计算机科学 2022-09-08 Amir Emad Marvasti , Ehsan Emad Marvasti , Ulas Bagci

In this paper, we propose Total Variation Regularized Tensor-on-scalar Regression(TVTR), a novel method for estimating the association between a tensor outcome (a one dimensional or multidimensional array) and scalar predictors. While the…

统计方法学 · 统计学 2018-12-11 Ying Liu , Bowei Yan , Kathleen Merikangas , Haochang Shou

We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametric probability…

机器学习 · 统计学 2019-09-27 Nilesh A. Ahuja , Ibrahima Ndiour , Trushant Kalyanpur , Omesh Tickoo

Offline Reinforcement Learning (RL) aims to learn a near-optimal policy from a fixed dataset of transitions collected by another policy. This problem has attracted a lot of attention recently, but most existing methods with strong…

机器学习 · 计算机科学 2023-05-23 Germano Gabbianelli , Gergely Neu , Nneka Okolo , Matteo Papini

This paper is concerned with multi-agent optimization problem. A distributed randomized gradient-free mirror descent (DRGFMD) method is developed by introducing a randomized gradient-free oracle in the mirror descent scheme where the…

最优化与控制 · 数学 2019-03-12 Zhan Yu , Daniel W. C. Ho , Deming Yuan

Out-of-distribution (OOD) detection is crucial for ensuring reliable deployment of machine learning models. Recent advancements focus on utilizing easily accessible auxiliary outliers (e.g., data from the web or other datasets) in training.…

机器学习 · 计算机科学 2024-11-22 Haiyun Yao , Zongbo Han , Huazhu Fu , Xi Peng , Qinghua Hu , Changqing Zhang

The total variation (TV) regularization has phenomenally boosted various variational models for image processing tasks. We propose to combine the backward diffusion process in the earlier literature of image enhancement with the TV…

图像与视频处理 · 电气工程与系统科学 2023-06-14 Congpei An , Hao-Ning Wu , Xiaoming Yuan

Out-of-Distribution (OOD) detection, aiming to distinguish outliers from known categories, has gained prominence in practical scenarios. Recently, the advent of vision-language models (VLM) has heightened interest in enhancing OOD detection…

计算机视觉与模式识别 · 计算机科学 2025-02-27 Fanhu Zeng , Zhen Cheng , Fei Zhu , Hongxin Wei , Xu-Yao Zhang

Modern deep learning techniques have illustrated their excellent capabilities in many areas, but relies on large training data. Optimization-based meta-learning train a model on a variety tasks, such that it can solve new learning tasks…

机器学习 · 计算机科学 2023-02-23 Penghao Jiang , Ke Xin , Zifeng Wang , Chunxi Li

Out-of-distribution (O.O.D.) generalization remains to be a key challenge for real-world machine learning systems. We describe a method for O.O.D. generalization that, through training, encourages models to only preserve features in the…

机器学习 · 计算机科学 2022-08-09 Arjun Ashok , Chaitanya Devaguptapu , Vineeth Balasubramanian

In real-world applications, it is important and desirable to learn a model that performs well on out-of-distribution (OOD) data. Recently, causality has become a powerful tool to tackle the OOD generalization problem, with the idea resting…

机器学习 · 统计学 2022-03-25 Ruoyu Wang , Mingyang Yi , Zhitang Chen , Shengyu Zhu

Total Variation (TV) based regularization has been widely applied in restoration problems due to its simple derivative filters based formulation and robust performance. While first order TV suffers from staircase effect, second order TV…

信号处理 · 电气工程与系统科学 2019-04-08 Sanjay Viswanath , Muthuvel Arigovindan

Despite multiple efforts made towards robust machine learning (ML) models, their vulnerability to adversarial examples remains a challenging problem that calls for rethinking the defense strategy. In this paper, we take a step back and…

机器学习 · 计算机科学 2022-02-21 Abderrahmen Amich , Birhanu Eshete

We study how to learn $\epsilon$-optimal strategies in zero-sum imperfect information games (IIG) with trajectory feedback. In this setting, players update their policies sequentially based on their observations over a fixed number of…

计算机科学与博弈论 · 计算机科学 2023-09-06 Côme Fiegel , Pierre Ménard , Tadashi Kozuno , Rémi Munos , Vianney Perchet , Michal Valko

Out-of-distribution (OoD) generalization occurs when representation learning encounters a distribution shift. This occurs frequently in practice when training and testing data come from different environments. Covariate shift is a type of…

机器学习 · 计算机科学 2026-04-22 Simon Zhang , Ryan P. DeMilt , Kun Jin , Cathy H. Xia

We consider a class of integer-constrained optimization problems governed by partial differential equation (PDE) constraints and regularized via total variation (TV) in the context of topology optimization. The presence of discrete design…

最优化与控制 · 数学 2025-09-25 Harsh Choudhary , Sven Leyffer , Dominic Yang

We introduce a twice differentiable augmented Lagrangian for nonlinear optimization with general inequality constraints and show that a strict local minimizer of the original problem is an approximate strict local solution of the augmented…

最优化与控制 · 数学 2021-06-30 Xin-Wei Liu , Yu-Hong Dai , Ya-Kui Huang , Jie Sun

We define the space of functions of bounded variation ($BV$) on the graph. Using the notion of divergence of flows on graphs, we show that the unit ball of the dual space to $BV$ in the graph setting can be described as the image of the…

最优化与控制 · 数学 2019-11-27 Japhet Niyobuhungiro , Eric Setterqvist , Freddie Åström , George Baravdish

The total variation (TV) regularization method is an effective method for image deblurring in preserving edges. However, the TV based solutions usually have some staircase effects. In this paper, in order to alleviate the staircase effect,…

数值分析 · 数学 2015-05-20 Gang Liu , Ting-Zhu Huang , Jun Liu , Xiao-Guang Lv