English
Related papers

Related papers: Non-Negative Bregman Divergence Minimization for D…

200 papers

Density-power-based divergences are known to provide robust inference procedures against outliers, and their extensions have been widely studied. A characteristic of successful divergences is that the estimation problem can be reduced to…

Information Theory · Computer Science 2025-02-03 Masahiro Kobayashi

Recent domain generalization (DG) approaches typically use the hypothesis learned on source domains for inference on the unseen target domain. However, such a hypothesis can be arbitrarily far from the optimal one for the target domain,…

Machine Learning · Computer Science 2023-05-25 Yi-Fan Zhang , Jindong Wang , Jian Liang , Zhang Zhang , Baosheng Yu , Liang Wang , Dacheng Tao , Xing Xie

Adversarial robustness poses a critical challenge in the deployment of deep learning models for real-world applications. Traditional approaches to adversarial training and supervised detection rely on prior knowledge of attack types and…

Machine Learning · Computer Science 2023-08-08 Chien Cheng Chyou , Hung-Ting Su , Winston H. Hsu

The limited and dynamically varied resources on edge devices motivate us to deploy an optimized deep neural network that can adapt its sub-networks to fit in different resource constraints. However, existing works often build sub-networks…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Zhongnan Qu , Syed Shakib Sarwar , Xin Dong , Yuecheng Li , Ekin Sumbul , Barbara De Salvo

Anomaly detection is an important problem in many application areas, such as network security. Many deep learning methods for unsupervised anomaly detection produce good empirical performance but lack theoretical guarantees. By casting…

Machine Learning · Statistics 2024-09-16 Tian-Yi Zhou , Matthew Lau , Jizhou Chen , Wenke Lee , Xiaoming Huo

Achieving fast and stable off-policy learning in deep reinforcement learning (RL) is challenging. Most existing methods rely on semi-gradient temporal-difference (TD) methods for their simplicity and efficiency, but are consequently…

Machine Learning · Computer Science 2025-09-22 Esraa Elelimy , Brett Daley , Andrew Patterson , Marlos C. Machado , Adam White , Martha White

This paper presents a fast, principled approach for detecting anomalous and out-of-distribution (OOD) samples in deep neural networks (DNN). We propose the application of linear statistical dimensionality reduction techniques on the…

Machine Learning · Computer Science 2022-03-22 Ibrahima J. Ndiour , Nilesh A. Ahuja , Omesh Tickoo

Deep neural networks (DNNs) for supervised learning can be viewed as a pipeline of the feature extractor (i.e., last hidden layer) and a linear classifier (i.e., output layer) that are trained jointly with stochastic gradient descent (SGD)…

Machine Learning · Computer Science 2022-11-28 Xin Li , Xiangrui Li , Deng Pan , Yao Qiang , Dongxiao Zhu

Limiting failures of machine learning systems is of paramount importance for safety-critical applications. In order to improve the robustness of machine learning systems, Distributionally Robust Optimization (DRO) has been proposed as a…

Most approaches to dense anomaly detection rely on generative modeling or on discriminative methods that train with negative data. We consider a recent hybrid method that optimizes the same shared representation according to cross-entropy…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Anja Delić , Matej Grcić , Siniša Šegvić

In this paper, we introduce new learning algorithms for reducing false positives in intrusion detection. It is based on decision tree-based attribute weighting with adaptive na\"ive Bayesian tree, which not only reduce the false positives…

Cryptography and Security · Computer Science 2010-05-07 Dewan Md. Farid , Mohammad Zahidur Rahman

We study the problem of estimating Dynamic Discrete Choice (DDC) models, also known as offline Maximum Entropy-Regularized Inverse Reinforcement Learning (offline MaxEnt-IRL) in machine learning. The objective is to recover reward or $Q^*$…

Machine Learning · Computer Science 2026-05-06 Enoch H. Kang , Hema Yoganarasimhan , Lalit Jain

Despite the promising results of machine learning models in malicious files detection, they face the problem of concept drift due to their constant evolution. This leads to declining performance over time, as the data distribution of the…

Cryptography and Security · Computer Science 2024-08-02 William Maillet , Benjamin Marais

Density-based Out-of-distribution (OOD) detection has recently been shown unreliable for the task of detecting OOD images. Various density ratio based approaches achieve good empirical performance, however methods typically lack a…

Machine Learning · Statistics 2022-06-09 Mingtian Zhang , Andi Zhang , Tim Z. Xiao , Yitong Sun , Steven McDonagh

Non-destructive evaluation (NDE) of rail tracks is crucial to ensure the safety and reliability of rail transportation systems. In this work, we present a quantitative study using various signal processing methods to identify defects in…

Classical Physics · Physics 2025-09-09 Elissa Akiki , Lynda Chehami , Nikolay Smagin , Emmanuel Moulin , Jamal Assaad , Youssef Zaatar

A number of popular transfer learning methods rely on grid search to select regularization hyperparameters that control over-fitting. This grid search requirement has several key disadvantages: the search is computationally expensive,…

Machine Learning · Computer Science 2025-01-28 Ethan Harvey , Mikhail Petrov , Michael C. Hughes

When incorporating deep neural networks into robotic systems, a major challenge is the lack of uncertainty measures associated with their output predictions. Methods for uncertainty estimation in the output of deep object detectors (DNNs)…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Ali Harakeh , Michael Smart , Steven L. Waslander

Anomaly subsequence detection is to detect inconsistent data, which always contains important information, among time series. Due to the high dimensionality of the time series, traditional anomaly detection often requires a large time…

Machine Learning · Computer Science 2019-07-02 Chunkai Zhang , Yingyang Chen , Ao Yin

Estimating longitudinal treatment effects is essential for sequential decision-making but is challenging due to treatment-confounder feedback. While Iterative Conditional Expectation (ICE) G-computation offers a principled approach, its…

Machine Learning · Computer Science 2026-02-16 Wenxin Chen , Weishen Pan , Kyra Gan , Fei Wang

We study a sparse negative binomial regression (NBR) for count data by showing the non-asymptotic advantages of using the elastic-net estimator. Two types of oracle inequalities are derived for the NBR's elastic-net estimates by using the…

Machine Learning · Statistics 2022-01-11 Huiming Zhang , Jinzhu Jia