English
Related papers

Related papers: DisARM: An Antithetic Gradient Estimator for Binar…

200 papers

Imperfect labels are ubiquitous in real-world datasets. Several recent successful methods for training deep neural networks (DNNs) robust to label noise have used two primary techniques: filtering samples based on loss during a warm-up…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Kento Nishi , Yi Ding , Alex Rich , Tobias Höllerer

Latent variable models are powerful tools for modeling complex phenomena involving in particular partially observed data, unobserved variables or underlying complex unknown structures. Inference is often difficult due to the latent…

Statistics Theory · Mathematics 2023-06-23 Charlotte Baey , Maud Delattre , Estelle Kuhn , Jean-Benoist Leger , Sarah Lemler

Sharpness-Aware Minimization (SAM) has emerged as a promising approach for effectively reducing the generalization error. However, SAM incurs twice the computational cost compared to base optimizer (e.g., SGD). We propose Asymptotic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Jiaxin Deng , Junbiao Pang , Baochang Zhang

The article considers the problem of identifying the variable frequency of a sinusoidal signal. To obtain a regression model of the signal, an iterative differentiation of the original analytical expression is performed, and the swapping…

Systems and Control · Electrical Eng. & Systems 2021-09-21 S. I. Nizovtsev , S. V. Shavetov , A. A. Pyrkin

Disentanglement is a useful property in representation learning which increases the interpretability of generative models such as Variational autoencoders (VAE), Generative Adversarial Models, and their many variants. Typically in such…

Machine Learning · Computer Science 2022-05-31 Arun Pandey , Michael Fanuel , Joachim Schreurs , Johan A. K. Suykens

Zero inflation is a common nuisance while monitoring disease progression over time. This article proposes a new observation driven model for zero inflated and over-dispersed count time series. The counts given the past history of the…

Statistics Theory · Mathematics 2021-05-14 Vurukonda Sathish , Siuli Mukhopadhyay , Rashmi Tiwari

State-of-the art neutron spectrometers enable simultaneous measurements of high-dimensional datasets, allowing for a large collection rate of dynamic material properties. In this paper, we present the Algorithm for Multiplexing spectrometer…

Instrumentation and Detectors · Physics 2026-03-02 Jakob Lass , Victor Cohen , Benjamín Béjar Haro , Daniel G. Mazzone

This paper introduces a novel algorithm for transductive inference in higher-order MRFs, where the unary energies are parameterized by a variable classifier. The considered task is posed as a joint optimization problem in the continuous…

This paper presents a method for robust optimization for online incremental Simultaneous Localization and Mapping (SLAM). Due to the NP-Hardness of data association in the presence of perceptual aliasing, tractable (approximate) approaches…

Robotics · Computer Science 2023-04-28 Daniel McGann , John G. Rogers , Michael Kaess

Data augmentation (DA) is commonly used during model training, as it significantly improves test error and model robustness. DA artificially expands the training set by applying random noise, rotations, crops, or even adversarial…

Machine Learning · Computer Science 2019-05-09 Shashank Rajput , Zhili Feng , Zachary Charles , Po-Ling Loh , Dimitris Papailiopoulos

Many recent loss functions in deep metric learning are expressed with logarithmic and exponential forms, and they involve margin and scale as essential hyper-parameters. Since each data class has an intrinsic characteristic, several…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Myunghun Jung , Hoirin Kim

Discriminative latent-variable models are typically learned using EM or gradient-based optimization, which suffer from local optima. In this paper, we develop a new computationally efficient and provably consistent estimator for a mixture…

Machine Learning · Computer Science 2013-06-18 Arun Tejasvi Chaganty , Percy Liang

Detecting out of distribution (OOD) samples is of paramount importance in all Machine Learning applications. Deep generative modeling has emerged as a dominant paradigm to model complex data distributions without labels. However, prior work…

Machine Learning · Computer Science 2021-01-05 Gowthami Somepalli , Yexin Wu , Yogesh Balaji , Bhanukiran Vinzamuri , Soheil Feizi

This paper addresses the problem of inverse covariance (also known as precision matrix) estimation in high-dimensional settings. Specifically, we focus on two classes of estimators: linear shrinkage estimators with a target proportional to…

Machine Learning · Statistics 2025-11-21 Lucas Morisset , Adrien Hardy , Alain Durmus

Self-reflection enables language agents to iteratively refine solutions, yet often produces repetitive outputs that limit reasoning performance. Recent studies have attempted to address this limitation through various approaches, among…

Machine Learning · Computer Science 2026-03-02 Tianjun Yao , Yongqiang Chen , Yujia Zheng , Pan Li , Zhiqiang Shen , Kun Zhang

Data efficiency of learning, which plays a key role in the Reinforcement Learning (RL) training process, becomes even more important in continual RL with sequential environments. In continual RL, the learner interacts with non-stationary,…

Machine Learning · Computer Science 2024-10-17 Sihao Wu , Xingyu Zhao , Xiaowei Huang

The autoregressive language model (ALM) trained with maximum likelihood estimation (MLE) is widely used in unconditional text generation. Due to exposure bias, the generated texts still suffer from low quality and diversity. This presents…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Xingyuan Chen , Ping Cai , Peng Jin , Hongjun Wang , Xinyu Dai , Jiajun Chen

The deconfounder was proposed as a method for estimating causal parameters in a context with multiple causes and unobserved confounding. It is based on recovery of a latent variable from the observed causes. We disentangle the causal…

Statistics Theory · Mathematics 2024-03-04 Jeffrey Adams , Niels Richard Hansen

This paper introduces the RUMBoost model, a novel discrete choice modelling approach that combines the interpretability and behavioural robustness of Random Utility Models (RUMs) with the generalisation and predictive ability of deep…

Machine Learning · Computer Science 2024-11-19 Nicolas Salvadé , Tim Hillel

Reinforcement learning methods for robotics are increasingly successful due to the constant development of better policy gradient techniques. A precise (low variance) and accurate (low bias) gradient estimator is crucial to face…

Machine Learning · Computer Science 2022-03-09 Joao Carvalho , Jan Peters