English
Related papers

Related papers: Revisiting L21-norm Robustness with Vector Outlier…

200 papers

In recent years, there have been significant improvements in various forms of image outlier detection. However, outlier detection performance under adversarial settings lags far behind that in standard settings. This is due to the lack of…

Many common loss functions such as mean-squared-error, cross-entropy, and reconstruction loss are unnecessarily rigid. Under a probabilistic interpretation, these common losses correspond to distributions with fixed shapes and scales. We…

Machine Learning · Computer Science 2020-10-05 Mark Hamilton , Evan Shelhamer , William T. Freeman

Modern neural networks are known to give overconfident prediction for out-of-distribution inputs when deployed in the open world. It is common practice to leverage a surrogate outlier dataset to regularize the model during training, and…

Machine Learning · Computer Science 2024-02-27 Wenyu Jiang , Hao Cheng , Mingcai Chen , Chongjun Wang , Hongxin Wei

Our recent work lays out a general framework for inferring information about the parameters and associated dynamics of a differential equation model from a discrete set of data points collected from the system being modeled. Rigorous…

Dynamical Systems · Mathematics 2022-09-29 Xiaoyu Duan , Jonathan E Rubin , David Swigon

The key of the out-of-distribution (OOD) generalization is to generalize invariance from training domains to target domains. The variance risk extrapolation (V-REx) is a practical OOD method, which depends on a domain-level regularization…

Machine Learning · Computer Science 2021-04-12 Chuanlong Xie , Haotian Ye , Fei Chen , Yue Liu , Rui Sun , Zhenguo Li

This paper proposes robust estimators of the variogram, a statistical tool that is commonly used in geostatistics to capture the spatial dependence structure of data. The new estimators are based on the highly robust minimum covariance…

Methodology · Statistics 2025-03-31 Jana Gierse , Roland Fried

Vision-Language-Action (VLA) models aim to unify perception, language understanding, and action generation, offering strong cross-task and cross-scene generalization with broad impact on embodied AI. However, current VLA models often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Angen Ye , Zeyu Zhang , Boyuan Wang , Xiaofeng Wang , Dapeng Zhang , Zheng Zhu

Ordinal response model is a popular and commonly used regression for ordered categorical data in a wide range of fields such as medicine and social sciences. However, it is empirically known that the existence of ``outliers'', combinations…

Methodology · Statistics 2023-05-15 Tomotaka Momozaki , Tomoyuki Nakagawa

Out-of-distribution (OOD) detection is a crucial task for deploying deep learning models in the wild. One of the major challenges is that well-trained deep models tend to perform over-confidence on unseen test data. Recent research attempts…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Mingrong Gong , Chaoqi Chen , Qingqiang Sun , Yue Wang , Hui Huang

A robust estimation framework for binary regression models is studied, aiming to extend traditional approaches like logistic regression models. While previous studies largely focused on logistic models, we explore a broader class of models…

Methodology · Statistics 2025-02-24 Kenichi Hayashi , Shinto Eguchi

This paper examines the role and efficiency of the non-convex loss functions for binary classification problems. In particular, we investigate how to design a simple and effective boosting algorithm that is robust to the outliers in the…

Machine Learning · Statistics 2017-08-25 Alexander Hanbo Li , Jelena Bradic

In practice, network applications have to deal with failing nodes, malicious attacks, or, somehow, nodes facing highly corrupted data --- generally classified as outliers. This calls for robust, uncomplicated, and efficient methods. We…

Optimization and Control · Mathematics 2014-10-10 Cláudia Soares , João Gomes

We revisit the problem of estimating the mean of a high-dimensional distribution in the presence of an $\varepsilon$-fraction of adversarial outliers. When $\varepsilon$ is at most some sufficiently small constant, previous works can…

Data Structures and Algorithms · Computer Science 2024-11-22 Hongjie Chen , Deepak Narayanan Sridharan , David Steurer

We propose VL Norm (Variance-reduced Length-dependent Normalization), a simple yet effective loss aggregation method tailored to the characteristic of dynamic generation lengths in Reinforcement Learning with Verifiable Rewards (RLVR).…

Machine Learning · Computer Science 2025-10-14 Zhiyuan He , Xufang Luo , Yike Zhang , Yuqing Yang , Lili Qiu

Nonparametric methods are widely applicable to statistical inference problems, since they rely on a few modeling assumptions. In this context, the fresh look advocated here permeates benefits from variable selection and compressive…

Machine Learning · Statistics 2015-03-19 Gonzalo Mateos , Georgios B. Giannakis

This paper reexamines the research on out-of-distribution (OOD) robustness in the field of NLP. We find that the distribution shift settings in previous studies commonly lack adequate challenges, hindering the accurate evaluation of OOD…

Computation and Language · Computer Science 2023-10-27 Lifan Yuan , Yangyi Chen , Ganqu Cui , Hongcheng Gao , Fangyuan Zou , Xingyi Cheng , Heng Ji , Zhiyuan Liu , Maosong Sun

We study the change detection problem with an unknown post-change distribution. Under this constraint, the unknown change in the distribution of observations may occur in many ways without much structure on the observations, whereas, before…

Signal Processing · Electrical Eng. & Systems 2020-12-11 Deniz Sargun , C. Emre Koksal

Automatic detection of statistical outliers is facilitated through knowledge of the source distribution of regular observations. Since the population distribution is often unknown in practice, one approach is to apply a transformation to…

Methodology · Statistics 2025-11-19 Saranjeet Singh Saluja , Fatma Parlak , Amanda Mejia

We consider the problem of learning support vector machines robust to uncertainty. It has been established in the literature that typical loss functions, including the hinge loss, are sensible to data perturbations and outliers, thus…

Machine Learning · Computer Science 2024-02-06 Valentina Cepeda , Andrés Gómez , Shaoning Han

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

Machine Learning · Computer Science 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang