English
Related papers

Related papers: How Emotionally Stable is ALBERT? Testing Robustne…

200 papers

Targeted studies testing knowledge of subject-verb agreement (SVA) indicate that pre-trained language models encode syntactic information. We assert that if models robustly encode subject-verb agreement, they should be able to identify when…

Computation and Language · Computer Science 2022-10-31 Christopher Davis , Christopher Bryant , Andrew Caines , Marek Rei , Paula Buttery

Machine learning models for speech emotion recognition (SER) can be trained for different tasks and are usually evaluated based on a few available datasets per task. Tasks could include arousal, valence, dominance, emotional categories, or…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-13 Anna Derington , Hagen Wierstorf , Ali Özkil , Florian Eyben , Felix Burkhardt , Björn W. Schuller

Inference for models with recursively defined likelihoods is computationally demanding, limiting scalability to large datasets. We propose a stabilised weighted subsampling methodology for accelerated inference based on an unbiased…

Methodology · Statistics 2026-05-14 Matias Quiroz , Aishwarya Bhaskaran , Zixuan Wang , Thomas Goodwin

Sample average approximation (SAA), a popular method for tractably solving stochastic optimization problems, enjoys strong asymptotic performance guarantees in settings with independent training samples. However, these guarantees are not…

Optimization and Control · Mathematics 2021-12-13 Yafei Wang , Bo Pan , Wei Tu , Peng Liu , Bei Jiang , Chao Gao , Wei Lu , Shangling Jui , Linglong Kong

Causal inference, especially in observational studies, relies on untestable assumptions about the true data-generating process. Sensitivity analysis helps us determine how robust our conclusions are when we alter these underlying…

Machine Learning · Computer Science 2026-05-11 Nikita Dhawan , Daniel Shen , Leonardo Cotta , Chris J. Maddison

A representation learning method is considered stable if it consistently generates similar representation of the given data across multiple runs. Word Embedding Methods (WEMs) are a class of representation learning methods that generate…

Computation and Language · Computer Science 2024-06-13 Angana Borah , Manash Pratim Barman , Amit Awekar

Robustness against unwanted perturbations is an important aspect of deploying neural network classifiers in the real world. Common natural perturbations include noise, saturation, occlusion, viewpoint changes, and blur deformations. All of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Sadaf Gulshad , Ivan Sosnovik , Arnold Smeulders

In supervised machine learning, models are typically trained using data with hard labels, i.e., definite assignments of class membership. This traditional approach, however, does not take the inherent uncertainty in these labels into…

Machine Learning · Computer Science 2024-09-25 Sjoerd de Vries , Dirk Thierens

Is the Text to Motion model robust? Recent advancements in Text to Motion models primarily stem from more accurate predictions of specific actions. However, the text modality typically relies solely on pre-trained Contrastive Language-Image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Wenshuo Chen , Hongru Xiao , Erhang Zhang , Lijie Hu , Lei Wang , Mengyuan Liu , Chen Chen

Understanding robustness and sensitivity of BERT models predicting Alzheimer's disease from text is important for both developing better classification models and for understanding their capabilities and limitations. In this paper, we…

Computation and Language · Computer Science 2021-10-27 Jekaterina Novikova

Many modern datasets don't fit neatly into $n \times p$ matrices, but most techniques for measuring statistical stability expect rectangular data. We study methods for stability assessment on non-rectangular data, using statistical learning…

Computation · Statistics 2021-02-23 Kris Sankaran

Sentiment analysis (SA) has become an extensive research area in recent years impacting diverse fields including ecommerce, consumer business, and politics, driven by increasing adoption and usage of social media platforms. It is…

Computation and Language · Computer Science 2021-06-03 Sarojadevi Palani , Prabhu Rajagopal , Sidharth Pancholi

$\alpha$-stable distributions are utilised as models for heavy-tailed noise in many areas of statistics, finance and signal processing engineering. However, in general, neither univariate nor multivariate $\alpha$-stable models admit closed…

Computation · Statistics 2009-12-24 G. W. Peters , S. A. Sisson , Y. Fan

Robustness and counterfactual bias are usually evaluated on a test dataset. However, are these evaluations robust? If the test dataset is perturbed slightly, will the evaluation results keep the same? In this paper, we propose a "double…

Computation and Language · Computer Science 2021-04-13 Chong Zhang , Jieyu Zhao , Huan Zhang , Kai-Wei Chang , Cho-Jui Hsieh

We consider the problem of learning linear prediction models with model misspecification bias. In such case, the collinearity among input variables may inflate the error of parameter estimation, resulting in instability of prediction…

Machine Learning · Computer Science 2019-12-02 Zheyan Shen , Peng Cui , Tong Zhang , Kun Kuang

Randomized smoothing has shown promising certified robustness against adversaries in classification tasks. Despite such success with only zeroth-order access to base models, randomized smoothing has not been extended to a general form of…

Machine Learning · Computer Science 2024-05-16 Aref Miri Rekavandi , Olga Ohrimenko , Benjamin I. P. Rubinstein

Randomized controlled trials (RCT's) allow researchers to estimate causal effects in an experimental sample with minimal identifying assumptions. However, to generalize or transport a causal effect from an RCT to a target population,…

Methodology · Statistics 2022-02-08 Melody Huang

Reliable methods for automatic readability assessment have the potential to impact a variety of fields, ranging from machine translation to self-informed learning. Recently, large language models for the German language (such as GBERT and…

Computation and Language · Computer Science 2022-09-12 Patrick Gustav Blaneck , Tobias Bornheim , Niklas Grieger , Stephan Bialonski

Oral Glucose Tolerance Test (OGTT) is one of many way to produce data in the study of the diabetes dynamic. In a recent paper [1.]:\textit{ Estimating insulin sensitivity and $ \beta $-cell function from the oral glucose tolerance test:…

Probability · Mathematics 2024-12-17 Paul Bekima

Building robust multimodal models are crucial for achieving reliable deployment in the wild. Despite its importance, less attention has been paid to identifying and improving the robustness of Multimodal Sentiment Analysis (MSA) models. In…

Computation and Language · Computer Science 2022-06-01 Devamanyu Hazarika , Yingting Li , Bo Cheng , Shuai Zhao , Roger Zimmermann , Soujanya Poria