English
Related papers

Related papers: Robustness tests for biomedical foundation models …

200 papers

We study the robustness of system estimation to parametric perturbations in system dynamics and initial conditions. We define the problem of sensitivity-based parametric uncertainty quantification in dynamical system estimation. The main…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Ayush Pandey

As multimodal learning finds applications in a wide variety of high-stakes societal tasks, investigating their robustness becomes important. Existing work has focused on understanding the robustness of vision-and-language models to…

Machine Learning · Computer Science 2022-11-07 Gaurav Verma , Vishwa Vinay , Ryan A. Rossi , Srijan Kumar

Risk assessment of a robot in controlled environments, such as laboratories and proving grounds, is a common means to assess, certify, validate, verify, and characterize the robots' safety performance before, during, and even after their…

Robotics · Computer Science 2025-01-29 Linda Capito , Guillermo A. Castillo , Bowen Weng

AI models, including both time-series-specific and general-purpose Foundation Models (FMs), have demonstrated strong potential in time-series forecasting across sectors like finance. However, these models are highly sensitive to input…

Robust explanations of machine learning models are critical to establish human trust in the models. Due to limited cognition capability, most humans can only interpret the top few salient features. It is critical to make top salient…

Machine Learning · Computer Science 2023-07-11 Chao Chen , Chenghua Guo , Guixiang Ma , Ming Zeng , Xi Zhang , Sihong Xie

Medical reasoning models (MRMs) achieve superior performance on medical benchmarks compared to medical LLMs; however, high accuracy alone is insufficient for practical deployment. One of such requirements for real-world application is…

The workshop is devoted to model-based testing of both software and hardware. Model-based testing uses models describing the required behavior of the system under consideration to guide such efforts as test selection and test results…

Software Engineering · Computer Science 2015-04-09 Nikolay Pakulin , Alexander K. Petrenko , Bernd-Holger Schlingloff

This paper studies the design of mechanisms that are robust to misspecification. We introduce a novel notion of robustness that connects a variety of disparate approaches and study its implications in a wide class of mechanism design…

Theoretical Economics · Economics 2021-08-31 Giuseppe Lopomo , Luca Rigotti , Chris Shannon

We propose an algorithm to enhance certified robustness of a deep model ensemble by optimally weighting each base model. Unlike previous works on using ensembles to empirically improve robustness, our algorithm is based on optimizing a…

Machine Learning · Statistics 2019-11-01 Huan Zhang , Minhao Cheng , Cho-Jui Hsieh

In genetic studies of complex diseases, the underlying mode of inheritance is often not known. Thus, the most powerful test or other optimal procedure for one model, e.g. recessive, may be quite inefficient if another model, e.g. dominant,…

Statistics Theory · Mathematics 2007-06-13 Gang Zheng , Boris Freidlin , Joseph L. Gastwirth

As machine learning models become increasingly prevalent in critical decision-making models and systems in fields like finance, healthcare, etc., ensuring their robustness against adversarial attacks and changes in the input data is…

Machine Learning · Statistics 2024-08-05 Arun Prakash R , Anwesha Bhattacharyya , Joel Vaughan , Vijayan N. Nair

The problem of robust binary hypothesis testing is studied. Under both hypotheses, the data-generating distributions are assumed to belong to uncertainty sets constructed through moments; in particular, the sets contain distributions whose…

Statistics Theory · Mathematics 2024-01-09 Akshayaa Magesh , Zhongchang Sun , Venugopal V. Veeravalli , Shaofeng Zou

Systems biology models are useful models of complex biological systems that may require a large amount of experimental data to fit each model's parameters or to approximate a likelihood function. These models range from a few to thousands…

Quantitative Methods · Quantitative Biology 2024-07-12 Vincent D. Zaballa , Elliot E. Hui

Discrete-time random walks and their extensions are common tools for analyzing animal movement data. In these analyses, resolution of temporal discretization is a critical feature. Ideally, a model both mirrors the relevant temporal scale…

Quantitative Methods · Quantitative Biology 2015-08-27 Ulrike E. Schlägel , Mark A. Lewis

Robustness is widely regarded as a fundamental problem in the analysis of machine learning (ML) models. Most often robustness equates with deciding the non-existence of adversarial examples, where adversarial examples denote situations…

Machine Learning · Computer Science 2023-12-19 Yacine Izza , Joao Marques-Silva

Training foundation models on extensive datasets and then finetuning them on specific tasks has emerged as the mainstream approach in artificial intelligence. However, the model robustness, which is a critical aspect for safety, is often…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Kai Qiu , Huishuai Zhang , Zhirong Wu , Stephen Lin

We evaluate the robustness of several large language models on multiple datasets. Robustness here refers to the relative insensitivity of the model's answers to meaning-preserving variants of their input. Benchmark datasets are constructed…

Computation and Language · Computer Science 2024-11-05 Samuel Ackerman , Ella Rabinovich , Eitan Farchi , Ateret Anaby-Tavor

Bayesian hierarchical models are increasing popular in economics. When using hierarchical models, it is useful not only to calculate posterior expectations, but also to measure the robustness of these expectations to reasonable alternative…

Machine Learning · Statistics 2016-06-24 Ryan Giordano , Tamara Broderick , Rachael Meager , Jonathan Huggins , Michael Jordan

We study the problem of assessing the robustness of counterfactual explanations for deep learning models. We focus on $\textit{plausible model shifts}$ altering model parameters and propose a novel framework to reason about the robustness…

Machine Learning · Computer Science 2024-07-11 Luca Marzari , Francesco Leofante , Ferdinando Cicalese , Alessandro Farinelli

Building robust multimodal models are crucial for achieving reliable deployment in the wild. Despite its importance, less attention has been paid to identifying and improving the robustness of Multimodal Sentiment Analysis (MSA) models. In…

Computation and Language · Computer Science 2022-06-01 Devamanyu Hazarika , Yingting Li , Bo Cheng , Shuai Zhao , Roger Zimmermann , Soujanya Poria