English
Related papers

Related papers: Circuit Stability Characterizes Language Model Gen…

200 papers

This paper proves that robustness implies generalization via data-dependent generalization bounds. As a result, robustness and generalization are shown to be connected closely in a data-dependent manner. Our bounds improve previous bounds…

Machine Learning · Computer Science 2022-08-04 Kenji Kawaguchi , Zhun Deng , Kyle Luh , Jiaoyang Huang

The explanations of large language models have recently been shown to be sensitive to the randomness used for their training, creating a need to characterize this sensitivity. In this paper, we propose a characterization that questions the…

Computation and Language · Computer Science 2024-03-18 Jeremie Bogaert , Francois-Xavier Standaert

Employing model predictive control to systems with unbounded, stochastic disturbances poses the challenge of guaranteeing safety, i.e., repeated feasibility and stability of the closed-loop system. Especially, there are no strict repeated…

Systems and Control · Electrical Eng. & Systems 2024-10-11 Maik Pfefferkorn , Rolf Findeisen

Large Language Models (LLMs) have emerged as a promising cornerstone for the development of natural language processing (NLP) and artificial intelligence (AI). However, ensuring the robustness of LLMs remains a critical challenge. To…

Computation and Language · Computer Science 2025-11-07 Pankaj Kumar , Subhankar Mishra

Modern language models (LMs) pose a new challenge in capability assessment. Static benchmarks inevitably saturate without providing confidence in the deployment tolerances of LM-based systems, but developers nonetheless claim that their…

Software Engineering · Computer Science 2024-07-31 Michael Saxon , Ari Holtzman , Peter West , William Yang Wang , Naomi Saphra

The stability of dynamical systems against perturbations (variations in initial conditions/model parameters) is a property referred to as structural stability. The study of sensitivity to perturbation is essential because in experiment…

Quantum Physics · Physics 2014-11-18 Elliott Tammaro

Desirable system performance in the face of threats and disruptions has been characterized by various management concepts. Through semi-structured interviews with editors of journals in the fields of emergency response and systems…

Physics and Society · Physics 2020-08-25 Stephanie Galaitsi , Benjamin D. Trump , Jeffrey M. Keisler , Igor Linkov

Control systems can show robustness to many events, like disturbances and model inaccuracies. It is natural to speculate that they are also robust to sporadic deadline misses when implemented as digital tasks on an embedded platform. This…

Optimization and Control · Mathematics 2022-08-31 Nils Vreman , Paolo Pazzaglia , Jie Wang , Victor Magron , Martina Maggio

Robustness of neural networks has recently attracted a great amount of interest. The many investigations in this area lack a precise common foundation of robustness concepts. Therefore, in this paper, we propose a rigorous and flexible…

Machine Learning · Computer Science 2021-06-01 Alessandro Tibo , Manfred Jaeger , Kim G. Larsen

In this paper, we mainly study the robust stability of linear continuous systems with parameter uncertainties, a more general kind of uncertainties for system matrices is considered, i.e., entries of system matrices are rational functions…

Symbolic Computation · Computer Science 2010-03-17 Xiaorong Hou , Junwei Shao

Large language models (LLMs) often present answers with high apparent confidence despite lacking an explicit mechanism for reasoning about certainty or truth. While existing benchmarks primarily evaluate single-turn accuracy, truthfulness…

Computation and Language · Computer Science 2026-03-05 Mohammadreza Saadat , Steve Nemzer

As machine learning models are increasingly considered for high-stakes domains, effective explanation methods are crucial to ensure that their prediction strategies are transparent to the user. Over the years, numerous metrics have been…

Machine Learning · Computer Science 2025-04-14 Johannes Maeß , Grégoire Montavon , Shinichi Nakajima , Klaus-Robert Müller , Thomas Schnake

Recently developed control methods with strong disturbance rejection capabilities provide a useful option for control design. The key lies in a general concept of disturbance and effective ways to estimate and compensate the disturbance.…

Optimization and Control · Mathematics 2018-01-19 Wuhua Hu , Eduardo F. Camacho , Lihua Xie

Systems design processes are increasingly reliant on simulation models to inform design decisions. A pervasive issue within the systems engineering community is trusting in the models used to make decisions about complex systems. This work…

Computational Engineering, Finance, and Science · Computer Science 2025-08-05 Edward Louis , Gregory Mocko , Evan Taylor

The complexity of modern control systems necessitates architectures that achieve high performance while ensuring robust stability, particularly for nonlinear systems. In this work, we tackle the challenge of designing output-feedback…

Systems and Control · Electrical Eng. & Systems 2025-06-16 Clara Lucía Galimberti , Luca Furieri , Giancarlo Ferrari-Trecate

Small language models fine-tuned for graph property estimation have demonstrated strong in-distribution performance, yet their generalization capabilities beyond training conditions remain poorly understood. In this work, we systematically…

Machine Learning · Computer Science 2026-04-21 Michal Podstawski

Recent studies on reasoning in language models (LMs) have sparked a debate on whether they can learn systematic inferential principles or merely exploit superficial patterns in the training data. To understand and uncover the mechanisms…

Computation and Language · Computer Science 2025-06-24 Geonhee Kim , Marco Valentino , André Freitas

The objective of this paper is to assess the quality of explanation heatmaps for image classification tasks. To assess the quality of explainability methods, we approach the task through the lens of accuracy and stability. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Lassi Raatikainen , Esa Rahtu

Modular and well-written software is an ideal that programmers strive to achieve. However, real-world project constraints limit the amount of reusable and modular code that programmers can produce. Many techniques exist that refactor code…

Software Engineering · Computer Science 2018-12-05 Mohammad Raji , Behzad Montazeri

The layered structure of deep neural networks hinders the use of numerous analysis tools and thus the development of its interpretability. Inspired by the success of functional brain networks, we propose a novel framework for…

Machine Learning · Computer Science 2022-05-25 Ben Zhang , Zhetong Dong , Junsong Zhang , Hongwei Lin