English
Related papers

Related papers: Convex Hybrid Modeling: An Operator-Based Approach

200 papers

Simulating multi-scale phenomena such as turbulent fluid flows is typically computationally very expensive. Filtering the smaller scales allows for using coarse discretizations, however, this requires closure models to account for the…

Computational Engineering, Finance, and Science · Computer Science 2022-08-22 Syver Døving Agdestein , Benjamin Sanderse

This work presents a non-intrusive model reduction method to learn low-dimensional models of dynamical systems with non-polynomial nonlinear terms that are spatially local and that are given in analytic form. In contrast to state-of-the-art…

Numerical Analysis · Mathematics 2020-10-28 Peter Benner , Pawan Goyal , Boris Kramer , Benjamin Peherstorfer , Karen Willcox

Small additive ensembles of symbolic rules offer interpretable prediction models. Traditionally, these ensembles use rule conditions based on conjunctions of simple threshold propositions $x \geq t$ on a single input variable $x$ and…

Machine Learning · Computer Science 2025-06-27 Shahrzad Behzadimanesh , Pierre Le Bodic , Geoffrey I. Webb , Mario Boley

This paper proposes a novel approach for learning a data-driven quadratic manifold from high-dimensional data, then employing this quadratic manifold to derive efficient physics-based reduced-order models. The key ingredient of the approach…

Numerical Analysis · Mathematics 2022-12-29 Rudy Geelen , Stephen Wright , Karen Willcox

We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space, but with a non-convex constraint set introduced by model parameterization.…

Machine Learning · Computer Science 2020-04-21 Yongqiang Cai , Qianxiao Li , Zuowei Shen

To address the issues of stability and fidelity in interpretable learning, a novel interpretable methodology, ensemble interpretation, is presented in this paper which integrates multi-perspective explanation of various interpretation…

Machine Learning · Computer Science 2023-12-12 Chao Min , Guoyong Liao , Guoquan Wen , Yingjun Li , Xing Guo

Still under debate is the question of whether machine learning is capable of going beyond black-box modeling for complex physical systems. We investigate the generalizing and interpretability properties of learning algorithms. To this end,…

Statistical Mechanics · Physics 2019-02-18 C. Casert , T. Vieijra , J. Nys , J. Ryckebusch

Perceptual learning enables humans to recognize and represent stimuli invariant to various transformations and build a consistent representation of the self and physical world. Such representations preserve the invariant physical relations…

Neural and Evolutionary Computing · Computer Science 2020-07-02 Du Xiaorui , Yavuzhan Erdem , Immanuel Schweizer , Cristian Axenie

Several researchers have argued that a machine learning system's interpretability should be defined in relation to a specific agent or task: we should not ask if the system is interpretable, but to whom is it interpretable. We describe a…

Artificial Intelligence · Computer Science 2018-06-21 Richard Tomsett , Dave Braines , Dan Harborne , Alun Preece , Supriyo Chakraborty

Mechanistic interpretability (MI) is an emerging framework for interpreting neural networks. Given a task and model, MI aims to discover a succinct algorithmic process, an interpretation, that explains the model's decision process on that…

Machine Learning · Computer Science 2026-04-01 Alan Sun , Mariya Toneva

With dramatic breakthroughs in recent years, machine learning is showing great potential to upgrade the toolbox for power system optimization. Understanding the strength and limitation of machine learning approaches is crucial to decide…

Systems and Control · Electrical Eng. & Systems 2022-02-03 Guangchun Ruan , Haiwang Zhong , Guanglun Zhang , Yiliu He , Xuan Wang , Tianjiao Pu

We introduce two novel generalizations of the Koopman operator method of nonlinear dynamic modeling. Each of these generalizations leads to greatly improved predictive performance without sacrificing a unique trait of Koopman methods: the…

Systems and Control · Electrical Eng. & Systems 2020-10-15 Span Spanbauer , Ian Hunter

Operator learning aims to discover properties of an underlying dynamical system or partial differential equation (PDE) from data. Here, we present a step-by-step guide to operator learning. We explain the types of problems and PDEs amenable…

Numerical Analysis · Mathematics 2025-04-30 Nicolas Boullé , Alex Townsend

Machine Learning (ML) models are often complex and difficult to interpret due to their 'black-box' characteristics. Interpretability of a ML model is usually defined as the degree to which a human can understand the cause of decisions…

Methodology · Statistics 2020-06-25 Simon Kocbek , Primoz Kocbek , Leona Cilar , Gregor Stiglic

Circuit representations are becoming the lingua franca to express and reason about tractable generative and discriminative models. In this paper, we show how complex inference scenarios for these models that commonly arise in machine…

Machine Learning · Statistics 2021-02-12 Antonio Vergari , YooJung Choi , Anji Liu , Stefano Teso , Guy Van den Broeck

There are two things to be considered when we evaluate predictive models. One is prediction accuracy,and the other is interpretability. Over the recent decades, many prediction models of high performance, such as ensemble-based models and…

Machine Learning · Statistics 2024-08-05 Yongchan Choi , Seokhun Park , Chanmoo Park , Dongha Kim , Yongdai Kim

The development of the works of the author about adaptive algorithms of teaching the robotic systems with the help of operator is described here. An operator is assumed to be an experience decision-maker and sane carrier of a target which…

Robotics · Computer Science 2015-09-08 Valery Vilisov

Learning with limited data is one of the biggest problems of machine learning. Current approaches to this issue consist in learning general representations from huge amounts of data before fine-tuning the model on a small dataset of…

Machine Learning · Computer Science 2023-02-22 Grégoire Mialon

We present a hybrid algorithm for optimizing a convex, smooth function over the cone of positive semidefinite matrices. Our algorithm converges to the global optimal solution and can be used to solve general large-scale semidefinite…

Machine Learning · Computer Science 2012-06-22 Soeren Laue

Deep neural networks have been well-known for their superb handling of various machine learning and artificial intelligence tasks. However, due to their over-parameterized black-box nature, it is often difficult to understand the prediction…

Machine Learning · Computer Science 2022-07-18 Xuhong Li , Haoyi Xiong , Xingjian Li , Xuanyu Wu , Xiao Zhang , Ji Liu , Jiang Bian , Dejing Dou