English
Related papers

Related papers: Physics-Aware Learnability: From Set-Theoretic Ind…

200 papers

Learning Analytics (LA) has rapidly expanded through practical and technological innovation, yet its foundational identity has remained theoretically under-specified. This paper addresses this gap by proposing the first axiomatic theory…

Computers and Society · Computer Science 2025-12-12 Kensuke Takii , Changhao Liang , Hiroaki Ogata

Complex classifiers may exhibit "embarassing" failures in cases where humans can easily provide a justified classification. Avoiding such failures is obviously of key importance. In this work, we focus on one such setting, where a label is…

Machine Learning · Computer Science 2019-06-14 Deborah Cohen , Amit Daniely , Amir Globerson , Gal Elidan

While machine learning can accurately model process systems, models for decision making should also be structurally simple and physically interpretable. In process control, for example, (nearly) linear models are favored than nonlinear…

Systems and Control · Electrical Eng. & Systems 2026-05-25 Wentao Tang

Multi-index models - functions which only depend on the covariates through a non-linear transformation of their projection on a subspace - are a useful benchmark for investigating feature learning with neural nets. This paper examines the…

Machine Learning · Computer Science 2025-11-13 Emanuele Troiani , Yatin Dandi , Leonardo Defilippis , Lenka Zdeborová , Bruno Loureiro , Florent Krzakala

While there are many applications of ML to scientific problems that look promising, visuals can be deceiving. Using numerical analysis techniques, we rigorously quantify the accuracy, convergence rates, and generalization bounds of certain…

Machine Learning · Computer Science 2026-05-27 Alejandro Francisco Queiruga , Theo Gutman-Solo , Shuai Jiang

We present a type of epistemic logics that encapsulates both the dynamics of acquiring knowledge (knowing) and losing information (forgetting), alongside the integration of group knowledge concepts. Our approach is underpinned by a system…

Logic in Computer Science · Computer Science 2024-10-31 Xiaolong Liang , Yì N. Wáng

Strategic classification studies learning settings in which individuals can modify their features, at a cost, in order to influence the classifier's decision. A central question is how the sample complexity of the induced (strategic)…

Machine Learning · Computer Science 2026-05-15 Yuval Filmus , Shay Moran , Elizaveta Nesterova , Nir Rosenfeld , Alexander Shlimovich

Standard epistemic logic studies propositional knowledge, yet many other types of knowledge such as "knowing whether", "knowing what", "knowing how" are frequently and widely used in everyday life as well as academic fields. In…

Logic in Computer Science · Computer Science 2016-11-28 Yifeng Ding

Uncertainty-aware machine learners, such as Bayesian neural networks, output a quantification of uncertainty instead of a point prediction. We provide uncertainty-aware learners with a principled framework to characterize, and identify ways…

Machine Learning · Computer Science 2026-04-01 Sabina J. Sloman , Michele Caprio , Samuel Kaski

We consider interactive learning in the realizable setting and develop a general framework to handle problems ranging from best arm identification to active classification. We begin our investigation with the observation that agnostic…

Machine Learning · Computer Science 2021-11-10 Julian Katz-Samuels , Blake Mason , Kevin Jamieson , Rob Nowak

We describe a novel approach to explainable prediction of a continuous variable based on learning fuzzy weighted rules. Our model trains a set of weighted rules to maximise prediction accuracy and minimise an ontology-based 'semantic loss'…

Artificial Intelligence · Computer Science 2022-08-29 Martin Glauer , Robert West , Susan Michie , Janna Hastings

While reinforcement learning (RL) is gaining popularity in energy systems control, its real-world applications are limited due to the fact that the actions from learned policies may not satisfy functional requirements or be feasible for the…

Systems and Control · Electrical Eng. & Systems 2021-05-20 Bingqing Chen , Priya Donti , Kyri Baker , J. Zico Kolter , Mario Berges

Online learning is a familiar problem setting within Machine-Learning in which data is presented serially in time to a learning agent, requiring it to progressively adapt within the constraints of the learning algorithm. More sophisticated…

Artificial Intelligence · Computer Science 2015-03-10 David Windridge

We study several questions in the reliable agnostic learning framework of Kalai et al. (2009), which captures learning tasks in which one type of error is costlier than others. A positive reliable classifier is one that makes no false…

Machine Learning · Computer Science 2014-02-25 Varun Kanade , Justin Thaler

Much attention has been devoted to the use of machine learning to approximate physical concepts. Yet, due to challenges in interpretability of machine learning techniques, the question of what physics machine learning models are able to…

Before we attempt to learn a function between two (sets of) observables of a physical process, we must first decide what the inputs and what the outputs of the desired function are going to be. Here we demonstrate two distinct, data-driven…

We study a classification problem with three key challenges: pervasive informative missingness, the integration of partial prior expert knowledge into the learning process, and the need for interpretable decision rules. We propose a…

Machine Learning · Statistics 2026-04-17 Shahar Cohen , David M. Steinberg , Yael Radzyner , Yochai Ben Horin

A salient approach to interpretable machine learning is to restrict modeling to simple models. In the Bayesian framework, this can be pursued by restricting the model structure and prior to favor interpretable models. Fundamentally,…

Machine Learning · Computer Science 2020-09-08 Homayun Afrabandpey , Tomi Peltola , Juho Piironen , Aki Vehtari , Samuel Kaski

Learning is a process wherein a learning agent enhances its performance through exposure of experience or data. Throughout this journey, the agent may encounter diverse learning environments. For example, data may be presented to the leaner…

We consider the fundamental question of learnability of a hypotheses class in the supervised learning setting and in the general learning setting introduced by Vladimir Vapnik. We survey classic results characterizing learnability in term…

Machine Learning · Statistics 2013-03-26 Silvia Villa , Lorenzo Rosasco , Tomaso Poggio