English
Related papers

Related papers: Learning Boolean functions with concentrated spect…

200 papers

In this paper we address the problem of discretization in the context of learning Bayesian networks (BNs) from data containing both continuous and discrete variables. We describe a new technique for <EM>multivariate</EM> discretization,…

Artificial Intelligence · Computer Science 2013-02-01 Stefano Monti , Gregory F. Cooper

We develop a meta-learning framework for simple regret minimization in bandits. In this framework, a learning agent interacts with a sequence of bandit tasks, which are sampled i.i.d.\ from an unknown prior distribution, and learns its…

Machine Learning · Computer Science 2023-07-06 Mohammadjavad Azizi , Branislav Kveton , Mohammad Ghavamzadeh , Sumeet Katariya

It has been shown that optimizing quadratic costs while stabilizing affine control systems to desired (sets of) states subject to state and control constraints can be reduced to a sequence of Quadratic Programs (QPs) by using Control…

Optimization and Control · Mathematics 2023-03-17 Wei Xiao , Christos G. Cassandras , Calin A. Belta

We develop the theory and practice of an approach to modelling and probabilistic inference in causal networks that is suitable when application-specific or analysis-specific constraints should inform such inference or when little or no data…

Artificial Intelligence · Computer Science 2017-05-16 Paul Beaumont , Michael Huth

We show a connection between the Fourier spectrum of Boolean functions and the REINFORCE gradient estimator for binary latent variable models. We show that REINFORCE estimates (up to a factor) the degree-1 Fourier coefficients of a Boolean…

Machine Learning · Computer Science 2018-08-14 Adeel Pervez

In many practical applications, spatial data are often collected at areal levels (i.e., block data) and the inferences and predictions about the variable at points or blocks different from those at which it has been observed typically…

Computation · Statistics 2020-01-10 Peter Simonson , Douglas Nychka , Soutir Bandyopadhyay

Deep learning for supervised learning has achieved astonishing performance in various machine learning applications. However, annotated data is expensive and rare. In practice, only a small portion of data samples are annotated.…

Machine Learning · Computer Science 2019-06-25 Yifu Wu , Jin Wei , Rigoberto Roche

We study Bayesian optimization (BO) in high-dimensional and non-stationary scenarios. Existing algorithms for such scenarios typically require extensive hyperparameter tuning, which limits their practical effectiveness. We propose a…

Machine Learning · Computer Science 2023-07-26 Fengxue Zhang , Jialin Song , James Bowden , Alexander Ladd , Yisong Yue , Thomas A. Desautels , Yuxin Chen

Items in a test are often used as a basis for making decisions and such tests are therefore required to have good psychometric properties, like unidimensionality. In many cases the sum score is used in combination with a threshold to decide…

Methodology · Statistics 2020-07-14 Lourens Waldorp , Maarten Marsman , Denny Borsboom

Obtaining guarantees on the convergence of the minimizers of empirical risks to the ones of the true risk is a fundamental matter in statistical learning. Instead of deriving guarantees on the usual estimation error, the goal of this paper…

Statistics Theory · Mathematics 2024-09-12 Paul Escande

This paper focuses on learning a model of system dynamics online while satisfying safety constraints. Our objective is to avoid offline system identification or hand-specified models and allow a system to safely and autonomously estimate…

Systems and Control · Electrical Eng. & Systems 2022-01-25 Vikas Dhiman , Mohammad Javad Khojasteh , Massimo Franceschetti , Nikolay Atanasov

Deep learning has achieved the state-of-the-art performance across medical imaging tasks; however, model calibration is often not considered. Uncalibrated models are potentially dangerous in high-risk applications since the user does not…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Skylar E. Stolte , Kyle Volle , Aprinda Indahlastari , Alejandro Albizu , Adam J. Woods , Kevin Brink , Matthew Hale , Ruogu Fang

Canalizing functions have important applications in physics and biology. For example, they represent a mechanism capable of stabilizing chaotic behavior in Boolean network models of discrete dynamical systems. When comparing the class of…

Mathematical Physics · Physics 2009-11-10 Winfried Just , Ilya Shmulevich , John Konvalina

What factors contribute to the relative success and corresponding difficulties of in-context learning for Large Language Models (LLMs)? Drawing on insights from the literature on human concept learning, we test LLMs on carefully designed…

Computation and Language · Computer Science 2024-12-05 Leroy Z. Wang , R. Thomas McCoy , Shane Steinert-Threlkeld

We propose a simple but effective multi-source domain generalization technique based on deep neural networks by incorporating optimized normalization layers that are specific to individual domains. Our approach employs multiple…

Machine Learning · Computer Science 2020-07-22 Seonguk Seo , Yumin Suh , Dongwan Kim , Geeho Kim , Jongwoo Han , Bohyung Han

Despite the widespread success of Transformers on NLP tasks, recent works have found that they struggle to model several formal languages when compared to recurrent models. This raises the question of why Transformers perform well in…

Machine Learning · Computer Science 2023-07-11 Satwik Bhattamishra , Arkil Patel , Varun Kanade , Phil Blunsom

This paper studies the hazard-free formula complexity of Boolean functions. Our first result shows that unate functions are the only Boolean functions for which the monotone formula complexity of the hazard-derivative equals the hazard-free…

Computational Complexity · Computer Science 2025-06-17 Leah London Arazi , Amir Shpilka

We consider the problem of distributed feature quantization, where the goal is to enable a pretrained classifier at a central node to carry out its classification on features that are gathered from distributed nodes through communication…

Machine Learning · Computer Science 2019-11-04 Osama A. Hanna , Yahya H. Ezzeldin , Tara Sadjadpour , Christina Fragouli , Suhas Diggavi

While federated learning is a promising approach for training deep learning models over distributed sensitive datasets, it presents new challenges for machine learning, especially when applied in the medical domain where multi-centric data…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Mathieu Andreux , Jean Ogier du Terrail , Constance Beguier , Eric W. Tramel

Learning sparse feature representations is a useful instrument for solving an unsupervised learning problem. In this paper, we present three labeled handwritten digit datasets, collectively called n-MNIST. Then, we propose a novel framework…

Computer Vision and Pattern Recognition · Computer Science 2015-09-14 Saikat Basu , Manohar Karki , Sangram Ganguly , Robert DiBiano , Supratik Mukhopadhyay , Ramakrishna Nemani