English
Related papers

Related papers: A Probabilistic Neuro-symbolic Layer for Algebraic…

200 papers

A new method to solve computationally challenging (random) parametric obstacle problems is developed and analyzed, where the parameters can influence the related partial differential equation (PDE) and determine the position and surface…

Machine Learning · Computer Science 2025-04-08 Martin Eigel , Cosmas Heiß , Janina E. Schütte

Neural-symbolic computing aims at integrating robust neural learning and sound symbolic reasoning into a single framework, so as to leverage the complementary strengths of both of these, seemingly unrelated (maybe even contradictory) AI…

Artificial Intelligence · Computer Science 2022-12-02 Xuan Wu , Xinhao Zhu , Yizheng Zhao , Xinyu Dai

We develop a general framework for estimating function-valued parameters under equality or inequality constraints in infinite-dimensional statistical models. Such constrained learning problems are common across many areas of statistics and…

Machine Learning · Statistics 2025-07-22 Razieh Nabi , Nima S. Hejazi , Mark J. van der Laan , David Benkeser

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

Region-specific linear models are widely used in practical applications because of their non-linear but highly interpretable model representations. One of the key challenges in their use is non-convexity in simultaneous optimization of…

Machine Learning · Statistics 2014-11-03 Hidekazu Oiwa , Ryohei Fujimaki

Spatial self-attention layers, in the form of Non-Local blocks, introduce long-range dependencies in Convolutional Neural Networks by computing pairwise similarities among all possible positions. Such pairwise functions underpin the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Francesca Babiloni , Ioannis Marras , Filippos Kokkinos , Jiankang Deng , Grigorios Chrysos , Stefanos Zafeiriou

We present Revel, a partially neural reinforcement learning (RL) framework for provably safe exploration in continuous state and action spaces. A key challenge for provably safe deep RL is that repeatedly verifying neural networks within a…

Machine Learning · Computer Science 2020-10-27 Greg Anderson , Abhinav Verma , Isil Dillig , Swarat Chaudhuri

Intelligent agents must reason over both continuous dynamics and discrete representations to generate effective plans in complex environments. Previous studies have shown that symbolic abstractions can emerge from neural effect predictors…

Robotics · Computer Science 2026-03-10 Fatih Dogangun , Burcu Kilic , Serdar Bahar , Emre Ugur

We present a probabilistic graphical model formulation for the graph clustering problem. This enables to locally represent uncertainty of image partitions by approximate marginal distributions in a mathematically substantiated way, and to…

Computer Vision and Pattern Recognition · Computer Science 2016-01-12 Jörg Hendrik Kappes , Paul Swoboda , Bogdan Savchynskyy , Tamir Hazan , Christoph Schnörr

This paper proposes QPALM, a proximal augmented Lagrangian method based on quadratic approximations, for solving nonlinear programming problems with weakly convex objective and constraint functions. The algorithm is constructed by…

Optimization and Control · Mathematics 2026-05-06 Yule Zhang , Benqi Liu , Xiantao Xiao , Liwei Zhang

Motivation: Ab initio protein docking represents a major challenge for optimizing a noisy and costly "black box"-like function in a high-dimensional space. Despite progress in this field, there is no docking method available for rigorous…

Biomolecules · Quantitative Biology 2019-02-04 Yue Cao , Yang Shen

We introduce a parameterization method called Neural Bayes which allows computing statistical quantities that are in general difficult to compute and opens avenues for formulating new objectives for unsupervised representation learning.…

Machine Learning · Statistics 2020-02-24 Devansh Arpit , Huan Wang , Caiming Xiong , Richard Socher , Yoshua Bengio

Building robust, interpretable, and secure AI system requires quantifying and representing uncertainty under a probabilistic perspective to mimic human cognitive abilities. However, probabilistic computation presents significant challenges…

Machine Learning · Computer Science 2024-01-15 Hengyuan Ma , Yang Qi , Li Zhang , Wenlian Lu , Jianfeng Feng

In this paper, "chance optimization" problems are introduced, where one aims at maximizing the probability of a set defined by polynomial inequalities. These problems are, in general, nonconvex and computationally hard. With the objective…

Optimization and Control · Mathematics 2015-05-12 Ashkan Jasour , Necdet Serhat Aybat , Constantino Lagoa

A popular approach to neurosymbolic AI involves mapping logic formulas to arithmetic circuits (computation graphs consisting of sums and products) and passing the outputs of a neural network through these circuits. This approach enforces…

Machine Learning · Computer Science 2025-02-24 Jaron Maene , Vincent Derkinderen , Pedro Zuidberg Dos Martires

Mixed cooperative-competitive control scenarios such as human-machine interaction with individual goals of the interacting partners are very challenging for reinforcement learning agents. In order to contribute towards intuitive…

Systems and Control · Electrical Eng. & Systems 2020-03-03 Florian Köpf , Alexander Nitsch , Michael Flad , Sören Hohmann

Neural network design has utilized flexible nonlinear processes which can mimic biological systems, but has suffered from a lack of traceability in the resulting network. Graphical probabilistic models ground network design in probabilistic…

Machine Learning · Computer Science 2015-06-19 Kenric P. Nelson , Madalina Barbu , Brian J. Scannell

The following questions are often encountered in system and control theory. Given an algebraic model of a physical process, which variables can be, in theory, deduced from the input-output behavior of an experiment? How many of the…

Optimization and Control · Mathematics 2025-10-20 Alexandre Sedoglavic

Backpropagation (BP) is the cornerstone of today's deep learning algorithms, but it is inefficient partially because of backward locking, which means updating the weights of one layer locks the weight updates in the other layers.…

Neural and Evolutionary Computing · Computer Science 2021-02-10 Yu-Wei Kao , Hung-Hsuan Chen

Artificial neural networks (ANNs) are highly flexible predictive models. However, reliably quantifying uncertainty for their predictions is a continuing challenge. There has been much recent work on "recalibration" of predictive…

Methodology · Statistics 2024-03-12 R. Torres , D. J. Nott , S. A. Sisson , T. Rodrigues , J. G. Reis , G. S. Rodrigues