English
Related papers

Related papers: Theory-guided hard constraint projection (HCP): a …

200 papers

We propose a novel training method that integrates rules into deep learning, in a way the strengths of the rules are controllable at inference. Deep Neural Networks with Controllable Rule Representations (DeepCTRL) incorporates a rule…

Machine Learning · Computer Science 2021-11-18 Sungyong Seo , Sercan O. Arik , Jinsung Yoon , Xiang Zhang , Kihyuk Sohn , Tomas Pfister

This paper proposes an algorithm called Forward Composition Propagation (FCP) to explain the predictions of feed-forward neural networks operating on structured classification problems. In the proposed FCP algorithm, each neuron is…

Machine Learning · Computer Science 2023-10-26 Isel Grau , Gonzalo Nápoles , Marilyn Bello , Yamisleydi Salgueiro , Agnieszka Jastrzebska

Conformal Prediction (CP) has recently received a tremendous amount of interest, leading to a wide range of new theoretical and methodological results for predictive inference with formal theoretical guarantees. However, the vast majority…

Statistics Theory · Mathematics 2025-08-22 Manit Paul , Arun Kumar Kuchibhotla , Eric J. Tchetgen Tchetgen

This paper develops a novel deep learning approach for solving evolutionary equations, which integrates sequential learning strategies with an enhanced hard constraint strategy featuring trainable parameters, addressing the low…

Machine Learning · Computer Science 2025-03-25 Yushi Zhang , Shuai Su , Yong Wang , Yanzhong Yao

We introduce the hierarchical compositional network (HCN), a directed generative model able to discover and disentangle, without supervision, the building blocks of a set of binary images. The building blocks are binary features defined…

Machine Learning · Computer Science 2017-10-27 Miguel Lázaro-Gredilla , Yi Liu , D. Scott Phoenix , Dileep George

While reliable data-driven decision-making hinges on high-quality labeled data, the acquisition of quality labels often involves laborious human annotations or slow and expensive scientific measurements. Machine learning is becoming an…

Machine Learning · Statistics 2024-03-01 Tijana Zrnic , Emmanuel J. Candès

Multi-label classification (MC) is a standard machine learning problem in which a data point can be associated with a set of classes. A more challenging scenario is given by hierarchical multi-label classification (HMC) problems, in which…

Machine Learning · Computer Science 2022-10-05 Eleonora Giunchiglia , Thomas Lukasiewicz

Conformal prediction (CP) is a powerful statistical framework that generates prediction intervals or sets with guaranteed coverage probability. While CP algorithms have evolved beyond traditional classifiers and regressors to sophisticated…

Machine Learning · Computer Science 2026-02-02 Jianguo Huang , Jianqing Song , Xuanning Zhou , Bingyi Jing , Hongxin Wei

Algorithms based on the hard thresholding principle have been well studied with sounding theoretical guarantees in the compressed sensing and more general sparsity-constrained optimization. It is widely observed in existing empirical…

Optimization and Control · Mathematics 2021-11-17 Shenglong Zhou , Naihua Xiu , Hou-Duo Qi

A large amount of recent research has the far-reaching goal of finding training methods for deep neural networks that can serve as alternatives to backpropagation (BP). A prominent example is predictive coding (PC), which is a…

Machine Learning · Computer Science 2022-11-08 Luca Pinchetti , Tommaso Salvatori , Yordan Yordanov , Beren Millidge , Yuhang Song , Thomas Lukasiewicz

Objective: To automatically create large labeled training datasets and reduce the efforts of feature engineering for training accurate machine learning models for clinical information extraction. Materials and Methods: We propose a distant…

Information Retrieval · Computer Science 2018-04-24 Yanshan Wang , Sunghwan Sohn , Sijia Liu , Feichen Shen , Liwei Wang , Elizabeth J. Atkinson , Shreyasee Amin , Hongfang Liu

Model predictive control (MPC) is a method to formulate the optimal scheduling problem for grid flexibilities in a mathematical manner. The resulting time-constrained optimization problem can be re-solved in each optimization time step…

Systems and Control · Electrical Eng. & Systems 2021-08-20 Steven de Jongh , Sina Steinle , Anna Hlawatsch , Felicitas Mueller , Michael Suriyah , Thomas Leibfried

Imitation learning has emerged as a powerful paradigm in robot manipulation, yet its generalization capability remains constrained by object-specific dependencies in limited expert demonstrations. To address this challenge, we propose…

Robotics · Computer Science 2025-06-27 Zhuochen Miao , Jun Lv , Hongjie Fang , Yang Jin , Cewu Lu

We propose a data-driven approach for deep convolutional neural network compression that achieves high accuracy with high throughput and low memory requirements. Current network compression methods either find a low-rank factorization of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Breton Minnehan , Andreas Savakis

While existing depression prediction methods based on deep learning show promise, their practical application is hindered by the lack of trustworthiness, as these deep models are often deployed as black box models, leaving us uncertain on…

Machine Learning · Computer Science 2024-08-28 Yonghong Li , Xiuzhuang Zhou

Hyperspectral image (HSI) classification involves assigning unique labels to each pixel to identify various land cover categories. While deep classifiers have achieved high predictive accuracy in this field, they lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Kangdao Liu , Tianhao Sun , Hao Zeng , Yongshan Zhang , Chi-Man Pun , Chi-Man Vong

This paper presents a constraint-guided deep learning framework for developing physically consistent health indicators in bearing prognostics and health management. Conventional data-driven methods often lack physical plausibility, while…

Machine Learning · Computer Science 2025-03-13 Yonas Tefera , Quinten Van Baelen , Maarten Meire , Stijn Luca , Peter Karsmakers

Co-optimizing safety and performance in large-scale multi-agent systems remains a fundamental challenge. Existing approaches based on multi-agent reinforcement learning (MARL), safety filtering, or Model Predictive Control (MPC) either lack…

Robotics · Computer Science 2025-09-30 Manan Tayal , Aditya Singh , Shishir Kolathaya , Somil Bansal

This paper presents a deep learning based model predictive control algorithm for control affine nonlinear discrete time systems with matched and bounded state dependent uncertainties of unknown structure. Since the structure of…

Optimization and Control · Mathematics 2021-09-28 Prabhat K. Mishra , Mateus V. Gasparino , Andres E. B. Velsasquez , Girish Chowdhary

Reliable spacecraft attitude control depends on accurate prediction of attitude dynamics, particularly when model-based strategies such as Model Predictive Control (MPC) are employed, where performance is limited by the quality of the…

Robotics · Computer Science 2026-02-19 Carlo Cena , Mauro Martini , Marcello Chiaberge