English
Related papers

Related papers: Scaling Symbolic Methods using Gradients for Neura…

200 papers

Semantic similarity measures (SSMs) refer to a set of algorithms used to quantify the similarity of two or more terms belonging to the same ontology. Ontology terms may be associated to concepts, for instance in computational biology gene…

Molecular Networks · Quantitative Biology 2013-05-22 Pietro Hiram Guzzi , Simone Truglia , Pierangelo Veltri , Mario Cannataro

Machine learning techniques using neural networks have achieved promising success for time-series data classification. However, the models that they produce are challenging to verify and interpret. In this paper, we propose an explainable…

Formal Languages and Automata Theory · Computer Science 2023-07-04 Danyang Li , Mingyu Cai , Cristian-Ioan Vasile , Roberto Tron

Feature attribution methods, or saliency maps, are one of the most popular approaches for explaining the decisions of complex machine learning models such as deep neural networks. In this study, we propose a stochastic optimization approach…

Machine Learning · Statistics 2018-07-17 Kouichi Ikeno , Satoshi Hara

Recent advances in methods focused on the grounding problem have resulted in techniques that can be used to construct a symbolic language associated with a specific domain. Inspired by how humans communicate complex ideas through language,…

Artificial Intelligence · Computer Science 2020-08-06 Alberto Santamaria-Pang , James Kubricht , Aritra Chowdhury , Chitresh Bhushan , Peter Tu

This paper reviews the gradient sampling methodology for solving nonsmooth, nonconvex optimization problems. An intuitively straightforward gradient sampling algorithm is stated and its convergence properties are summarized. Throughout this…

Optimization and Control · Mathematics 2018-05-01 James V. Burke , Frank E. Curtis , Adrian S. Lewis , Michael L. Overton , Lucas E. A. Simões

CAM-based methods are widely-used post-hoc interpretability method that produce a saliency map to explain the decision of an image classification model. The saliency map highlights the important areas of the image relevant to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Magamed Taimeskhanov , Ronan Sicre , Damien Garreau

To mitigate the negative effect of low quality training data on the performance of neural machine translation models, most existing strategies focus on filtering out harmful data before training starts. In this paper, we explore strategies…

Computation and Language · Computer Science 2021-03-01 Xinyi Wang , Ankur Bapna , Melvin Johnson , Orhan Firat

Strategic classification~(SC) explores how individuals or entities modify their features strategically to achieve favorable classification outcomes. However, existing SC methods, which are largely based on linear models or shallow neural…

Saliency prediction is a well studied problem in computer vision. Early saliency models were based on low-level hand-crafted feature derived from insights gained in neuroscience and psychophysics. In the wake of deep learning breakthrough,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Sen He , Nicolas Pugeault

A fundamental question for understanding brain function is what types of stimuli drive neurons to fire. In visual neuroscience, this question has also been posted as characterizing the receptive field of a neuron. The search for effective…

Neurons and Cognition · Quantitative Biology 2020-09-01 Will Xiao , Gabriel Kreiman

Analogical Reasoning problems challenge both connectionist and symbolic AI systems as these entail a combination of background knowledge, reasoning and pattern recognition. While symbolic systems ingest explicit domain knowledge and perform…

Artificial Intelligence · Computer Science 2022-09-20 Vishwa Shah , Aditya Sharma , Gautam Shroff , Lovekesh Vig , Tirtharaj Dash , Ashwin Srinivasan

Currently, existing efforts in Weakly Supervised Semantic Segmentation (WSSS) based on Convolutional Neural Networks (CNNs) have predominantly focused on enhancing the multi-label classification network stage, with limited attention given…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Jia Zhang , Bo Peng , Xi Wu

Conventional neural network elastoplasticity models are often perceived as lacking interpretability. This paper introduces a two-step machine learning approach that returns mathematical models interpretable by human experts. In particular,…

Computational Engineering, Finance, and Science · Computer Science 2024-02-09 Bahador Bahmani , Hyoung Suk Suh , WaiChing Sun

Symbolic indefinite integration in Computer Algebra Systems such as Maple involves selecting the most effective algorithm from multiple available methods. Not all methods will succeed for a given problem, and when several do, the results,…

Symbolic Computation · Computer Science 2025-08-11 Rashid Barket , Matthew England , Jürgen Gerhard

This paper establishes the theoretical foundations of the online scaled gradient methods (OSGM), a framework that utilizes online learning to adapt stepsizes and provably accelerate first-order methods. OSGM quantifies the effectiveness of…

Optimization and Control · Mathematics 2025-09-08 Wenzhi Gao , Ya-Chi Chu , Yinyu Ye , Madeleine Udell

Low-rank matrix estimation is a canonical problem that finds numerous applications in signal processing, machine learning and imaging science. A popular approach in practice is to factorize the matrix into two compact low-rank factors, and…

Machine Learning · Computer Science 2021-06-16 Tian Tong , Cong Ma , Yuejie Chi

The goal of neuro-symbolic AI is to integrate symbolic and subsymbolic AI approaches, to overcome the limitations of either. Prominent systems include Logic Tensor Networks (LTN) or DeepProbLog, which offer neural predicates and end-to-end…

Artificial Intelligence · Computer Science 2025-06-18 Stephen Roth , Lennart Baur , Derian Boer , Stefan Kramer

Saliency maps have become a widely used method to make deep learning models more interpretable by providing post-hoc explanations of classifiers through identification of the most pertinent areas of the input medical image. They are…

The recent success of implicit neural scene representations has presented a viable new method for how we capture and store 3D scenes. Unlike conventional 3D representations, such as point clouds, which explicitly store scene properties in…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Amit Kohli , Vincent Sitzmann , Gordon Wetzstein

Growing interest in modelling complex systems from brains to societies to cities using networks has led to increased efforts to describe generative processes that explain those networks. Recent successes in machine learning have prompted…

Neural and Evolutionary Computing · Computer Science 2024-01-12 Govind Gandhi