English
Related papers

Related papers: A parameterized activation function for learning f…

200 papers

A key challenge in eXplainable Artificial Intelligence is the well-known tradeoff between the transparency of an algorithm (i.e., how easily a human can directly understand the algorithm, as opposed to receiving a post-hoc explanation), and…

Artificial Intelligence · Computer Science 2024-03-19 Mojtaba Yeganejou , Kimia Honari , Ryan Kluzinski , Scott Dick , Michael Lipsett , James Miller

Despite the remarkable success of deep learning in pattern recognition, deep network models face the problem of training a large number of parameters. In this paper, we propose and evaluate a novel multi-path wavelet neural network…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 D. D. N. De Silva , H. W. M. K. Vithanage , K. S. D. Fernando , I. T. S. Piyatilake

The methods of extracting image features are the key to many image processing tasks. At present, the most popular method is the deep neural network which can automatically extract robust features through end-to-end training instead of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Xiang Ma , Liangzhe Chen , Zhaohong Deng , Peng Xu , Qisheng Yan , Kup-Sze Choi , Shitong Wang

In tis paper we consider approaches for time series forecasting based on deep neural networks and neuro-fuzzy nets. Also, we make short review of researches in forecasting based on various models of ANFIS models. Deep Learning has proven to…

Neural and Evolutionary Computing · Computer Science 2020-11-12 Alexey Averkin , Sergey Yarushev

In this work we are analyzing scalability of the heuristic algorithm we used in the past to discover knowledge from multi-valued symbolic attributes in fuzzy databases. The non-atomic descriptors, characterizing a single attribute of a…

Databases · Computer Science 2011-03-31 M. Shahriar Hossain , Rafal A. Angryk

Computer vision applications are omnipresent nowadays. The current paper explores the use of fuzzy logic in computer vision, stressing its role in handling uncertainty, noise, and imprecision in image data. Fuzzy logic is able to model…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Adilet Yerkin , Ayan Igali , Elnara Kadyrgali , Maksat Shagyrov , Malika Ziyada , Muragul Muratbekova , Pakizar Shamoi

We study mechanisms to characterize how the asymptotic convergence of backpropagation in deep architectures, in general, is related to the network structure, and how it may be influenced by other design choices including activation type,…

Machine Learning · Computer Science 2017-03-02 Vamsi K Ithapu , Sathya N Ravi , Vikas Singh

Deep neural networks have achieved impressive supervised classification performance in many tasks including image recognition, speech recognition, and sequence to sequence learning. However, this success has not been translated to…

Machine Learning · Computer Science 2016-08-05 Arvind Neelakantan , Quoc V. Le , Ilya Sutskever

Active localization is the problem of generating robot actions that allow it to maximally disambiguate its pose within a reference map. Traditional approaches to this use an information-theoretic criterion for action selection and…

Robotics · Computer Science 2019-03-06 Sai Krishna , Keehong Seo , Dhaivat Bhatt , Vincent Mai , Krishna Murthy , Liam Paull

By bridging deep networks and physics, the programme of geometrization of deep networks was proposed as a framework for the interpretability of deep learning systems. Following this programme we can apply two key ideas of physics, the…

Machine Learning · Computer Science 2019-07-16 X. Dong , L. Zhou

The AI community is increasingly focused on merging logic with deep learning to create Neuro-Symbolic (NeSy) paradigms and assist neural approaches with symbolic knowledge. A significant trend in the literature involves integrating axioms…

Artificial Intelligence · Computer Science 2023-06-27 Samy Badreddine , Luciano Serafini , Michael Spranger

Fractional gradient descent has been studied extensively, with a focus on its ability to extend traditional gradient descent methods by incorporating fractional-order derivatives. This approach allows for more flexibility in navigating…

Machine Learning · Computer Science 2024-11-25 Teodor Alexandru Szente , James Harrison , Mihai Zanfir , Cristian Sminchisescu

The training process of neural networks usually optimize weights and bias parameters of linear transformations, while nonlinear activation functions are pre-specified and fixed. This work develops a systematic approach to constructing…

Machine Learning · Computer Science 2024-10-29 Zhengqi Liu , Shuhao Cao , Yuwen Li , Ludmil Zikatanov

Most stochastic gradient descent algorithms can optimize neural networks that are sub-differentiable in their parameters; however, this implies that the neural network's activation function must exhibit a degree of continuity which limits…

Neural and Evolutionary Computing · Computer Science 2021-12-16 Anastasis Kratsios , Behnoosh Zamanlooy

The paper investigates the properties of a fuzzy logic of typicality. The extension of fuzzy logic with a typicality operator was proposed in recent work to define a fuzzy multipreference semantics for Multilayer Perceptrons, by regarding…

Artificial Intelligence · Computer Science 2021-07-15 Laura Giordano

As recommender systems become increasingly complex, transparency is essential to increase user trust, accountability, and regulatory compliance. Neuro-symbolic approaches that integrate symbolic reasoning with sub-symbolic learning offer a…

Machine Learning · Computer Science 2025-05-12 Stephan Bartl , Kevin Innerebner , Elisabeth Lex

Recent years have witnessed the great success of deep neural networks in many research areas. The fundamental idea behind the design of most neural networks is to learn similarity patterns from data for prediction and inference, which lacks…

Artificial Intelligence · Computer Science 2019-10-22 Shaoyun Shi , Hanxiong Chen , Min Zhang , Yongfeng Zhang

In the paper, we show that quantum logic of linear subspaces can be used for recognition of random signals by a Bayesian energy discriminant classifier. The energy distribution on linear subspaces is described by the correlation matrix of…

Quantum Physics · Physics 2011-11-10 Grigorii Melnichenko

We propose a sequential Monte Carlo algorithm for parameter learning when the studied model exhibits random discontinuous jumps in behaviour. To facilitate the learning of high dimensional parameter sets, such as those associated to neural…

Machine Learning · Statistics 2024-12-19 John-Joseph Brady , Yuhui Luo , Wenwu Wang , Víctor Elvira , Yunpeng Li

The combination of neural network and fuzzy systems into neuro-fuzzy systems integrates fuzzy reasoning rules into the connectionist networks. However, the existing neuro-fuzzy systems are developed under shallow structures having lower…

Neural and Evolutionary Computing · Computer Science 2020-01-07 Omolbanin Yazdanbakhsh , Scott Dick