English
Related papers

Related papers: Enhancing classification accuracy through chaos

200 papers

Modern deep learning continues to achieve outstanding performance on an astounding variety of high-dimensional tasks. In practice, this is obtained by fitting deep neural models to all the input data with minimal feature engineering, thus…

Neural and Evolutionary Computing · Computer Science 2024-08-21 Yelleti Vivek , Sri Krishna Vadlamani , Vadlamani Ravi , P. Radha Krishna

Recently, learning discriminative features to improve the recognition performances gradually becomes the primary goal of deep learning, and numerous remarkable works have emerged. In this paper, we propose a novel yet extremely simple…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Binghui Chen , Weihong Deng , Haifeng Shen

We propose DropMax, a stochastic version of softmax classifier which at each iteration drops non-target classes according to dropout probabilities adaptively decided for each instance. Specifically, we overlay binary masking variables over…

Machine Learning · Computer Science 2018-11-05 Hae Beom Lee , Juho Lee , Saehoon Kim , Eunho Yang , Sung Ju Hwang

We present a latent variable model for classification that provides a novel probabilistic interpretation of neural network softmax classifiers. We derive a variational objective to train the model, analogous to the evidence lower bound…

Machine Learning · Computer Science 2024-01-10 Shehzaad Dhuliawala , Mrinmaya Sachan , Carl Allen

Chaos presents complex dynamics arising from nonlinearity and a sensitivity to initial states. These characteristics suggest a depth of expressivity that underscores their potential for advanced computational applications. However,…

Neural and Evolutionary Computing · Computer Science 2024-06-06 Shuhong Liu , Nozomi Akashi , Qingyao Huang , Yasuo Kuniyoshi , Kohei Nakajima

Polynomial chaos based methods enable the efficient computation of output variability in the presence of input uncertainty in complex models. Consequently, they have been used extensively for propagating uncertainty through a wide variety…

Optimization and Control · Mathematics 2020-09-18 Tuhin Sahai

We propose a new scalable multi-class Gaussian process classification approach building on a novel modified softmax likelihood function. The new likelihood has two benefits: it leads to well-calibrated uncertainty estimates and allows for…

Machine Learning · Statistics 2019-05-24 Théo Galy-Fajou , Florian Wenzel , Christian Donner , Manfred Opper

We demonstrate the presence of chaos in stochastic simulations that are widely used to study biodiversity in nature. The investigation deals with a set of three distinct species that evolve according to the standard rules of mobility,…

Biological Physics · Physics 2017-03-28 D. Bazeia , M. B. P. N. Pereira , A. V. Brito , B. F. de Oliveira , J. G. G. S. Ramos

The success of contrastive learning is well known to be dependent on data augmentation. Although the degree of data augmentations has been well controlled by utilizing pre-defined techniques in some domains like vision, time-series data…

Machine Learning · Computer Science 2023-12-22 Berken Utku Demirel , Christian Holz

Neural networks utilize the softmax as a building block in classification tasks, which contains an overconfidence problem and lacks an uncertainty representation ability. As a Bayesian alternative to the softmax, we consider a random…

Machine Learning · Computer Science 2020-06-30 Taejong Joo , Uijung Chung , Min-Gwan Seo

Polynomial Chaos Expansions represent a powerful tool to simulate stochastic models of dynamical systems. Yet, deriving the expansion's coefficients for complex systems might require a significant and non-trivial manipulation of the model,…

Computation · Statistics 2012-11-13 Lorenzo Fagiano , Mustafa Khammash

Deterministic chaos permits a precise notion of a "perfect measurement" as one that, when obtained repeatedly, captures all of the information created by the system's evolution with minimal redundancy. Finding an optimal measurement is…

Machine Learning · Computer Science 2024-03-21 Kieran A. Murphy , Dani S. Bassett

Cross-entropy loss with softmax output is a standard choice to train neural network classifiers. We give a new view of neural network classifiers with softmax and cross-entropy as mutual information evaluators. We show that when the dataset…

Machine Learning · Computer Science 2021-08-17 Zhenyue Qin , Dongwoo Kim , Tom Gedeon

Deep classifiers have achieved great success in visual recognition. However, real-world data is long-tailed by nature, leading to the mismatch between training and testing distributions. In this paper, we show that the Softmax function,…

Machine Learning · Computer Science 2020-11-24 Jiawei Ren , Cunjun Yu , Shunan Sheng , Xiao Ma , Haiyu Zhao , Shuai Yi , Hongsheng Li

We use standard deep neural networks to classify univariate time series generated by discrete and continuous dynamical systems based on their chaotic or non-chaotic behaviour. Our approach to circumvent the lack of precise models for some…

Signal Processing · Electrical Eng. & Systems 2020-02-26 Nicolas Boullé , Vassilios Dallas , Yuji Nakatsukasa , D. Samaddar

The softmax function is widely used in artificial neural networks for the multiclass classification problems, where the softmax transformation enforces the output to be positive and sum to one, and the corresponding loss function allows to…

Machine Learning · Computer Science 2021-12-24 Shaoshi Sun , Zhenyuan Zhang , BoCheng Huang , Pengbin Lei , Jianlin Su , Shengfeng Pan , Jiarun Cao

Selective classifiers improve model reliability by abstaining on inputs the model deems uncertain. However, few practical approaches achieve the gold-standard performance of a perfect-ordering oracle that accepts examples exactly in order…

Machine Learning · Computer Science 2025-10-27 Stephan Rabanser , Nicolas Papernot

This study redefines the analysis of Devaney chaos in multiple mappings from a set-valued perspective and introduces new conditions to characterize their chaotic behavior. As an innovative advancement, we develop computational algorithms to…

Chaotic Dynamics · Physics 2024-09-27 Illych Alvarez , Ivonne Leon , Ivy Peña

Chaos is an intriguing phenomenon that can be found in an immense variate of systems. Its detection and discrimination from its counterpart order poses an interesting challenge. To address it, we present a deep classifier capable of…

Adaptation and Self-Organizing Systems · Physics 2024-02-20 Ippocratis D. Saltas , Georgios Lukes-Gerakopoulos

A novel technique for deep learning of image classifiers is presented. The learned CNN models offer better separation of deep features (also known as embedded vectors) measured by Euclidean proximity and also no deterioration of the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Rafal Pilarczyk , Wladyslaw Skarbek
‹ Prev 1 2 3 10 Next ›