English
Related papers

Related papers: From Two-Class Linear Discriminant Analysis to Int…

200 papers

We propose a planning and perception mechanism for a robot (agent), that can only observe the underlying environment partially, in order to solve an image classification problem. A three-layer architecture is suggested that consists of a…

Machine Learning · Computer Science 2019-09-24 Hossein K. Mousavi , Guangyi Liu , Weihang Yuan , Martin Takáč , Héctor Muñoz-Avila , Nader Motee

Implicit neural fields, typically encoded by a multilayer perceptron (MLP) that maps from coordinates (e.g., xyz) to signals (e.g., signed distances), have shown remarkable promise as a high-fidelity and compact representation. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Ziya Erkoç , Fangchang Ma , Qi Shan , Matthias Nießner , Angela Dai

We analytically derive the geometrical structure of the weight space in multilayer neural networks (MLN), in terms of the volumes of couplings associated to the internal representations of the training set. Focusing on the parity and…

Condensed Matter · Physics 2016-08-31 R. Monasson , R. Zecchina

Studying the complex interactions between different brain regions is crucial in neuroscience. Various statistical methods have explored the latent communication across multiple brain regions. Two main categories are the Gaussian Process…

Neurons and Cognition · Quantitative Biology 2024-05-31 Weihan Li , Chengrui Li , Yule Wang , Anqi Wu

Most contemporary multi-task learning methods assume linear models. This setting is considered shallow in the era of deep learning. In this paper, we present a new deep multi-task representation learning framework that learns cross-task…

Machine Learning · Computer Science 2017-02-20 Yongxin Yang , Timothy Hospedales

Many real world data are sampled functions. As shown by Functional Data Analysis (FDA) methods, spectra, time series, images, gesture recognition data, etc. can be processed more efficiently if their functional nature is taken into account…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Fabrice Rossi , Brieuc Conan-Guez

Multi-label classification (MLC) refers to the problem of tagging a given instance with a set of relevant labels. Most existing MLC methods are based on the assumption that the correlation of two labels in each label pair is symmetric,…

Machine Learning · Computer Science 2024-10-04 Xingyu Zhao , Yuexuan An , Lei Qi , Xin Geng

We show that for unconstrained Deep Linear Discriminant Analysis (LDA) classifiers, maximum-likelihood training admits pathological solutions in which class means drift together, covariances collapse, and the learned representation becomes…

Machine Learning · Statistics 2026-01-06 Maxat Tezekbayev , Rustem Takhanov , Arman Bolatov , Zhenisbek Assylbekov

This paper gives the definition of Transparent Neural Network "TNN" for the simulation of the globallocal vision and its application to the segmentation of administrative document image. We have developed and have adapted a recognition…

Computer Vision and Pattern Recognition · Computer Science 2013-10-29 Boulbaba Ben Ammar

Differentiable Logic Gate Networks (DLGNs) are a very fast and energy-efficient alternative to conventional feed-forward networks. With learnable combinations of logical gates, DLGNs enable fast inference by hardware-friendly execution.…

Machine Learning · Computer Science 2025-10-01 Sven Brändle , Till Aczel , Andreas Plesner , Roger Wattenhofer

This work concerns estimation of multidimensional nonlinear regression models using multilayer perceptron (MLP). The main problem with such model is that we have to know the covariance matrix of the noise to get optimal estimator. however…

Statistics Theory · Mathematics 2008-02-22 Joseph Rynkiewicz

Multimodal Large Language Models (MLLMs) have demonstrated strong performance across a wide range of vision-language tasks, yet their internal processing dynamics remain underexplored. In this work, we introduce a probing framework to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zhuoran Yu , Yong Jae Lee

Due to their weak inductive bias, Multi-Layer Perceptrons (MLPs) have subpar performance at low-compute levels compared to standard architectures such as convolution-based networks (CNN). Recent work, however, has shown that the performance…

Machine Learning · Computer Science 2024-10-15 Sean Wu , Jordan Hong , Keyu Bai , Gregor Bachmann

Label distribution learning (LDL) is a general learning framework, which assigns to an instance a distribution over a set of labels rather than a single label or multiple labels. Current LDL methods have either restricted assumptions on the…

Machine Learning · Computer Science 2017-10-18 Wei Shen , Kai Zhao , Yilu Guo , Alan Yuille

Multimodal Large Language Models (MLLMs) are increasingly applied to pixel-level vision tasks, yet their intrinsic capacity for spatial understanding remains poorly understood. We investigate segmentation capacity through a layerwise linear…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Boyong Wu , Sanghwan Kim , Zeynep Akata

We review the use of artificial neural networks, particularly the feedforward multilayer perceptron with back-propagation for training (MLP), in ecological modelling. Overtraining on data or giving vague references to how it was avoided is…

Populations and Evolution · Quantitative Biology 2011-07-29 Stacy L. Ozesmi , Uygar Ozesmi , Can Ozan Tan

A Hyperspectral image contains much more number of channels as compared to a RGB image, hence containing more information about entities within the image. The convolutional neural network (CNN) and the Multi-Layer Perceptron (MLP) have been…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Uphar Singh , Kumar Saurabh , Neelaksh Trehan , Ranjana Vyas , O. P. Vyas

This paper introduces Multidimensional Task Learning (MTL), a unified mathematical framework based on Generalized Einstein MLPs (GE-MLPs) that operate directly on tensors via the Einstein product. We argue that current computer vision task…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Alaa El Ichi , Khalide Jbilou

In this paper, we propose a probabilistic representation of MultiLayer Perceptrons (MLPs) to improve the information-theoretic interpretability. Above all, we demonstrate that the activations being i.i.d. is not valid for all the hidden…

Machine Learning · Computer Science 2020-10-28 Xinjie Lan , Kenneth E. Barner

The Transformer architecture has dominated machine learning in a wide range of tasks. The specific characteristic of this architecture is an expensive scaled dot-product attention mechanism that models the inter-token interactions, which is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zizhao Hu , Mohammad Rostami