English
Related papers

Related papers: Optimal Multivariate Tuning with Neuron-Level and …

200 papers

Neural populations encode information about their stimulus in a collective fashion, by joint activity patterns of spiking and silence. A full account of this mapping from stimulus to neural activity is given by the conditional probability…

Neurons and Cognition · Quantitative Biology 2013-06-14 Einat Granot-Atedgi , Gašper Tkačik , Ronen Segev , Elad Schneidman

The firing dynamics of biological neurons in mathematical models is often determined by the model's parameters, representing the neurons' underlying properties. The parameter estimation problem seeks to recover those parameters of a single…

Neurons and Cognition · Quantitative Biology 2022-10-05 Long Le , Yao Li

Neuronal responses to complex stimuli and tasks can encompass a wide range of time scales. Understanding these responses requires measures that characterize how the information on these response patterns are represented across multiple…

Neurons and Cognition · Quantitative Biology 2019-12-23 Ryan John Cubero , Matteo Marsili , Yasser Roudi

We propose an optimal MMSE precoding technique using quantized signals with constant envelope. Unlike the existing MMSE design that relies on 1-bit resolution, the proposed approach employs uniform phase quantization and the bounding step…

Information Theory · Computer Science 2021-05-26 Erico S. P. Lopes , Lukas T. N. Landau

A mainstream type of current self-supervised learning methods pursues a general-purpose representation that can be well transferred to downstream tasks, typically by optimizing on a given pretext task such as instance discrimination. In…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Xin Liu , Zhongdao Wang , Yali Li , Shengjin Wang

Precise spike timing as a means to encode information in neural networks is biologically supported, and is advantageous over frequency-based codes by processing input features on a much shorter time-scale. For these reasons, much recent…

Neural and Evolutionary Computing · Computer Science 2016-10-31 Brian Gardner , André Grüning

In this paper, the problem of training optimization for estimating a multiple-input multiple-output (MIMO) flat fading channel in the presence of spatially and temporally correlated Gaussian noise is studied in an application-oriented…

We address the problem of automatically finding the parameters of a statistical machine translation system that maximize BLEU scores while ensuring that decoding speed exceeds a minimum value. We propose the use of Bayesian Optimization to…

Computation and Language · Computer Science 2016-04-19 Daniel Beck , Adrià de Gispert , Gonzalo Iglesias , Aurelien Waite , Bill Byrne

Maximizing the precision in estimating parameters in a quantum system subject to instrumentation constraints is cast as a convex optimization problem. We account for prior knowledge about the parameter range by developing a worst-case and…

Quantum Physics · Physics 2008-04-01 Robert L. Kosut

Feedback communication is studied from a control-theoretic perspective, mapping the communication problem to a control problem in which the control signal is received through the same noisy channel as in the communication problem, and the…

Information Theory · Computer Science 2010-06-29 Ehsan Ardestanizadeh , Massimo Franceschetti

The weight decay regularization term is widely used during training to constrain expressivity, avoid overfitting, and improve generalization. Historically, this concept was borrowed from the SVM maximum margin principle and extended to…

Machine Learning · Computer Science 2021-10-12 Berry Weinstein , Shai Fine , Yacov Hel-Or

The maximum-entropy sampling problem is a fundamental and challenging combinatorial-optimization problem, with application in spatial statistics. It asks to find a maximum-determinant order-$s$ principal submatrix of an order-$n$ covariance…

Optimization and Control · Mathematics 2020-02-03 Zhongzhu Chen , Marcia Fampa , Amélie Lambert , Jon Lee

Resource allocation and transceivers in wireless networks are usually designed by solving optimization problems subject to specific constraints, which can be formulated as variable or functional optimization. If the objective and constraint…

Machine Learning · Computer Science 2020-01-06 Dong Liu , Chengjian Sun , Chenyang Yang , Lajos Hanzo

This work presents a machine learning approach to optimize the energy efficiency (EE) in a multi-cell wireless network. This optimization problem is non-convex and its global optimum is difficult to find. In the literature, either simple…

Signal Processing · Electrical Eng. & Systems 2023-12-18 Bile Peng , Karl-Ludwig Besser , Ramprasad Raghunath , Eduard A. Jorswieck

Chance constrained optimization problems allow to model problems where constraints involving stochastic components should only be violated with a small probability. Evolutionary algorithms have been applied to this scenario and shown to…

Neural and Evolutionary Computing · Computer Science 2024-08-23 Frank Neumann , Carsten Witt

For the last few decades, optimization has been developing at a fast rate. Bio-inspired optimization algorithms are metaheuristics inspired by nature. These algorithms have been applied to solve different problems in engineering, economics,…

Artificial Intelligence · Computer Science 2014-07-17 Muhammad Marwan Muhammad Fuad

Optimization problems with both control variables and environmental variables arise in many fields. This paper introduces a framework of personalized optimization to han- dle such problems. Unlike traditional robust optimization,…

Computation · Statistics 2016-07-07 Shifeng Xiong

Inference scaling helps LLMs solve complex reasoning problems through extended runtime computation. On top of long chain-of-thought (long-CoT) models, purely inference-time techniques such as best-of-N (BoN) sampling, majority voting, or…

In continuation to a recent work on the statistical--mechanical analysis of minimum mean square error (MMSE) estimation in Gaussian noise via its relation to the mutual information (the I-MMSE relation), here we propose a simple and more…

Information Theory · Computer Science 2016-11-17 Neri Merhav

We investigate the choice of tuning parameters for a Bayesian multi-level group lasso model developed for the joint analysis of neuroimaging and genetic data. The regression model we consider relates multivariate phenotypes consisting of…

Machine Learning · Statistics 2016-03-29 Farouk S. Nathoo , Keelin Greenlaw , Mary Lesperance