English
Related papers

Related papers: Contextual Optimizer through Neighborhood Estimati…

200 papers

In this work, we develop proximal preconditioned gradient methods with a focus on spectral gradient methods providing a proximal extension to the Muon and Scion optimizers. We introduce a family of stochastic algorithms that can handle a…

We conduct an empirical study to test the ability of Convolutional Neural Networks (CNNs) to reduce the effects of nuisance transformations of the input data, such as location, scale and aspect ratio. We isolate factors by adopting a common…

Computer Vision and Pattern Recognition · Computer Science 2016-04-29 Nikolaos Karianakis , Jingming Dong , Stefano Soatto

Image classification is a longstanding problem in computer vision and machine learning research. Most recent works (e.g. SupCon , Triplet, and max-margin) mainly focus on grouping the intra-class samples aggressively and compactly, with the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Mingkai Zheng , Shan You , Lang Huang , Xiu Su , Fei Wang , Chen Qian , Xiaogang Wang , Chang Xu

Accurate spatio-temporal prediction is crucial for the sustainable development of smart cities. However, current approaches often struggle to capture important spatio-temporal relationships, particularly overlooking global relations among…

Machine Learning · Computer Science 2024-11-12 Ashutosh Sao , Simon Gottschalk

Many decision-making processes involve solving a combinatorial optimization problem with uncertain input that can be estimated from historic data. Recently, problems in this class have been successfully addressed via end-to-end learning…

Machine Learning · Computer Science 2021-07-07 Maxime Mulamba , Jayanta Mandi , Michelangelo Diligenti , Michele Lombardi , Victor Bucarey , Tias Guns

This paper introduces a framework for uncertainty quantification in regression models defined in metric spaces. Leveraging a newly defined notion of homoscedasticity, we develop a conformal prediction algorithm that offers finite-sample…

Machine Learning · Statistics 2025-07-22 Gábor Lugosi , Marcos Matabuena

For best performance, today's semantic segmentation methods use large and carefully labeled datasets, requiring expensive annotation budgets. In this work, we show that coarse annotation is a low-cost but highly effective alternative for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Anurag Das , Yongqin Xian , Yang He , Zeynep Akata , Bernt Schiele

The goal of this work is to localize sound sources in visual scenes with a self-supervised approach. Contrastive learning in the context of sound source localization leverages the natural correspondence between audio and visual signals…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Sooyoung Park , Arda Senocak , Joon Son Chung

Subset selection is a fundamental problem in combinatorial optimization, which has a wide range of applications such as influence maximization and sparse regression. The goal is to select a subset of limited size from a ground set in order…

Neural and Evolutionary Computing · Computer Science 2026-04-22 Yiheng Xu , Danxuan Liu , Bin Zhang , Weiyong Yang , Chao Qian

There are multiple applications to automatically count people and specify their gender at work, exhibitions, malls, sales, and industrial usage. Although current speech detection methods are supposed to operate well, in most situations, in…

Sound · Computer Science 2024-07-23 Praveen Damacharla , Hamid Rajabalipanah , Mohammad Hosein Fakheri

Based on stochastic differential equations (SDEs), we analyse the overall performance of heterogeneous power systems network, subject to spatially distributed and correlated noise with random initial conditions. We determine bounds on the…

Optimization and Control · Mathematics 2021-11-22 Taouba Jouini , Zhiyong Sun

The problem of monotone submodular maximization has been studied extensively due to its wide range of applications. However, there are cases where one can only access the objective function in a distorted or noisy form because of the…

Data Structures and Algorithms · Computer Science 2022-10-24 Lingxiao Huang , Yuyi Wang , Chunxue Yang , Huanjian Zhou

Existing learning-based denoising methods typically train models to generalize the image prior from large-scale datasets, suffering from the variability in noise distributions encountered in real-world scenarios. In this work, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-31 Yuanfei Huang , Hua Huang

We address the problem of policy selection in contextual stochastic optimization (CSO), where covariates are available as contextual information and decisions must satisfy hard feasibility constraints. In many CSO settings, multiple…

Machine Learning · Computer Science 2026-05-29 Caio de Prospero Iglesias , Kimberly Villalobos Carballo , Dimitris Bertsimas

Bayesian optimization (BO) is a sample-efficient method and has been widely used for optimizing expensive black-box functions. Recently, there has been a considerable interest in BO literature in optimizing functions that are affected by…

Machine Learning · Computer Science 2023-12-22 Xiaobin Huang , Lei Song , Ke Xue , Chao Qian

Magnetoencephalography (MEG) and Electroencephalography (EEG) source estimates have thus far mostly been derived sample by sample, i.e., independent of each other in time. However, neuronal assemblies are heavily interconnected,…

Quantitative Methods · Quantitative Biology 2019-09-09 Christoph Dinh , John GW Samuelsson , Alexander Hunold , Matti S Hämäläinen , Sheraz Khan

We study a linear contextual optimization problem where a decision maker has access to historical data and contextual features to learn a cost prediction model aimed at minimizing decision error. We adopt the predict-then-optimize framework…

Optimization and Control · Mathematics 2025-04-09 Omar Bennouna , Jiawei Zhang , Saurabh Amin , Asuman Ozdaglar

There are many models, often called unnormalized models, whose normalizing constants are not calculated in closed form. Maximum likelihood estimation is not directly applicable to unnormalized models. Score matching, contrastive divergence…

Machine Learning · Statistics 2018-08-27 Masatoshi Uehara , Takeru Matsuda , Fumiyasu Komaki

Contextual biasing improves automatic speech recognition (ASR) by integrating external knowledge, such as user-specific phrases or entities, during decoding. In this work, we use an attention-based biasing decoder to produce scores for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-29 Wanting Huang , Weiran Wang

One of the biggest challenges of acoustic scene classification (ASC) is to find proper features to better represent and characterize environmental sounds. Environmental sounds generally involve more sound sources while exhibiting less…

Sound · Computer Science 2019-04-11 Hongwei Song , Jiqing Han , Shiwen Deng