English
Related papers

Related papers: A Comparative Study of Invariance-Aware Loss Funct…

200 papers

Estimation of a precision matrix (i.e., inverse covariance matrix) is widely used to exploit conditional independence among continuous variables. The influence of abnormal observations is exacerbated in a high dimensional setting as the…

Methodology · Statistics 2021-05-17 Peng Tang , Huijing Jiang , Heeyoung Kim , Xinwei Deng

We introduce a new second-order inertial optimization method for machine learning called INNA. It exploits the geometry of the loss function while only requiring stochastic approximations of the function values and the generalized…

Machine Learning · Computer Science 2021-08-17 Camille Castera , Jérôme Bolte , Cédric Févotte , Edouard Pauwels

Direction of arrival (DoA) estimation is a fundamental task in array processing. A popular family of DoA estimation algorithms are subspace methods, which operate by dividing the measurements into distinct signal and noise subspaces.…

Signal Processing · Electrical Eng. & Systems 2024-07-12 Dor H. Shmuel , Julian P. Merkofer , Guy Revach , Ruud J. G. van Sloun , Nir Shlezinger

In this work, we present direction-of-arrival (DoA) estimation algorithms based on the Krylov subspace that effectively exploit prior knowledge of the signals that impinge on a sensor array. The proposed multi-step knowledge-aided iterative…

Signal Processing · Electrical Eng. & Systems 2018-12-19 S. Pinto , R. C. de Lamare

This paper studies linear reconstruction of partially observed functional data which are recorded on a discrete grid. We propose a novel estimation approach based on approximate factor models with increasing rank taking into account…

Statistics Theory · Mathematics 2024-05-22 Maximilian Ofner , Siegfried Hörmann

An ambiguity-free direction-of-arrival (DOA) estimation scheme is proposed for sparse uniform linear arrays under low signal-to-noise ratios (SNRs) and non-stationary broadband signals. First, for achieving better DOA estimation performance…

Signal Processing · Electrical Eng. & Systems 2025-03-06 Wei Wang , Shefeng Yan , Linlin Mao , Zeping Sui , Jirui Yang

We conjecture that the inherent difference in generalisation between adaptive and non-adaptive gradient methods in deep learning stems from the increased estimation noise in the flattest directions of the true loss surface. We demonstrate…

Machine Learning · Statistics 2022-03-17 Diego Granziol , Nicholas Baskerville

Accurate image segmentation remains challenging, particularly in generating sharp, confident boundaries. While modern architectures have advanced the field, many of them still rely on standard loss functions like Cross-Entropy and Dice,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Adam Dawid Sztamborski , Raül Pérez-Gonzalo , Antonio Agudo

Modern deep models are often pretrained on large-scale data with missing labels using composite objectives, where the relative weights of multiple loss terms act as hyperparameters. Tuning these weights with random search or Bayesian…

Machine Learning · Computer Science 2026-05-11 Ivan Karpukhin , Andrey Savchenko

Direction of arrival (DoA) estimation is a common sensing problem in radar, sonar, audio, and wireless communication systems. It has gained renewed importance with the advent of the integrated sensing and communication paradigm. To fully…

The near-field effect of short-range multiple-input multiple-output (MIMO) systems imposes many challenges on direction-of-arrival (DoA) estimation. Most conventional scenarios assume that the far-field planar wavefronts hold. In this…

Signal Processing · Electrical Eng. & Systems 2020-07-22 Yashuai Cao , Tiejun Lv , Zhipeng Lin , Pingmu Huang , Fuhong Lin

Uncertainty estimation in large deep-learning models is a computationally challenging task, where it is difficult to form even a Gaussian approximation to the posterior distribution. In such situations, existing methods usually resort to a…

Machine Learning · Computer Science 2019-01-15 Aaron Mishkin , Frederik Kunstner , Didrik Nielsen , Mark Schmidt , Mohammad Emtiyaz Khan

In this paper, we address the problem of direction of arrival (DOA) estimation for multiple targets in the presence of sensor failures in a sparse array. Generally, sparse arrays are known with very high-resolution capabilities, where N…

Machine Learning · Computer Science 2023-06-22 Aya Mostafa Ahmed , Udaya S. K. P. Miriya Thanthrige , Aydin Sezgin , Fulvio Gini

Channel pruning, which seeks to reduce the model size by removing redundant channels, is a popular solution for deep networks compression. Existing channel pruning methods usually conduct layer-wise channel selection by directly minimizing…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Yiming Hu , Siyang Sun , Jianquan Li , Jiagang Zhu , Xingang Wang , Qingyi Gu

A blind Direction-of-Arrivals (DOAs) estimate of narrowband signals for Acoustic Vector-Sensor (AVS) arrays is proposed. Building upon the special structure of the signal measured by an AVS, we show that the covariance matrix of all the…

Signal Processing · Electrical Eng. & Systems 2020-12-17 Amir Weiss

Deep functional map frameworks are widely employed for 3D shape matching. However, most existing deep functional map methods cannot adaptively capture important frequency information for functional map estimation in specific matching…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Feifan Luo , Qinsong Li , Ling Hu , Haibo Wang , Xinru Liu , Shengjun Liu , Hongyang Chen

General-purpose planning algorithms for automated driving combine mission, behavior, and local motion planning. Such planning algorithms map features of the environment and driving kinematics into complex reward functions. To achieve this,…

Robotics · Computer Science 2020-09-17 Sascha Rosbach , Vinit James , Simon Großjohann , Silviu Homoceanu , Xing Li , Stefan Roth

Unsupervised Domain Adaptation Regression (DAR) aims to bridge the domain gap between a labeled source dataset and an unlabelled target dataset for regression problems. Recent works mostly focus on learning a deep feature encoder by…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Ismail Nejjar , Qin Wang , Olga Fink

This paper proposes a dynamic regression (DR) framework that enhances existing deep spatiotemporal models by incorporating structured learning for the error process in traffic forecasting. The framework relaxes the assumption of time…

Machine Learning · Computer Science 2025-04-09 Vincent Zhihao Zheng , Seongjin Choi , Lijun Sun

The importance of domain knowledge in enhancing model performance and making reliable predictions in the real-world is critical. This has led to an increased focus on specific model properties for interpretability. We focus on incorporating…

Machine Learning · Computer Science 2019-12-04 Akhil Gupta , Naman Shukla , Lavanya Marla , Arinbjörn Kolbeinsson , Kartik Yellepeddi