English
Related papers

Related papers: Mean Absolute Directional Loss as a New Loss Funct…

200 papers

This paper investigates the impact of the loss function in value-based methods for reinforcement learning through an analysis of underlying prediction objectives. We theoretically show that mean absolute error is a better prediction…

Machine Learning · Computer Science 2025-11-11 Alex Ayoub , David Szepesvári , Alireza Bakhtiari , Csaba Szepesvári , Dale Schuurmans

Multi-task learning (MTL) is a subfield of machine learning with important applications, but the multi-objective nature of optimization in MTL leads to difficulties in balancing training between tasks. The best MTL optimization methods…

Machine Learning · Computer Science 2021-09-20 Michael Crawshaw , Jana Košecká

Empirical Risk Minimization (ERM) based machine learning algorithms have suffered from weak generalization performance on data obtained from out-of-distribution (OOD). To address this problem, Invariant Risk Minimization (IRM) objective was…

Machine Learning · Computer Science 2021-03-25 Jun-Hyun Bae , Inchul Choi , Minho Lee

Deep-learning architectures for classification problems involve the cross-entropy loss sometimes assisted with auxiliary loss functions like center loss, contrastive loss and triplet loss. These auxiliary loss functions facilitate better…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Hongjun Choi , Anirudh Som , Pavan Turaga

This research paper explores the performance of Machine Learning (ML) algorithms and techniques that can be used for financial asset price forecasting. The prediction and forecasting of asset prices and returns remains one of the most…

Statistical Finance · Quantitative Finance 2020-04-06 Philip Ndikum

Multi-task learning (MTL) can improve performance on a task by sharing representations with one or more related auxiliary-tasks. Usually, MTL-networks are trained on a composite loss function formed by a constant weighted combination of the…

Machine Learning · Computer Science 2020-08-31 Sam Verboven , Muhammad Hafeez Chaudhary , Jeroen Berrevoets , Wouter Verbeke

Deep learning has recently demonstrated its excellent performance on the task of multi-view stereo (MVS). However, loss functions applied for deep MVS are rarely studied. In this paper, we first analyze existing loss functions' properties…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Qinglu Min , Jie Zhao , Zhihao Zhang , Chen Min

Objective functions that optimize deep neural networks play a vital role in creating an enhanced feature representation of the input data. Although cross-entropy-based loss formulations have been extensively used in a variety of supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Deen Dayal Mohan , Bhavin Jawade , Srirangaraj Setlur , Venu Govindaraj

We propose two numerical methods for the optimal control of McKean-Vlasov dynamics in finite time horizon. Both methods are based on the introduction of a suitable loss function defined over the parameters of a neural network. This allows…

Optimization and Control · Mathematics 2021-03-31 René Carmona , Mathieu Laurière

Training neural networks requires optimizing a loss function that may be highly irregular, and in particular neither convex nor smooth. Popular training algorithms are based on stochastic gradient descent with momentum (SGDM), for which…

Machine Learning · Computer Science 2026-03-17 Qinzi Zhang , Ashok Cutkosky

Given a financial time series data, one of the most fundamental and interesting challenges is the need to learn the stock dynamics signals in a financial time series data. A good example is to represent the time series in line segments…

Computational Engineering, Finance, and Science · Computer Science 2021-01-05 Chi-Jen Wu , Wei-Sheng Zeng , Jan-Ming Ho

This paper presents a new loss function for the prediction of oriented bounding boxes, named head-tail-loss. The loss function consists in minimizing the distance between the prediction and the annotation of two key points that are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Pau Gallés , Xi Chen

The effectiveness of Object Detection, one of the central problems in computer vision tasks, highly depends on the definition of the loss function - a measure of how accurately your ML model can predict the expected outcome. Conventional…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Zhora Gevorgyan

Humans can often quickly and efficiently solve complex new learning tasks given only a small set of examples. In contrast, modern artificially intelligent systems often require thousands or millions of observations in order to solve even…

Machine Learning · Computer Science 2025-05-08 Christian Raymond

Loss functions are error metrics that quantify the difference between a prediction and its corresponding ground truth. Fundamentally, they define a functional landscape for traversal by gradient descent. Although numerous loss functions…

Image and Video Processing · Electrical Eng. & Systems 2021-04-09 Chaitanya Kaul , Nick Pears , Hang Dai , Roderick Murray-Smith , Suresh Manandhar

Simultaneous localization and mapping (SLAM) is a foundational state estimation problem in robotics in which a robot accurately constructs a map of its environment while also localizing itself within this construction. We study the active…

Robotics · Computer Science 2026-04-24 Ilir Gusija , Fady Alajaji , Serdar Yüksel

Long-tail motion forecasting is a core challenge for autonomous driving, where rare yet safety-critical events-such as abrupt maneuvers and dense multi-agent interactions-dominate real-world risk. Existing approaches struggle in these…

Computational Engineering, Finance, and Science · Computer Science 2025-11-11 Bin Rao , Chengyue Wang , Haicheng Liao , Qianfang Wang , Yanchen Guan , Jiaxun Zhang , Xingcheng Liu , Meixin Zhu , Kanye Ye Wang , Zhenning Li

This paper proposes a meta-learning approach to evolving a parametrized loss function, which is called Meta-Loss Network (MLN), for training the image classification learning on small datasets. In our approach, the MLN is embedded in the…

Artificial Intelligence · Computer Science 2023-10-31 Zhaoyang Hai , Xiabi Liu

Online Active Learning (OAL) aims to manage unlabeled datastream by selectively querying the label of data. OAL is applicable to many real-world problems, such as anomaly detection in health-care and finance. In these problems, there are…

Machine Learning · Computer Science 2019-11-19 Yifan Zhang , Peilin Zhao , Shuaicheng Niu , Qingyao Wu , Jiezhang Cao , Junzhou Huang , Mingkui Tan

We present a data-driven algorithm and mathematical model for anomaly alarming at directional drilling. The algorithm is based on machine learning. It compares the real-time drilling telemetry with one corresponding to past accidents and…