English
Related papers

Related papers: DeepTriangle: A Deep Learning Approach to Loss Res…

200 papers

In this paper, we consider the temporal pattern in traffic flow time series, and implement a deep learning model for traffic flow prediction. Detrending based methods decompose original flow series into trend and residual series, in which…

Machine Learning · Computer Science 2017-07-12 Xingyuan Dai , Rui Fu , Yilun Lin , Li Li , Fei-Yue Wang

This paper investigates how to incorporate expert observations (without explicit information on expert actions) into a deep reinforcement learning setting to improve sample efficiency. First, we formulate an augmented policy loss combining…

Machine Learning · Computer Science 2025-02-28 Erhan Can Ozcan , Vittorio Giammarino , James Queeney , Ioannis Ch. Paschalidis

We present a formulation of deep learning that aims at producing a large margin classifier. The notion of margin, minimum distance to a decision boundary, has served as the foundation of several theoretically profound and empirically…

Machine Learning · Statistics 2018-12-05 Gamaleldin F. Elsayed , Dilip Krishnan , Hossein Mobahi , Kevin Regan , Samy Bengio

Deep neural networks have revolutionized numerous research fields and applications. Despite their widespread success, a fundamental limitation known as catastrophic forgetting remains, where models fail to retain their ability to perform…

Machine Learning · Computer Science 2025-02-21 Karolina Bogacka , Maximilian Höfler , Maria Ganzha , Wojciech Samek , Katarzyna Wasielewska-Michniewska

Deterministic neural nets have been shown to learn effective predictors on a wide range of machine learning problems. However, as the standard approach is to train the network to minimize a prediction loss, the resultant model remains…

Machine Learning · Computer Science 2018-11-02 Murat Sensoy , Lance Kaplan , Melih Kandemir

We present efficient deep learning techniques for approximating flow and transport equations for both single phase and two-phase flow problems. The proposed methods take advantages of the sparsity structures in the underlying discrete…

Numerical Analysis · Mathematics 2020-01-08 Yating Wang , Guang Lin

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

We develop a probabilistic framework for deep learning based on the Deep Rendering Mixture Model (DRMM), a new generative probabilistic model that explicitly capture variations in data due to latent task nuisance variables. We demonstrate…

Machine Learning · Statistics 2016-12-07 Ankit B. Patel , Tan Nguyen , Richard G. Baraniuk

Precise load forecasting in buildings could increase the bill savings potential and facilitate optimized strategies for power generation planning. With the rapid evolution of computer science, data-driven techniques, in particular the Deep…

Machine Learning · Computer Science 2023-01-30 Menna Nawar , Moustafa Shomer , Samy Faddel , Huangjie Gong

Various work has suggested that the memorability of an image is consistent across people, and thus can be treated as an intrinsic property of an image. Using computer vision models, we can make specific predictions about what people will…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Coen D. Needell , Wilma A. Bainbridge

Advancing loss function design is pivotal for optimizing neural network training and performance. This work introduces Random Linear Projections (RLP) loss, a novel approach that enhances training efficiency by leveraging geometric…

Machine Learning · Computer Science 2024-06-03 Shyam Venkatasubramanian , Ahmed Aloui , Vahid Tarokh

Although deep learning performs really well in a wide variety of tasks, it still suffers from catastrophic forgetting -- the tendency of neural networks to forget previously learned information upon learning new tasks where previous data is…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Ankur Singh

Deep hedging is a deep-learning-based framework for derivative hedging in incomplete markets. The advantage of deep hedging lies in its ability to handle various realistic market conditions, such as market frictions, which are challenging…

Computational Finance · Quantitative Finance 2023-07-26 Masanori Hirano , Kentaro Minami , Kentaro Imajo

Deep learning models generally display catastrophic forgetting when learning new data continuously. Many incremental learning approaches address this problem by reusing data from previous tasks while learning new tasks. However, the direct…

Machine Learning · Computer Science 2024-11-12 Young Jo Choi , Min Kyoon Yoo , Yu Rang Park

This article proposes a data-driven methodology to achieve a fast design support, in order to generate or develop novel designs covering multiple object categories. This methodology implements two state-of-the-art Variational Autoencoder…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Zhangsihao Yang , Haoliang Jiang , Zou Lan

We deal with the \textit{selective classification} problem (supervised-learning problem with a rejection option), where we want to achieve the best performance at a certain level of coverage of the data. We transform the original $m$-class…

Machine Learning · Computer Science 2019-10-02 Liu Ziyin , Zhikang Wang , Paul Pu Liang , Ruslan Salakhutdinov , Louis-Philippe Morency , Masahito Ueda

Network embedding is an effective technique to learn the low-dimensional representations of nodes in networks. Real-world networks are usually with multiplex or having multi-view representations from different relations. Recently, there has…

Machine Learning · Computer Science 2022-03-08 Qifan Wang , Yi Fang , Anirudh Ravula , Ruining He , Bin Shen , Jingang Wang , Xiaojun Quan , Dongfang Liu

Stochastic variational inference is an established way to carry out approximate Bayesian inference for deep models. While there have been effective proposals for good initializations for loss minimization in deep learning, far less…

Machine Learning · Statistics 2019-01-28 Simone Rossi , Pietro Michiardi , Maurizio Filippone

Demand forecasting in the online fashion industry is particularly amendable to global, data-driven forecasting models because of the industry's set of particular challenges. These include the volume of data, the irregularity, the high…

Machine learning plays an essential role in preventing financial losses in the banking industry. Perhaps the most pertinent prediction task that can result in billions of dollars in losses each year is the assessment of credit risk (i.e.,…

Risk Management · Quantitative Finance 2021-01-01 Jillian M. Clements , Di Xu , Nooshin Yousefi , Dmitry Efimov