中文
相关论文

相关论文: Multi-Task Learning Using Uncertainty to Weigh Los…

200 篇论文

Multitask learning (MTL) aims to learn multiple tasks simultaneously through the interdependence between different tasks. The way to measure the relatedness between tasks is always a popular issue. There are mainly two ways to measure…

机器学习 · 计算机科学 2019-04-04 Ya Li , Xinmei Tian , Tongliang Liu , Dacheng Tao

The recent surge in performance for image analysis of digitised pathology slides can largely be attributed to the advances in deep learning. Deep models can be used to initially localise various structures in the tissue and hence facilitate…

图像与视频处理 · 电气工程与系统科学 2022-11-15 Simon Graham , Quoc Dang Vu , Mostafa Jahanifar , Shan E Ahmed Raza , Fayyaz Minhas , David Snead , Nasir Rajpoot

Recent efforts on training visual navigation agents conditioned on language using deep reinforcement learning have been successful in learning policies for different multimodal tasks, such as semantic goal navigation and embodied question…

机器学习 · 计算机科学 2019-02-05 Devendra Singh Chaplot , Lisa Lee , Ruslan Salakhutdinov , Devi Parikh , Dhruv Batra

In this paper, we propose a learning algorithm that enables a model to quickly exploit commonalities among related tasks from an unseen task distribution, before quickly adapting to specific tasks from that same distribution. We investigate…

机器学习 · 计算机科学 2021-07-21 Arnout Devos , Yatin Dandi

Using backward error analysis, we compute implicit training biases in multitask and continual learning settings for neural networks trained with stochastic gradient descent. In particular, we derive modified losses that are implicitly…

机器学习 · 统计学 2023-11-02 Benoit Dherin

As machine learning becomes more prominent there is a growing demand to perform several inference tasks in parallel. Running a dedicated model for each task is computationally expensive and therefore there is a great interest in multi-task…

机器学习 · 计算机科学 2024-05-14 Idan Achituve , Idit Diamant , Arnon Netzer , Gal Chechik , Ethan Fetaya

Recently, end-to-end learning frameworks are gaining prevalence in the field of robot control. These frameworks input states/images and directly predict the torques or the action parameters. However, these approaches are often critiqued due…

机器人学 · 计算机科学 2016-09-29 Lerrel Pinto , Abhinav Gupta

Key to multitask learning is exploiting relationships between different tasks to improve prediction performance. If the relations are linear, regularization approaches can be used successfully. However, in practice assuming the tasks to be…

机器学习 · 计算机科学 2017-08-11 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco , Massimiliano Pontil

Multi-task learning aims to acquire a set of functions, either regressors or classifiers, that perform well for diverse tasks. At its core, the idea behind multi-task learning is to exploit the intrinsic similarity across data sources to…

机器学习 · 计算机科学 2022-10-28 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

Despite the fast progress in training specialized models for various tasks, learning a single general model that works well for many tasks is still challenging for computer vision. Here we introduce multi-task self-training (MuST), which…

计算机视觉与模式识别 · 计算机科学 2021-08-26 Golnaz Ghiasi , Barret Zoph , Ekin D. Cubuk , Quoc V. Le , Tsung-Yi Lin

We consider the supervised training setting in which we learn task-specific word embeddings. We assume that we start with initial embeddings learned from unlabelled data and update them to learn task-specific embeddings for words in the…

计算与语言 · 计算机科学 2016-06-24 Pranava Swaroop Madhyastha , Mohit Bansal , Kevin Gimpel , Karen Livescu

This paper proposes a paradigm of uncertainty injection for training deep learning model to solve robust optimization problems. The majority of existing studies on deep learning focus on the model learning capability, while assuming the…

机器学习 · 计算机科学 2023-02-28 Wei Cui , Wei Yu

Deep learning uses neural networks which are parameterised by their weights. The neural networks are usually trained by tuning the weights to directly minimise a given loss function. In this paper we propose to re-parameterise the weights…

神经与进化计算 · 计算机科学 2022-03-14 Michael Fairbank , Spyridon Samothrakis , Luca Citi

For responsible decision making in safety-critical settings, machine learning models must effectively detect and process edge-case data. Although existing works show that predictive uncertainty is useful for these tasks, it is not evident…

机器学习 · 计算机科学 2022-08-09 Mark Penrod , Harrison Termotto , Varshini Reddy , Jiayu Yao , Finale Doshi-Velez , Weiwei Pan

Data-driven approaches such as deep learning can result in predictive models for material properties with exceptional accuracy and efficiency. However, in many applications, data is sparse, severely limiting their accuracy and…

机器学习 · 计算机科学 2025-10-29 Robert J Appleton , Brian C Barnes , Alejandro Strachan

This paper addresses the challenge of training a single network to jointly perform multiple dense prediction tasks, such as segmentation and depth estimation, i.e., multi-task learning (MTL). Current approaches mainly capture cross-task…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Xiaoye Wang , Chen Tang , Xiangyu Yue , Wei-Hong Li

Learning two tasks in a single shared function has some benefits. Firstly by acquiring information from the second task, the shared function leverages useful information that could have been neglected or underestimated in the first task.…

机器学习 · 计算机科学 2020-08-06 Jonghwa Yim , Sang Hwan Kim

We present a deep learning approach for learning the joint semantic embeddings of images and captions in a Euclidean space, such that the semantic similarity is approximated by the L2 distances in the embedding space. For that, we introduce…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Noam Malali , Yosi Keller

Multimodal semantic understanding often has to deal with uncertainty, which means the obtained messages tend to refer to multiple targets. Such uncertainty is problematic for our interpretation, including inter- and intra-modal uncertainty.…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Yatai Ji , Junjie Wang , Yuan Gong , Lin Zhang , Yanru Zhu , Hongfa Wang , Jiaxing Zhang , Tetsuya Sakai , Yujiu Yang

In apparel recognition, specialized models (e.g. models trained for a particular vertical like dresses) can significantly outperform general models (i.e. models that cover a wide range of verticals). Therefore, deep neural network models…

计算机视觉与模式识别 · 计算机科学 2017-08-16 Yang Song , Yuan Li , Bo Wu , Chao-Yeh Chen , Xiao Zhang , Hartwig Adam