English
Related papers

Related papers: Multi-target prediction for dummies using two-bran…

200 papers

Multi-token prediction (MTP) has been proposed as an auxiliary objective to improve next-token prediction (NTP) in language model training but shows inconsistent improvements, underperforming in standard NLP benchmarks. We found MTP's exact…

Machine Learning · Computer Science 2026-02-17 Zayd M. K. Zuhri , Erland Hilman Fuadi , Alham Fikri Aji

The great success of Convolutional Neural Networks (CNN) for facial attribute prediction relies on a large amount of labeled images. Facial image datasets are usually annotated by some commonly used attributes (e.g., gender), while labels…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Fariborz Taherkhani , Ali Dabouei , Sobhan Soleymani , Jeremy Dawson , Nasser M. Nasrabadi

Multi-task learning has recently emerged as a promising solution for a comprehensive understanding of complex scenes. In addition to being memory-efficient, multi-task models, when appropriately designed, can facilitate the exchange of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Ivan Lopes , Tuan-Hung Vu , Raoul de Charette

Prompt tuning (PT) which only tunes the embeddings of an additional sequence of tokens per task, keeping the pre-trained language model (PLM) frozen, has shown remarkable performance in few-shot learning. Despite this, PT has been shown to…

Computation and Language · Computer Science 2023-11-21 Chengwei Qin , Qian Li , Ruochen Zhao , Shafiq Joty

Multi-task learning (MTL) enables simultaneous training across related tasks, leveraging shared information to improve generalization, efficiency, and robustness, especially in data-scarce or high-dimensional scenarios. While deep learning…

Machine Learning · Computer Science 2025-10-31 Fatemeh Bazikar , Hossein Moosaei , Atefeh Hemmati , Panos M. Pardalos

Wireless signal recognition is becoming increasingly more significant for spectrum monitoring, spectrum management, and secure communications. Consequently, it will become a key enabler with the emerging fifth-generation (5G) and beyond 5G…

Machine Learning · Computer Science 2021-02-23 Anu Jagannath , Jithin Jagannath

The process of association and tracking of sensor detections is a key element in providing situational awareness. When the targets in the scenario are dense and exhibit high maneuverability, Multi-Target Tracking (MTT) becomes a challenging…

Machine Learning · Computer Science 2020-11-20 Rishabh Verma , R Rajesh , MS Easwaran

As machine learning becomes more prominent there is a growing demand to perform several inference tasks in parallel. Running a dedicated model for each task is computationally expensive and therefore there is a great interest in multi-task…

Machine Learning · Computer Science 2024-05-14 Idan Achituve , Idit Diamant , Arnon Netzer , Gal Chechik , Ethan Fetaya

Automated predictions require explanations to be interpretable by humans. Past work used attention and rationale mechanisms to find words that predict the target variable of a document. Often though, they result in a tradeoff between noisy…

Computation and Language · Computer Science 2020-12-22 Diego Antognini , Claudiu Musat , Boi Faltings

Multi-task learning, as it is understood nowadays, consists of using one single model to carry out several similar tasks. From classifying hand-written characters of different alphabets to figuring out how to play several Atari games using…

Machine Learning · Computer Science 2019-03-25 Unai Garciarena , Alexander Mendiburu , Roberto Santana

Modeling event sequences of multiple event types with marked temporal point processes (MTPPs) provides a principled way to uncover governing dynamical rules and predict future events. Current neural network approaches to MTPP inference rely…

Machine Learning · Computer Science 2026-03-02 David Berghaus , Patrick Seifner , Kostadin Cvejoski , César Ojeda , Ramsés J. Sánchez

Multi-task learning (MTL) is an efficient solution to solve multiple tasks simultaneously in order to get better speed and performance than handling each single-task in turn. The most current methods can be categorized as either: (i) hard…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Yifan Liu , Bohan Zhuang , Chunhua Shen , Hao Chen , Wei Yin

Future projection of climate is typically obtained by combining outputs from multiple Earth System Models (ESMs) for several climate variables such as temperature and precipitation. While IPCC has traditionally used a simple model output…

Machine Learning · Computer Science 2017-02-01 André R. Gonçalves , Arindam Banerjee , Fernando J. Von Zuben

Trajectory prediction has garnered widespread attention in different fields, such as autonomous driving and robotic navigation. However, due to the significant variations in trajectory patterns across different scenarios, models trained in…

Robotics · Computer Science 2024-02-14 Xiaohe Li , Feilong Huang , Zide Fan , Fangli Mou , Yingyan Hou , Chen Qian , Lijie Wen

Neural processes have recently emerged as a class of powerful neural latent variable models that combine the strengths of neural networks and stochastic processes. As they can encode contextual data in the network's function space, they…

Machine Learning · Computer Science 2021-12-03 Jiayi Shen , Xiantong Zhen , Marcel Worring , Ling Shao

Traditional neural network approaches for traffic flow forecasting are usually single task learning (STL) models, which do not take advantage of the information provided by related tasks. In contrast to STL, multitask learning (MTL) has the…

Machine Learning · Computer Science 2017-12-27 Feng Jin , Shiliang Sun

The terms multi-task learning and multitasking are easily confused. Multi-task learning refers to a paradigm in machine learning in which a network is trained on various related tasks to facilitate the acquisition of tasks. In contrast,…

Machine Learning · Computer Science 2021-01-06 Sachin Ravi , Sebastian Musslick , Maia Hamin , Theodore L. Willke , Jonathan D. Cohen

In Neural Machine Translation (NMT) the usage of subwords and characters as source and target units offers a simple and flexible solution for translation of rare and unseen words. However, selecting the optimal subword segmentation involves…

Computation and Language · Computer Science 2019-10-29 Tejas Srinivasan , Ramon Sanabria , Florian Metze

With the emergence of powerful data-driven methods in human trajectory prediction (HTP), gaining a finer understanding of multi-agent interactions lies within hand's reach, with important implications in areas such as social robot…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Céline Finet , Stephane Da Silva Martins , Jean-Bernard Hayet , Ioannis Karamouzas , Javad Amirian , Sylvie Le Hégarat-Mascle , Julien Pettré , Emanuel Aldea

Accurate temporal prediction is the bridge between comprehensive scene understanding and embodied artificial intelligence. However, predicting multiple fine-grained states of a scene at multiple temporal scales is difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Zhitao Zeng , Guojian Yuan , Junyuan Mao , Yuxuan Wang , Xiaoshuang Jia , Yueming Jin