中文
相关论文

相关论文: SUM: Suboptimal Unitary Multi-task Learning Framew…

200 篇论文

Recently, tensor data (or multidimensional array) have been generated in many modern applications, such as functional magnetic resonance imaging (fMRI) in neuroscience and videos in video analysis. Many efforts are made in recent years to…

机器学习 · 计算机科学 2023-08-10 Jiaqi Zhang , Yinghao Cai , Zhaoyang Wang , Beilun Wang

Multi-task learning has shown to significantly enhance the performance of multiple related learning tasks in a variety of situations. We present the fused logistic regression, a sparse multi-task learning approach for binary classification.…

机器学习 · 统计学 2013-12-31 Venelin Mitov , Manfred Claassen

In this paper, we propose an energy-efficient federated meta-learning framework. The objective is to enable learning a meta-model that can be fine-tuned to a new task with a few number of samples in a distributed setting and at low…

机器学习 · 计算机科学 2021-06-01 Anis Elgabli , Chaouki Ben Issaid , Amrit S. Bedi , Mehdi Bennis , Vaneet Aggarwal

Many real-world large-scale regression problems can be formulated as Multi-task Learning (MTL) problems with a massive number of tasks, as in retail and transportation domains. However, existing MTL methods still fail to offer both the…

机器学习 · 计算机科学 2018-11-15 Xiao He , Francesco Alesiani , Ammar Shaker

Sampling strategies have been widely applied in many recommendation systems to accelerate model learning from implicit feedback data. A typical strategy is to draw negative instances with uniform distribution, which however will severely…

信息检索 · 计算机科学 2020-11-17 Jiawei Chen , Chengquan Jiang , Can Wang , Sheng Zhou , Yan Feng , Chun Chen , Martin Ester , Xiangnan He

Multi-task learning has emerged as a powerful machine learning paradigm for integrating data from multiple sources, leveraging similarities between tasks to improve overall model performance. However, the application of multi-task learning…

统计方法学 · 统计学 2024-02-09 Parker Knight , Rui Duan

Undersampling is a common method in Magnetic Resonance Imaging (MRI) to subsample the number of data points in k-space, reducing acquisition times at the cost of decreased image quality. A popular approach is to employ undersampling…

图像与视频处理 · 电气工程与系统科学 2023-08-23 Tobias Weber , Michael Ingrisch , Bernd Bischl , David Rügamer

This study aims to explore the performance improvement method of large language models based on GPT-4 under the multi-task learning framework and conducts experiments on two tasks: text classification and automatic summary generation.…

计算与语言 · 计算机科学 2024-12-10 Zhen Qi , Jiajing Chen , Shuo Wang , Bingying Liu , Hongye Zheng , Chihang Wang

In this work, we consider convex optimization problems with smooth objective function and nonsmooth functional constraints. We propose a new stochastic gradient algorithm, called Stochastic Halfspace Approximation Method (SHAM), to solve…

最优化与控制 · 数学 2024-12-04 Nitesh Kumar Singh , Ion Necoara

Motivated by multi-task and meta-learning approaches, we consider the problem of learning structure shared by tasks or users, such as shared low-rank representations or clustered structures. While all previous works focus on well-specified…

机器学习 · 计算机科学 2025-02-14 Mathieu Even , Laurent Massoulié

Multi-Task Learning (MTL) can enhance a classifier's generalization performance by learning multiple related tasks simultaneously. Conventional MTL works under the offline or batch setting, and suffers from expensive training cost and poor…

机器学习 · 计算机科学 2017-06-28 Peng Yang , Peilin Zhao , Xin Gao

In multi-task learning (MTL), we improve the performance of key machine learning algorithms by training various tasks jointly. When the number of tasks is large, modeling task structure can further refine the task relationship model. For…

机器学习 · 计算机科学 2020-11-25 Xiangyu Niu , Yifan Sun , Jinyuan Sun

Recent multi-task learning research argues against unitary scalarization, where training simply minimizes the sum of the task losses. Several ad-hoc multi-task optimization algorithms have instead been proposed, inspired by various…

机器学习 · 计算机科学 2023-03-10 Vitaly Kurin , Alessandro De Palma , Ilya Kostrikov , Shimon Whiteson , M. Pawan Kumar

We consider learning a predictive model to be subsequently used for a given downstream task (described by an algorithm) that requires access to the model evaluation. This task need not be prediction, and this situation is frequently…

机器学习 · 计算机科学 2025-06-05 Jianyuan Yin , Qianxiao Li

We propose a new simple variant of Fast Gradient Method that requires only one projection per iteration. We called this method Triangle Method (TM) because it has a corresponding geometric description. We generalize TM for convex and…

最优化与控制 · 数学 2017-11-28 Alexander Gasnikov , Yurii Nesterov

For effective human-robot interaction, it is important that a robotic assistant can forecast the next action a human will consider in a given task. Unfortunately, real-world tasks are often very long, complex, and repetitive; as a result…

计算机视觉与模式识别 · 计算机科学 2017-09-20 Tengda Han , Jue Wang , Anoop Cherian , Stephen Gould

In recent years, meta-reinforcement learning (meta-RL) algorithm has been proposed to improve sample efficiency in the field of decision-making and control, enabling agents to learn new knowledge from a small number of samples. However,…

机器学习 · 计算机科学 2025-01-14 Chenyang Qi , Huiping Li , Panfeng Huang

Low-rank gradient-based optimization methods have significantly improved memory efficiency during the training of large language models (LLMs), enabling operations within constrained hardware without sacrificing performance. However, these…

机器学习 · 计算机科学 2025-10-28 Yehonathan Refael , Guy Smorodinsky , Tom Tirer , Ofir Lindenbaum

This paper considers clustered multi-task compressive sensing, a hierarchical model that solves multiple compressive sensing tasks by finding clusters of tasks that leverage shared information to mutually improve signal reconstruction. The…

信号处理 · 电气工程与系统科学 2023-10-03 Alexander Lin , Demba Ba

We propose a task-agnostic framework for multimodal fusion of time series and single timestamp images, enabling cross-modal generation and robust downstream performance. Our approach explores deterministic and learned strategies for time…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Gianfranco Basile , Johannes Jakubik , Benedikt Blumenstiel , Thomas Brunschwiler , Juan Bernabe Moreno