English
Related papers

Related papers: Tensorized LSSVMs for Multitask Regression

200 papers

We propose a novel multilinear dynamical system (MLDS) in a transform domain, named $\mathcal{L}$-MLDS, to model tensor time series. With transformations applied to a tensor data, the latent multidimensional correlations among the frontal…

Machine Learning · Computer Science 2018-11-20 Weijun Lu , Xiao-Yang Liu , Qingwei Wu , Yue Sun , Anwar Walid

Missing value problem in spatiotemporal traffic data has long been a challenging topic, in particular for large-scale and high-dimensional data with complex missing mechanisms and diverse degrees of missingness. Recent studies based on…

Machine Learning · Statistics 2021-06-15 Xinyu Chen , Yixian Chen , Nicolas Saunier , Lijun Sun

Multi-task learning solves multiple correlated tasks. However, conflicts may exist between them. In such circumstances, a single solution can rarely optimize all the tasks, leading to performance trade-offs. To arrive at a set of optimized…

Artificial Intelligence · Computer Science 2024-03-26 Lu Bai , Abhishek Gupta , Yew-Soon Ong

Modern ConvNets continue to achieve state-of-the-art results over a vast array of vision and image classification tasks, but at the cost of increasing parameters. One strategy for compactifying a network without sacrificing much expressive…

Machine Learning · Computer Science 2024-01-09 Tahseen Rabbani , Jiahao Su , Xiaoyu Liu , David Chan , Geoffrey Sangston , Furong Huang

Engineering and applied sciences use models of increasing complexity to simulate the behaviour of manufactured and physical systems. Propagation of uncertainties from the input to a response quantity of interest through such models may…

Computation · Statistics 2016-06-29 K. Konakli , B. Sudret

Least squares (LS) fitting is one of the most fundamental techniques in science and engineering. It is used to estimate parameters from multiple noisy observations. In many problems the parameters are known a-priori to be bounded integer…

Information Theory · Computer Science 2009-01-05 Amir Leshem , Jacob Goldberger

Multi-task learning (MTL) is frequently used in settings where a target task has to be learnt based on limited training data, but knowledge can be leveraged from related auxiliary tasks. While MTL can improve task performance overall…

Machine Learning · Computer Science 2020-12-18 Rafael Peres da Silva , Chayaporn Suphavilai , Niranjan Nagarajan

Multi-task reinforcement learning could enable robots to scale across a wide variety of manipulation tasks in homes and workplaces. However, generalizing from one task to another and mitigating negative task interference still remains a…

Machine Learning · Computer Science 2024-03-07 Josselin Somerville Roberts , Julia Di

Multi-task learning (MTL) has achieved great success in various research domains, such as CV, NLP and IR etc. Due to the complex and competing task correlation, naive training all tasks may lead to inequitable learning, i.e. some tasks are…

Machine Learning · Computer Science 2023-06-21 Jun Yuan , Rui Zhang

We evaluate some methods designed for tensor- (or data-) based multivariate model construction (approximation and compression). To this aim, a collection of multivariate functions and an evaluation methodology are suggested. First, these…

Numerical Analysis · Mathematics 2026-02-10 Charles Poussot-Vassal , Ion Victor Gosea , Pierre Vuillemin , Athanasios C. Antoulas

Multi-task learning (MTL) can improve performance on a task by sharing representations with one or more related auxiliary-tasks. Usually, MTL-networks are trained on a composite loss function formed by a constant weighted combination of the…

Machine Learning · Computer Science 2020-08-31 Sam Verboven , Muhammad Hafeez Chaudhary , Jeroen Berrevoets , Wouter Verbeke

Modern sensing and metrology systems now stream terabytes of heterogeneous, high-dimensional (HD) data profiles, images, and dense point clouds, whose natural representation is multi-way tensors. Understanding such data requires regression…

Machine Learning · Computer Science 2025-10-08 Qian Wang , Mohammad N. Bisheh , Kamran Paynabar

Tensors provide a robust framework for managing high-dimensional data. Consequently, tensor analysis has emerged as an active research area in various domains, including machine learning, signal processing, computer vision, graph analysis,…

Computation · Statistics 2025-10-01 Michele Gallo

Large language models (LLMs) have achieved remarkable success across various artificial intelligence tasks. However, their enormous sizes and computational demands pose significant challenges for the deployment on edge devices. To address…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-19 Kai Zhang , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

Multi-task learning (MTL) improves prediction performance in different contexts by learning models jointly on multiple different, but related tasks. Network data, which are a priori data with a rich relational structure, provide an…

Machine Learning · Statistics 2014-11-11 Chen Fang , Daniel N. Rockmore

We consider the problem of low-rank decomposition of incomplete multiway tensors. Since many real-world data lie on an intrinsically low dimensional subspace, tensor low-rank decomposition with missing entries has applications in many data…

Numerical Analysis · Computer Science 2016-08-24 Linxiao Yang , Jun Fang , Hongbin Li , Bing Zeng

Currently, existing tensor recovery methods fail to recognize the impact of tensor scale variations on their structural characteristics. Furthermore, existing studies face prohibitive computational costs when dealing with large-scale…

Machine Learning · Computer Science 2025-07-09 Wenjin Qin , Hailin Wang , Jingyao Hou , Jianjun Wang

Parameter-dependent models arise in many contexts such as uncertainty quantification, sensitivity analysis, inverse problems or optimization. Parametric or uncertainty analyses usually require the evaluation of an output of a model for many…

Numerical Analysis · Mathematics 2018-10-22 Anthony Nouy

The Recurrent Neural Networks and their variants have shown promising performances in sequence modeling tasks such as Natural Language Processing. These models, however, turn out to be impractical and difficult to train when exposed to very…

Computer Vision and Pattern Recognition · Computer Science 2017-07-07 Yinchong Yang , Denis Krompass , Volker Tresp

The efficient implementation of large language models (LLMs) is crucial for deployment on resource-constrained devices. Low-rank tensor compression techniques, such as tensor-train (TT) networks, have been widely studied for…

Computation and Language · Computer Science 2025-10-14 Ryan Solgi , Kai Zhen , Rupak Vignesh Swaminathan , Nathan Susanj , Athanasios Mouchtaris , Siegfried Kunzmann , Zheng Zhang