English
Related papers

Related papers: Unified Pretraining for Recommendation via Task Hy…

200 papers

Biological intelligence systems of animals perceive the world by integrating information in different modalities and processing simultaneously for various tasks. In contrast, current machine learning research follows a task-specific…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Xizhou Zhu , Jinguo Zhu , Hao Li , Xiaoshi Wu , Xiaogang Wang , Hongsheng Li , Xiaohua Wang , Jifeng Dai

Despite recent progress, learning new tasks through language instructions remains an extremely challenging problem. On the ALFRED benchmark for task learning, the published state-of-the-art system only achieves a task success rate of less…

Artificial Intelligence · Computer Science 2021-06-08 Yichi Zhang , Joyce Chai

Arguably one of the top success stories of deep learning is transfer learning. The finding that pre-training a network on a rich source set (eg., ImageNet) can help boost performance once fine-tuned on a usually much smaller target set, has…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Saining Xie , Jiatao Gu , Demi Guo , Charles R. Qi , Leonidas J. Guibas , Or Litany

While image-text representation learning has become very popular in recent years, existing models tend to lack spatial awareness and have limited direct applicability for dense understanding tasks. For this reason, self-supervised…

Large pre-trained neural networks are ubiquitous and critical to the success of many downstream tasks in natural language processing and computer vision. However, within the field of web information retrieval, there is a stark contrast in…

Machine Learning · Computer Science 2022-10-28 Benedict Yeoh , Huijuan Wang

Bundle recommendations strive to offer users a set of items as a package named bundle, enhancing convenience and contributing to the seller's revenue. While previous approaches have demonstrated notable performance, we argue that they may…

Information Retrieval · Computer Science 2024-12-11 Yang Li , Kangbo Liu , Yaoxin Wu , Zhaoxuan Wang , Erik Cambria , Xiaoxu Wang

Cold-start problem is a fundamental challenge for recommendation tasks. The recent self-supervised learning (SSL) on Graph Neural Networks (GNNs) model, PT-GNN, pre-trains the GNN model to reconstruct the cold-start embeddings and has shown…

Information Retrieval · Computer Science 2022-05-24 Bowen Hao , Hongzhi Yin , Jing Zhang , Cuiping Li , Hong Chen

Massively multilingual models are promising for transfer learning across tasks and languages. However, existing methods are unable to fully leverage training data when it is available in different task-language combinations. To exploit such…

Computation and Language · Computer Science 2022-10-26 Ahmet Üstün , Arianna Bisazza , Gosse Bouma , Gertjan van Noord , Sebastian Ruder

We present a novel methodology to jointly perform multi-task learning and infer intrinsic relationship among tasks by an interpretable and sparse graph. Unlike existing multi-task learning methodologies, the graph structure is not assumed…

Machine Learning · Computer Science 2020-09-15 Shujian Yu , Francesco Alesiani , Ammar Shaker , Wenzhe Yin

Pre-training is prevalent in deep learning for vision and text data, leveraging knowledge from other datasets to enhance downstream tasks. However, for tabular data, the inherent heterogeneity in attribute and label spaces across datasets…

Machine Learning · Computer Science 2025-02-13 Han-Jia Ye , Qi-Le Zhou , Huai-Hong Yin , De-Chuan Zhan , Wei-Lun Chao

Cold-start problem is a fundamental challenge for recommendation tasks. Despite the recent advances on Graph Neural Networks (GNNs) incorporate the high-order collaborative signal to alleviate the problem, the embeddings of the cold-start…

Information Retrieval · Computer Science 2020-12-15 Bowen Hao , Jing Zhang , Hongzhi Yin , Cuiping Li , Hong Chen

Link prediction is a crucial task in graph machine learning, where the goal is to infer missing or future links within a graph. Traditional approaches leverage heuristic methods based on widely observed connectivity patterns, offering broad…

Machine Learning · Computer Science 2024-02-16 Kaiwen Dong , Haitao Mao , Zhichun Guo , Nitesh V. Chawla

In this paper, we focus on the unsupervised multi-view feature selection which tries to handle high dimensional data in the field of multi-view learning. Although some graph-based methods have achieved satisfactory performance, they ignore…

Machine Learning · Computer Science 2021-04-13 Qi Wang , Xu Jiang , Mulin Chen , Xuelong Li

Accurate user and item embedding learning is crucial for modern recommender systems. However, most existing recommendation techniques have thus far focused on modeling users' preferences over singular type of user-item interactions. Many…

Information Retrieval · Computer Science 2021-10-11 Lianghao Xia , Chao Huang , Yong Xu , Peng Dai , Xiyue Zhang , Hongsheng Yang , Jian Pei , Liefeng Bo

Tables stored in databases and tables which are present in web pages and articles account for a large part of semi-structured data that is available on the internet. It then becomes pertinent to develop a modeling approach with large…

Computation and Language · Computer Science 2023-10-03 Soumajyoti Sarkar , Leonard Lausen

Multimodal recommender systems improve the performance of canonical recommender systems with no item features by utilizing diverse content types such as text, images, and videos, while alleviating inherent sparsity of user-item interactions…

Information Retrieval · Computer Science 2026-03-25 Yu-Seung Roh , Joo-Young Kim , Jin-Duk Park , Won-Yong Shin

In-context learning is a new learning paradigm where a language model conditions on a few input-output pairs (demonstrations) and a test input, and directly outputs the prediction. It has been shown highly dependent on the provided…

Computation and Language · Computer Science 2023-05-17 Xiaonan Li , Kai Lv , Hang Yan , Tianyang Lin , Wei Zhu , Yuan Ni , Guotong Xie , Xiaoling Wang , Xipeng Qiu

With the rapid development of online multimedia services, especially in e-commerce platforms, there is a pressing need for personalised recommendation systems that can effectively encode the diverse multi-modal content associated with each…

Artificial Intelligence · Computer Science 2024-07-30 Zixuan Yi , Iadh Ounis

The pretrain-finetune paradigm has shown outstanding performance on many applications of deep learning, where a model is pre-trained on a upstream large dataset (e.g. ImageNet), and is then fine-tuned to different downstream tasks. Though…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yutong Feng , Jianwen Jiang , Mingqian Tang , Rong Jin , Yue Gao

The problem of learning simultaneously several related tasks has received considerable attention in several domains, especially in machine learning with the so-called multitask learning problem or learning to learn problem [1], [2].…

Signal Processing · Electrical Eng. & Systems 2021-09-29 Roula Nassif , Stefan Vlaski , Cedric Richard , Jie Chen , Ali H. Sayed