中文
相关论文

相关论文: Exploring Correlations of Self-Supervised Tasks fo…

200 篇论文

Graph neural networks (GNNs) work well when the graph structure is provided. However, this structure may not always be available in real-world applications. One solution to this problem is to infer a task-specific latent structure and then…

机器学习 · 计算机科学 2021-11-02 Bahare Fatemi , Layla El Asri , Seyed Mehran Kazemi

This work explores the problem of generating task graphs of real-world activities. Different from prior formulations, we consider a setting where text transcripts of instructional videos performing a real-world activity (e.g., making…

人工智能 · 计算机科学 2023-05-04 Lajanugen Logeswaran , Sungryull Sohn , Yunseok Jang , Moontae Lee , Honglak Lee

Self-supervised learning is an effective way for label-free model pre-training, especially in the video domain where labeling is expensive. Existing self-supervised works in the video domain use varying experimental setups to demonstrate…

计算机视觉与模式识别 · 计算机科学 2023-11-22 Akash Kumar , Ashlesha Kumar , Vibhav Vineet , Yogesh Singh Rawat

We introduce a self-supervised approach for learning node and graph level representations by contrasting structural views of graphs. We show that unlike visual representation learning, increasing the number of views to more than two or…

机器学习 · 计算机科学 2020-06-11 Kaveh Hassani , Amir Hosein Khasahmadi

Recommender systems (RecSys) are essential for online platforms, providing personalized suggestions to users within a vast sea of information. Self-supervised graph learning seeks to harness high-order collaborative filtering signals…

信息检索 · 计算机科学 2025-07-18 Weizhi Zhang , Liangwei Yang , Zihe Song , Henrry Peng Zou , Ke Xu , Yuanjie Zhu , Philip S. Yu

Contrastive pretraining techniques for text classification has been largely studied in an unsupervised setting. However, oftentimes labeled data from related tasks which share label semantics with current task is available. We hypothesize…

计算与语言 · 计算机科学 2021-12-22 Samujjwal Ghosh , Subhadeep Maji , Maunendra Sankar Desarkar

Attempting to fully exploit the rich information of topological structure and node features for attributed graph, we introduce self-supervised learning mechanism to graph representation learning and propose a novel Self-supervised Consensus…

社会与信息网络 · 计算机科学 2021-08-12 Changshu Liu , Liangjian Wen , Zhao Kang , Guangchun Luo , Ling Tian

Deep learning perception models require a massive amount of labeled training data to achieve good performance. While unlabeled data is easy to acquire, the cost of labeling is prohibitive and could create a tremendous burden on companies or…

计算机视觉与模式识别 · 计算机科学 2021-11-19 Xinnan Du , William Zhang , Jose M. Alvarez

Leveraging task-aware annotated data as supervised signals to assist with self-supervised learning on large-scale unlabeled data has become a new trend in pre-training language models. Existing studies show that multi-task learning with…

计算与语言 · 计算机科学 2022-10-13 Zhuosheng Zhang , Shuohang Wang , Yichong Xu , Yuwei Fang , Wenhao Yu , Yang Liu , Hai Zhao , Chenguang Zhu , Michael Zeng

With the rise of contrastive learning, unsupervised graph representation learning has been booming recently, even surpassing the supervised counterparts in some machine learning tasks. Most of existing contrastive models for graph…

机器学习 · 计算机科学 2021-12-16 Chunyang Zhang , Hongyu Yao , C. L. Philip Chen , Yuena Lin

Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures,…

机器学习 · 计算机科学 2024-08-21 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Self-supervised metric learning has been a successful approach for learning a distance from an unlabeled dataset. The resulting distance is broadly useful for improving various distance-based downstream tasks, even when no information from…

机器学习 · 统计学 2022-03-18 Shulei Wang

Learning on text-attributed graphs (TAGs), in which nodes are associated with one or more texts, has been the subject of much recent work. However, most approaches tend to make strong assumptions about the downstream task of interest, are…

计算与语言 · 计算机科学 2024-07-11 William Brannon , Wonjune Kang , Suyash Fulay , Hang Jiang , Brandon Roy , Deb Roy , Jad Kabbara

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human…

计算机视觉与模式识别 · 计算机科学 2021-11-04 Mrinal Anand , Aditya Garg

Self-supervised representation learning on text-attributed graphs, which aims to create expressive and generalizable representations for various downstream tasks, has received increasing research attention lately. However, existing methods…

计算与语言 · 计算机科学 2023-10-24 Yichuan Li , Kaize Ding , Kyumin Lee

Label propagation is a powerful and flexible semi-supervised learning technique on graphs. Neural networks, on the other hand, have proven track records in many supervised learning tasks. In this work, we propose a training framework with a…

机器学习 · 计算机科学 2017-03-16 Thang D. Bui , Sujith Ravi , Vivek Ramavajjala

In this paper, we propose a novel graph-based approach for semi-supervised learning problems, which considers an adaptive adjacency of the examples throughout the unsupervised portion of the training. Adjacency of the examples is inferred…

机器学习 · 计算机科学 2020-08-06 Ozsel Kilinc , Ismail Uysal

In this paper, we propose a novel semi-supervised feature selection framework by mining correlations among multiple tasks and apply it to different multimedia applications. Instead of independently computing the importance of features for…

机器学习 · 计算机科学 2017-07-11 Xiaojun Chang , Yi Yang

We investigate tasks that can be accomplished with unlabeled graphs, which are graphs with nodes that do not have persistent or semantically meaningful labels attached. New visualization techniques to represent unlabeled graphs have been…

人机交互 · 计算机科学 2026-03-20 Matt I. B. Oddo , Ryan Smith , Stephen Kobourov , Tamara Munzner

Pretraining has been widely explored to augment the adaptability of graph learning models to transfer knowledge from large datasets to a downstream task, such as link prediction or classification. However, the gap between training…

信息检索 · 计算机科学 2024-03-29 Mingdai Yang , Zhiwei Liu , Liangwei Yang , Xiaolong Liu , Chen Wang , Hao Peng , Philip S. Yu