English
Related papers

Related papers: SynCL: A Synergistic Training Strategy with Instan…

200 papers

Continual learning is a process that involves training learning agents to sequentially master a stream of tasks or classes without revisiting past data. The challenge lies in leveraging previously acquired knowledge to learn new tasks…

Machine Learning · Computer Science 2024-02-21 Marcus de Carvalho , Mahardhika Pratama , Jie Zhang , Chua Haoyan , Edward Yapp

In recent years, self-supervised representation learning for skeleton-based action recognition has been developed with the advance of contrastive learning methods. The existing contrastive learning methods use normal augmentations to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Tianyu Guo , Hong Liu , Zhan Chen , Mengyuan Liu , Tao Wang , Runwei Ding

In recent years, semi-supervised learning has been widely explored and shows excellent data efficiency for 2D data. There is an emerging need to improve data efficiency for 3D tasks due to the scarcity of labeled 3D data. This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhimin Chen , Longlong Jing , Yang Liang , YingLi Tian , Bing Li

Vast quantities of person-generated health data (wearables) are collected but the process of annotating to feed to machine learning models is impractical. This paper discusses ways in which self-supervised approaches that use contrastive…

Machine Learning · Computer Science 2021-11-16 Kevalee Shah , Dimitris Spathis , Chi Ian Tang , Cecilia Mascolo

Self-supervised contrastive learning has emerged as a powerful paradigm for skeleton-based action recognition by enforcing consistency in the embedding space. However, existing methods rely on binary contrastive objectives that overlook the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yingjie Feng , Yi Wang , Jiaze Wang , Anfeng Liu , Zhuotao Tian

Knowledge tracing and dropout prediction are crucial for online education to estimate students' knowledge states or to prevent dropout rates. While traditional systems interacting with students suffered from data sparsity and overfitting,…

Computers and Society · Computer Science 2022-10-20 Jungbae Park , Jinyoung Kim , Soonwoo Kwon , Sang Wan Lee

Semi-supervised learning in medical image segmentation leverages unlabeled data to reduce annotation burdens through consistency learning. However, current methods struggle with class imbalance and high uncertainty from pathology…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Maregu Assefa , Muzammal Naseer , Iyyakutti Iyappan Ganapathi , Syed Sadaf Ali , Mohamed L Seghier , Naoufel Werghi

Constrained image splicing detection and localization (CISDL) is a fundamental task of multimedia forensics, which detects splicing operation between two suspected images and localizes the spliced region on both images. Recent works regard…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yuxuan Tan , Yuanman Li , Limin Zeng , Jiaxiong Ye , Wei wang , Xia Li

In-context learning (ICL) has become a classic approach for enabling LLMs to handle various tasks based on a few input-output examples. The effectiveness of ICL heavily relies on the quality of these examples, and previous works which…

Computation and Language · Computer Science 2025-07-25 Yifu Chen , Bingchen Huang , Zhiling Wang , Yuanchao Du , Junfeng Luo , Lei Shen , Zhineng chen

Learning effective visual representations without human supervision is a long-standing problem in computer vision. Recent advances in self-supervised learning algorithms have utilized contrastive learning, with methods such as SimCLR, which…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Jansel Herrera-Gerena , Ramakrishnan Sundareswaran , John Just , Matthew Darr , Ali Jannesari

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

Machine Learning · Computer Science 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Successful learning depends on learners' ability to sustain attention, which is particularly challenging in online education due to limited teacher interaction. A potential indicator for attention is gaze synchrony, demonstrating predictive…

Human-Computer Interaction · Computer Science 2024-04-02 Babette Bühler , Efe Bozkir , Hannah Deininger , Peter Gerjets , Ulrich Trautwein , Enkelejda Kasneci

While attention-based models have demonstrated the remarkable ability of in-context learning (ICL), the theoretical understanding of how these models acquired this ability through gradient descent training is still preliminary. Towards…

Machine Learning · Computer Science 2025-05-29 Yedi Zhang , Aaditya K. Singh , Peter E. Latham , Andrew Saxe

As a safety critical task, autonomous driving requires accurate predictions of road users' future trajectories for safe motion planning, particularly under challenging conditions. Yet, many recent deep learning methods suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Junrui Zhang , Mozhgan Pourkeshavarz , Amir Rasouli

This research introduces an innovative method for adaptive traffic signal control (ATSC) through the utilization of multi-objective deep reinforcement learning (DRL) techniques. The proposed approach aims to enhance control strategies at…

Machine Learning · Computer Science 2024-08-05 Shahin Mirbakhsh , Mahdi Azizi

Self-supervised contrastive learning (SSCL) has recently demonstrated superiority in multiple downstream tasks. In this paper, we generalize the standard SSCL methods to a Generalized Learning Framework (GLF) consisting of two parts: the…

Machine Learning · Computer Science 2025-08-20 Lingyu Si , Jingyao Wang , Wenwen Qiang

Session-based recommendation, which aims to predict the next item of users' interest as per an existing sequence interaction of items, has attracted growing applications of Contrastive Learning (CL) with improved user and item…

Information Retrieval · Computer Science 2023-12-21 Zhengxiang Shi , Xi Wang , Aldo Lipani

To address the issues of MixUp and its variants (e.g., Manifold MixUp) in image classification tasks-namely, their neglect of mixing within the same class (intra-class mixup) and their inadequacy in enhancing intra-class cohesion through…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Ye Xu , Ya Gao , Xiaorong Qiu , Yang Chen , Ying Ji

Many Click-Through Rate (CTR) prediction works focused on designing advanced architectures to model complex feature interactions but neglected the importance of feature representation learning, e.g., adopting a plain embedding layer for…

Information Retrieval · Computer Science 2022-12-02 Fangye Wang , Yingxu Wang , Dongsheng Li , Hansu Gu , Tun Lu , Peng Zhang , Ning Gu

Large language models (LLMs) can adapt to new tasks via in-context learning (ICL) without parameter updates, making them powerful learning engines for fast adaptation. While extensive research has examined ICL as a few-shot learner, whether…

Machine Learning · Computer Science 2025-09-30 Liuwang Kang , Fan Wang , Shaoshan Liu , Hung-Chyun Chou , Chuan Lin , Ning Ding