English
Related papers

Related papers: Contrastive Modules with Temporal Attention for Mu…

200 papers

Tactile-vision-language (TVL) models are increasingly deployed in real-world robotic and multimodal perception tasks, where test-time distribution shifts are unavoidable. Existing test-time adaptation (TTA) methods provide filtering in…

Robotics · Computer Science 2026-02-19 Chuyang Ye , Haoxian Jing , Qinting Jiang , Yixi Lin , Qiang Li , Xing Tang , Jingyan Jiang

Many advanced Learning from Demonstration (LfD) methods consider the decomposition of complex, real-world tasks into simpler sub-tasks. By reusing the corresponding sub-policies within and between tasks, they provide training data for each…

Machine Learning · Computer Science 2018-08-13 Kyriacos Shiarlis , Markus Wulfmeier , Sasha Salter , Shimon Whiteson , Ingmar Posner

Most deep reinforcement learning algorithms are data inefficient in complex and rich environments, limiting their applicability to many scenarios. One direction for improving data efficiency is multitask learning with shared neural network…

In this paper, we study the Tiered Reinforcement Learning setting, a parallel transfer learning framework, where the goal is to transfer knowledge from the low-tier (source) task to the high-tier (target) task to reduce the exploration risk…

Machine Learning · Computer Science 2024-06-14 Jiawei Huang , Niao He

Contrastive Language-Image Pretraining (CLIP) models excel at understanding image-text relationships but struggle with adapting to new data without forgetting prior knowledge. To address this, models are typically fine-tuned using both new…

Machine Learning · Computer Science 2026-05-06 Ryan King , Gang Li , Bobak Mortazavi , Tianbao Yang

Scientific literature understanding tasks have gained significant attention due to their potential to accelerate scientific discovery. Pre-trained language models (LMs) have shown effectiveness in these tasks, especially when tuned via…

Computation and Language · Computer Science 2023-10-24 Yu Zhang , Hao Cheng , Zhihong Shen , Xiaodong Liu , Ye-Yi Wang , Jianfeng Gao

Continual learning requires learning incremental tasks with dynamic data distributions. So far, it has been observed that employing a combination of contrastive loss and distillation loss for training in continual learning yields strong…

Machine Learning · Computer Science 2024-05-30 Yichen Wen , Zhiquan Tan , Kaipeng Zheng , Chuanlong Xie , Weiran Huang

Multimodal Diffusion Transformers (MM-DiTs) have achieved remarkable progress in text-driven visual generation. However, even state-of-the-art MM-DiT models like FLUX struggle with achieving precise alignment between text prompts and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Zhengyao Lv , Tianlin Pan , Chenyang Si , Zhaoxi Chen , Wangmeng Zuo , Ziwei Liu , Kwan-Yee K. Wong

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

Machine Learning · Computer Science 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin

Multi-modal contrastive learning with language supervision has presented a paradigm shift in modern machine learning. By pre-training on a web-scale dataset, multi-modal contrastive learning can learn high-quality representations that…

Machine Learning · Computer Science 2024-11-06 Wei Huang , Andi Han , Yongqiang Chen , Yuan Cao , Zhiqiang Xu , Taiji Suzuki

The success of deep learning in transient stability assessment (TSA) heavily relies on high-quality training data. However, the label information in TSA datasets is vulnerable to contamination through false label injection (FLI)…

Machine Learning · Computer Science 2024-06-12 Hanxuan Wang , Na Lu , Yinhong Liu , Zhuqing Wang , Zixuan Wang

The task of language-guided video temporal grounding is to localize the particular video clip corresponding to a query sentence in an untrimmed video. Though progress has been made continuously in this field, some issues still need to be…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Binjie Zhang , Yu Li , Chun Yuan , Dejing Xu , Pin Jiang , Ying Shan

Multivariate Time-Series (MTS) clustering is crucial for signal processing and data analysis. Although deep learning approaches, particularly those leveraging Contrastive Learning (CL), are prominent for MTS representation, existing…

Machine Learning · Computer Science 2026-01-13 Zexi Tan , Tao Xie , Haoyi Xiao , Baoyao Yang , Yuzhu Ji , An Zeng , Xiang Zhang , Yiqun Zhang

Multi-task learning (MTL) has been widely adopted for its ability to simultaneously learn multiple tasks. While existing gradient manipulation methods often yield more balanced solutions than simple scalarization-based approaches, they…

Machine Learning · Computer Science 2025-09-29 Peiyao Xiao , Chaosheng Dong , Shaofeng Zou , Kaiyi Ji

Achieving high-performance in multi-object tracking algorithms heavily relies on modeling spatio-temporal relationships during the data association stage. Mainstream approaches encompass rule-based and deep learning-based methods for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhonglin Liu , Shujie Chen , Jianfeng Dong , Xun Wang , Di Zhou

Classification of multi-dimensional time series from real-world systems require fine-grained learning of complex features such as cross-dimensional dependencies and intra-class variations-all under the practical challenge of low training…

Machine Learning · Computer Science 2025-05-16 Anushiya Arunan , Yan Qin , Xiaoli Li , Yuen Chau

Recent self-supervised contrastive methods have been able to produce impressive transferable visual representations by learning to be invariant to different data augmentations. However, these methods implicitly assume a particular set of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Tete Xiao , Xiaolong Wang , Alexei A. Efros , Trevor Darrell

Multi-task learning (MTL) can advance assistive driving by exploring inter-task correlations through shared representations. However, existing methods face two critical limitations: single-modality constraints limiting comprehensive scene…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Wenzhuo Liu , Yicheng Qiao , Zhen Wang , Qiannan Guo , Zilong Chen , Meihua Zhou , Xinran Li , Letian Wang , Zhiwei Li , Huaping Liu , Wenshuo Wang

Multi-task learning (MTL) is a paradigm that simultaneously learns multiple tasks by sharing information at different levels, enhancing the performance of each individual task. While previous research has primarily focused on feature-level…

Machine Learning · Computer Science 2024-04-02 Xiangming Xi , Feng Gao , Jun Xu , Fangtai Guo , Tianlei Jin

In the era of Industry 4.0 and smart manufacturing, process systems engineering must adapt to digital transformation. While reinforcement learning offers a model-free approach to process control, its applications are limited by the…

Systems and Control · Electrical Eng. & Systems 2025-05-28 Runze Lin , Junghui Chen , Biao Huang , Lei Xie , Hongye Su