English
Related papers

Related papers: C2:Cross learning module enhanced decision transfo…

200 papers

Cross-domain CTR (CDCTR) prediction is an important research topic that studies how to leverage meaningful data from a related domain to help CTR prediction in target domain. Most existing CDCTR works design implicit ways to transfer…

Information Retrieval · Computer Science 2024-02-20 Xu Chen , Zida Cheng , Jiangchao Yao , Chen Ju , Weilin Huang , Jinsong Lan , Xiaoyi Zeng , Shuai Xiao

Accurate prediction of CB2 receptor ligand activity is pivotal for advancing drug discovery targeting this receptor, which is implicated in inflammation, pain management, and neurodegenerative conditions. Although conventional machine…

Machine Learning · Computer Science 2025-02-19 Jiacheng Xie , Yingrui Ji , Linghuan Zeng , Xi Xiao , Gaofei Chen , Lijing Zhu , Joyanta Jyoti Mondal , Jiansheng Chen

Many real-world combinatorial problems involve uncertain parameters, which can be predicted given contextual features and historical data. These `predict-then-optimize' or `contextual optimization' problems have gained significant…

Machine Learning · Computer Science 2026-05-19 Noah Schutte , Senne Berden , Tias Guns , Krzysztof Postek , Neil Yorke-Smith

With the increasing computing power, using data-driven approaches to co-design a robot's morphology and controller has become a promising way. However, most existing data-driven methods require training the controller for each morphology to…

Robotics · Computer Science 2023-11-08 Ci Chen , Pingyu Xiang , Haojian Lu , Yue Wang , Rong Xiong

Deep learning (DL) compilers rely on cost models and auto-tuning to optimize tensor programs for target hardware. However, existing approaches depend on large offline datasets, incurring high collection costs and offering suboptimal…

Machine Learning · Computer Science 2026-04-15 Chaoyao Shen , Linfeng Jiang , Yixian Shen , Tao Xu , Guoqing Li , Anuj Pathania , Andy D. Pimentel , Meng Zhang

Deep learning models achieve state-of-the-art performance across domains but face scalability challenges in real-time or resource-constrained scenarios. To address this, we propose Loss Trajectory Correlation (LTC), a novel metric for…

Machine Learning · Computer Science 2025-03-14 Manish Nagaraj , Deepak Ravikumar , Efstathia Soufleri , Kaushik Roy

Cross domain recommender system constitutes a powerful method to tackle the cold-start and sparsity problem by aggregating and transferring user preferences across multiple category domains. Therefore, it has great potential to improve…

Information Retrieval · Computer Science 2021-06-08 Pan Li , Zhichao Jiang , Maofei Que , Yao Hu , Alexander Tuzhilin

We propose a novel adaptive transfer learning framework, learning to transfer learn (L2TL), to improve performance on a target dataset by careful extraction of the related information from a source dataset. Our framework considers…

Machine Learning · Computer Science 2020-07-17 Linchao Zhu , Sercan O. Arik , Yi Yang , Tomas Pfister

Cross-Project Defect Prediction (CPDP), which borrows data from similar projects by combining a transfer learner with a classifier, have emerged as a promising way to predict software defects when the available data about the target project…

Software Engineering · Computer Science 2020-09-01 Ke Li , Zilin Xiang , Tao Chen , Kay Chen Tan

In recent years, extensive work has explored the application of the Transformer architecture to reinforcement learning problems. Among these, Decision Transformer (DT) has gained particular attention in the context of offline reinforcement…

Artificial Intelligence · Computer Science 2025-07-15 Yumi Omori , Zixuan Dong , Keith Ross

Artificial neural networks, celebrated for their human-like cognitive learning abilities, often encounter the well-known catastrophic forgetting (CF) problem, where the neural networks lose the proficiency in previously acquired knowledge.…

Machine Learning · Computer Science 2024-05-14 Weiwei Weng , Mahardhika Pratama , Jie Zhang , Chen Chen , Edward Yapp Kien Yee , Ramasamy Savitha

Unsupervised/self-supervised representation learning in time series is critical since labeled samples are usually scarce in real-world scenarios. Existing approaches mainly leverage the contrastive learning framework, which automatically…

Machine Learning · Computer Science 2023-07-10 Wenrui Zhang , Ling Yang , Shijia Geng , Shenda Hong

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

Artificial Intelligence · Computer Science 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

Learning to learn (L2L) trains a meta-learner to assist the learning of a task-specific base learner. Previously, it was shown that a meta-learner could learn the direct rules to update learner parameters; and that the learnt neural…

Semantic segmentation is an important task for scene understanding in self-driving cars and robotics, which aims to assign dense labels for all pixels in the image. Existing work typically improves semantic segmentation performance by…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Li Wang , Dong Li , Han Liu , Jinzhang Peng , Lu Tian , Yi Shan

Decision Transformer (DT), which integrates reinforcement learning (RL) with the transformer model, introduces a novel approach to offline RL. Unlike classical algorithms that take maximizing cumulative discounted rewards as objective, DT…

Machine Learning · Computer Science 2025-10-08 Rui Lin , Yiwen Zhang , Zhicheng Peng , Minghao Lyu

We study online learning problems in which a decision maker has to make a sequence of costly decisions, with the goal of maximizing their expected reward while adhering to budget and return-on-investment (ROI) constraints. Existing…

Computer Science and Game Theory · Computer Science 2024-03-05 Matteo Castiglioni , Andrea Celli , Christian Kroer

As a data-driven paradigm, offline reinforcement learning (Offline RL) has been formulated as sequence modeling, where the Decision Transformer (DT) has demonstrated exceptional capabilities. Unlike previous reinforcement learning methods…

Machine Learning · Computer Science 2024-09-13 Teng Yan , Zhendong Ruan , Yaobang Cai , Yu Han , Wenxian Li , Yang Zhang

The ability to discover optimal behaviour from fixed data sets has the potential to transfer the successes of reinforcement learning (RL) to domains where data collection is acutely problematic. In this offline setting, a key challenge is…

Machine Learning · Computer Science 2022-11-23 Alex Beeson , Giovanni Montana

Online display advertising platforms service numerous advertisers by providing real-time bidding (RTB) for the scale of billions of ad requests every day. The bidding strategy handles ad requests cross multiple channels to maximize the…

Machine Learning · Computer Science 2024-08-21 Hao Wang , Bo Tang , Chi Harold Liu , Shangqin Mao , Jiahong Zhou , Zipeng Dai , Yaqi Sun , Qianlong Xie , Xingxing Wang , Dong Wang