English
Related papers

Related papers: Cross-Episodic Curriculum for Transformer Agents

200 papers

Interaction and navigation defined by natural language instructions in dynamic environments pose significant challenges for neural agents. This paper focuses on addressing two challenges: handling long sequence of subtasks, and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Alexander Pashevich , Cordelia Schmid , Chen Sun

Attention mechanisms have become integral in AI, significantly enhancing model performance and scalability by drawing inspiration from human cognition. Concurrently, the Attention Schema Theory (AST) in cognitive science posits that…

Artificial Intelligence · Computer Science 2025-09-22 Krati Saxena , Federico Jurado Ruiz , Guido Manzi , Dianbo Liu , Alex Lamb

The idea of experience sharing between cooperative agents naturally emerges from our understanding of how humans learn. Our evolution as a species is tightly linked to the ability to exchange learned knowledge with one another. It follows…

Machine Learning · Computer Science 2019-11-07 Lucas Oliveira Souza , Gabriel de Oliveira Ramos , Celia Ghedini Ralha

Episodic control enables sample efficiency in reinforcement learning by recalling past experiences from an episodic memory. We propose a new model-based episodic memory of trajectories addressing current limitations of episodic control. Our…

Machine Learning · Computer Science 2021-11-09 Hung Le , Thommen Karimpanal George , Majid Abdolshah , Truyen Tran , Svetha Venkatesh

Driver intention prediction seeks to anticipate drivers' actions by analyzing their behaviors with respect to surrounding traffic environments. Existing approaches primarily focus on late-fusion techniques, and neglect the importance of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Yunsheng Ma , Wenqian Ye , Xu Cao , Amr Abdelraouf , Kyungtae Han , Rohit Gupta , Ziran Wang

In real-world applications, dynamic scenarios require the models to possess the capability to learn new tasks continuously without forgetting the old knowledge. Experience-Replay methods store a subset of the old images for joint training.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Xinyuan Gao , Songlin Dong , Yuhang He , Xing Wei , Yihong Gong

As a representative evidential clustering algorithm, evidential c-means (ECM) provides a deeper insight into the data by allowing an object to belong not only to a single class, but also to any subset of a collection of classes, which…

Machine Learning · Computer Science 2022-12-07 Lianmeng Jiao , Feng Wang , Zhun-ga Liu , Quan Pan

Transformer networks have achieved remarkable success across diverse domains, leveraging a variety of architectural innovations, including residual connections. However, traditional residual connections, which simply sum the outputs of…

Machine Learning · Computer Science 2025-07-25 Mike Heddes , Adel Javanmard , Kyriakos Axiotis , Gang Fu , MohammadHossein Bateni , Vahab Mirrokni

Peptide sequencing-the process of identifying amino acid sequences from mass spectrometry data-is a fundamental task in proteomics. Non-Autoregressive Transformers (NATs) have proven highly effective for this task, outperforming traditional…

Biomolecules · Quantitative Biology 2025-06-17 Xiang Zhang , Jiaqi Wei , Zijie Qiu , Sheng Xu , Nanqing Dong , Zhiqiang Gao , Siqi Sun

It is common knowledge that the quantity and quality of the training data play a significant role in the creation of a good machine learning model. In this paper, we take it one step further and demonstrate that the way the training…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-12 Georgios Karakasidis , Tamás Grósz , Mikko Kurimo

Attention-based neural networks, such as Transformers, have become ubiquitous in numerous applications, including computer vision, natural language processing, and time-series analysis. In all kinds of attention networks, the attention maps…

Machine Learning · Computer Science 2023-05-01 Yujing Wang , Yaming Yang , Zhuo Li , Jiangang Bai , Mingliang Zhang , Xiangtai Li , Jing Yu , Ce Zhang , Gao Huang , Yunhai Tong

Recently, channel attention mechanism has demonstrated to offer great potential in improving the performance of deep convolutional neural networks (CNNs). However, most existing methods dedicate to developing more sophisticated attention…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Qilong Wang , Banggu Wu , Pengfei Zhu , Peihua Li , Wangmeng Zuo , Qinghua Hu

We demonstrate how an evolutionary algorithm can be extended with a curriculum learning process that selects automatically the environmental conditions in which the evolving agents are evaluated. The environmental conditions are selected so…

Neural and Evolutionary Computing · Computer Science 2021-02-18 Nicola Milano , Stefano Nolfi

Self-supervised pretraining has been extensively studied in language and vision domains, where a unified model can be easily adapted to various downstream tasks by pretraining representations without explicit labels. When it comes to…

Machine Learning · Computer Science 2023-01-25 Yanchao Sun , Shuang Ma , Ratnesh Madaan , Rogerio Bonatti , Furong Huang , Ashish Kapoor

Efficient instruction tuning aims to enhance the ultimate performance of large language models (LLMs) trained on a given instruction dataset. Curriculum learning as a typical data organization strategy has shown preliminary effectiveness in…

Computation and Language · Computer Science 2025-11-04 Yangning Li , Tingwei Lu , Yinghui Li , Yankai Chen , Wei-Chieh Huang , Wenhao Jiang , Hui Wang , Hai-Tao Zheng , Philip S. Yu

Various automatic curriculum learning (ACL) methods have been proposed to improve the sample efficiency and final performance of deep reinforcement learning (DRL). They are designed to control how a DRL agent collects data, which is…

Machine Learning · Computer Science 2022-10-26 Jikun Kang , Miao Liu , Abhinav Gupta , Chris Pal , Xue Liu , Jie Fu

Learning complex tasks from scratch is challenging and often impossible for humans as well as for artificial agents. A curriculum can be used instead, which decomposes a complex task (target task) into a sequence of source tasks (the…

Machine Learning · Computer Science 2020-08-24 Binyamin Manela , Armin Biess

In this work, we aim to establish a strong connection between two significant bodies of machine learning research: continual learning and sequence modeling. That is, we propose to formulate continual learning as a sequence modeling problem,…

Machine Learning · Computer Science 2024-05-31 Soochan Lee , Jaehyeon Son , Gunhee Kim

Curriculum learning and imitation learning have been leveraged extensively in the robotics domain. However, minimal research has been done on leveraging these ideas on control tasks over highly stochastic time-series data. Here, we…

Machine Learning · Computer Science 2024-01-17 Woosung Koh , Insu Choi , Yuntae Jang , Gimin Kang , Woo Chang Kim

Recently, deep learning with Convolutional Neural Networks (CNNs) and Transformers has shown encouraging results in fully supervised medical image segmentation. However, it is still challenging for them to achieve good performance with…

Image and Video Processing · Electrical Eng. & Systems 2022-03-02 Xiangde Luo , Minhao Hu , Tao Song , Guotai Wang , Shaoting Zhang