English
Related papers

Related papers: Reinforcement Learning with Automated Auxiliary Lo…

200 papers

Modern statistical analysis often encounters high-dimensional problems but with a limited sample size. It poses great challenges to traditional statistical estimation methods. In this work, we adopt auxiliary learning to solve the…

Statistics Theory · Mathematics 2025-01-08 Hanchao Yan , Feifei Wang , Chuanxin Xia , Hansheng Wang

All machine learning algorithms use a loss, cost, utility or reward function to encode the learning objective and oversee the learning process. This function that supervises learning is a frequently unrecognized hyperparameter that…

Neural and Evolutionary Computing · Computer Science 2024-11-06 Mathew Mithra Noel , Arindam Banerjee , Yug Oswal , Geraldine Bessie Amali D , Venkataraman Muthiah-Nakarajan

As retrieval-augmented generation (RAG) becomes more widespread, the role of retrieval is shifting from retrieving information for human browsing to retrieving context for AI reasoning. This shift creates more complex search environments,…

Computation and Language · Computer Science 2026-01-05 Jiawei Zhou , Lei Chen

Balancing exploration and exploitation remains a key challenge in reinforcement learning (RL). State-of-the-art RL algorithms suffer from high sample complexity, particularly in the sparse reward case, where they can do no better than to…

Machine Learning · Computer Science 2020-01-22 Philippe Morere , Gilad Francis , Tom Blau , Fabio Ramos

Autonomous robots require high degrees of cognitive and motoric intelligence to come into our everyday life. In non-structured environments and in the presence of uncertainties, such degrees of intelligence are not easy to obtain.…

Auxiliary objectives, supplementary learning signals that are introduced to help aid learning on data-starved or highly complex end-tasks, are commonplace in machine learning. Whilst much work has been done to formulate useful auxiliary…

Machine Learning · Computer Science 2023-03-01 Lucio M. Dery , Paul Michel , Mikhail Khodak , Graham Neubig , Ameet Talwalkar

Designing an effective loss function plays a crucial role in training deep recommender systems. Most existing works often leverage a predefined and fixed loss function that could lead to suboptimal recommendation quality and training…

Information Retrieval · Computer Science 2021-06-15 Xiangyu Zhao , Haochen Liu , Wenqi Fan , Hui Liu , Jiliang Tang , Chong Wang

With the recent prevalence of reinforcement learning (RL), there have been tremendous interests in utilizing RL for ads allocation in recommendation platforms (e.g., e-commerce and news feed sites). To achieve better allocation, the input…

Machine Learning · Computer Science 2022-08-12 Ze Wang , Guogang Liao , Xiaowen Shi , Xiaoxu Wu , Chuheng Zhang , Yongkang Wang , Xingxing Wang , Dong Wang

Abstraction is key to scaling up reinforcement learning (RL). However, autonomously learning abstract state and action representations to enable transfer and generalization remains a challenging open problem. This paper presents a novel…

Artificial Intelligence · Computer Science 2024-12-24 Rashmeet Kaur Nayyar , Siddharth Srivastava

Arguably, intelligent agents ought to be able to discover their own questions so that in learning answers for them they learn unanticipated useful knowledge and skills; this departs from the focus in much of machine learning on agents…

In many real-world problems, the learning agent needs to learn a problem's abstractions and solution simultaneously. However, most such abstractions need to be designed and refined by hand for different problems and domains of application.…

Machine Learning · Computer Science 2022-12-09 Mehdi Dadvar , Rashmeet Kaur Nayyar , Siddharth Srivastava

Reinforcement Learning (RL) has emerged as a transformative approach in the domains of automation and robotics, offering powerful solutions to complex problems that conventional methods struggle to address. In scenarios where the problem…

Robotics · Computer Science 2023-09-04 Meraj Mammadov

We propose a method for meta-learning reinforcement learning algorithms by searching over the space of computational graphs which compute the loss function for a value-based model-free RL agent to optimize. The learned algorithms are…

Machine Learning · Computer Science 2022-11-11 John D. Co-Reyes , Yingjie Miao , Daiyi Peng , Esteban Real , Sergey Levine , Quoc V. Le , Honglak Lee , Aleksandra Faust

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning…

Robotics · Computer Science 2019-11-12 Jonáš Kulhánek , Erik Derner , Tim de Bruin , Robert Babuška

Reinforcement learning (RL) is challenging in the common case of delays between events and their sensory perceptions. State-of-the-art (SOTA) state augmentation techniques either suffer from state space explosion or performance degeneration…

Machine Learning · Computer Science 2024-06-07 Qingyuan Wu , Simon Sinong Zhan , Yixuan Wang , Yuhui Wang , Chung-Wei Lin , Chen Lv , Qi Zhu , Jürgen Schmidhuber , Chao Huang

Active learning continues to remain significant in the industry since it is data efficient. Not only is it cost effective on a constrained budget, continuous refinement of the model allows for early detection and resolution of failure…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Megh Shukla , Shuaib Ahmed

The endeavor of artificial intelligence (AI) is to design autonomous agents capable of achieving complex tasks. Namely, reinforcement learning (RL) proposes a theoretical background to learn optimal behaviors. In practice, RL algorithms…

Machine Learning · Computer Science 2022-09-27 Firas Jarboui , Ahmed Akakzia

Reinforcement Learning (RL) traditionally relies on scalar reward signals, limiting its ability to leverage the rich semantic knowledge often available in real-world tasks. In contrast, humans learn efficiently by combining numerical…

Most deep reinforcement learning (RL) algorithms distill experience into parametric behavior policies or value functions via gradient updates. While effective, this approach has several disadvantages: (1) it is computationally expensive,…

Despite achieving great success, Deep Neural Networks (DNNs) are vulnerable to adversarial examples. How to accurately evaluate the adversarial robustness of DNNs is critical for their deployment in real-world applications. An ideal…

Machine Learning · Computer Science 2022-04-12 Pengfei Xia , Ziqiang Li , Bin Li