English
Related papers

Related papers: Implementing Transitive Credit with JSON-LD

200 papers

To leverage machine learning in any decision-making process, one must convert the given knowledge (for example, natural language, unstructured text) into representation vectors that can be understood and processed by machine learning model…

Machine Learning · Computer Science 2023-07-11 Shibo Yao

Offline reinforcement learning refers to the process of learning policies from fixed datasets, without requiring additional environment interaction. However, it often relies on well-defined reward functions, which are difficult and…

Artificial Intelligence · Computer Science 2025-10-13 Xiancheng Gao , Yufeng Shi , Wengang Zhou , Houqiang Li

Transfer learning aims to transfer knowledge or information from a source domain to a relevant target domain. In this paper, we understand transfer learning from the perspectives of knowledge transferability and trustworthiness. This…

Machine Learning · Computer Science 2025-11-13 Jun Wu , Jingrui He

While Reinforcement Learning with Verifiable Rewards (RLVR) enhances complex reasoning in LLMs, current methods struggle to balance exploration and exploitation. This leads to critical issues like inaccurate credit assignment for…

Machine Learning · Computer Science 2025-10-13 Junxi Yin , Haisen Luo , Zhenyu Li , Yihua Liu , Dan Liu , Zequn Li , Xiaohang Xu

Many machine learning applications involve jointly predicting multiple mutually dependent output variables. Learning to search is a family of methods where the complex decision problem is cast into a sequence of decisions via a search…

Machine Learning · Computer Science 2016-06-02 Kai-Wei Chang , He He , Hal Daumé , John Langford , Stephane Ross

Many transfer problems require re-using previously optimal decisions for solving new tasks, which suggests the need for learning algorithms that can modify the mechanisms for choosing certain actions independently of those for choosing…

Machine Learning · Computer Science 2021-07-22 Michael Chang , Sidhant Kaushik , Sergey Levine , Thomas L. Griffiths

The prosperity of mobile and financial technologies has bred and expanded various kinds of financial products to a broader scope of people, which contributes to advocating financial inclusion. It has non-trivial social benefits of…

Machine Learning · Computer Science 2021-12-17 Yiheng Sun , Tian Lu , Cong Wang , Yuan Li , Huaiyu Fu , Jingran Dong , Yunjie Xu

Transfer Learning (TL) offers the potential to accelerate learning by transferring knowledge across tasks. However, it faces critical challenges such as negative transfer, domain adaptation and inefficiency in selecting solid source…

Machine Learning · Computer Science 2025-07-29 Alessandro Capurso , Elia Piccoli , Davide Bacciu

Inspired by a recent editorial (Langer 2012), we suggest a relative simple scheme to grade grants and proposals that might enhance scientific innovation.

Instrumentation and Methods for Astrophysics · Physics 2012-10-22 N. Mirabal , J. L. Contreras

The Credit Assignment Problem (CAP) refers to the longstanding challenge of Reinforcement Learning (RL) agents to associate actions with their long-term consequences. Solving the CAP is a crucial step towards the successful deployment of RL…

Machine Learning · Computer Science 2024-07-08 Eduardo Pignatelli , Johan Ferret , Matthieu Geist , Thomas Mesnard , Hado van Hasselt , Olivier Pietquin , Laura Toni

The question of how to determine which states and actions are responsible for a certain outcome is known as the credit assignment problem and remains a central research question in reinforcement learning and artificial intelligence.…

Machine Learning · Computer Science 2021-02-09 Hado van Hasselt , Sephora Madjiheurem , Matteo Hessel , David Silver , André Barreto , Diana Borsa

Developers often leave behind clues in their code, admitting where it falls short, known as Self-Admitted Technical Debt (SATD). In the world of Scientific Software (SSW), where innovation moves fast and collaboration is key, such debt is…

Software Engineering · Computer Science 2025-11-24 Eric L. Melin , Ahmed Musa Awon , Nasir U. Eisty , Neil A. Ernst , Shurui Zhou

Static Random-Access Memory (SRAM) yield analysis is essential for semiconductor innovation, yet research progress faces a critical challenge: the large gap between simplified academic models and the complexities observed in practice. The…

Hardware Architecture · Computer Science 2025-11-18 Shan Shen , Xingyang Li , Zhuohua Liu , Junhao Ma , Yikai Wang , Yiheng Wu , Yuquan Sun , Wei W. Xing

Transfer learning aims at improving the performance of target learners on target domains by transferring the knowledge contained in different but related source domains. In this way, the dependence on a large number of target domain data…

Machine Learning · Computer Science 2020-06-24 Fuzhen Zhuang , Zhiyuan Qi , Keyu Duan , Dongbo Xi , Yongchun Zhu , Hengshu Zhu , Hui Xiong , Qing He

Recent advances in deep reinforcement learning algorithms have shown great potential and success for solving many challenging real-world problems, including Go game and robotic applications. Usually, these algorithms need a carefully…

Machine Learning · Computer Science 2019-06-03 Yang Liu , Yunan Luo , Yuanyi Zhong , Xi Chen , Qiang Liu , Jian Peng

Safety validation is important during the development of safety-critical autonomous systems but can require significant computational effort. Existing algorithms often start from scratch each time the system under test changes. We apply…

Machine Learning · Computer Science 2020-12-11 Anthony Corso , Mykel J. Kochenderfer

This paper considers the estimation and prediction of a high-dimensional linear regression in the setting of transfer learning, using samples from the target model as well as auxiliary samples from different but possibly related regression…

Methodology · Statistics 2020-06-19 Sai Li , T. Tony Cai , Hongzhe Li

Posterior drift refers to changes in the relationship between responses and covariates while the distributions of the covariates remain unchanged. In this work, we explore functional linear regression under posterior drift with transfer…

Methodology · Statistics 2024-12-20 Xiaoyu Hu , Zhenhua Lin

Student mobility or academic mobility involves students moving between institutions during their post-secondary education, and one of the challenging tasks in this process is to assess the transfer credits to be offered to the incoming…

Computation and Language · Computer Science 2022-06-24 Dhivya Chandrasekaran , Vijay Mago

Credit assignment in reinforcement learning is the problem of measuring an action's influence on future rewards. In particular, this requires separating skill from luck, i.e. disentangling the effect of an action on rewards from that of…