English
Related papers

Related papers: Gradient Imitation Reinforcement Learning for Low …

200 papers

Distant supervision assumes that any sentence containing the same entity pairs reflects identical relationships. Previous works of distantly supervised relation extraction (DSRE) task generally focus on sentence-level or bag-level…

Computation and Language · Computer Science 2022-03-03 Dongyang Li , Taolin Zhang , Nan Hu , Chengyu Wang , Xiaofeng He

ROI extraction is an active but challenging task in remote sensing because of the complicated landform, the complex boundaries and the requirement of annotations. Weakly supervised learning (WSL) aims at learning a mapping from input image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Lingfeng He , Mengze Xu , Jie Ma

Recent years have seen rapid development in Information Extraction, as well as its subtask, Relation Extraction. Relation Extraction is able to detect semantic relations between entities in sentences. Currently, many efficient approaches…

Computation and Language · Computer Science 2024-03-19 Zhuang Li

Meta-reinforcement learning (meta-RL) aims to learn from multiple training tasks the ability to adapt efficiently to unseen test tasks. Despite the success, existing meta-RL algorithms are known to be sensitive to the task distribution…

Machine Learning · Computer Science 2021-03-02 Zichuan Lin , Garrett Thomas , Guangwen Yang , Tengyu Ma

Reinforcement learning has emerged as a powerful paradigm for improving large language model (LLM) reasoning, where rollouts are sampled from the policy and reward signals computed on those rollouts are used to update the policy. However,…

Machine Learning · Computer Science 2026-05-25 Tianyang Luo , Tao Feng , Zhigang Hua , Yan Xie , Shuang Yang , Ge Liu , Jiaxuan You

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as homogeneous, thereby…

Machine Learning · Computer Science 2024-12-16 Mark Beliaev , Ramtin Pedarsani

Low-shot relation extraction~(RE) aims to recognize novel relations with very few or even no samples, which is critical in real scenario application. Few-shot and zero-shot RE are two representative low-shot RE tasks, which seem to be with…

Computation and Language · Computer Science 2022-03-24 Fangchao Liu , Hongyu Lin , Xianpei Han , Boxi Cao , Le Sun

The field of relation extraction (RE) is experiencing a notable shift towards generative relation extraction (GRE), leveraging the capabilities of large language models (LLMs). However, we discovered that traditional relation extraction…

Computation and Language · Computer Science 2024-02-19 Pengcheng Jiang , Jiacheng Lin , Zifeng Wang , Jimeng Sun , Jiawei Han

Traditional Incremental Learning (IL) targets to handle sequential fully-supervised learning problems where novel classes emerge from time to time. However, due to inherent annotation uncertainty and ambiguity, collecting high-quality…

Machine Learning · Computer Science 2025-05-08 Rui Wang , Mingxuan Xia , Chang Yao , Lei Feng , Junbo Zhao , Gang Chen , Haobo Wang

Designing rewards for Reinforcement Learning (RL) is challenging because it needs to convey the desired task, be efficient to optimize, and be easy to compute. The latter is particularly problematic when applying RL to robotics, where…

Machine Learning · Computer Science 2020-05-28 Yiming Ding , Carlos Florensa , Mariano Phielipp , Pieter Abbeel

Incremental Named Entity Recognition (INER) involves the sequential learning of new entity types without accessing the training data of previously learned types. However, INER faces the challenge of catastrophic forgetting specific for…

Computation and Language · Computer Science 2023-08-21 Duzhen Zhang , Hongliu Li , Wei Cong , Rongtao Xu , Jiahua Dong , Xiuyi Chen

Offline goal-conditioned reinforcement learning (GCRL) is a promising approach for pretraining generalist policies on large datasets of reward-free trajectories, akin to the self-supervised objectives used to train foundation models for…

Machine Learning · Computer Science 2026-01-05 John L. Zhou , Jonathan C. Kao

Active learning is an iterative labeling process that is used to obtain a small labeled subset, despite the absence of labeled data, thereby enabling to train a model for supervised tasks such as text classification. While active learning…

Computation and Language · Computer Science 2024-10-07 Christopher Schröder , Gerhard Heyer

Domain-specific intelligence demands specialized knowledge and sophisticated reasoning for problem-solving, posing significant challenges for large language models (LLMs) that struggle with knowledge hallucination and inadequate reasoning…

Computation and Language · Computer Science 2025-05-20 Zhengren Wang , Jiayang Yu , Dongsheng Ma , Zhe Chen , Yu Wang , Zhiyu Li , Feiyu Xiong , Yanfeng Wang , Weinan E , Linpeng Tang , Wentao Zhang

Relation extraction (RE) has been extensively studied due to its importance in real-world applications such as knowledge base construction and question answering. Most of the existing works train the models on either distantly supervised…

Computation and Language · Computer Science 2020-11-25 Woohwan Jung , Kyuseok Shim

Model-free deep reinforcement learning (RL) agents can learn an effective policy directly from repeated interactions with a black-box environment. However in practice, the algorithms often require large amounts of training experience to…

Machine Learning · Computer Science 2020-05-29 Parth Chadha

Two key obstacles in biomedical relation extraction (RE) are the scarcity of annotations and the prevalence of instances without explicitly pre-defined labels due to low annotation coverage. Existing approaches, which treat biomedical RE as…

Computation and Language · Computer Science 2023-10-20 Jiashu Xu , Mingyu Derek Ma , Muhao Chen

The goal of multi-label learning (MLL) is to associate a given instance with its relevant labels from a set of concepts. Previous works of MLL mainly focused on the setting where the concept set is assumed to be fixed, while many real-world…

Machine Learning · Computer Science 2021-10-01 Cheng-Yu Hsieh , Wei-I Lin , Miao Xu , Gang Niu , Hsuan-Tien Lin , Masashi Sugiyama

Deep learning based models have excelled in many computer vision tasks and appear to surpass humans' performance. However, these models require an avalanche of expensive human labeled training data and many iterations to train their large…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Yikai Wang , Li Zhang , Yuan Yao , Yanwei Fu

In aligning large language models (LLMs), reward models have played an important role, but are standardly trained as discriminative models and rely only on labeled human preference data. In this paper, we explore methods that train reward…

Computation and Language · Computer Science 2026-01-27 Chenglong Wang , Yang Gan , Yifu Huo , Yongyu Mu , Qiaozhi He , Murun Yang , Bei Li , Tong Xiao , Chunliang Zhang , Tongran Liu , Jingbo Zhu