中文
相关论文

相关论文: Design of Negative Sampling Strategies for Distant…

200 篇论文

In Natural Language Processing, entity linking (EL) has centered around Wikipedia, but yet remains underexplored for the job market domain. Disambiguating skill mentions can help us get insight into the current labor market demands. In this…

计算与语言 · 计算机科学 2024-02-01 Mike Zhang , Rob van der Goot , Barbara Plank

For many prediction tasks, stakeholders desire not only predictions but also supporting evidence that a human can use to verify its correctness. However, in practice, additional annotations marking supporting evidence may only be available…

计算与语言 · 计算机科学 2020-11-04 Danish Pruthi , Bhuwan Dhingra , Graham Neubig , Zachary C. Lipton

Supervised object detection has been proven to be successful in many benchmark datasets achieving human-level performances. However, acquiring a large amount of labeled image samples for supervised detection training is tedious,…

计算机视觉与模式识别 · 计算机科学 2021-05-12 Bishwo Adhikari , Esa Rahtu , Heikki Huttunen

Reinforcement learning (RL) has become a central component of post-training for large language models (LLMs), particularly for complex reasoning tasks that require stable optimization over long generation horizons. However, achieving…

机器学习 · 计算机科学 2026-02-17 Yuepeng Sheng , Yuwei Huang , Shuman Liu , Anxiang Zeng , Haibo Zhang

Gradient descent methods and especially their stochastic variants have become highly popular in the last decade due to their efficiency on big data optimization problems. In this thesis we present the development of data sampling strategies…

最优化与控制 · 数学 2018-04-03 Dominik Csiba

The growing demand for structured knowledge has led to great interest in relation extraction, especially in cases with limited supervision. However, existing distance supervision approaches only extract relations expressed in single…

计算与语言 · 计算机科学 2017-08-16 Chris Quirk , Hoifung Poon

Evaluation of models on benchmarks is unreliable without knowing the degree of sample hardness; this subsequently overestimates the capability of AI systems and limits their adoption in real world applications. We propose a Data Scoring…

计算与语言 · 计算机科学 2022-10-17 Swaroop Mishra , Anjana Arunkumar , Chris Bryan , Chitta Baral

We present a probabilistic modeling and inference framework for discriminative analysis dictionary learning under a weak supervision setting. Dictionary learning approaches have been widely used for tasks such as low-level signal denoising…

信号处理 · 电气工程与系统科学 2018-05-09 Zeyu You , Raviv Raich , Xiaoli Z. Fern , Jinsub Kim

Self-supervised learning aims to extract meaningful features from unlabeled data for further downstream tasks. In this paper, we consider classification as a downstream task in phase 2 and develop rigorous theories to realize the factors…

机器学习 · 计算机科学 2023-05-18 Ngoc N. Tran , Son Duong , Hoang Phan , Tung Pham , Dinh Phung , Trung Le

Negative sampling has emerged as an effective technique that enables deep learning models to learn better representations by introducing the paradigm of learn-to-compare. The goal of this approach is to add robustness to deep learning…

计算与语言 · 计算机科学 2025-03-26 Suman Adhya , Avishek Lahiri , Debarshi Kumar Sanyal , Partha Pratim Das

Distant supervision has been a widely used method for neural relation extraction for its convenience of automatically labeling datasets. However, existing works on distantly supervised relation extraction suffer from the low quality of test…

计算与语言 · 计算机科学 2020-10-20 Pengshuai Li , Xinsong Zhang , Weijia Jia , Wei Zhao

There has been significant recent progress in the area of unsupervised skill discovery, utilizing various information-theoretic objectives as measures of diversity. Despite these advances, challenges remain: current methods require…

机器学习 · 计算机科学 2024-06-24 Marin Vlastelica , Jin Cheng , Georg Martius , Pavel Kolev

Distantly Supervised Named Entity Recognition (DS-NER) has attracted attention due to its scalability and ability to automatically generate labeled data. However, distant annotation introduces many mislabeled instances, limiting its…

计算与语言 · 计算机科学 2025-04-08 Qi Zhang , Huitong Pan , Zhijia Chen , Longin Jan Latecki , Cornelia Caragea , Eduard Dragut

In recent years, text summarization methods have attracted much attention again thanks to the researches on neural network models. Most of the current text summarization methods based on neural network models are supervised methods which…

计算与语言 · 计算机科学 2024-01-25 Dehao Tao , Yingzhu Xiong , Zhongliang Yang , Yongfeng Huang

Large reasoning models such as DeepSeek-R1 and their distilled variants achieve strong performance on complex reasoning tasks. Yet, distilling these models often demands large-scale data for supervised fine-tuning (SFT), motivating the…

计算与语言 · 计算机科学 2026-01-16 Lechen Zhang , Yunxiang Zhang , Wei Hu , Lu Wang

We consider worker skill estimation for the single-coin Dawid-Skene crowdsourcing model. In practice, skill-estimation is challenging because worker assignments are sparse and irregular due to the arbitrary and uncontrolled availability of…

人机交互 · 计算机科学 2020-07-24 Yao Ma , Alex Olshevsky , Venkatesh Saligrama , Csaba Szepesvari

The task of event extraction has long been investigated in a supervised learning paradigm, which is bound by the number and the quality of the training instances. Existing training data must be manually generated through a combination of…

计算与语言 · 计算机科学 2017-12-12 Ying Zeng , Yansong Feng , Rong Ma , Zheng Wang , Rui Yan , Chongde Shi , Dongyan Zhao

Data inherently possesses dual attributes: samples and targets. For targets, knowledge distillation has been widely employed to accelerate model convergence, primarily relying on teacher-generated soft target supervision. Conversely, recent…

机器学习 · 计算机科学 2025-06-04 Runkang Yang , Peng Sun , Xinyi Shang , Yi Tang , Tao Lin

Instance discriminative self-supervised representation learning has been attracted attention thanks to its unsupervised nature and informative feature representation for downstream tasks. In practice, it commonly uses a larger number of…

机器学习 · 计算机科学 2022-01-17 Kento Nozawa , Issei Sato

Relation extraction (RE) aims to extract relations from sentences and documents. Existing relation extraction models typically rely on supervised machine learning. However, recent studies showed that many RE datasets are incompletely…

计算与语言 · 计算机科学 2023-06-19 Qingyu Tan , Lu Xu , Lidong Bing , Hwee Tou Ng