中文
相关论文

相关论文: A Benchmark for Text Expansion: Datasets, Metrics,…

200 篇论文

Recent advances in text-driven image editing have been significant, yet the task of accurately evaluating these edited images continues to pose a considerable challenge. Different from the assessment of text-driven image generation,…

计算机视觉与模式识别 · 计算机科学 2025-01-20 Shangkun Sun , Bowen Qu , Xiaoyu Liang , Songlin Fan , Wei Gao

Image aesthetics is a crucial metric in the field of image generation. However, textual aesthetics has not been sufficiently explored. With the widespread application of large language models (LLMs), previous work has primarily focused on…

计算与语言 · 计算机科学 2024-11-06 Lingjie Jiang , Shaohan Huang , Xun Wu , Furu Wei

Many analysis and prediction tasks require the extraction of structured data from unstructured texts. However, an annotation scheme and a training dataset have not been available for training machine learning models to mine structured data…

信息检索 · 计算机科学 2025-06-24 Chaochao Zhou , Bo Yang

In the medical domain, identifying and expanding abbreviations in clinical texts is a vital task for both better human and machine understanding. It is a challenging task because many abbreviations are ambiguous especially for intensive…

计算与语言 · 计算机科学 2018-06-11 Yue Liu , Tao Ge , Kusum S. Mathews , Heng Ji , Deborah L. McGuinness

Text embeddings are commonly evaluated on a small set of datasets from a single task not covering their possible applications to other tasks. It is unclear whether state-of-the-art embeddings on semantic textual similarity (STS) can be…

计算与语言 · 计算机科学 2023-03-21 Niklas Muennighoff , Nouamane Tazi , Loïc Magne , Nils Reimers

This paper proposes Text mAtching based SequenTial rEcommendation model (TASTE), which maps items and users in an embedding space and recommends items by matching their text representations. TASTE verbalizes items and user-item interactions…

信息检索 · 计算机科学 2023-08-29 Zhenghao Liu , Sen Mei , Chenyan Xiong , Xiaohua Li , Shi Yu , Zhiyuan Liu , Yu Gu , Ge Yu

We propose BERTScore, an automatic evaluation metric for text generation. Analogously to common metrics, BERTScore computes a similarity score for each token in the candidate sentence with each token in the reference sentence. However,…

计算与语言 · 计算机科学 2020-02-25 Tianyi Zhang , Varsha Kishore , Felix Wu , Kilian Q. Weinberger , Yoav Artzi

Biomedical research results are being published at a high rate, and with existing search engines, the vast amount of published work is usually easily accessible. However, reproducing published results, either experimental data or…

分子网络 · 定量生物学 2017-06-19 Kai-Wen Liang , Qinsi Wang , Cheryl Telmer , Divyaa Ravichandran , Peter Spirtes , Natasa Miskov-Zivanov

Temporal expression (TE) normalization is a well-studied problem. However, the predominately used rule-based systems are highly restricted to specific settings, and upcoming machine learning approaches suffer from a lack of labeled data. In…

计算与语言 · 计算机科学 2024-04-12 Akash Kumar Gautam , Lukas Lange , Jannik Strötgen

Table-to-text generation aims at automatically generating natural text to help people to conveniently obtain the important information in tables. Although neural models for table-to-text have achieved remarkable progress, some problems…

计算与语言 · 计算机科学 2021-03-31 Liang Li , Can Ma , Yinliang Yue , Linjun Shou , Dayong Hu

We report on novel investigations into training models that make sentences concise. We define the task and show that it is different from related tasks such as summarization and simplification. For evaluation, we release two test sets,…

计算与语言 · 计算机科学 2022-11-09 Felix Stahlberg , Aashish Kumar , Chris Alberti , Shankar Kumar

The Entity Set Expansion (ESE) task aims to expand a handful of seed entities with new entities belonging to the same semantic class. Conventional ESE methods are based on mono-modality (i.e., literal modality), which struggle to deal with…

计算与语言 · 计算机科学 2023-07-28 Yangning Li , Tingwei Lu , Yinghui Li , Tianyu Yu , Shulin Huang , Hai-Tao Zheng , Rui Zhang , Jun Yuan

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

计算与语言 · 计算机科学 2025-06-12 Yuxin Jiang

As research on machine translation moves to translating text beyond the sentence level, it remains unclear how effective automatic evaluation metrics are at scoring longer translations. In this work, we first propose a method for creating…

计算与语言 · 计算机科学 2023-08-29 Daniel Deutsch , Juraj Juraska , Mara Finkelstein , Markus Freitag

As Large Language Models (LLMs) become increasingly integrated into real-world, autonomous applications, relying on static, pre-annotated references for evaluation poses significant challenges in cost, scalability, and completeness. We…

计算与语言 · 计算机科学 2025-06-23 Sher Badshah , Ali Emami , Hassan Sajjad

Table processing, a key task in natural language processing, has significantly benefited from recent advancements in language models (LMs). However, the capabilities of LMs in table-to-text generation, which transforms structured data into…

计算与语言 · 计算机科学 2024-10-18 Sahar Iravani , Tim . O . F Conrad

Results in interpretability suggest that large vision and language models learn implicit linear encodings when models are biased by in-context prompting. However, the existence of similar linear representations in more general adaptation…

机器学习 · 计算机科学 2025-12-18 Darrin O' Brien , Dhikshith Gajulapalli , Eric Xia

Accelerating exploration in visual reinforcement learning under sparse rewards remains challenging due to the substantial task-irrelevant variations. Despite advances in intrinsic exploration, many methods either assume access to…

人工智能 · 计算机科学 2026-02-24 Dayang Liang , Ruihan Liu , Lipeng Wan , Yunlong Liu , Bo An

As major progress is made in open-ended text generation, measuring how close machine-generated text is to human language remains a critical open problem. We introduce MAUVE, a comparison measure for open-ended text generation, which…

计算与语言 · 计算机科学 2021-11-24 Krishna Pillutla , Swabha Swayamdipta , Rowan Zellers , John Thickstun , Sean Welleck , Yejin Choi , Zaid Harchaoui

We introduce SelfExplain, a novel self-explaining model that explains a text classifier's predictions using phrase-based concepts. SelfExplain augments existing neural classifiers by adding (1) a globally interpretable layer that identifies…

计算与语言 · 计算机科学 2021-09-09 Dheeraj Rajagopal , Vidhisha Balachandran , Eduard Hovy , Yulia Tsvetkov