English
Related papers

Related papers: Extending Text Informativeness Measures to Passage…

200 papers

Many tasks in Natural Language Processing involve recognizing lexical entailment. Two different approaches to this problem have been proposed recently that are quite different from each other. The first is an asymmetric similarity measure…

Computation and Language · Computer Science 2014-12-03 John Wieting

Modeling topics effectively in short texts, such as tweets and news snippets, is crucial to capturing rapidly evolving social trends. Existing topic models often struggle to accurately capture the underlying semantic patterns of short…

Computation and Language · Computer Science 2025-02-18 Shuyu Chang , Rui Wang , Peng Ren , Qi Wang , Haiping Huang

With the growing popularity of general-purpose Large Language Models (LLMs), comes a need for more global explanations of model behaviors. Concept-based explanations arise as a promising avenue for explaining high-level patterns learned by…

Artificial Intelligence · Computer Science 2024-10-07 Meng Li , Haoran Jin , Ruixuan Huang , Zhihao Xu , Defu Lian , Zijia Lin , Di Zhang , Xiting Wang

Text summarization is the research area aiming at creating a short and condensed version of the original document, which conveys the main idea of the document in a few words. This research topic has started to attract the attention of a…

Computation and Language · Computer Science 2020-05-12 Shen Gao , Xiuying Chen , Zhaochun Ren , Dongyan Zhao , Rui Yan

Text classification, a core component of task-oriented dialogue systems, attracts continuous research from both the research and industry community, and has resulted in tremendous progress. However, existing method does not consider the use…

Computation and Language · Computer Science 2022-12-16 Yifeng Xie

The study of the stock market with the attraction of machine learning approaches is a major direction for revealing hidden market regularities. This knowledge contributes to a profound understanding of financial market dynamics and getting…

Machine Learning · Computer Science 2023-03-28 Andrei Zaichenko , Aleksei Kazakov , Elizaveta Kovtun , Semen Budennyy

The amount of information stored in the form of documents on the internet has been increasing rapidly. Thus it has become a necessity to organize and maintain these documents in an optimum manner. Text classification algorithms study the…

Computation and Language · Computer Science 2022-02-22 Vedangi Wagh , Snehal Khandve , Isha Joshi , Apurva Wani , Geetanjali Kale , Raviraj Joshi

Following the recent success of word embeddings, it has been argued that there is no such thing as an ideal representation for words, as different models tend to capture divergent and often mutually incompatible aspects like…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Iñigo Lopez-Gazpio , Eneko Agirre

This paper considers the problem of automatically characterizing overall attitudes and biases that may be associated with emerging information operations via artificial intelligence. Accurate analysis of these emerging topics usually…

Computers and Society · Computer Science 2020-12-07 Autumn Toney , Akshat Pandey , Wei Guo , David Broniatowski , Aylin Caliskan

Word embeddings have been shown to benefit from ensambling several word embedding sources, often carried out using straightforward mathematical operations over the set of word vectors. More recently, self-supervised learning has been used…

Computation and Language · Computer Science 2020-01-27 James O' Neill , Danushka Bollegala

A major difficulty in applying word vector embeddings in IR is in devising an effective and efficient strategy for obtaining representations of compound units of text, such as whole documents, (in comparison to the atomic words), for the…

Information Retrieval · Computer Science 2016-06-28 Dwaipayan Roy , Debasis Ganguly , Mandar Mitra , Gareth J. F. Jones

One of the first steps in many text-based social science studies is to retrieve documents that are relevant for the analysis from large corpora of otherwise irrelevant documents. The conventional approach in social science to address this…

Information Retrieval · Computer Science 2022-05-04 Sandra Wankmüller

We investigate the integration of word embeddings as classification features in the setting of large scale text classification. Such representations have been used in a plethora of tasks, however their application in classification…

Computation and Language · Computer Science 2016-06-22 Georgios Balikas , Massih-Reza Amini

Recently, it has been claimed that a linear relationship between a measure of information content and word length is expected from word length optimization and it has been shown that this linearity is supported by a strong correlation…

Data Analysis, Statistics and Probability · Physics 2019-12-11 Ramon Ferrer-i-Cancho , Fermín Moscoso del Prado Martín

Automatic sentence summarization produces a shorter version of a sentence, while preserving its most important information. A good summary is characterized by language fluency and high information overlap with the source sentence. We model…

Computation and Language · Computer Science 2020-05-06 Raphael Schumann , Lili Mou , Yao Lu , Olga Vechtomova , Katja Markert

Word embeddings carry stereotypical connotations from the text they are trained on, which can lead to invalid inferences in downstream models that rely on them. We use this observation to design a mechanism for measuring stereotypes using…

Computation and Language · Computer Science 2019-11-27 Sunipa Dev , Tao Li , Jeff Phillips , Vivek Srikumar

Text representations using neural word embeddings have proven effective in many NLP applications. Recent researches adapt the traditional word embedding models to learn vectors of multiword expressions (concepts/entities). However, these…

Computation and Language · Computer Science 2018-12-21 Walid Shalaby , Wlodek Zadrozny , Hongxia Jin

Attribution and fact verification are critical challenges in natural language processing for assessing information reliability. While automated systems and Large Language Models (LLMs) aim to retrieve and select concise evidence to support…

Computation and Language · Computer Science 2026-01-30 Guy Alt , Eran Hirsch , Serwar Basch , Ido Dagan , Oren Glickman

This paper presents an unsupervised extractive approach to summarize scientific long documents based on the Information Bottleneck principle. Inspired by previous work which uses the Information Bottleneck principle for sentence…

Computation and Language · Computer Science 2021-10-05 Jiaxin Ju , Ming Liu , Huan Yee Koh , Yuan Jin , Lan Du , Shirui Pan

Summarization is a way to represent same information in concise way with equal sense. This can be categorized in two type Abstractive and Extractive type. Our work is focused around Extractive summarization. A generic approach to extractive…

Information Retrieval · Computer Science 2017-05-19 Chandra Shekhar Yadav , Aditi Sharan