English
Related papers

Related papers: Transcending the Attention Paradigm: Representatio…

200 papers

The geolocation of online information is an essential component in any geospatial application. While most of the previous work on geolocation has focused on Twitter, in this paper we quantify and compare the performance of text-based…

Computation and Language · Computer Science 2018-11-20 Konstantinos Pappas , Mahmoud Azab , Rada Mihalcea

Modern sociology has profoundly uncovered many convincing social criteria for behavioural analysis. Unfortunately, many of them are too subjective to be measured and presented in online social networks. On the other hand, data mining…

Social and Information Networks · Computer Science 2023-01-09 Xiangguo Sun , Hong Cheng , Bo Liu , Jia Li , Hongyang Chen , Guandong Xu , Hongzhi Yin

Transformer architecture has become ubiquitous in the natural language processing field. To interpret the Transformer-based models, their attention patterns have been extensively analyzed. However, the Transformer architecture is not only…

Computation and Language · Computer Science 2021-09-16 Goro Kobayashi , Tatsuki Kuribayashi , Sho Yokoi , Kentaro Inui

Citizens are actively interacting with their surroundings, especially through social media. Not only do shared posts give important information about what is happening (from the users' perspective), but also the metadata linked to these…

Social and Information Networks · Computer Science 2023-12-19 Héctor Cerezo-Costas , Ana Fernández Vilas , Manuela Martín-Vicente , Rebeca P. Díaz-Redondo

Computer-mediated communication is driving fundamental changes in the nature of written language. We investigate these changes by statistical analysis of a dataset comprising 107 million Twitter messages (authored by 2.7 million unique user…

Computation and Language · Computer Science 2014-11-25 Jacob Eisenstein , Brendan O'Connor , Noah A. Smith , Eric P. Xing

This paper investigates contextual word representation models from the lens of similarity analysis. Given a collection of trained models, we measure the similarity of their internal representations and attention. Critically, these models…

Computation and Language · Computer Science 2020-05-05 John M. Wu , Yonatan Belinkov , Hassan Sajjad , Nadir Durrani , Fahim Dalvi , James Glass

Self-attention networks have proven to be of profound value for its strength of capturing global dependencies. In this work, we propose to model localness for self-attention networks, which enhances the ability of capturing useful local…

Computation and Language · Computer Science 2018-10-25 Baosong Yang , Zhaopeng Tu , Derek F. Wong , Fandong Meng , Lidia S. Chao , Tong Zhang

Transformers have significantly advanced the field of natural language processing, but comprehending their internal mechanisms remains a challenge. In this paper, we introduce a novel geometric perspective that elucidates the inner…

Computation and Language · Computer Science 2023-09-20 Raul Molina

Information on social media spreads through an underlying diffusion network that connects people of common interests and opinions. This diffusion network often comprises multiple layers, each capturing the spreading dynamics of a certain…

Social and Information Networks · Computer Science 2024-10-08 Yan Xia , Ted Hsuan Yun Chen , Mikko Kivelä

With state-of-the-art models achieving high performance on standard benchmarks, contemporary research paradigms continue to emphasize general intelligence as an enduring objective. However, this pursuit overlooks the fundamental disparities…

Artificial Intelligence · Computer Science 2023-10-03 Nick DiSanto

Networked environments shape how information embedded in narratives influences individual and group beliefs and behavior. This raises key questions about how group communication around narrative media impacts belief formation and how such…

Social and Information Networks · Computer Science 2025-11-03 Abha Jha , J. Hunter Priniski , Carolyn Steinle , Fred Morstatter

Learning representations of spatial references in natural language is a key challenge in tasks like autonomous navigation and robotic manipulation. Recent work has investigated various neural architectures for learning multi-modal…

Computation and Language · Computer Science 2020-10-08 Tsung-Yen Yang , Andrew S. Lan , Karthik Narasimhan

Research in social media analysis is experiencing a recent surge with a large number of works applying representation learning models to solve high-level syntactico-semantic tasks such as sentiment analysis, semantic textual similarity…

Computation and Language · Computer Science 2016-11-16 J Ganesh , Manish Gupta , Vasudeva Varma

Social media and online review platforms have become valuable sources for studying how people express opinions, report experiences, and respond to events across space. This work presents a practical guide to using user-generated social data…

Social and Information Networks · Computer Science 2026-04-10 Lingyao Li

Sentiment analysis is crucial for understanding public opinion and consumer behavior. Existing models face challenges with linguistic diversity, generalizability, and explainability. We propose TRABSA, a hybrid framework integrating…

Computation and Language · Computer Science 2024-11-05 Md Abrar Jahin , Md Sakib Hossain Shovon , M. F. Mridha , Md Rashedul Islam , Yutaka Watanobe

User-generated data on social media contain rich information about who we are, what we like and how we make decisions. In this paper, we survey representative work on learning a concise latent user representation (a.k.a. user embedding)…

Artificial Intelligence · Computer Science 2021-05-18 Fatema Hasan , Kevin S. Xu , James R. Foulds , Shimei Pan

Social media outlets such as Twitter constitute valuable data sources for understanding human activities in the virtual world from a geographic perspective. This paper examines spatial distribution of tweets and densities within cities. The…

Physics and Society · Physics 2020-09-04 Bin Jiang , Ding Ma , Junjun Yin , Mats Sandberg

Social media has become an emerging alternative to opinion polls for public opinion collection, while it is still posing many challenges as a passive data source, such as structurelessness, quantifiability, and representativeness. Social…

Social and Information Networks · Computer Science 2020-05-26 Zhaoya Gong , Tengteng Cai , Jean-Claude Thill , Scott Hale , Mark Graham

The proliferation of e-commerce and urbanization has significantly intensified delivery operations in urban areas, boosting the volume and complexity of delivery demand. Data-driven predictive methods, especially those utilizing machine…

Machine Learning · Computer Science 2025-03-28 Tong Nie , Junlin He , Yuewen Mei , Guoyang Qin , Guilong Li , Jian Sun , Wei Ma

Transductive tasks on graphs differ fundamentally from typical supervised machine learning tasks, as the independent and identically distributed (i.i.d.) assumption does not hold among samples. Instead, all train/test/validation samples are…

Machine Learning · Computer Science 2024-11-21 Hamed Shirzad , Honghao Lin , Ameya Velingker , Balaji Venkatachalam , David Woodruff , Danica Sutherland