English
Related papers

Related papers: User Sentiment as a Success Metric: Persistent Bia…

200 papers

Aspect-Based Sentiment Analysis (ABSA) provides a fine-grained understanding of opinions by linking sentiment to specific aspects in text. While transformer-based models excel at this task, their black-box nature limits their…

Methodology · Statistics 2026-02-24 Luisa Stracqualursi , Patrizia Agati

In this paper, we propose a robust method to estimate the average treatment effects in observational studies when the number of potential confounders is possibly much greater than the sample size. We first use a class of penalized…

Methodology · Statistics 2018-12-21 Yang Ning , Sida Peng , Kosuke Imai

With the proliferation of its applications in various industries, sentiment analysis by using publicly available web data has become an active research area in text classification during these years. It is argued by researchers that…

Computation and Language · Computer Science 2013-08-06 Jimmy SJ. Ren , Wei Wang , Jiawei Wang , Stephen Shaoyi Liao

We study the relationship between the sentiment levels of Twitter users and the evolving network structure that the users created by @-mentioning each other. We use a large dataset of tweets to which we apply three sentiment scoring…

Social and Information Networks · Computer Science 2016-04-13 Nathaniel Charlton , Colin Singleton , Danica Vukadinović Greetham

Recent neural-based aspect-based sentiment analysis approaches, though achieving promising improvement on benchmark datasets, have reported suffering from poor robustness when encountering confounder such as non-target aspects. In this…

Computation and Language · Computer Science 2021-04-26 Zhen Bi , Ningyu Zhang , Ganqiang Ye , Haiyang Yu , Xi Chen , Huajun Chen

This paper proposes new estimators for the propensity score that aim to maximize the covariate distribution balance among different treatment groups. Heuristically, our proposed procedure attempts to estimate a propensity score model by…

Econometrics · Economics 2020-04-07 Pedro H. C. Sant'Anna , Xiaojun Song , Qi Xu

Randomized experimentation (also known as A/B testing or bucket testing) is widely used in the internet industry to measure the metric impact obtained by different treatment variants. A/B tests identify the treatment variant showing the…

A/B testing methodology is generally performed by private companies to increase user engagement and satisfaction about online features. Their usage is far from being transparent and may undermine user autonomy (e.g. polarizing individual…

Social and Information Networks · Computer Science 2024-05-03 Matteo Ottaviani , Stefan M. Herzog , Pietro Leonardo Nickl , Philipp Lorenz-Spreen

The bias of an estimator is defined as the difference of its expected value from the parameter to be estimated, where the expectation is with respect to the model. Loosely speaking, small bias reflects the desire that if an experiment is…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis

Reducing negative user experiences is essential for the success of recommendation platforms. Exposing users to inappropriate content could not only adversely affect users' psychological well-beings, but also potentially drive users away…

Information Retrieval · Computer Science 2025-02-18 Chenghui Yu , Peiyi Li , Haoze Wu , Yiri Wen , Bingfeng Deng , Hongyu Xiong

Marginal structural models are a popular tool for investigating the effects of time-varying treatments, but they require an assumption of no unobserved confounders between the treatment and outcome. With observational data, this assumption…

Methodology · Statistics 2021-06-10 Matthew Blackwell , Soichiro Yamauchi

Oversubscribed treatments are often allocated using randomized waiting lists. Applicants are ranked randomly, and treatment offers are made following that ranking until all seats are filled. To estimate causal effects, researchers often…

Methodology · Statistics 2018-10-24 Clement de Chaisemartin , Luc Behaghel

Random-effects meta-analyses of observational studies can produce biased estimates if the synthesized studies are subject to unmeasured confounding. We propose sensitivity analyses quantifying the extent to which unmeasured confounding of…

Methodology · Statistics 2017-10-10 Maya B. Mathur , Tyler J. VanderWeele

This paper studies inference in randomized controlled trials with covariate-adaptive randomization when there are multiple treatments. More specifically, we study inference about the average effect of one or more treatments relative to…

Econometrics · Economics 2019-01-21 Federico A. Bugni , Ivan A. Canay , Azeem M. Shaikh

We establish the asymptotic normality of the regression estimator in a fixed-design setting when the errors are given by a field of dependent random variables. The result applies to martingale-difference or strongly mixing random fields. On…

Statistics Theory · Mathematics 2009-07-10 Mohamed El Machkouri , Radu Stoica

One central goal of design of observational studies is to embed non-experimental data into an approximate randomized controlled trial using statistical matching. Despite empirical researchers' best intention and effort to create…

Methodology · Statistics 2022-06-22 Kan Chen , Siyu Heng , Qi Long , Bo Zhang

We consider the conditional randomization test as a way to account for covariate imbalance in randomized experiments. The test accounts for covariate imbalance by comparing the observed test statistic to the null distribution of the test…

Biases induced to text by generative models have become an increasingly large topic in recent years. In this paper we explore how machine translation might introduce a bias in sentiments as classified by sentiment analysis models. For this,…

Computation and Language · Computer Science 2023-06-13 Kai Hartung , Aaricia Herygers , Shubham Kurlekar , Khabbab Zakaria , Taylan Volkan , Sören Gröttrup , Munir Georges

Rating prediction is an important application, and a popular research topic in collaborative filtering. However, both the validity of learning algorithms, and the validity of standard testing procedures rest on the assumption that missing…

Machine Learning · Computer Science 2012-06-26 Benjamin Marlin , Richard S. Zemel , Sam Roweis , Malcolm Slaney

Missing exposure information is a very common feature of many observational studies. Here we study identifiability and efficient estimation of causal effects on vector outcomes, in such cases where treatment is unconfounded but partially…

Methodology · Statistics 2020-02-04 Edward H. Kennedy