English
Related papers

Related papers: The Need for a Recurring Large-Scale Benchmarking …

200 papers

Understanding human attitudes, preferences, and behaviors through social surveys is essential for academic research and policymaking. Yet traditional surveys face persistent challenges, including fixed-question formats, high costs, limited…

Computation and Language · Computer Science 2025-11-14 Chenxi Lin , Weikang Yuan , Zhuoren Jiang , Biao Huang , Ruitao Zhang , Jianan Ge , Yueqian Xu , Jianxing Yu

In recent years, large language models (LLMs) have attracted attention due to their ability to generate human-like text. As surveys and opinion polls remain key tools for gauging public attitudes, there is increasing interest in assessing…

General Economics · Economics 2025-02-12 Shapeng Jiang , Lijia Wei , Chen Zhang

Mobile crowdsensing (MCS) is a promising sensing paradigm that leverages the diverse embedded sensors in massive mobile devices. A key objective in MCS is to efficiently schedule mobile users to perform multiple sensing tasks. Prior work…

Computer Science and Game Theory · Computer Science 2017-05-18 Changkun Jiang , Lin Gao , Lingjie Duan , Jianwei Huang

Finite population inference is a central goal in survey sampling. Probability sampling is the main statistical approach to finite population inference. Challenges arise due to high cost and increasing non-response rates. Data integration…

Methodology · Statistics 2020-01-13 Shu Yang , Jae Kwang Kim

Large-scale surveys are essential tools for informing social science research and policy, but running surveys is costly and time-intensive. If we could accurately simulate group-level survey results, this would therefore be very valuable to…

Computation and Language · Computer Science 2025-02-20 Yong Cao , Haijiang Liu , Arnav Arora , Isabelle Augenstein , Paul Röttger , Daniel Hershcovich

Public opinion surveys are vital for informing democratic decision-making, but responding to rapidly evolving information environments and measuring beliefs within niche communities can be challenging for traditional survey methods. This…

Computation and Language · Computer Science 2024-12-10 Yamil Velez

Survey sampling plays an important role in the efficient allocation and management of resources. The essence of survey sampling lies in acquiring a sample of data points from a population and subsequently using this sample to estimate the…

Methodology · Statistics 2024-01-29 Jonne Pohjankukka , Sakari Tuominen , Jukka Heikkonen

Surveys have recently gained popularity as a tool to study large language models. By comparing survey responses of models to those of human reference populations, researchers aim to infer the demographics, political opinions, or values best…

Computation and Language · Computer Science 2024-12-10 Ricardo Dominguez-Olmedo , Moritz Hardt , Celestine Mendler-Dünner

The research on the efforts of combining human and machine intelligence has a long history. With the development of mobile sensing and mobile Internet techniques, a new sensing paradigm called Mobile Crowd Sensing (MCS), which leverages the…

Human-Computer Interaction · Computer Science 2014-01-15 Bin Guo , Zhiwen Yu , Daqing Zhang , Xingshe Zhou

Interest in equilibrium-based sampling methods has grown with recent advances in computational hardware and Markov state modeling (MSM) methods, yet outstanding questions remain that hinder widespread adoption. Namely, how do sampling…

Biomolecules · Quantitative Biology 2018-05-15 Maxwell I. Zimmerman , Justin R. Porter , Xianqiang Sun , Roseane R. Silva , Gregory R. Bowman

Traditional survey-based political issue polling is becoming less tractable due to increasing costs and risk of bias associated with growing non-response rates and declining coverage of key demographic groups. With researchers and pollsters…

Computers and Society · Computer Science 2026-03-24 Eric Gong , Nathan E. Sanders , Bruce Schneier

Survey research has a long-standing history of being a human-powered field, but one that embraces various technologies for the collection, processing, and analysis of various behavioral, political, and social outcomes of interest, among…

Digital Libraries · Computer Science 2025-09-04 Trent D. Buskirk , Florian Keusch , Leah von der Heyde , Adam Eck

Sampling strategies have been widely applied in many recommendation systems to accelerate model learning from implicit feedback data. A typical strategy is to draw negative instances with uniform distribution, which however will severely…

Information Retrieval · Computer Science 2020-11-17 Jiawei Chen , Chengquan Jiang , Can Wang , Sheng Zhou , Yan Feng , Chun Chen , Martin Ester , Xiangnan He

This pedagogical review examines the use of machine learning methods in finite-population inference for survey sampling, with an emphasis on design-based validity and statistical inference. While flexible prediction tools offer substantial…

Methodology · Statistics 2026-05-19 Mehdi Dagdoug , David Haziza

Indirect surveys, in which respondents provide information about other people they know, have been proposed for estimating (nowcasting) the size of a \emph{hidden population} where privacy is important or the hidden population is hard to…

Social and Information Networks · Computer Science 2023-12-15 Ajitesh Srivastava , Juan Marcos Ramírez , Sergio Díaz-Aranda , Jose Aguilar , Antonio Ortega , Antonio Fernández Anta , Rosa Elvira Lillo

Administrative data, or non-probability sample data, are increasingly being used to obtain official statistics due to their many benefits over survey methods. In particular, they are less costly, provide a larger sample size, and are not…

Methodology · Statistics 2021-03-30 Asma Bahamyirou , Mireille E. Schnitzer

Evaluating LLMs and text-to-image models is a computationally intensive task often overlooked. Efficient evaluation is crucial for understanding the diverse capabilities of these models and enabling comparisons across a growing number of…

Nationally representative surveys track public opinion, yet they ask only a limited set of questions each year, limiting its potential to capture historical changes. To fill this gap, we develop a large language model (LLM)-based framework…

Computation and Language · Computer Science 2026-05-21 Junsol Kim , Byungkyu Lee

Social surveys have been widely used as a method of obtaining public opinion. Sometimes it is more ideal to collect opinions by presenting questions in free-response formats than in multiple-choice formats. Despite their advantages,…

Social and Information Networks · Computer Science 2020-07-09 Tatsuro Kawamoto , Takaaki Aoki

In this study, we propose a structured methodology that utilizes large language models (LLMs) in a cost-efficient and parsimonious manner, integrating the strengths of scholars and machines while offsetting their respective weaknesses. Our…

Computation and Language · Computer Science 2025-12-30 Navid Asgari , Benjamin M. Cole
‹ Prev 1 2 3 10 Next ›