English
Related papers

Related papers: Statistical Inference for Complete and Incomplete …

200 papers

Most practical data science problems encounter missing data. A wide variety of solutions exist, each with strengths and weaknesses that depend upon the missingness-generating process. Here we develop a theoretical framework for training and…

Machine Learning · Computer Science 2022-11-15 Jahan C. Penny-Dimri , Christoph Bergmeir , Julian Smith

The recent availability of digital traces from Information and Communications Technologies (ICT) has facilitated the study of both individual- and population-level movement with unprecedented spatiotemporal resolution, enabling us to better…

Physics and Society · Physics 2023-10-10 Surendra Hazarie , Hugo Barbosa , Adam Frank , Ronaldo Menezes , Gourab Ghoshal

Despite a large body of literature on trip inference using call detail record (CDR) data, a fundamental understanding of their limitations is lacking. In particular, because of the sparse nature of CDR data, users may travel to a location…

Applications · Statistics 2023-10-09 Zhan Zhao , Haris N. Koutsopoulos , Jinhua Zhao

Missingness in categorical data is a common problem in various real applications. Traditional approaches either utilize only the complete observations or impute the missing data by some ad hoc methods rather than the true conditional…

Methodology · Statistics 2019-07-12 Chaojie Wang , Linghao Shen , Han Li , Xiaodan Fan

Missing data is a crucial issue when applying machine learning algorithms to real-world datasets. Starting from the simple assumption that two batches extracted randomly from the same dataset should share the same distribution, we leverage…

Machine Learning · Statistics 2020-07-02 Boris Muzellec , Julie Josse , Claire Boyer , Marco Cuturi

This article provides an overview on the statistical modeling of complex data as increasingly encountered in modern data analysis. It is argued that such data can often be described as elements of a metric space that satisfies certain…

Methodology · Statistics 2024-02-28 Paromita Dubey , Yaqing Chen , Hans-Georg Müller

Research into, and design and construction of mobile systems and algorithms requires access to large-scale mobility data. Unfortunately, the wireless and mobile research community lacks such data. For instance, the largest available human…

Networking and Internet Architecture · Computer Science 2009-09-21 Pan Hui , Richard Mortier , Tristan Henderson , Jon Crowcroft

Individual mobility prediction is an essential task for transportation demand management and traffic system operation. There exist a large body of works on modeling location sequence and predicting the next location of users; however,…

Machine Learning · Computer Science 2021-09-08 Yuankai Wu , Zhanhong Cheng , Lijun Sun

Methods for addressing missing data have become much more accessible to applied researchers. However, little guidance exists to help researchers systematically identify plausible missing data mechanisms in order to ensure that these methods…

Applications · Statistics 2020-07-29 Adam Davey , Ting Dai

Time-of-flight measurements such as the OPERA and MINOS experiments rely crucially on statistical analysis (as well as many other ingredients) for their conclusions. The nature of these experiments leads to a simple class of statistical…

High Energy Physics - Experiment · Physics 2011-11-02 Oliver Riordan , Alex Selby

Statistical modeling of animal movement is of critical importance. The continuous trajectory of an animal's movements is only observed at discrete, often irregularly spaced time points. Most existing models cannot handle the unequal…

Methodology · Statistics 2021-08-13 Chaoran Hu , Mark Elbroch , Thomas Meyer , Vladimir Pozdnyakov , Jun Yan

We present a method for incorporating missing data in non-parametric statistical learning without the need for imputation. We focus on a tree-based method, Bayesian Additive Regression Trees (BART), enhanced with "Missingness Incorporated…

Machine Learning · Statistics 2014-02-14 Adam Kapelner , Justin Bleich

The communication devices have produced digital traces for their users either voluntarily or not. This type of collective data can give powerful indications that are affecting the urban systems design and development. In this study mobile…

Social and Information Networks · Computer Science 2018-07-16 Suhad Faisal Behadili , Cyrille Bertelle , Loay E. George

A large fraction of data generated via human activities such as online purchases, health records, spatial mobility etc. can be represented as a sequence of events over a continuous-time. Learning deep learning models over these…

Machine Learning · Computer Science 2022-08-29 Vinayak Gupta , Srikanta Bedathur , Sourangshu Bhattacharya , Abir De

We investigate methods for penalized regression in the presence of missing observations. This paper introduces a method for estimating the parameters which compensates for the missing observations. We first, derive an unbiased estimator of…

Applications · Statistics 2013-10-09 Yunjin Choi , Robert Tibshirani

Human mobility is investigated using a continuum approach that allows to calculate the probability to observe a trip to anyarbitrary region, and the fluxes between any two regions. The considered description offers a general and unified…

Physics and Society · Physics 2013-04-02 Filippo Simini , Amos Maritan , Zoltán Néda

In this paper, we extend some ideas of statistical physics to describe the properties of human mobility. From a physical point of view, we consider the statistical empirical laws of private cars mobility, taking advantage of a GPS database…

Physics and Society · Physics 2015-01-12 Riccardo Gallotti , Armando Bazzani , Sandro Rambaldi

Missing data is pervasive in econometric applications, and rarely is it plausible that the data are missing (completely) at random. This paper proposes a methodology for studying the robustness of results drawn from incomplete datasets.…

Econometrics · Economics 2025-12-29 Daniel Ober-Reynolds

Vehicle mobility has a significant impact on wireless communication between vehicles (buses) in Public Transportation Systems (PTS). Nevertheless, the transportation literature does not provide satisfactory models for bus movements because…

Networking and Internet Architecture · Computer Science 2025-06-04 Eduardo R. Manika , Emilio C. G. Wille , Joilson Alves

Missing data is an inevitable and common problem in data-driven intelligent transportation systems (ITS). In the past decade, scholars have done many research on the recovery of missing traffic data, however how to make full use of…

Signal Processing · Electrical Eng. & Systems 2022-08-17 Yuting Ding , Di Wu