English
Related papers

Related papers: Starting Off on the Wrong Foot: Pitfalls in Data P…

200 papers

Traffic prediction is a crucial topic because of its broad scope of applications in the transportation domain. Recently, various studies have achieved promising results. However, most studies assume the prediction locations have complete or…

Machine Learning · Computer Science 2024-02-07 Hao Mei , Junxian Li , Zhiming Liang , Guanjie Zheng , Bin Shi , Hua Wei

Knowing when a trained segmentation model is encountering data that is different to its training data is important. Understanding and mitigating the effects of this play an important part in their application from a performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 David S. W. Williams , Daniele De Martini , Matthew Gadd , Paul Newman

A novel data-driven stochastic robust optimization (DDSRO) framework is proposed for optimization under uncertainty leveraging labeled multi-class uncertainty data. Uncertainty data in large datasets are often collected from various…

Machine Learning · Computer Science 2019-04-04 Chao Ning , Fengqi You

Methods to handle missing data have been extensively explored in the context of estimation and descriptive studies, with multiple imputation being the most widely used method in clinical research. However, in the context of clinical risk…

Methodology · Statistics 2024-11-25 Junhui Mi , Rahul D. Tendulkar , Sarah M. C. Sittenfeld , Sujata Patil , Emily C. Zabor

While many real-world data streams imply that they change frequently in a nonstationary way, most of deep learning methods optimize neural networks on training data, and this leads to severe performance degradation when dataset shift…

Machine Learning · Computer Science 2021-07-02 Wonju Lee , Seok-Yong Byun , Jooeun Kim , Minje Park , Kirill Chechil

Conditional risk minimization arises in high-stakes decisions where risk must be assessed in light of side information, such as stressed economic conditions, specific customer profiles, or other contextual covariates. Constructing reliable…

Machine Learning · Statistics 2025-09-30 Xinqiao Xie , Jonathan Yu-Meng Li

Black-box methods such as deep neural networks are exceptionally fast at obtaining point estimates of model parameters due to their amortisation of the loss function computation, but are currently restricted to settings for which simulating…

Methodology · Statistics 2024-12-31 Emily C. Hector , Amanda Lenzi

In the current competitive world, industrial companies seek to manufacture products of higher quality which can be achieved by increasing reliability, maintainability and thus the availability of products. On the other hand, improvement in…

Machine Learning · Computer Science 2012-01-31 Golriz Amooee , Behrouz Minaei-Bidgoli , Malihe Bagheri-Dehnavi

Predicting crash events is crucial for understanding crash distributions and their contributing factors, thereby enabling the design of proactive traffic safety policy interventions. However, existing methods struggle to interpret the…

Computation and Language · Computer Science 2025-05-22 Yang Zhao , Pu Wang , Yibo Zhao , Hongru Du , Hao Frank Yang

We consider the problem of remanufacturing planning in the presence of statistical estimation errors. Determining the optimal remanufacturing timing, first and foremost, requires modeling of the state transitions of a system. The estimation…

Optimization and Control · Mathematics 2021-03-19 Zhicheng Zhu , Yisha Xiang , Ming Zhao , Yue Shi

In a standard classification framework a set of trustworthy learning data are employed to build a decision rule, with the final aim of classifying unlabelled units belonging to the test set. Therefore, unreliable labelled observations,…

Applications · Statistics 2019-11-20 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

In today's corporate landscape, particularly where operations rely heavily on information technologies, establishing a robust business continuity plan, including a disaster recovery strategy, is essential for ensuring swift recuperation…

Networking and Internet Architecture · Computer Science 2025-12-02 Saso Nikolovski , Pece Mitrevski

Classification rules can be severely affected by the presence of disturbing observations in the training sample. Looking for an optimal classifier with such data may lead to unnecessarily complex rules. So, simpler effective classification…

Statistics Theory · Mathematics 2017-01-19 Marina Antolín , Eustasio Del Barrio , Jean-Michel Loubes

Failure in brittle materials led by the evolution of micro- to macro-cracks under repetitive or increasing loads is often catastrophic with no significant plasticity to advert the onset of fracture. Early failure detection with respective…

Computational Engineering, Finance, and Science · Computer Science 2020-03-25 Eduardo A. Barros de Moraes , Hadi Salehi , Mohsen Zayernouri

In scientific simulations, observations, and experiments, the cost of transferring data to and from disk and across networks has become a significant bottleneck that particularly impacts subsequent data analysis and visualization. To…

Databases · Computer Science 2023-08-24 Victor A. P. Magri , Peter Lindstrom

Errors are prevalent in time series data, such as GPS trajectories or sensor readings. Existing methods focus more on anomaly detection but not on repairing the detected anomalies. By simply filtering out the dirty data via anomaly…

Databases · Computer Science 2020-03-30 Aoqian Zhang , Shaoxu Song , Jianmin Wang , Philip S. Yu

The assessment of risk based on historical data faces many challenges, in particular due to the limited amount of available data, lack of stationarity, and heavy tails. While estimation on a short-term horizon for less extreme percentiles…

Risk Management · Quantitative Finance 2023-12-12 Marcin Pitera , Thorsten Schmidt , Łukasz Stettner

In the fields of big data, AI, and streaming processing, we work with large amounts of data from multiple sources. Due to memory and network limitations, we process data streams on distributed systems to alleviate computational and network…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-18 József Dániel Gáspár , Martin Horváth , Győző Horváth , Zoltán Zvara

Randomized experiments are the gold standard for causal inference but face significant challenges in business applications, including limited traffic allocation, the need for heterogeneous treatment effect estimation, and the complexity of…

Methodology · Statistics 2025-08-18 Zhenkang Peng , Chengzhang Li , Ying Rong , Renyu Zhang

When we use simulation to evaluate the performance of a stochastic system, the simulation often contains input distributions estimated from real-world data; therefore, there is both simulation and input uncertainty in the performance…

Methodology · Statistics 2020-11-10 Wei Xie , Barry L. Nelson , Russell R. Barton