English
Related papers

Related papers: AdaNDV: Adaptive Number of Distinct Value Estimati…

200 papers

Estimating the number of distinct values (NDV) in a column is useful for many tasks in database systems, such as columnstore compression and data profiling. In this work, we focus on how to derive accurate NDV estimations from random…

Machine Learning · Computer Science 2022-02-08 Renzhi Wu , Bolin Ding , Xu Chu , Zhewei Wei , Xiening Dai , Tao Guan , Jingren Zhou

Number of Distinct Values (NDV) estimation of a multiset/column is a basis for many data management tasks, especially within databases. Despite decades of research, most existing methods require either a significant amount of samples…

Databases · Computer Science 2025-04-02 Xianghong Xu , Xiao He , Tieying Zhang , Lei Zhang , Rui Shi , Jianjun Chen

In data mining, estimating the number of distinct values (NDV) is a fundamental problem with various applications. Existing methods for estimating NDV can be broadly classified into two categories: i) scanning-based methods, which scan the…

Databases · Computer Science 2022-06-14 Jiajun Li , Zhewei Wei , Bolin Ding , Xiening Dai , Lu Lu , Jingren Zhou

We tackle unsupervised anomaly detection (UAD), a problem of detecting data that significantly differ from normal data. UAD is typically solved by using density estimation. Recently, deep neural network (DNN)-based density estimators, such…

Machine Learning · Statistics 2019-03-14 Masataka Yamaguchi , Yuma Koizumi , Noboru Harada

Recognizing text in the wild is a really challenging task because of complex backgrounds, various illuminations and diverse distortions, even with deep neural networks (convolutional neural networks and recurrent neural networks). In the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-11 Chun Yang , Xu-Cheng Yin , Zejun Li , Jianwei Wu , Chunchao Guo , Hongfa Wang , Lei Xiao

Data valuation has become a cornerstone of the modern data economy, where datasets function as tradable intellectual assets that drive decision-making, model training, and market transactions. Despite substantial progress, existing…

Machine Learning · Statistics 2025-12-25 Zhangyong Liang , Ji Zhang , Xin Wang , Pengfei Zhang , Zhao Li

Visual anomaly detection targets to detect images that notably differ from normal pattern, and it has found extensive application in identifying defective parts within the manufacturing industry. These anomaly detection paradigms…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Anindya Sundar Das , Guansong Pang , Monowar Bhuyan

Debiased machine learning estimators for smooth functionals in nonparametric models can exhibit substantial variability and instability, often leading practitioners to instead rely on parametric or semiparametric working models. Such…

Methodology · Statistics 2026-03-20 Lars van der Laan , Marco Carone , Alex Luedtke , Mark van der Laan

Probabilistic modeling is iterative. A scientist posits a simple model, fits it to her data, refines it according to her analysis, and repeats. However, fitting complex models to large data is a bottleneck in this process. Deriving…

Machine Learning · Statistics 2016-03-03 Alp Kucukelbir , Dustin Tran , Rajesh Ranganath , Andrew Gelman , David M. Blei

Automated visualization recommendation facilitates the rapid creation of effective visualizations, which is especially beneficial for users with limited time and limited knowledge of data visualization. There is an increasing trend in…

Human-Computer Interaction · Computer Science 2023-10-19 Songheng Zhang , Haotian Li , Huamin Qu , Yong Wang

Data valuation quantifies data importance, but existing methods cannot ensure validity in a single training process. The neural dynamic data valuation (NDDV) method [3] addresses this limitation. Based on NDDV, we are the first to explore…

Machine Learning · Computer Science 2025-12-19 Zhangyong Liang , Huanhuan Gao , Ji Zhang

We propose a new algorithm for training deep neural networks (DNNs) with binary weights. In particular, we first cast the problem of training binary neural networks (BiNNs) as a bilevel optimization instance and subsequently construct…

Machine Learning · Computer Science 2021-12-07 Huu Le , Rasmus Kjær Høier , Che-Tsung Lin , Christopher Zach

This paper considers the problem of distributed model fitting using the alternating directions method of multipliers (ADMM). ADMM splits the learning problem into several smaller subproblems, usually by partitioning the data samples. The…

Optimization and Control · Mathematics 2022-03-04 Dinesh Krishnamoorthy , Vyacheslav Kungurtsev

Anomaly detection tools and methods enable key analytical capabilities in modern cyberphysical and sensor-based systems. Despite the fast-paced development in deep learning architectures for anomaly detection, model optimization for a given…

Neural and Evolutionary Computing · Computer Science 2024-04-12 Marcin Pietroń , Dominik Żurek , Kamil Faber , Roberto Corizzo

Food authenticity studies are concerned with determining if food samples have been correctly labeled or not. Discriminant analysis methods are an integral part of the methodology for food authentication. Motivated by food authenticity…

Methodology · Statistics 2010-10-08 Thomas Brendan Murphy , Nema Dean , Adrian E. Raftery

To acquire a new skill, humans learn better and faster if a tutor, based on their current knowledge level, informs them of how much attention they should pay to particular content or practice problems. Similarly, a machine learning model…

Machine Learning · Computer Science 2021-06-18 Xinyi Wang , Hieu Pham , Paul Michel , Antonios Anastasopoulos , Jaime Carbonell , Graham Neubig

Anomaly detection tools and methods present a key capability in modern cyberphysical and failure prediction systems. Despite the fast-paced development in deep learning architectures for anomaly detection, model optimization for a given…

Machine Learning · Computer Science 2023-05-29 Marcin Pietron , Dominik Zurek , Kamil Faber , Roberto Corizzo

The Alternating Direction Method of Multipliers (ADMM) has been studied for years. The traditional ADMM algorithm needs to compute, at each iteration, an (empirical) expected loss function on all training examples, resulting in a…

Machine Learning · Statistics 2014-06-10 Peilin Zhao , Jinwei Yang , Tong Zhang , Ping Li

In supervised classification problems, the test set may contain data points belonging to classes not observed in the learning phase. Moreover, the same units in the test data may be measured on a set of additional variables recorded at a…

Methodology · Statistics 2021-02-04 Michael Fop , Pierre-Alexandre Mattei , Charles Bouveyron , Thomas Brendan Murphy

As Large Language Models (LLMs) are pre-trained on ultra-large-scale corpora, the problem of data contamination is becoming increasingly serious, and there is a risk that static evaluation benchmarks overestimate the performance of LLMs. To…

Computation and Language · Computer Science 2025-08-13 Yang Fan
‹ Prev 1 2 3 10 Next ›