English
Related papers

Related papers: KNN-Averaging for Noisy Multi-objective Optimisati…

200 papers

Bayesian Optimization (BO) is a common solution to search optimal hyperparameters based on sample observations of a machine learning model. Existing BO algorithms could converge slowly even collapse when the potential observation noise…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Lei Cui , Yangguang Li , Xin Lu , Dong An , Fenggang Liu

Nonconvex sparse models have received significant attention in high-dimensional machine learning. In this paper, we study a new model consisting of a general convex or nonconvex objectives and a variety of continuous nonconvex…

Optimization and Control · Mathematics 2020-10-26 Digvijay Boob , Qi Deng , Guanghui Lan , Yilin Wang

We study a variant of the canonical k-center problem over a set of vertices in a metric space, where the underlying distances are apriori unknown. Instead, we can query an oracle which provides noisy/incomplete estimates of the distance…

Data Structures and Algorithms · Computer Science 2022-04-05 Neharika Jali , Nikhil Karamchandani , Sharayu Moharir

Approximate K Nearest Neighbor (AKNN) algorithms play a pivotal role in various AI applications, including information retrieval, computer vision, and natural language processing. Although numerous AKNN algorithms and benchmarks have been…

Databases · Computer Science 2024-07-01 Xianzhi Zeng , Zhuoyan Wu , Xinjing Hu , Xuanhua Shi , Shixuan Sun , Shuhao Zhang

A multiple objective simulation optimization algorithm named Multiple Objective Probabilistic Branch and Bound with Single Observation (MOPBnB(so)) is presented for approximating the Pareto optimal set and the associated efficient frontier…

Optimization and Control · Mathematics 2025-06-06 Hao Huang , Zelda B. Zabinsky

Geometric programming problems occur frequently in engineering design and management. In multiobjective optimization, the trade-off information between different objective functions is probably the most important piece of information in a…

Data Structures and Algorithms · Computer Science 2010-03-25 A. K. Ojha , A. K. Das

This paper deals with the problem of finding suboptimal values of an unknown function on the basis of measured data corrupted by bounded noise. As a prior, we assume that the unknown function is parameterized in terms of a number of basis…

Optimization and Control · Mathematics 2025-06-10 Jaap Eising , Jorge Cortes

Learning a good distance metric in feature space potentially improves the performance of the KNN classifier and is useful in many real-world applications. Many metric learning algorithms are however based on the point estimation of a…

Computer Vision and Pattern Recognition · Computer Science 2016-04-11 Dong Wang , Xiaoyang Tan

Excess noise is a major obstacle to high-performance continuous-variable quantum key distribution (CVQKD), which is mainly derived from the amplitude attenuation and phase fluctuation of quantum signals caused by channel instability. Here,…

Quantum Physics · Physics 2022-07-22 Kexin Liang , Geng Chai , Zhengwen Cao , Qing Wang , Lei Wang , Jinye Peng

This paper presents a new solution for choosing the K parameter in the k-nearest neighbor (KNN) algorithm, the solution depending on the idea of ensemble learning, in which a weak KNN classifier is used each time with a different K,…

Machine Learning · Computer Science 2014-09-04 Ahmad Basheer Hassanat , Mohammad Ali Abbadi , Ghada Awad Altarawneh , Ahmad Ali Alhasanat

In high-dimensional data, structured noise caused by observed and unobserved factors affecting multiple target variables simultaneously, imposes a serious challenge for modeling, by masking the often weak signal. Therefore, (1) explaining…

Multi-objective learning endeavors to concurrently optimize multiple objectives using a single model, aiming to achieve high and balanced performance across diverse objectives. However, this often entails a more complex optimization…

Machine Learning · Computer Science 2025-05-16 Shijun Li , Hilaf Hasson , Jing Hu , Joydeep Ghosh

Aggregating signals from a collection of noisy sources is a fundamental problem in many domains including crowd-sourcing, multi-agent planning, sensor networks, signal processing, voting, ensemble learning, and federated learning. The core…

Machine Learning · Computer Science 2022-06-07 Ben Abramowitz , Nicholas Mattei

The advancement of imaging devices and countless images generated everyday pose an increasingly high demand on image denoising, which still remains a challenging task in terms of both effectiveness and efficiency. To improve denoising…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Zhaoming Kong , Fangxi Deng , Haomin Zhuang , Jun Yu , Lifang He , Xiaowei Yang

Consensus based optimization is a derivative-free particles-based method for the solution of global optimization problems. Several versions of the method have been proposed in the literature, and different convergence results have been…

Optimization and Control · Mathematics 2025-04-04 Stefania Bellavia , Greta Malaspina

Overfitting is one of the most critical challenges in deep neural networks, and there are various types of regularization methods to improve generalization performance. Injecting noises to hidden units during training, e.g., dropout, is…

Machine Learning · Computer Science 2017-11-10 Hyeonwoo Noh , Tackgeun You , Jonghwan Mun , Bohyung Han

In planning problems, it is often challenging to fully model the desired specifications. In particular, in human-robot interaction, such difficulty may arise due to human's preferences that are either private or complex to model.…

Robotics · Computer Science 2021-01-01 Mahsa Ghasemi , Evan Scope Crafts , Bo Zhao , Ufuk Topcu

This paper is devoted to the study of approximate solutions for a multiobjective interval-valued optimization problem based on an interval order. We establish new existence theorems of approximate solutions for such a problem under some…

Optimization and Control · Mathematics 2025-02-19 Chuang-liang Zhang , Yun-cheng Liu , Nan-jing Huang

K-nearest neighbors (KNN) is one of the earliest and most established algorithms in machine learning. For regression tasks, KNN averages the targets within a neighborhood which poses a number of challenges: the neighborhood definition is…

Machine Learning · Computer Science 2022-05-18 Youssef Nader , Leon Sixt , Tim Landgraf

In this paper, we address the problem of unsupervised video anomaly detection (UVAD). The task aims to detect abnormal events in test video using unlabeled videos as training data. The presence of anomalies in the training data poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Jihun Yi , Sungroh Yoon