English
Related papers

Related papers: Global Truncated Loss Minimization for Robust and …

200 papers

Developing a contemporary optimal transport (OT) solver requires navigating trade-offs among several critical requirements: GPU parallelization, scalability to high-dimensional problems, theoretical convergence guarantees, empirical…

Machine Learning · Computer Science 2025-04-04 Mete Kemertas , Amir-massoud Farahmand , Allan D. Jepson

Gradient-based meta-learning (GBML) with deep neural nets (DNNs) has become a popular approach for few-shot learning. However, due to the non-convexity of DNNs and the bi-level optimization in GBML, the theoretical properties of GBML with…

Machine Learning · Computer Science 2020-11-17 Haoxiang Wang , Ruoyu Sun , Bo Li

We analyze the performance of graph neural network (GNN) architectures from the perspective of random graph theory. Our approach promises to complement existing lenses on GNN analysis, such as combinatorial expressive power and worst-case…

Machine Learning · Computer Science 2023-10-12 Drake Brown , Trevor Garrity , Kaden Parker , Jason Oliphant , Stone Carson , Cole Hanson , Zachary Boyd

Graph Neural Networks (GNNs) have achieved impressive performance in collaborative filtering. However, GNNs tend to yield inferior performance when the distributions of training and test data are not aligned well. Also, training GNNs…

Machine Learning · Computer Science 2023-07-19 Huiyuan Chen , Chin-Chia Michael Yeh , Yujie Fan , Yan Zheng , Junpeng Wang , Vivian Lai , Mahashweta Das , Hao Yang

Multiscale topology optimization (M-TO) entails generating an optimal global topology, and an optimal set of microstructures at a smaller scale, for a physics-constrained problem. With the advent of additive manufacturing, M-TO has gained…

Computational Engineering, Finance, and Science · Computer Science 2022-04-15 Aaditya Chandrasekhar , Saketh Sridhara , Krishnan Suresh

Outliers widely occur in big-data applications and may severely affect statistical estimation and inference. In this paper, a framework of outlier-resistant estimation is introduced to robustify an arbitrarily given loss function. It has a…

Methodology · Statistics 2023-04-20 Yiyuan She , Zhifeng Wang , Jiahui Shen

Gradient temporal-difference (GTD) learning algorithms are widely used for off-policy policy evaluation with function approximation. However, existing convergence analyses rely on the restrictive assumption that the so-called feature…

Machine Learning · Computer Science 2026-05-11 Hyunjun Na , Donghwan Lee

In this paper, we present LBM-GNN, a novel approach that enhances the traditional Lattice Boltzmann Method (LBM) with Graph Neural Networks (GNNs). We apply this method to fluid dynamics simulations, demonstrating improved stability and…

Fluid Dynamics · Physics 2025-11-03 Yue Li

Total least squares (TLS) methods have been widely used in data fitting. Compared with the least squares method, for TLS problem we takes into account not only the observation errors, but also the errors in the measurement matrix. This is…

Numerical Analysis · Mathematics 2022-05-03 Qian Zuo , Yimin Wei , Hua Xiang

In this paper, we study the generalization capabilities of geometric graph neural networks (GNNs). We consider GNNs over a geometric graph constructed from a finite set of randomly sampled points over an embedded manifold with topological…

Signal Processing · Electrical Eng. & Systems 2025-06-10 Zhiyang Wang , Juan Cervino , Alejandro Ribeiro

In this paper, our goal is to design a simple learning paradigm for long-tail visual recognition, which not only improves the robustness of the feature extractor but also alleviates the bias of the classifier towards head classes while…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Fei Du , Peng Yang , Qi Jia , Fengtao Nan , Xiaoting Chen , Yun Yang

The threat of adversarial examples has motivated work on training certifiably robust neural networks to facilitate efficient verification of local robustness at inference time. We formalize a notion of global robustness, which captures the…

Machine Learning · Computer Science 2021-06-15 Klas Leino , Zifan Wang , Matt Fredrikson

Learning with a {\it convex loss} function has been a dominating paradigm for many years. It remains an interesting question how non-convex loss functions help improve the generalization of learning with broad applicability. In this paper,…

Machine Learning · Computer Science 2018-05-22 Yi Xu , Shenghuo Zhu , Sen Yang , Chi Zhang , Rong Jin , Tianbao Yang

Mixture modelling using elliptical distributions promises enhanced robustness, flexibility and stability over the widely employed Gaussian mixture model (GMM). However, existing studies based on the elliptical mixture model (EMM) are…

Machine Learning · Computer Science 2020-09-30 Shengxi Li , Zeyang Yu , Danilo Mandic

This article presents GLIM, a 3D range-inertial localization and mapping framework with GPU-accelerated scan matching factors. The odometry estimation module of GLIM employs a combination of fixed-lag smoothing and keyframe-based point…

Robotics · Computer Science 2024-07-16 Kenji Koide , Masashi Yokozuka , Shuji Oishi , Atsuhiko Banno

Computing the exact optimal experimental design has been a longstanding challenge in various scientific fields. This problem, when formulated using a specific information function, becomes a mixed-integer nonlinear programming (MINLP)…

Methodology · Statistics 2024-09-30 Ling Liang , Haizhao Yang

Robust estimation is primarily concerned with providing reliable parameter estimates in the presence of outliers. Numerous robust loss functions have been proposed in regression and classification, along with various computing algorithms.…

Methodology · Statistics 2024-02-26 Zhu Wang

In this study, we address the challenge of constructing continuous three-dimensional (3D) models that accurately represent uncertain surfaces, derived from noisy and incomplete LiDAR scanning data. Building upon our prior work, which…

Robotics · Computer Science 2024-10-27 Qianqian Zou , Monika Sester

In this paper, we propose a novel kernel stochastic gradient descent (SGD) algorithm for large-scale supervised learning with general losses. Compared to traditional kernel SGD, our algorithm improves efficiency and scalability through an…

Machine Learning · Computer Science 2026-04-28 Jinhui Bai , Andreas Christmann , Lei Shi

This paper proposes an efficient implementation of the generalized labeled multi-Bernoulli (GLMB) filter by combining the prediction and update into a single step. In contrast to an earlier implementation that involves separate truncations…

Computation · Statistics 2017-03-01 Ba Ngu Vo , Ba Tuong Vo , Hung Gia Hoang