English
Related papers

Related papers: Two Ridge Solutions for the Incremental Broad Lear…

200 papers

In the real open world, data tends to follow long-tailed class distributions, motivating the well-studied long-tailed recognition (LTR) problem. Naive training produces models that are biased toward common classes in terms of higher…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shaden Alshammari , Yu-Xiong Wang , Deva Ramanan , Shu Kong

In this work, we solve inverse problems of nonlinear Schr\"{o}dinger equations that can be formulated as a learning process of a special convolutional neural network. Instead of attempting to approximate functions in the inverse problems,…

Numerical Analysis · Mathematics 2023-08-08 Yiran Wang

In this work, we investigate various approaches that use learning from training data to solve inverse problems, following a bi-level learning approach. We consider a general framework for optimal inversion design, where training data can be…

Numerical Analysis · Mathematics 2021-10-07 Julianne Chung , Matthias Chung , Silvia Gazzola , Mirjeta Pasha

This paper studies the unconstrained nonconvex-strongly-convex bilevel optimization problem. A common approach to solving this problem is to alternately update the upper-level and lower-level variables using (biased) stochastic gradients or…

Optimization and Control · Mathematics 2025-03-18 Haimei Huo , Zhixun Su

Two-stage stochastic programs with binary recourse are challenging to solve and efficient solution methods for such problems have been limited. In this work, we generalize an existing binary decision diagram-based (BDD-based) approach of…

Optimization and Control · Mathematics 2023-11-16 Moira MacNeil , Merve Bodur

This paper focuses on exploring the sparsity of the inverse covariance matrix $\bSigma^{-1}$, or the precision matrix. We form blocks of parameters based on each off-diagonal band of the Cholesky factor from its modified Cholesky…

Methodology · Statistics 2008-05-27 Clifford Lam

In this paper, we propose two linearized finite difference schemes for solving the logarithmic Schr\"odinger equation (LogSE) without the need for regularization of the logarithmic term. These two schemes employ the first-order and the…

Numerical Analysis · Mathematics 2025-09-19 Tingchun Wang , Jingye Yan

Randomized Smoothing (RS) offers formal $\ell_2$ guarantees for arbitrary base classifiers but faces two key practical bottlenecks: (i) it often relies on noise-augmented training to achieve nontrivial certificates, which increases training…

Machine Learning · Computer Science 2026-04-29 Miao Lin , MD Saifur Rahman Mazumder , Feng Yu , Daniel Takabi , Rui Ning

One fundamental problem when solving inverse problems is how to find regularization parameters. This article considers solving this problem using data-driven bilevel optimization, i.e. we consider the adaptive learning of the regularization…

Statistics Theory · Mathematics 2021-01-08 Neil K. Chada , Claudia Schillings , Xin T. Tong , Simon Weissmann

Lagrangian coherent structures (LCS) in fluid flows appear as co-dimension one ridges of the finite time Lyapunov exponent (FTLE) field. In three- dimensions this means two-dimensional ridges. A fast algorithm is presented here to locate…

Fluid Dynamics · Physics 2012-02-24 Doug Lipinski , Kamran Mohseni

In this paper, mixed categorical structural optimization problems are investigated. The aim is to minimize the weight of a truss structure with respect to cross-section areas, materials and cross-section type. The proposed methodology…

Computational Engineering, Finance, and Science · Computer Science 2022-07-13 Pierre-Jean Barjhoux , Youssef Diouane , Stéphane Grihon , Joseph Morlier

We propose an approach to reduce the bias of ridge regression and regularization kernel network. When applied to a single data set the new algorithms have comparable learning performance with the original ones. When applied to incremental…

Machine Learning · Statistics 2016-03-17 Qiang Wu

Regularization techniques are crucial to improving the generalization performance and training efficiency of deep neural networks. Many deep learning algorithms rely on weight decay, dropout, batch/layer normalization to converge faster and…

Machine Learning · Computer Science 2025-05-23 Peng Lu , Ahmad Rashid , Ivan Kobyzev , Mehdi Rezagholizadeh , Philippe Langlais

The linear regression model cannot be fitted to high-dimensional data, as the high-dimensionality brings about empirical non-identifiability. Penalized regression overcomes this non-identifiability by augmentation of the loss function by a…

Methodology · Statistics 2023-06-29 Wessel N. van Wieringen

In this paper, we propose two algorithms for solving linear inverse problems when the observations are corrupted by noise. A proper data fidelity term (log-likelihood) is introduced to reflect the statistics of the noise (e.g. Gaussian,…

Applications · Statistics 2011-03-14 François-Xavier Dupé , Jalal Fadili , Jean-Luc Starck

Physics-informed extreme learning machine (PIELM) has recently received significant attention as a rapid version of physics-informed neural network (PINN) for solving partial differential equations (PDEs). The key characteristic is to fix…

Machine Learning · Computer Science 2024-09-30 Xu Liu , Wen Yao , Wei Peng , Weien Zhou

In this paper, we propose a novel, computationally efficient reduced order method to solve linear parabolic inverse source problems. Our approach provides accurate numerical solutions without relying on specific training data. The forward…

Numerical Analysis · Mathematics 2023-06-12 Yuxuan Huang , Yangwen Zhang

Accurate post-processing navigation is essential for applications such as survey and mapping, where the full measurement history can be exploited to refine past state estimates. Fixed-interval smoothing algorithms represent the…

Robotics · Computer Science 2026-03-27 Nadav Cohen , Itzik Klein

Reinforcement learning has recently been used to enhance index structures, giving rise to reinforcement learning-enhanced spatial indices (RLESIs) that aim to improve query efficiency during index construction. However, their practical…

Databases · Computer Science 2025-12-15 Guanli Liu , Renata Borovica-Gajic , Hai Lan , Zhifeng Bao

In this paper, we present an advanced approach to solving the inverse rig problem in blendshape animation, using high-quality corrective blendshapes. Our algorithm introduces novel enhancements in three key areas: ensuring high data…

Graphics · Computer Science 2024-01-31 Stevo Racković , Cláudia Soares , Dušan Jakovetić