English
Related papers

Related papers: GridTuner: Reinvestigate Grid Size Selection for S…

200 papers

This paper addresses the problem of optimizing partition functions in a stochastic learning setting. We propose a stochastic variant of the bound majorization algorithm that relies on upper-bounding the partition function with a quadratic…

Machine Learning · Computer Science 2020-11-04 Jing Wang , Anna Choromanska

We study the fundamental computational problem of approximating optimal transport (OT) equations using neural differential equations (Neural ODEs). More specifically, we develop a novel framework for approximating unbalanced optimal…

Numerical Analysis · Mathematics 2026-05-21 Minh-Nhat Phung , Minh-Binh Tran

Signals of opportunity (SOPs) are a promising technique that can be used for relative positioning in areas where global navigation satellite system (GNSS) information is unreliable or unavailable. This technique processes features of the…

Signal Processing · Electrical Eng. & Systems 2022-08-10 Nicolas Souli , Panayiotis Kolios , Georgios Ellinas

We present a different view on stochastic optimization, which goes back to the splitting schemes for approximate solutions of ODE. In this work, we provide a connection between stochastic gradient descent approach and first-order splitting…

Machine Learning · Statistics 2020-04-21 Daniil Merkulov , Ivan Oseledets

Optimal transport (OT) distances between probability distributions are parameterized by the ground metric they use between observations. Their relevance for real-life applications strongly hinges on whether that ground metric parameter is…

Machine Learning · Statistics 2020-11-06 Matthieu Heitz , Nicolas Bonneel , David Coeurjolly , Marco Cuturi , Gabriel Peyré

We study the forecasting problem for traffic with dynamic, possibly periodical, and joint spatial-temporal dependency between regions. Given the aggregated inflow and outflow traffic of regions in a city from time slots 0 to t-1, we predict…

Machine Learning · Computer Science 2022-05-05 Guanyao Li , Shuhan Zhong , S. -H. Gary Chan , Ruiyuan Li , Chih-Chieh Hung , Wen-Chih Peng

We study a ranking and selection (R&S) problem when all solutions share common parametric Bayesian input models updated with the data collected from multiple independent data-generating sources. Our objective is to identify the best system…

Methodology · Statistics 2025-02-25 Eunhye Song , Taeho Kim

Given a set of astrometric observations of the same object, the problem of orbit determination is to compute the orbit and to assess its uncertainty and reliability. For the next generation surveys, with much larger number density of…

Variational inference methods for latent variable statistical models have gained popularity because they are relatively fast, can handle large data sets, and have deterministic convergence guarantees. However, in practice it is unclear…

Methodology · Statistics 2017-03-22 Hachem Saddiki , Andrew C. Trapp , Patrick Flaherty

We investigate the multi-step prediction of the drivable space, represented by Occupancy Grid Maps (OGMs), for autonomous vehicles. Our motivation is that accurate multi-step prediction of the drivable space can efficiently improve path…

Machine Learning · Computer Science 2019-01-24 Nima Mohajerin , Mohsen Rohani

The relevance of optimal transport methods to machine learning has long been hindered by two salient limitations. First, the $O(n^3)$ computational cost of standard sample-based solvers (when used on batches of $n$ samples) is prohibitive.…

Machine Learning · Computer Science 2023-06-01 Meyer Scetbon , Michal Klein , Giovanni Palla , Marco Cuturi

Optimal margin Distribution Machine (ODM) is a newly proposed statistical learning framework rooting in the novel margin theory, which demonstrates better generalization performance than the traditional large margin based counterparts.…

Machine Learning · Computer Science 2023-06-13 Yilin Wang , Nan Cao , Teng Zhang , Xuanhua Shi , Hai Jin

In the era of big data, one of the key challenges is the development of novel optimization algorithms that can accommodate vast amounts of data while at the same time satisfying constraints and limitations of the problem under study. The…

Optimization and Control · Mathematics 2019-09-27 Nicolas Loizou

One of the challenges for neural networks in real-life applications is the overconfident errors these models make when the data is not from the original training distribution. Addressing this issue is known as Out-of-Distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sina Sharifi , Taha Entesari , Bardia Safaei , Vishal M. Patel , Mahyar Fazlyab

In this paper, we formulate optimization problems to perform optimal transmission switching (OTS) in order to operate power transmission grids most efficiently. In any given electrical network, several of the transmission lines are…

Systems and Control · Electrical Eng. & Systems 2023-09-07 Vineet Jagadeesan Nair

Selecting input features of top relevance has become a popular method for building self-explaining models. In this work, we extend this selective rationalization approach to text matching, where the goal is to jointly select and align text…

Machine Learning · Computer Science 2020-05-28 Kyle Swanson , Lili Yu , Tao Lei

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

High penetration from volatile renewable energy resources in the grid and the varying nature of loads raise the need for frequent line switching to ensure the efficient operation of electrical distribution networks. Operators must ensure…

Systems and Control · Electrical Eng. & Systems 2024-11-19 Richard Asiamah , Yuqi Zhou , Ahmed S. Zamzam

Understanding generalization in deep learning has been one of the major challenges in statistical learning theory over the last decade. While recent work has illustrated that the dataset and the training algorithm must be taken into account…

Real-time tsunami early warning relies on distributed sensor networks to infer seismic sources and seafloor motion. Optimizing these networks via Bayesian optimal experimental design (OED) is exceptionally challenging for systems governed…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-13 Sreeram Venkat , Stefan Henneking , Omar Ghattas