English
Related papers

Related papers: Parameterized Fine-Grained Reductions

200 papers

Gaussian process regression (GPR) is a powerful machine learning method which has recently enjoyed wider use, in particular in physical sciences. In its original formulation, GPR uses a square matrix of covariances among training data and…

Numerical Analysis · Mathematics 2023-09-08 Sergei Manzhos , Manabu Ihara

When approaching a novel visual recognition problem in a specialized image domain, a common strategy is to start with a pre-trained deep neural network and fine-tune it to the specialized domain. If the target domain covers a smaller visual…

Computer Vision and Pattern Recognition · Computer Science 2017-07-31 Frederick Tung , Srikanth Muralidharan , Greg Mori

We consider parametrized problems driven by spatially nonlocal integral operators with parameter-dependent kernels. In particular, kernels with varying nonlocal interaction radius $\delta > 0$ and fractional Laplace kernels, parametrized by…

Numerical Analysis · Mathematics 2019-10-02 Olena Burkovska , Max Gunzburger

Parameter-efficient fine-tuning aims to achieve performance comparable to fine-tuning, using fewer trainable parameters. Several strategies (e.g., Adapters, prefix tuning, BitFit, and LoRA) have been proposed. However, their designs are…

Computation and Language · Computer Science 2023-01-06 Jiaao Chen , Aston Zhang , Xingjian Shi , Mu Li , Alex Smola , Diyi Yang

In modern engineering scenarios, there is often a strict upper bound on the number of algorithm iterations that can be performed within a given time limit. This raises the question of optimal algorithmic configuration for a fixed and finite…

Optimization and Control · Mathematics 2024-12-31 Yushun Zhang , Dmitry Rybin , Zhi-Quan Luo

We consider a class of nonsmooth fractional programming problems with fixed-point constraints, where the numerator is convex and the denominator is concave. To solve this problem, we propose splitting algorithms that compute subgradient…

Optimization and Control · Mathematics 2025-09-03 Mootta Prangprakhon , Nimit Nimana

Finite element approximations of minimal surface are not always precise. They can even sometimes completely collapse. In this paper, we provide a simple and inexpensive method, in terms of computational cost, to improve finite element…

Numerical Analysis · Mathematics 2018-05-18 Aymeric Grodet , Takuya Tsuchiya

Image classification has been one of the most popular tasks in Deep Learning, seeing an abundance of impressive implementations each year. However, there is a lot of criticism tied to promoting complex architectures that continuously push…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Maria Lymperaiou , Konstantinos Thomas , Giorgos Stamou

Many recent successes of machine learning went hand in hand with advances in optimization. The exchange of ideas between these fields has worked both ways, with machine learning building on standard optimization procedures such as gradient…

Optimization and Control · Mathematics 2021-10-26 Konstantin Mishchenko

This paper studies the parameter tuning problem of positive linear systems for optimizing their stability properties. We specifically show that, under certain regularity assumptions on the parametrization, the problem of finding the…

Optimization and Control · Mathematics 2019-11-26 Masaki Ogura , Masako Kishida , James Lam

Parametric optimization solves a family of optimization problems as a function of parameters. It is a critical component in situations where optimal decision making is repeatedly performed for updated parameter values, but computation…

Optimization and Control · Mathematics 2023-08-22 Hyunglip Bae , Jang Ho Kim , Woo Chang Kim

Fixed-point optimization of deep neural networks plays an important role in hardware based design and low-power implementations. Many deep neural networks show fairly good performance even with 2- or 3-bit precision when quantized weights…

Machine Learning · Computer Science 2017-02-28 Sungho Shin , Yoonho Boo , Wonyong Sung

Parameterized algorithms are a very useful tool for dealing with NP-hard problems on graphs. Yet, to properly utilize parameterized algorithms it is necessary to choose the right parameter based on the type of problem and properties of the…

Data Structures and Algorithms · Computer Science 2012-01-18 Robert Ganian

We initiate a study of algorithms with a focus on the computational complexity of individual elements, and introduce the fragile complexity of comparison-based algorithms as the maximal number of comparisons any individual element takes…

Data Structures and Algorithms · Computer Science 2019-09-04 Peyman Afshani , Rolf Fagerberg , David Hammer , Riko Jacob , Irina Kostitsyna , Ulrich Meyer , Manuel Penschuck , Nodari Sitchinava

Human feedback plays a critical role in learning and refining reward models for text-to-image generation, but the optimal form the feedback should take for learning an accurate reward function has not been conclusively established. This…

Local Fourier analysis is a useful tool for predicting and analyzing the performance of many efficient algorithms for the solution of discretized PDEs, such as multigrid and domain decomposition methods. The crucial aspect of local Fourier…

Optimization and Control · Mathematics 2020-07-29 Jed Brown , Yunhui He , Scott MacLachlan , Matt Menickelly , Stefan M. Wild

Fine-grained image recognition has been a hot research topic in computer vision due to its various applications. The-state-of-the-art is the part/region-based approaches that first localize discriminative parts/regions, and then learn their…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Peng Zhang , Xinyu Zhu , Zhanzhan Cheng , Shuigeng Zhou , Yi Niu

A dynamic graph algorithm is a data structure that answers queries about a property of the current graph while supporting graph modifications such as edge insertions and deletions. Prior work has shown strong conditional lower bounds for…

Data Structures and Algorithms · Computer Science 2023-01-30 Monika Henzinger , Ami Paz , A. R. Sricharan

Deep neural networks have become a mainstream approach to interactive segmentation. As we show in our experiments, while for some images a trained network provides accurate segmentation result with just a few clicks, for some unknown…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Konstantin Sofiiuk , Ilia Petrov , Olga Barinova , Anton Konushin

Video analysis tasks rely heavily on identifying the pixels from different frames that correspond to the same visual target. To tackle this problem, recent studies have advocated feature learning methods that aim to learn distinctive…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Rui Li , Shenglong Zhou , Dong Liu