English
Related papers

Related papers: Using Bounded Model Checking to Focus Fixpoint Ite…

200 papers

Fixed-point iterations are at the heart of numerical computing and are often a computational bottleneck in real-time applications that typically need a fast solution of moderate accuracy. We present neural fixed-point acceleration which…

Machine Learning · Computer Science 2021-07-26 Shobha Venkataraman , Brandon Amos

A reparametrization (of a continuous path) is given by a surjective weakly increasing self-map of the unit interval. We show that the monoid of reparametrizations (with respect to compositions) can be understood via ``stop-maps'' that allow…

General Topology · Mathematics 2007-06-26 Martin Raussen , Ulrich Fahrenberg

We propose a construction for joint feature learning and clustering of multichannel extracellular electrophysiological data across multiple recording periods for action potential detection and discrimination ("spike sorting"). Our…

Sparse model selection is ubiquitous from linear regression to graphical models where regularization paths, as a family of estimators upon the regularization parameter varying, are computed when the regularization parameter is unknown or…

Machine Learning · Statistics 2018-10-10 Chendi Huang , Yuan Yao

Benders' decomposition (BD) is a framework for solving optimization problems by removing some variables and modeling their contribution to the original problem via so-called Benders cuts. While many advanced optimization techniques can be…

Optimization and Control · Mathematics 2025-12-18 Christopher Hojny , Cédric Roy

Spatial confounding is how is called the confounding between fixed and spatial random effects. It has been widely studied and it gained attention in the past years in the spatial statistics literature, as it may generate unexpected results…

Compilers for statically typed functional programming languages are notorious for generating confusing type error messages. When the compiler detects a type error, it typically reports the program location where the type checking failed as…

Programming Languages · Computer Science 2015-08-28 Zvonimir Pavlinovic , Tim King , Thomas Wies

In continual learning, where task data arrives in a sequence, fine-tuning on later tasks will often lead to performance degradation on earlier tasks. This is especially pronounced when these tasks come from diverse domains. In this setting,…

Machine Learning · Computer Science 2025-01-13 Anat Kleiman , Gintare Karolina Dziugaite , Jonathan Frankle , Sham Kakade , Mansheej Paul

This thesis focuses on developing and analyzing accelerated and inexact first-order methods for solving or finding stationary points of various nonconvex composite optimization (NCO) problems. The main tools mainly come from variational and…

Optimization and Control · Mathematics 2021-12-28 Weiwei Kong

In the era of large language models, model merging is a promising way to combine multiple task-specific models into a single multitask model without extra training. However, two challenges remain: (a) interference between different models…

Computation and Language · Computer Science 2024-10-15 Zhenyi Lu , Chenghao Fan , Wei Wei , Xiaoye Qu , Dangyang Chen , Yu Cheng

Model merging provides a compelling paradigm for integrating specialized expertise into a unified multi-task model, a goal that aligns naturally with the sequential knowledge acquisition in continual learning (CL). However, the requirement…

Machine Learning · Computer Science 2026-05-12 Xi Wang , Cheng Deng

We study the convergence of random function iterations for finding an invariant measure of the corresponding Markov operator. We call the problem of finding such an invariant measure the stochastic fixed point problem. This generalizes…

Functional Analysis · Mathematics 2022-03-24 Neal Hermer , D. Russell Luke , Anja Sturm

A type system combining type application, constants as types, union types (associative, commutative and idempotent) and recursive types has recently been proposed for statically typing path polymorphism, the ability to define functions that…

Logic in Computer Science · Computer Science 2020-06-30 Juan Edi , Andrés Viso , Eduardo Bonelli

Multi-block separable convex problems recently received considerable attention. This class of optimization problems minimizes a separable convex objective function with linear constraints. The algorithmic challenges come from the fact that…

Optimization and Control · Mathematics 2016-08-18 Qia Li , Yuesheng Xu , Na Zhang

Sampling from unnormalized densities using diffusion models has emerged as a powerful paradigm. However, while recent approaches that use least-squares `matching' objectives have improved scalability, they often necessitate significant…

Machine Learning · Computer Science 2026-03-03 Denis Blessing , Lorenz Richter , Julius Berner , Egor Malitskiy , Gerhard Neumann

Despite the broad use of fixed-point iterations throughout applied mathematics, the optimal convergence rate of general fixed-point problems with nonexpansive nonlinear operators has not been established. This work presents an acceleration…

Optimization and Control · Mathematics 2022-06-28 Jisun Park , Ernest K. Ryu

SMT-based model checkers, especially IC3-style ones, are currently the most effective techniques for verification of infinite state systems. They infer global inductive invariants via local reasoning about a single step of the transition…

Logic in Computer Science · Computer Science 2020-05-28 Hari Govind V K , YuTing Chen , Sharon Shoham , Arie Gurfinkel

Previous papers have shown the impact of partial convergence of discretized PDE on the accuracy of tangent and adjoint linearizations. A series of papers suggested linearization of the fixed point iteration used in the solution process as a…

Numerical Analysis · Mathematics 2022-02-24 Emmett Padway , Dimitri Mavriplis

Supervised fine-tuning (SFT) is a crucial step for adapting large language models (LLMs) to downstream tasks. However, conflicting objectives across heterogeneous SFT tasks often induce the "seesaw effect": optimizing for one task may…

Computation and Language · Computer Science 2026-01-27 Xiaoyu Liu , Xiaoyu Guan , Di Liang , Xianjie Wu

This paper presents an enhanced direct-method-based approach for the real-time solution of optimal control problems to handle path constraints, such as obstacles. The principal contributions of this work are twofold: first, the existing…

Systems and Control · Electrical Eng. & Systems 2024-03-05 Juho Bae , Ji Hoon Bai , Byung-Yoon Lee , Jun-Yong Lee