English
Related papers

Related papers: Optimized mixing by cutting-and-shuffling

200 papers

Modern machine learning pipelines are increasingly combining and mixing data from diverse and disparate sources, e.g., pre-training large language models. Yet, finding the optimal data mixture is a challenging and open problem. We formalize…

Machine Learning · Computer Science 2026-01-16 Anvith Thudi , Evianne Rovers , Yangjun Ruan , Tristan Thrush , Chris J. Maddison

Performance variability is an important measure for a reliable high performance computing (HPC) system. Performance variability is affected by complicated interactions between numerous factors, such as CPU frequency, the number of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-16 Li Xu , Thomas Lux , Tyler Chang , Bo Li , Yili Hong , Layne Watson , Ali Butt , Danfeng Yao , Kirk Cameron

This paper describes a method for scheduling the events of a switched system to achieve an optimal performance. The approach has guarantees on convergence and computational complexity that parallel derivative-based iterative optimization…

Optimization and Control · Mathematics 2017-09-11 Timothy Caldwell , Todd Murphey

Considering deep neural networks as manifold mappers, the pretrain-then-fine-tune paradigm can be interpreted as a two-stage process: pretrain establishes a broad knowledge base, and fine-tune adjusts the model parameters to activate…

The effectiveness of the machine learning methods for real-world tasks depends on the proper structure of the modeling pipeline. The proposed approach is aimed to automate the design of composite machine learning pipelines, which is…

Machine learning techniques are used in a wide range of domains. However, machine learning models often suffer from the problem of over-fitting. Many data augmentation methods have been proposed to tackle such a problem, and one of them is…

Machine Learning · Statistics 2021-06-21 Masanari Kimura

Variational inequalities have gained significant attention in machine learning and optimization research. While stochastic methods for solving these problems typically assume independent data sampling, we investigate an alternative approach…

Optimization and Control · Mathematics 2025-10-22 Daniil Medyakov , Gleb Molodtsov , Grigoriy Evseev , Egor Petrov , Aleksandr Beznosikov

Deterministic chaos permits a precise notion of a "perfect measurement" as one that, when obtained repeatedly, captures all of the information created by the system's evolution with minimal redundancy. Finding an optimal measurement is…

Machine Learning · Computer Science 2024-03-21 Kieran A. Murphy , Dani S. Bassett

The selection of branching variables is a key component of branch-and-bound algorithms for solving Mixed-Integer Programming (MIP) problems since the quality of the selection procedure is likely to have a significant effect on the size of…

Optimization and Control · Mathematics 2016-08-23 Pierre Le Bodic , George L. Nemhauser

Early scheduling algorithms usually adjusted the clock cycle duration to the execution time of the slowest operation. This resulted in large slack times wasted in those cycles executing faster operations. To reduce the wasted times…

Hardware Architecture · Computer Science 2011-11-09 R. Ruiz-Sautua , M. C. Molina , J. M. Mendias , R. Hermida

This paper presents an efficient Mixed-Integer Nonlinear Programming (MINLP) formulation for systems with discrete control inputs under dwell time constraints. By viewing such systems as a switched system, the problem is decomposed into a…

Optimization and Control · Mathematics 2025-01-10 Ramin Abbasi-Esfeden , Armin Nurkanovic , Moritz Diehl , Panagiotis Patrinos , Jan Swevers

Chaotic multiscale dynamical systems are common in many areas of science, one of the examples being the interaction of the low-frequency dynamics in the atmosphere with the fast turbulent weather dynamics. One of the key questions about…

Dynamical Systems · Mathematics 2016-04-08 Rafail V. Abramov

Adaptive filters are at the core of many signal processing applications, ranging from acoustic noise supression to echo cancelation, array beamforming, channel equalization, to more recent sensor network applications in surveillance, target…

Systems and Control · Electrical Eng. & Systems 2021-12-24 Jerónimo Arenas-García , Luis A. Azpicueta-Ruiz , Magno T. M. Silva , Vitor H. Nascimento , Ali H. Sayed

We present an approach for the detection of sharp change points (short-lived and persistent) in nonlinear and nonstationary dynamic systems under high levels of noise by tracking the local phase and amplitude synchronization among the…

Data Analysis, Statistics and Probability · Physics 2020-08-04 Ashif Sikandar Iquebal , Satish Bukkapatnam , Arun Srinivasa

Molecular dynamics simulations are widely used across chemistry, physics, and biology, providing quantitative insight into complex processes with atomic detail. However, their limited timescale of a few microseconds is a significant…

Chemical Physics · Physics 2025-04-10 Ofir Blumer , Barak Hirshberg

We study decentralized estimation of time-varying signals at a fusion center, when energy harvesting sensors transmit sampled data over rate-constrained links. We propose dynamic strategies to select radio parameters, sampling set, and…

Signal Processing · Electrical Eng. & Systems 2020-08-05 C. Battiloro , P. Di Lorenzo , P. Banelli , S. Barbarossa

Scaling large language models has driven remarkable advancements across various domains, yet the continual increase in model size presents significant challenges for real-world deployment. The Mixture of Experts (MoE) architecture offers a…

Machine Learning · Computer Science 2025-03-18 Shwai He , Daize Dong , Liang Ding , Ang Li

Motion planning in modified environments is a challenging task, as it compounds the innate difficulty of the motion planning problem with a changing environment. This renders some algorithmic methods such as probabilistic roadmaps less…

As industrial recommender systems enter a scaling-driven regime, Transformer architectures have become increasingly attractive for scaling models towards larger capacity and longer sequence. However, existing Transformer-based…

Information Retrieval · Computer Science 2026-02-17 Xu Huang , Hao Zhang , Zhifang Fan , Yunwen Huang , Zhuoxing Wei , Zheng Chai , Jinan Ni , Yuchao Zheng , Qiwei Chen

Parameter-efficient fine-tuning (PEFT) is an effective methodology to unleash the potential of large foundation models in novel scenarios with limited training data. In the computer vision community, PEFT has shown effectiveness in image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zelin Peng , Zhengqin Xu , Zhilin Zeng , Lingxi Xie , Qi Tian , Wei Shen