中文
相关论文

相关论文: Faster SVM Training via Conjugate SMO

200 篇论文

The support vector machine (SVM) algorithm is well known to the computer learning community for its very good practical results. The goal of the present paper is to study this algorithm from a statistical perspective, using tools of…

统计理论 · 数学 2008-12-18 Gilles Blanchard , Olivier Bousquet , Pascal Massart

We propose a Stochastic Gradient Descent (SGD)-type algorithm for Personalized Federated Learning which can be particularly attractive for mobile energy-limited regimes due to its low per-client computational cost. The model to be trained…

机器学习 · 计算机科学 2025-12-15 Sotirios Nikoloutsopoulos , Iordanis Koutsopoulos , Michalis K. Titsias

The conjugation of multiple spatial light modulators (SLMs) enables the construction of optical diffractive neural networks (DNNs). To accelerate training, which is limited by the low refresh rate of SLMs, spatial multiplexing of the input…

光学 · 物理学 2026-05-20 Guillaume Noetinger , Tim Tuuva , Romain Fleury

Selecting the best data mixture is critical for successful Supervised Fine-Tuning (SFT) of Multimodal Large Language Models. However, determining the optimal mixture weights across multiple domain-specific datasets remains a significant…

机器学习 · 计算机科学 2026-02-06 Davide Berasi , Matteo Farina , Massimiliano Mancini , Elisa Ricci

Tackling pattern recognition problems in areas such as computer vision, bioinformatics, speech or text recognition is often done best by taking into account task-specific statistical relations between output variables. In structured…

机器学习 · 统计学 2016-03-14 Rein Houthooft , Filip De Turck

The computational complexity of solving nonlinear support vector machine (SVM) is prohibitive on large-scale data. In particular, this issue becomes very sensitive when the data represents additional difficulties such as highly imbalanced…

机器学习 · 计算机科学 2019-04-09 E. Sadrfaridpour , T. Razzaghi , I. Safro

We present a novel approach to learn a kernel-based regression function. It is based on the useof conical combinations of data-based parameterized kernels and on a new stochastic convex optimization procedure of which we establish…

机器学习 · 计算机科学 2012-01-13 Pierre Machart , Thomas Peel , Liva Ralaivola , Sandrine Anthoine , Hervé Glotin

Multiple-input multiple-output (MIMO) is a key ingredient of next-generation wireless communications. Recently, various MIMO signal detectors based on deep learning techniques and quantum(-inspired) algorithms have been proposed to improve…

信息论 · 计算机科学 2023-07-25 Satoshi Takabe

In this paper, we carry out numerical analysis to prove convergence of a novel sample-wise back-propagation method for training a class of stochastic neural networks (SNNs). The structure of the SNN is formulated as discretization of a…

数值分析 · 数学 2022-12-20 Richard Archibald , Feng Bao , Yanzhao Cao , Hui Sun

The binomial deviance and the SVM hinge loss functions are two of the most widely used loss functions in machine learning. While there are many similarities between them, they also have their own strengths when dealing with different types…

机器学习 · 统计学 2022-05-25 Man Huang , Luis Carvalho

Convolutional Neural Networks (ConvNets or CNNs) have been candidly deployed in the scope of computer vision and related fields. Nevertheless, the dynamics of training of these neural networks lie still elusive: it is hard and…

计算机视觉与模式识别 · 计算机科学 2023-09-13 Nguyen Huu Phong , Augusto Santos , Bernardete Ribeiro

We study the performance of the simulated bifurcation (SB) algorithm for signal detection in multiple-input multiple-output (MIMO) system, a problem of key interest in modern wireless communication systems. Our results show that SB…

信息论 · 计算机科学 2022-10-27 Wen Zhang , Yu-Lin Zheng

A major challenge in training large-scale machine learning models is configuring the training process to maximize model performance, i.e., finding the best training setup from a vast design space. In this work, we unlock a gradient-based…

机器学习 · 统计学 2025-03-19 Logan Engstrom , Andrew Ilyas , Benjamin Chen , Axel Feldmann , William Moses , Aleksander Madry

Singular value decomposition (SVD) is widely used in wireless systems, including multiple-input multiple-output (MIMO) processing and dimension reduction in distributed MIMO (D-MIMO). However, the iterative nature of decomposition methods…

信号处理 · 电气工程与系统科学 2025-09-24 Sijia Cheng , Liang Liu , Ove Edfors , Juan Vidal Alegria

In this paper we promote the use of Support Vector Machines (SVM) as a machine learning tool for searches in high-energy physics. As an example for a new- physics search we discuss the popular case of Supersymmetry at the Large Hadron…

高能物理 - 实验 · 物理学 2022-11-16 Mehmet Özgür Sahin , Dirk Krücker , Isabell-Alissandra Melzer-Pellmann

Category imbalance is one of the most popular and important issues in the domain of classification. Emotion classification model trained on imbalanced datasets easily leads to unreliable prediction. The traditional machine learning method…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Lu Jiang , Qi Wang , Yuhang Chang , Jianing Song , Haoyue Fu , Xiaochun Yang

Stochastic convex optimization algorithms are the most popular way to train machine learning models on large-scale data. Scaling up the training process of these models is crucial, but the most popular algorithm, Stochastic Gradient Descent…

机器学习 · 统计学 2018-10-30 Ashok Cutkosky , Robert Busa-Fekete

Support Vector Machines (SVMs) are powerful learners that have led to state-of-the-art results in various computer vision problems. SVMs suffer from various drawbacks in terms of selecting the right kernel, which depends on the image…

计算机视觉与模式识别 · 计算机科学 2014-03-31 Gemma Roig , Xavier Boix , Luc Van Gool

Alternating Direction Method of Multipliers (ADMM) is a popular method for solving large-scale Machine Learning problems. Stochastic ADMM was proposed to reduce the per iteration computational complexity, which is more suitable for big data…

数值分析 · 计算机科学 2023-04-25 Chao Zhang , Zebang Shen , Hui Qian , Tengfei Zhou , Jianya Zhou , Jianying Zhou

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

机器学习 · 计算机科学 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran