English
Related papers

Related papers: Safe Active Feature Selection for Sparse Learning

200 papers

The least-absolute shrinkage and selection operator (LASSO) is a regularization technique for estimating sparse signals of interest emerging in various applications and can be efficiently solved via the alternating direction method of…

Information Theory · Computer Science 2022-08-25 Huiyue Yi , Yan Xu , Wuxiong Zhang , Hui Xu

A framework is introduced for actively and adaptively solving a sequence of machine learning problems, which are changing in bounded manner from one time step to the next. An algorithm is developed that actively queries the labels of the…

Machine Learning · Computer Science 2018-05-31 Yuheng Bu , Jiaxun Lu , Venugopal V. Veeravalli

Recent work has found that sparse autoencoders (SAEs) are an effective technique for unsupervised discovery of interpretable features in language models' (LMs) activations, by finding sparse, linear reconstructions of LM activations. We…

Machine Learning · Computer Science 2024-05-01 Senthooran Rajamanoharan , Arthur Conmy , Lewis Smith , Tom Lieberum , Vikrant Varma , János Kramár , Rohin Shah , Neel Nanda

Sparse recovery is one of the most fundamental and well-studied inverse problems. Standard statistical formulations of the problem are provably solved by general convex programming techniques and more practical, fast (nearly-linear time)…

Data Structures and Algorithms · Computer Science 2022-03-09 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian

Feature selection is a critical step in data-driven applications, reducing input dimensionality to enhance learning accuracy, computational efficiency, and interpretability. Existing state-of-the-art methods often require post-selection…

Machine Learning · Computer Science 2025-08-18 Pedram Pad , Hadi Hammoud , Mohamad Dia , Nadim Maamari , L. Andrea Dunbar

Single Image Super-Resolution (SISR) is a crucial task in low-level computer vision, aiming to reconstruct high-resolution images from low-resolution counterparts. Conventional attention mechanisms have significantly improved SISR…

Image and Video Processing · Electrical Eng. & Systems 2024-05-14 Cheng Wan , Hongyuan Yu , Zhiqi Li , Yihang Chen , Yajun Zou , Yuqing Liu , Xuanwu Yin , Kunlong Zuo

The widespread misuse of image generation technologies has raised security concerns, driving the development of AI-generated image detection methods. However, generalization has become a key challenge and open problem: existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yongkang Hu , Yu Cheng , Yushuo Zhang , Yuan Xie , Zhaoxia Yin

Decision trees are widely used for their low computational cost, good predictive performance, and ability to assess the importance of features. Though often used in practice for feature selection, the theoretical guarantees of these methods…

Machine Learning · Statistics 2023-03-09 Kiarash Banihashem , MohammadTaghi Hajiaghayi , Max Springer

Incorporating item-side information, such as category and brand, into sequential recommendation is a well-established and effective approach for improving performance. However, despite significant advancements, current models are generally…

Information Retrieval · Computer Science 2026-01-01 Jie Luo , Wenyu Zhang , Xinming Zhang , Yuan Fang

Sparse algorithms offer great flexibility for multi-view temporal perception tasks. In this paper, we present an enhanced version of Sparse4D, in which we improve the temporal fusion module by implementing a recursive form of multi-frame…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Xuewu Lin , Tianwei Lin , Zixiang Pei , Lichao Huang , Zhizhong Su

This paper presents an architecture-friendly k-means clustering algorithm called SIVF for a large-scale and high-dimensional sparse data set. Algorithm efficiency on time is often measured by the number of costly operations such as…

Machine Learning · Statistics 2021-03-31 Kazuo Aoyama , Kazumi Saito

We propose a novel implicit feature refinement module for high-quality instance segmentation. Existing image/video instance segmentation methods rely on explicitly stacked convolutions to refine instance features before the final…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Lufan Ma , Tiancai Wang , Bin Dong , Jiangpeng Yan , Xiu Li , Xiangyu Zhang

We consider the stochastic optimization problem where a convex function is minimized observing recursively the gradients. We introduce SAEW, a new procedure that accelerates exponential weights procedures with the slow rate $1/\sqrt{T}$ to…

Statistics Theory · Mathematics 2016-10-18 Pierre Gaillard , Olivier Wintenberger

For flexible yet safe imitation learning (IL), we propose theory and a modular method, with a safety layer that enables a closed-form probability density/gradient of the safe generative continuous policy, end-to-end generative adversarial…

Machine Learning · Computer Science 2023-07-31 Philipp Geiger , Christoph-Nikolas Straehle

Sparse regression is frequently employed in diverse scientific settings as a feature selection method. A pervasive aspect of scientific data that hampers both feature selection and estimation is the presence of strong correlations between…

Methodology · Statistics 2021-03-25 Ankit Kumar , Sharmodeep Bhattacharyya , Kristofer Bouchard

In this work, we propose a novel unsupervised deep learning model to address multi-focus image fusion problem. First, we train an encoder-decoder network in unsupervised manner to acquire deep feature of input images. And then we utilize…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Boyuan Ma , Xiaojuan Ban , Haiyou Huang , Yu Zhu

Sparse autoencoders (SAEs) are one of the main methods to interpret the inner workings of deep neural networks (DNNs), decomposing activations into higher-dimensional features. However, they exhibit critical shortcomings where a large…

Machine Learning · Computer Science 2026-05-19 Michał Brzozowski , Neo Christopher Chung

Sparse modelling or model selection with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm…

Methodology · Statistics 2022-11-14 Szymon Nowakowski , Piotr Pokarowski , Wojciech Rejchel , Agnieszka Sołtys

Click-through Rate (CTR) prediction in real-world recommender systems often deals with billions of user interactions every day. To improve the training efficiency, it is common to update the CTR prediction model incrementally using the new…

Information Retrieval · Computer Science 2025-05-07 Zhikai Wang , Yanyan Shen , Zibin Zhang , Kangyi Lin

Sparse 3D detectors have received significant attention since the query-based paradigm embraces low latency without explicit dense BEV feature construction. However, these detectors achieve worse performance than their dense counterparts.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Hongcheng Zhang , Liu Liang , Pengxin Zeng , Xiao Song , Zhe Wang
‹ Prev 1 8 9 10 Next ›