English
Related papers

Related papers: SLRQA: A Sparse Low-Rank Quaternion Model for Colo…

200 papers

The growing scale of Large Language Models (LLMs) has necessitated the development of parameter-efficient fine-tuning techniques. Low-Rank Adaptation (LoRA) has emerged as a promising approach, reducing the number of trainable parameters by…

Machine Learning · Computer Science 2025-09-01 Jessica Liang , Anirudh Bharadwaj

This paper presents a robust filter called quaternion Hardy filter (QHF) for color image edge detection. The QHF can be capable of color edge feature enhancement and noise resistance. It is flexible to use QHF by selecting suitable…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Wenshan Bi Dong Cheng Wankai Liu , Kit Ian Kou

This paper proposes QPALM, a proximal augmented Lagrangian method based on quadratic approximations, for solving nonlinear programming problems with weakly convex objective and constraint functions. The algorithm is constructed by…

Optimization and Control · Mathematics 2026-05-06 Yule Zhang , Benqi Liu , Xiantao Xiao , Liwei Zhang

In this paper, we consider a squared $L_1/L_2$ regularized model for sparse signal recovery from noisy measurements. We first establish the existence of optimal solutions to the model under mild conditions. Next, we propose a proximal…

Optimization and Control · Mathematics 2025-11-10 Na Zhang , Hong Chen , Qia Li , Junpeng Zhou

Face recognition remains a hot topic in computer vision, and it is challenging to tackle the problem that both the training and testing images are corrupted. In this paper, we propose a novel semi-supervised method based on the theory of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Pei Xie , He-Feng Yin , Xiao-Jun Wu

We propose Quantum-informed Tensor Adaptation (QuanTA), a novel, easy-to-implement, fine-tuning method with no inference overhead for large-scale pre-trained language models. By leveraging quantum-inspired methods derived from quantum…

Machine Learning · Computer Science 2025-11-11 Zhuo Chen , Rumen Dangovski , Charlotte Loh , Owen Dugan , Di Luo , Marin Soljačić

Latest least squares regression (LSR) methods mainly try to learn slack regression targets to replace strict zero-one labels. However, the difference of intra-class targets can also be highlighted when enlarging the distance between…

Computer Vision and Pattern Recognition · Computer Science 2019-10-09 Zhe Chen , Xiao-Jun Wu , Josef Kittler

Large Language Models have shown remarkable capabilities in the NLP domain. Their effectiveness can mainly be attributed to their ability to adapt to an array of downstream tasks. However, generally, full fine-tuning is a computationally…

Computation and Language · Computer Science 2025-06-10 Harsh Bihany , Shubham Patel , Ashutosh Modi

Large multimodal models (LMMs) have achieved impressive performance on various vision-language tasks, but their substantial computational and memory costs hinder their practical deployment. Existing compression methods often decouple…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Pengcheng Zheng , Chaoning Zhang , Jiarong Mo , GuoHui Li , Jiaquan Zhang , Jiahao Zhang , Sihan Cao , Sheng Zheng , Caiyan Qin , Guoqing Wang , Yang Yang

Recently, sparsity-based algorithms are proposed for super-resolution spectrum estimation. However, to achieve adequately high resolution in real-world signal analysis, the dictionary atoms have to be close to each other in frequency,…

Machine Learning · Statistics 2015-06-05 Yiyuan She , Huanghuang Li , Jiangping Wang , Dapeng Wu

Optimization-based filtering smoothes an image by minimizing a fidelity function and simultaneously preserves edges by exploiting a sparse norm penalty over gradients. It has obtained promising performance in practical problems, such as…

Graphics · Computer Science 2013-05-20 Chengxi Ye , Dacheng Tao , Mingli Song , David W. Jacobs , Min Wu

We study the problem of recovering the underlining sparse signals from clean or noisy phaseless measurements. Due to the sparse prior of signals, we adopt an L0regularized variational model to ensure only a small number of nonzero elements…

Optimization and Control · Mathematics 2016-12-09 Yuping Duan , Chunlin Wu , Zhi-Feng Pang , Huibin Chang

Speculative decoding and dynamic sparse attention are two complementary approaches for accelerating long-context LLM inference: the former amortizes target-model execution across multiple verifier queries, while the latter reduces each…

Operating Systems · Computer Science 2026-05-21 Zhibin Wang , Ziyu Zhong , Nuo Shen , Yuhang Zhou , Rong Gu , Sheng Zhong

Fine-tuning has become a popular approach to adapting large foundational models to specific tasks. As the size of models and datasets grows, parameter-efficient fine-tuning techniques are increasingly important. One of the most widely used…

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

Data Structures and Algorithms · Computer Science 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

We introduce SPRING, a novel stochastic proximal alternating linearized minimization algorithm for solving a class of non-smooth and non-convex optimization problems. Large-scale imaging problems are becoming increasingly prevalent due to…

Optimization and Control · Mathematics 2021-01-20 Derek Driggs , Junqi Tang , Jingwei Liang , Mike Davies , Carola-Bibiane Schönlieb

Deep learning has achieved significant success in single hyperspectral image super-resolution (SHSR); however, the high spectral dimensionality leads to a heavy computational burden, thus making it difficult to deploy in real-time…

Image and Video Processing · Electrical Eng. & Systems 2025-10-01 Haohan Shi , Fei Zhou , Xin Sun , Jungong Han

Multimodal Large Language Models (MLLMs) possess intrinsic reasoning and world-knowledge capabilities, yet adapting them for dense retrieval remains challenging. Existing approaches rely on invasive parameter updates, such as full…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Haoran Lou , Ziyan Liu , Chunxiao Fan , Yuexin Wu , Yue Ming , Hao Wu , Kai Zuo , Yibo Chen , Xu Tang

Digital human animation relies on high-quality 3D models of the human face: rigs. A face rig must be accurate and, at the same time, fast to compute. One of the most common rigging models is the blendshape model. We propose a novel…

Machine Learning · Computer Science 2021-10-06 Stevo Rackovic , Claudia Soares , Dusan Jakovetic , Zoranka Desnica

Insufficient prior knowledge of a captured hyperspectral image (HSI) scene may lead the experts or the automatic labeling systems to offer incorrect labels or ambiguous labels (i.e., assigning each training sample to a group of candidate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Shujun Yang , Yu Zhang , Yao Ding , Danfeng Hong