English
Related papers

Related papers: Enhanced Multi-Resolution Analysis for Multi-Dimen…

200 papers

Background: High-resolution MRI is critical for diagnosis, but long acquisition times limit clinical use. Super-resolution (SR) can enhance resolution post-scan, yet existing deep learning methods face fidelity-efficiency trade-offs.…

The machine learning community has witnessed impressive advancements since large language models (LLMs) first appeared. Yet, their massive memory consumption has become a significant roadblock to large-scale training. For instance, a 7B…

Machine Learning · Computer Science 2024-12-30 Rui Pan , Xiang Liu , Shizhe Diao , Renjie Pi , Jipeng Zhang , Chi Han , Tong Zhang

We introduce the Linearized Diffusion Map (LDM), a novel linear dimensionality reduction method constructed via a linear approximation of the diffusion-map kernel. LDM integrates the geometric intuition of diffusion-based nonlinear methods…

Machine Learning · Computer Science 2025-07-22 Julio Candanedo

Integrated sensing and communications (ISAC) has emerged as a promising paradigm to unify wireless communications and radar sensing, enabling efficient spectrum and hardware utilization. A core challenge with realizing the gains of ISAC…

Information Theory · Computer Science 2025-03-13 Tianyu Fang , Mengyuan Ma , Markku Juntti , Nir Shlezinger , A. Lee Swindlehurst , Nhan Thanh Nguyen

Low-rank adaptation is a popular parameter-efficient fine-tuning method for large language models. In this paper, we analyze the impact of low-rank updating, as implemented in LoRA. Our findings suggest that the low-rank updating mechanism…

Computation and Language · Computer Science 2024-05-21 Ting Jiang , Shaohan Huang , Shengyue Luo , Zihan Zhang , Haizhen Huang , Furu Wei , Weiwei Deng , Feng Sun , Qi Zhang , Deqing Wang , Fuzhen Zhuang

Modern image inpainting systems, despite the significant progress, often struggle with large missing areas, complex geometric structures, and high-resolution images. We find that one of the main reasons for that is the lack of an effective…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Roman Suvorov , Elizaveta Logacheva , Anton Mashikhin , Anastasia Remizova , Arsenii Ashukha , Aleksei Silvestrov , Naejin Kong , Harshith Goka , Kiwoong Park , Victor Lempitsky

We study superfast algorithms that computes low rank approximation of a matrix (hereafter referred to as LRA) that use much fewer memory cells and arithmetic operations than the input matrix has entries. We first specify a family of 2mn…

Numerical Analysis · Mathematics 2018-06-08 Victor Y. Pan , Qi Luan , John Svadlenka , Liang Zhao

We propose a simple yet effective model for Single Image Super-Resolution (SISR), by combining the merits of Residual Learning and Convolutional Sparse Coding (RL-CSC). Our model is inspired by the Learned Iterative Shrinkage-Threshold…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Menglei Zhang , Zhou Liu , Lei Yu

Remote Sensing Image-Text Retrieval (RSITR) is pivotal for knowledge services and data mining in the remote sensing (RS) domain. Considering the multi-scale representations in image content and text vocabulary can enable the models to learn…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Rui Yang , Shuang Wang , Yingping Han , Yuanheng Li , Dong Zhao , Dou Quan , Yanhe Guo , Licheng Jiao

Imaging beyond the diffraction limit barrier has attracted wide attention due to the ability to resolve image features that were previously hidden. Of the various super-resolution microscopy techniques available, a particularly simple…

Fine-tuning has become a popular approach to adapting large foundational models to specific tasks. As the size of models and datasets grows, parameter-efficient fine-tuning techniques are increasingly important. One of the most widely used…

Latency-critical applications tend to show low utilization of functional units due to frequent cache misses and mispredictions during speculative execution in high-performance superscalar processors. However, due to significant impact on…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Denis Los , Igor Petushkov

In clinical imaging, magnetic resonance (MR) image volumes are often acquired as stacks of 2D slices with decreased scan times, improved signal-to-noise ratio, and image contrasts unique to 2D MR pulse sequences. While this is sufficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Samuel W. Remedios , Shuwen Wei , Shuo Han , Jinwei Zhang , Aaron Carass , Kurt G. Schilling , Dzung L. Pham , Jerry L. Prince , Blake E. Dewey

ESA's PROBA-V Earth observation satellite enables us to monitor our planet at a large scale, studying the interaction between vegetation and climate and provides guidance for important decisions on our common global future. However, the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Marcus Märtens , Dario Izzo , Andrej Krzic , Daniël Cox

Efficient fine-tuning of pre-trained convolutional neural network (CNN) models using local data is essential for providing high-quality services to users using ubiquitous and resource-limited Internet of Things (IoT) devices. Low-Rank…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Chuntao Ding , Xu Cao , Jianhang Xie , Linlin Fan , Shangguang Wang , Zhichao Lu

Low-Rank Adaptation (LoRA) is a widely adopted parameter-efficient fine-tuning (PEFT) method validated across NLP and CV domains. However, LoRA faces an inherent low-rank bottleneck: narrowing its performance gap with full finetuning…

Machine Learning · Computer Science 2025-12-03 Haonan Dong , Wenhao Zhu , Guojie Song , Liang Wang

In 2D multi-slice magnetic resonance (MR) acquisition, the through-plane signals are typically of lower resolution than the in-plane signals. While contemporary super-resolution (SR) methods aim to recover the underlying high-resolution…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Samuel W. Remedios , Shuo Han , Yuan Xue , Aaron Carass , Trac D. Tran , Dzung L. Pham , Jerry L. Prince

Sustaining high fidelity and high throughput of perception tasks over vision sensor streams on edge devices remains a formidable challenge, especially given the continuing increase in image sizes (e.g., generated by 4K cameras) and…

Multimedia · Computer Science 2023-05-08 Ila Gokarn , Hemanth Sabella , Yigong Hu , Tarek Abdelzaher , Archan Misra

Multireference alignment (MRA) refers to the problem of recovering a signal from noisy samples subject to random circular shifts. Expectation--maximization (EM) and variational approaches use statistical modeling to achieve high accuracy at…

Information Theory · Computer Science 2025-10-30 Vahid Shahverdi , Emanuel Ström , Joakim Andén

Predicting how the microstructure governs the mechanical response of heterogeneous materials is essential for optimizing design and performance. Yet this task remains difficult due to the complex, high dimensional nature of microstructural…

Machine Learning · Computer Science 2026-03-16 Prabhat Karmakar , Sayan Gupta , Ilaksh Adlakha