English
Related papers

Related papers: Dual-Kernel Adapter: Expanding Spatial Horizons fo…

200 papers

Deep neural networks are parametrized by several thousands or millions of parameters, and have shown tremendous success in many classification problems. However, the large number of parameters makes it difficult to integrate these models…

Machine Learning · Computer Science 2022-01-04 Eun Som Jeon , Anirudh Som , Ankita Shukla , Kristina Hasanaj , Matthew P. Buman , Pavan Turaga

The excellent performance of deep neural networks is usually accompanied by a large number of parameters and computations, which have limited their usage on the resource-limited edge devices. To address this issue, abundant methods such as…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Muzhou Yu , Linfeng Zhang , Kaisheng Ma

Over the past few years, detection performance improvements of deep-learning based steganalyzers have been usually achieved through structure expansion. However, excessive expanded structure results in huge computational cost, storage…

Multimedia · Computer Science 2020-06-25 Shunquan Tan , Weilong Wu , Zilong Shao , Qiushi Li , Bin Li , Jiwu Huang

Image restoration has traditionally required training specialized models on thousands of paired examples per degradation type. We challenge this paradigm by demonstrating that powerful pre-trained text-conditioned image editing models can…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 M. Akın Yılmaz , Ahmet Bilican , Burak Can Biner , A. Murat Tekalp

Large pretrained models are increasingly crucial in modern computer vision tasks. These models are typically used in downstream tasks by end-to-end finetuning, which is highly memory-intensive for tasks with high-resolution data, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chen Zhao , Shuming Liu , Karttikeya Mangalam , Guocheng Qian , Fatimah Zohra , Abdulmohsen Alghannam , Jitendra Malik , Bernard Ghanem

Accurate segmentation is a crucial step in medical image analysis and applying supervised machine learning to segment the organs or lesions has been substantiated effective. However, it is costly to perform data annotation that provides…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yunxiang Li , Jingxiong Li , Ruilong Dan , Shuai Wang , Kai Jin , Guodong Zeng , Jun Wang , Xiangji Pan , Qianni Zhang , Huiyu Zhou , Qun Jin , Li Wang , Yaqi Wang

Hyperspectral imaging (HSI) holds great potential for healthcare due to its rich spectral information. However, acquiring HSI data remains costly and technically demanding. Hyperspectral image reconstruction offers a practical solution by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yufei Wen , Yuting Zhang , Jingdan Kang , Hao Ren , Weibin Cheng , Jintai Chen , Kaishun Wu

Purpose: The radial k-space trajectory is a well-established sampling trajectory used in conjunction with magnetic resonance imaging. However, the radial k-space trajectory requires a large number of radial lines for high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2018-01-10 Yo Seob Han , Jaejun Yoo , Jong Chul Ye

Recent breakthroughs and successful deployment of large language and vision models in a constrained environment predominantly follow a two phase approach. First, large models are trained to achieve peak performance, followed by a model…

Machine Learning · Computer Science 2024-11-22 Hanna Mazzawi , Pranjal Awasthi , Xavi Gonzalvo , Srikumar Ramalingam

Adapting pre-trained foundation models for various downstream tasks has been prevalent in artificial intelligence. Due to the vast number of tasks and high costs, adjusting all parameters becomes unfeasible. To mitigate this, several…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Chongjie Si , Xuehui Wang , Xue Yang , Zhengqin Xu , Qingyun Li , Jifeng Dai , Yu Qiao , Xiaokang Yang , Wei Shen

Image classification is one of the most fundamental tasks in Computer Vision. In practical applications, the datasets are usually not as abundant as those in the laboratory and simulation, which is always called as Data Hungry. How to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Feiyang Han , Yun Miao , Zhaoyi Sun , Yimin Wei

This paper presents a solution to the cross-domain adaptation problem for 2D surgical image segmentation, explicitly considering the privacy protection of distributed datasets belonging to different centers. Deep learning architectures in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Ronast Subedi , Rebati Raman Gaire , Sharib Ali , Anh Nguyen , Danail Stoyanov , Binod Bhattarai

Fine-tuning BERT-based models is resource-intensive in memory, computation, and time. While many prior works aim to improve inference efficiency via compression techniques, e.g., pruning, these works do not explicitly address the…

Computation and Language · Computer Science 2022-08-04 Danilo Vucetic , Mohammadreza Tayaranian , Maryam Ziaeefard , James J. Clark , Brett H. Meyer , Warren J. Gross

In medical images, various types of lesions often manifest significant differences in their shape and texture. Accurate medical image segmentation demands deep learning models with robust capabilities in multi-scale and boundary feature…

Image and Video Processing · Electrical Eng. & Systems 2024-08-20 Zhenhuan Zhou , Along He , Yanlin Wu , Rui Yao , Xueshuo Xie , Tao Li

Fine-tuning pretrained models is a common practice in domain generalization (DG) tasks. However, fine-tuning is usually computationally expensive due to the ever-growing size of pretrained models. More importantly, it may cause over-fitting…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Ziyue Li , Kan Ren , Xinyang Jiang , Bo Li , Haipeng Zhang , Dongsheng Li

Transformers have shown remarkable performance in 3D medical image segmentation, but their high computational requirements and need for large amounts of labeled data limit their applicability. To address these challenges, we consider two…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Xinyu Liu , Zhen Chen , Wuyang Li , Chenxin Li , Yixuan Yuan

Adapting large-scale pre-trained generative models in a parameter-efficient manner is gaining traction. Traditional methods like low rank adaptation achieve parameter efficiency by imposing constraints but may not be optimal for tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Xinxi Zhang , Song Wen , Ligong Han , Felix Juefei-Xu , Akash Srivastava , Junzhou Huang , Hao Wang , Molei Tao , Dimitris N. Metaxas

Data Augmentation (DA) is a technique to increase the quantity and diversity of the training data, and by that alleviate overfitting and improve generalisation. However, standard DA produces synthetic data for augmentation with limited…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Lorenzo Tronchin , Minh H. Vu , Paolo Soda , Tommy Löfstedt

Combining RGB images and the corresponding depth maps in semantic segmentation proves the effectiveness in the past few years. Existing RGB-D modal fusion methods either lack the non-linear feature fusion ability or treat both modal images…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Lizhi Bai , Jun Yang , Chunqi Tian , Yaoru Sun , Maoyu Mao , Yanjun Xu , Weirong Xu

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

Machine Learning · Computer Science 2017-08-22 Luke Taylor , Geoff Nitschke