English
Related papers

Related papers: C3-SL: Circular Convolution-Based Batch-Wise Compr…

200 papers

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in terms of energy and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yoshitomo Matsubara , Ruihan Yang , Marco Levorato , Stephan Mandt

Split computing ($\neq$ split learning) is a promising approach to deep learning models for resource-constrained edge computing systems, where weak sensor (mobile) devices are wirelessly connected to stronger edge servers through channels…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yoshitomo Matsubara , Matteo Mendula , Marco Levorato

Compressive learning (CL) is an emerging framework that integrates signal acquisition via compressed sensing (CS) and machine learning for inference tasks directly on a small number of measurements. It can be a promising alternative to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Chong Mou , Jian Zhang

As a basic component of SE(3)-equivariant deep feature learning, steerable convolution has recently demonstrated its advantages for 3D semantic analysis. The advantages are, however, brought by expensive computations on dense, volumetric…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Jiehong Lin , Hongyang Li , Ke Chen , Jiangbo Lu , Kui Jia

This article seeks for a distributed learning solution for the visual transformer (ViT) architectures. Compared to convolutional neural network (CNN) architectures, ViTs often have larger model sizes, and are computationally expensive,…

Machine Learning · Computer Science 2022-07-04 Sihun Baek , Jihong Park , Praneeth Vepakomma , Ramesh Raskar , Mehdi Bennis , Seong-Lyun Kim

Deep metric learning is essential for visual recognition. The widely used pair-wise (or triplet) based loss objectives cannot make full use of semantical information in training samples or give enough attention to those hard samples during…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Lin Xu , Han Sun , Yuai Liu

While scale-invariant modeling has substantially boosted the performance of visual recognition tasks, it remains largely under-explored in deep networks based image restoration. Naively applying those scale-invariant techniques (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Yuchen Fan , Jiahui Yu , Ding Liu , Thomas S. Huang

With the rapid advancement of stereo vision technologies, stereo image compression has emerged as a crucial field that continues to draw significant attention. Previous approaches have primarily employed a unidirectional paradigm, where the…

Image and Video Processing · Electrical Eng. & Systems 2024-10-29 Zhening Liu , Xinjie Zhang , Jiawei Shao , Zehong Lin , Jun Zhang

Although convolutional neural network (CNN) has made great progress, large redundant parameters restrict its deployment on embedded devices, especially mobile devices. The recent compression works are focused on real-value convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Jiasong Wu , Hongshan Ren , Youyong Kong , Chunfeng Yang , Lotfi Senhadji , Huazhong Shu

LiDAR point-cloud segmentation is an important problem for many applications. For large-scale point cloud segmentation, the \textit{de facto} method is to project a 3D point cloud to get a 2D LiDAR image and use convolutions to process it.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Chenfeng Xu , Bichen Wu , Zining Wang , Wei Zhan , Peter Vajda , Kurt Keutzer , Masayoshi Tomizuka

Reducing communication overhead in federated learning (FL) is challenging but crucial for large-scale distributed privacy-preserving machine learning. While methods utilizing sparsification or others can largely lower the communication…

Machine Learning · Computer Science 2023-03-21 Yuhao Zhou , Mingjia Shi , Yuanxi Li , Qing Ye , Yanan Sun , Jiancheng Lv

Transposed convolution is crucial for generating high-resolution outputs, yet has received little attention compared to convolution layers. In this work we revisit transposed convolution and introduce a novel layer that allows us to place…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Stefano B. Blumberg , Daniele Raví , Mou-Cheng Xu , Matteo Figini , Iasonas Kokkinos , Daniel C. Alexander

High dimensional data analysis for exploration and discovery includes three fundamental tasks: dimensionality reduction, clustering, and visualization. When the three associated tasks are done separately, as is often the case thus far,…

Machine Learning · Computer Science 2020-12-02 Stan Z. Li , Lirong Wu , Zelin Zang

Continual Learning (CL) enables machine learning models to learn from continuously shifting new training data in absence of data from old tasks. Recently, pretrained vision transformers combined with prompt tuning have shown promise for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Anurag Roy , Riddhiman Moulick , Vinay K. Verma , Saptarshi Ghosh , Abir Das

The growing complexity of neural networks hinders the deployment of distributed machine learning on resource-constrained devices. Split learning (SL) offers a promising solution by partitioning the large model and offloading the primary…

Machine Learning · Computer Science 2026-04-09 Zehang Lin , Miao Yang , Haihan Zhu , Zheng Lin , Jianhao Huang , Jing Yang , Guangjin Pan , Dianxin Luan , Zihan Fang , Shunzhi Zhu , Wei Ni , John Thompson

We propose a simple, yet effective approach for spatiotemporal feature learning using deep 3-dimensional convolutional networks (3D ConvNets) trained on a large scale supervised video dataset. Our findings are three-fold: 1) 3D ConvNets are…

Computer Vision and Pattern Recognition · Computer Science 2015-10-08 Du Tran , Lubomir Bourdev , Rob Fergus , Lorenzo Torresani , Manohar Paluri

Recent studies have witnessed the effectiveness of 3D convolutions on segmenting volumetric medical images. Compared with the 2D counterparts, 3D convolutions can capture the spatial context in three dimensions. Nevertheless, models…

Image and Video Processing · Electrical Eng. & Systems 2021-09-28 Junjun He , Jin Ye , Cheng Li , Diping Song , Wanli Chen , Shanshan Wang , Lixu Gu , Yu Qiao

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang

Convolution neural network demonstrates great capability for multiple tasks, such as image classification and many others. However, much resource is required to train a network. Hence much effort has been made to accelerate neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Fuyuan Lyu , Shien Zhu , Weichen Liu

This work proposes a new formulation to the long-standing problem of convex decomposition through learning feature fields, enabling the first feed-forward model for open-world convex decomposition. Our method produces high-quality…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yuezhi Yang , Qixing Huang , Mikaela Angelina Uy , Nicholas Sharp