English
Related papers

Related papers: GSPN-2: Efficient Parallel Sequence Modeling

200 papers

Sparse matrix-vector and matrix-matrix multiplication (SpMV and SpMM) are fundamental in both conventional (graph analytics, scientific computing) and emerging (sparse DNN, GNN) domains. Workload-balancing and parallel-reduction are…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-15 Guyue Huang , Guohao Dai , Yu Wang , Yufei Ding , Yuan Xie

This paper introduces SO(2)-Equivariant Gaussian Sculpting Networks (GSNs) as an approach for SO(2)-Equivariant 3D object reconstruction from single-view image observations. GSNs take a single observation as input to generate a Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ruihan Xu , Anthony Opipari , Joshua Mah , Stanley Lewis , Haoran Zhang , Hanzhe Guo , Odest Chadwicke Jenkins

Lightweight vision networks have witnessed remarkable progress in recent years, yet achieving a satisfactory balance among parameter scale, computational overhead, and task performance remains difficult. Although many existing lightweight…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Wei Xu

Graph Neural Networks (GNNs) are proven to be powerful models to generate node embedding for downstream applications. However, due to the high computation complexity of GNN inference, it is hard to deploy GNNs for large-scale or real-time…

Machine Learning · Computer Science 2021-05-11 Hongkuan Zhou , Ajitesh Srivastava , Hanqing Zeng , Rajgopal Kannan , Viktor Prasanna

In the last few years, several deep learning models, especially Generative Adversarial Networks have received a lot of attention for the task of Single Image Super-Resolution (SISR). These methods focus on building an end-to-end framework,…

Image and Video Processing · Electrical Eng. & Systems 2020-10-12 Vibhu Bhatia , Yatender Kumar

Graph Neural Networks (GNNs) are widely used today in recommendation systems, fraud detection, and node/link classification tasks. Real world GNNs continue to scale in size and require a large memory footprint for storing graphs and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-31 Jeongmin Brian Park , Kun Wu , Vikram Sharma Mailthody , Zaid Quresh , Scott Mahlke , Wen-mei Hwu

Implicit Neural Representation (INR) has demonstrated remarkable advances in the field of image representation but demands substantial GPU resources. GaussianImage recently pioneered the use of Gaussian Splatting to mitigate this cost,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zhaojie Zeng , Yuesong Wang , Chao Yang , Tao Guan , Lili Ju

Edge intelligence has arisen as a promising computing paradigm for supporting miscellaneous smart applications that rely on machine learning techniques. While the community has extensively investigated multi-tier edge deployment for…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Liekang Zeng , Chongyu Yang , Peng Huang , Zhi Zhou , Shuai Yu , Xu Chen

Graph Neural Networks (GNNs) have emerged as powerful tools for various graph mining tasks, yet existing scalable solutions often struggle to balance execution efficiency with prediction accuracy. These difficulties stem from iterative…

Machine Learning · Computer Science 2026-04-02 Xu Cheng , Liang Yao , Feng He , Yukuo Cen , Yufei He , Chenhui Zhang , Wenzheng Feng , Hongyun Cai , Jie Tang

Communication is a key bottleneck for distributed graph neural network (GNN) training. This paper proposes GNNPipe, a new approach that scales the distributed full-graph deep GNN training. Being the first to use layer-level model…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-26 Jingji Chen , Zhuoming Chen , Xuehai Qian

Transformers with remarkable global representation capacities achieve competitive results for visual tasks, but fail to consider high-level local pattern information in input images. In this paper, we present a generic Dual-stream Network…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Mingyuan Mao , Renrui Zhang , Honghui Zheng , Peng Gao , Teli Ma , Yan Peng , Errui Ding , Baochang Zhang , Shumin Han

The efficient spatial allocation of primitives serves as the foundation of 3D Gaussian Splatting, as it directly dictates the synergy between representation compactness, reconstruction speed, and rendering fidelity. Previous solutions,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Roni Itkin , Noam Issachar , Yehonatan Keypur , Xingyu Chen , Anpei Chen , Sagie Benaim

3D Gaussian Splatting has revolutionized neural rendering with real-time performance. However, scaling this approach to large scenes using Level-of-Detail methods faces critical challenges: inefficient serial traversal consuming over 60\%…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yixian Wang , Haolin Yu , Jiadong Tang , Yu Gao , Xihan Wang , Yufeng Yue , Yi Yang

Nowadays, vision-based computing tasks play an important role in various real-world applications. However, many vision computing tasks, e.g. semantic segmentation, are usually computationally expensive, posing a challenge to the computing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Shijie Hao , Yuan Zhou , Yanrong Guo , Richang Hong , Jun Cheng , Meng Wang

Vision-Language Models require efficient adaptation to continually emerging downstream tasks. While Parameter-Efficient Fine-Tuning mitigates catastrophic forgetting, assigning isolated modules per task leads to parameter explosion.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Xuezhi Cui , Dongbo Zhou , Wang Guo , Zeyuan Wang , Ziyu Li , Gaozhi Zhou , Xian Li , Ling Zhao , Wentao Yang , Chao Tao , Haifeng Li

Deep convolutional neural networks have been demonstrated to be effective for SISR in recent years. On the one hand, residual connections and dense connections have been used widely to ease forward information and backward gradient flows to…

Image and Video Processing · Electrical Eng. & Systems 2022-10-31 Bin-Cheng Yang , Gangshan Wu

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art method for graph-based learning tasks. However, training GCNs at scale is still challenging, hindering both the exploration of more sophisticated GCN architectures and…

Machine Learning · Computer Science 2022-03-29 Cheng Wan , Youjie Li , Ang Li , Nam Sung Kim , Yingyan Lin

We present a novel approach that converts partial and noisy RGB-D scans into high-quality 3D scene reconstructions by inferring unobserved scene geometry. Our approach is fully self-supervised and can hence be trained solely on real-world,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Angela Dai , Christian Diller , Matthias Nießner

Graph neural networks (GNNs) are widely used for learning on graph datasets derived from various real-world scenarios. Learning from extremely large graphs requires distributed training, and mini-batching with sampling is a popular approach…

3D Gaussian Splatting (3DGS) effectively synthesizes novel views through its flexible representation, yet fails to accurately reconstruct scene geometry. While modern variants like PGSR introduce additional losses to ensure proper depth and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Zhentao Huang , Di Wu , Zhenbang He , Minglun Gong