English
Related papers

Related papers: Global Context Is All You Need for Parallel Effici…

200 papers

In this thesis, we present robust and fully-automated methods for the subdivision of the entire human cerebral cortex based on connectivity information. Our contributions are four-fold: First, we propose a clustering approach to delineate a…

Neurons and Cognition · Quantitative Biology 2018-02-21 Salim Arslan

Tractography has become an indispensable part of brain connectivity studies. However, it is currently facing problems with reliability. In particular, a substantial amount of nerve fiber reconstructions (streamlines) in tractograms produced…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Antonia Hain , Daniel Jörgens , Rodrigo Moreno

The goal of data attribution is to trace model predictions back to training data. Despite a long line of work towards this goal, existing approaches to data attribution tend to force users to choose between computational tractability and…

Machine Learning · Statistics 2023-04-04 Sung Min Park , Kristian Georgiev , Andrew Ilyas , Guillaume Leclerc , Aleksander Madry

Registration of diffusion MRI tractography is an essential step for analyzing group similarities and variations in the brain's white matter (WM). Streamline-based registration approaches can leverage the 3D geometric information of fiber…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Junyi Wang , Mubai Du , Ye Wu , Yijie Li , William M. Wells , Lauren J. O'Donnell , Fan Zhang

Multivariate time series forecasting in graph-structured domains is critical for real-world applications, yet existing spatiotemporal models often suffer from performance degradation under data scarcity and cross-domain shifts. We address…

Machine Learning · Computer Science 2026-02-05 Zihao Jing , Yuxi Long , Ganlin Feng

In this work, we introduce the Global Planar Convolution module as a building-block for fully-convolutional networks that aggregates global information and, therefore, enhances the context perception capabilities of segmentation networks in…

Image and Video Processing · Electrical Eng. & Systems 2019-08-28 Santi Puch , Irina Sánchez , Aura Hernández , Gemma Piella , Vesna Prchkovska

Context parallelism (CP) has been widely adopted to support the growing context length in foundation model pretraining. However, existing designs fail to handle the large variation in sequence length from training datasets, resulting in…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Yilong Zhao , Xiaonan Nie , Kan Zhu , Shuang Ma , Zhichao Lai , Hongxiang Hao , Yang Zhou , Baris Kasikci , Ion Stoica

Efficient large-scale inference of transformer-based large language models (LLMs) remains a fundamental systems challenge, frequently requiring multi-GPU parallelism to meet stringent latency and throughput targets. Conventional tensor…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-10 Chong Wang , Nan Du , Tom Gunter , Tao Lei , Kulin Seth , Senyu Tong , Jianyu Wang , Guoli Yin , Xiyou Zhou , Kelvin Zou , Ruoming Pang

Diffusion MRI tractography is an advanced imaging technique for quantitative mapping of the brain's structural connectivity. Whole brain tractography (WBT) data contains over hundreds of thousands of individual fiber streamlines (estimated…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Fan Zhang , Tengfei Xue , Weidong Cai , Yogesh Rathi , Carl-Fredrik Westin , Lauren J O'Donnell

White matter bundle segmentation is crucial for studying brain structural connectivity, neurosurgical planning, and neurological disorders. White Matter Segmentation remains challenging due to structural similarity in streamlines, subject…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Anoushkrit Goel , Simroop Singh , Ankita Joshi , Ranjeet Ranjan Jha , Chirag Ahuja , Aditya Nigam , Arnav Bhavsar

We investigate the concept of rendering production-style content with full path tracing in a data-distributed fashion -- that is, with multiple collaborating nodes and/or GPUs that each store only part of the model. In particular, we…

Graphics · Computer Science 2022-04-22 Ingo Wald , Steven G Parker

We present a new multiscale algorithm for solving regularized Optimal Transport problems on the GPU, with a linear memory footprint. Relying on Sinkhorn divergences which are convex, smooth and positive definite loss functions, this method…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Jean Feydy , Pierre Roussillon , Alain Trouvé , Pietro Gori

Large language models have shown remarkable performance across a wide range of language tasks, owing to their exceptional capabilities in context modeling. The most commonly used method of context modeling is full self-attention, as seen in…

Computation and Language · Computer Science 2025-06-26 Zhisong Zhang , Yan Wang , Xinting Huang , Tianqing Fang , Hongming Zhang , Chenlong Deng , Shuaiyi Li , Dong Yu

Volumetric medical segmentation is a critical component of 3D medical image analysis that delineates different semantic regions. Deep neural networks have significantly improved volumetric medical segmentation, but they generally require…

Image and Video Processing · Electrical Eng. & Systems 2024-07-18 Hanan Gani , Muzammal Naseer , Fahad Khan , Salman Khan

Sampling-based motion planning algorithms, like the Rapidly-Exploring Random Tree (RRT) and its widely used variant, RRT-Connect, provide efficient solutions for high-dimensional planning problems faced by real-world robots. However, these…

Robotics · Computer Science 2025-10-08 Chih H. Huang , Pranav Jadhav , Brian Plancher , Zachary Kingston

We present an optimized algorithm that performs automatic classification of white matter fibers based on a multi-subject bundle atlas. We implemented a parallel algorithm that improves upon its previous version in both execution time and…

Deep research agents, which synthesize information across diverse sources, are significantly constrained by the sequential nature of reasoning. This bottleneck results in high latency, poor runtime adaptability, and inefficient resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-31 Lunyiu Nie , Nedim Lipka , Ryan A. Rossi , Swarat Chaudhuri

Device tracking is an important prerequisite for guidance during endovascular procedures. Especially during cardiac interventions, detection and tracking of guiding the catheter tip in 2D fluoroscopic images is important for applications…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Marc Demoustier , Yue Zhang , Venkatesh Narasimha Murthy , Florin C. Ghesu , Dorin Comaniciu

Cloud database systems, particularly their middleware and query execution layers, use sorting as a core operation in query processing, indexing and join execution. Distribution-dependence and limited parallelism are key issues inherent in…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Michael Dang'ana

Markov Chain Monte Carlo (MCMC) algorithms are essential tools in computational statistics for sampling from unnormalised probability distributions, but can be fragile when targeting high-dimensional, multimodal, or complex target…