English
Related papers

Related papers: Designing a Multi-petabyte Database for LSST

200 papers

We present a high-performance, graphics processing unit (GPU)-based framework for the efficient analysis and visualization of (nearly) terabyte (TB)-sized 3-dimensional images. Using a cluster of 96 GPUs, we demonstrate for a 0.5 TB image:…

Instrumentation and Methods for Astrophysics · Physics 2015-06-12 A. H. Hassan , C. J. Fluke , D. G. Barnes , V. A. Kilborn

Recording of transient absorption microscopy images requires fast detection of minute optical density changes, which is typically achieved with high-repetition-rate laser sources and lock-in detection. Here, we present a highly flexible and…

The growing demand for long-context inference capabilities in Large Language Models (LLMs) has intensified the computational and memory bottlenecks inherent to the self-attention mechanism. To address this challenge, we introduce BLASST, a…

This paper introduces a novel indexing and access method, called Feature- Based Adaptive Tolerance Tree (FATT), using wavelet transform is proposed to organize large image data sets efficiently and to support popular image access mechanisms…

Multimedia · Computer Science 2010-04-09 Dr. P. AnandhaKumar , V. Balamurugan

Characterizing the host galaxies of astrophysical transients is important to many areas of astrophysics, including constraining the progenitor systems of core-collapse supernovae, correcting Type Ia supernova distances, and…

Millimeter-scale embedded sensing systems have unique advantages over larger devices as they are able to capture, analyze, store, and transmit data at the source while being unobtrusive and covert. However, area-constrained systems pose…

Signal Processing · Electrical Eng. & Systems 2022-06-28 Andrea Bejarano-Carbo , Hyochan An , Kyojin Choo , Shiyu Liu , Qirui Zhang , Dennis Sylvester , David Blaauw , Hun-Seok Kim

Point-source transient events (PSTEs) - optical events that are both extremely fast and extremely small - pose several challenges to an imaging system. Due to their speed, accurately characterizing such events often requires detectors with…

Machine Learning · Statistics 2025-02-13 Frank Qiu , Joshua Michalenko , Lilian K. Casias , Cameron J. Radosevich , Jon Slater , Eric A. Shields

Data-hungry applications that require terabytes of memory have become widespread in recent years. To meet the memory needs of these applications, data centers are embracing tiered memory architectures with near and far memory tiers.…

Operating Systems · Computer Science 2023-12-01 Alan Nair , Sandeep Kumar , Aravinda Prasad , Andy Rudoff , Sreenivas Subramoney

Recently, transformers have captured significant interest in the area of single-image super-resolution tasks, demonstrating substantial gains in performance. Current models heavily depend on the network's extensive ability to extract…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Alik Pramanick , Utsav Bheda , Arijit Sur

We present a new video storage system (VSS) designed to decouple high-level video operations from the low-level details required to store and efficiently retrieve video data. VSS is designed to be the storage subsystem of a video data…

Databases · Computer Science 2021-04-01 Brandon Haynes , Maureen Daum , Dong He , Amrita Mazumdar , Magdalena Balazinska , Alvin Cheung , Luis Ceze

We have realised a simple prototype system to perform searches for short timescale optical transients, utilising the novel drift scan imaging technique described by Tingay (2020). We used two coordinated and aligned cameras, with an overlap…

High Energy Astrophysical Phenomena · Physics 2021-01-27 S. J. Tingay , W. Joubert

Event cameras encode visual information with high temporal precision, low data-rate, and high-dynamic range. Thanks to these characteristics, event cameras are particularly suited for scenarios with high motion, challenging lighting…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Etienne Perot , Pierre de Tournemire , Davide Nitti , Jonathan Masci , Amos Sironi

The need to recognise long-term dependencies in sequential data such as video streams has made Long Short-Term Memory (LSTM) networks a prominent Artificial Intelligence model for many emerging applications. However, the high computational…

Signal Processing · Electrical Eng. & Systems 2019-10-31 Alexandros Kouris , Stylianos I. Venieris , Michail Rizakis , Christos-Savvas Bouganis

The computational demands of self-attention mechanisms pose a critical challenge for transformer-based video generation, particularly in synthesizing ultra-long sequences. Current approaches, such as factorized attention and fixed sparse…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Qirui Li , Guangcong Zheng , Qi Zhao , Jie Li , Bin Dong , Yiwu Yao , Xi Li

Diffusion transformer-based video generation models (DiTs) have recently attracted widespread attention for their excellent generation quality. However, their computational cost remains a major bottleneck-attention alone accounts for over…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xuan Shen , Chenxia Han , Yufa Zhou , Yanyue Xie , Yifan Gong , Quanyi Wang , Yiwei Wang , Yanzhi Wang , Pu Zhao , Jiuxiang Gu

Due to the proliferation of applications for the Internet of Things, an increasing number of machine to machine (M2M) devices are being deployed. In particular, one of the M2M applications, video surveillance, has been widely discussed.…

Networking and Internet Architecture · Computer Science 2015-01-05 Yen-Kai Liao , Chih-Hang Wang , De-Nian Yang , Wen-Tsuen Chen

The landscape of computational building blocks of efficient image restoration architectures is dominated by a combination of convolutional processing and various attention mechanisms. However, convolutional filters, while efficient, are…

Image and Video Processing · Electrical Eng. & Systems 2025-01-23 Mohammad Shahab Sepehri , Zalan Fabian , Mahdi Soltanolkotabi

The Large Synoptic Survey Telescope (LSST) project will conduct a ten year multi-band survey starting in 2022. Observing strategies for this survey are being actively investigated, and the science capabilities can be best forecasted on the…

Instrumentation and Methods for Astrophysics · Physics 2020-04-08 Rahul Biswas , Scott F. Daniel , R. Hložek , A. G. Kim , Peter Yoachim

The usability and practicality of any machine learning (ML) applications are largely influenced by two critical but hard-to-attain factors: low latency and low cost. Unfortunately, achieving low latency and low cost is very challenging when…

Machine Learning · Computer Science 2019-10-22 Kevin Hsieh

Near-future astronomical survey experiments, such as LSST, possess system requirements of unprecedented fidelity that span photometry, astrometry and shape transfer. Some of these requirements flow directly to the array of science imaging…