English
Related papers

Related papers: ColdPress: Efficient Quantile-Based Compression of…

200 papers

Modern galaxy surveys produce redshift probability density functions (PDFs) in addition to traditional photometric redshift (photo-$z$) point estimates. However, the storage of photo-$z$ PDFs may present a challenge with increasingly large…

Instrumentation and Methods for Astrophysics · Physics 2021-08-03 A. I. Malz , P. J. Marshall , S. J. Schmidt , M. L. Graham , J. DeRose , R. Wechsler

One of the consequences of entering the era of precision cosmology is the widespread adoption of photometric redshift probability density functions (PDFs). Both current and future photometric surveys are expected to obtain images of…

Instrumentation and Methods for Astrophysics · Physics 2015-06-19 M. Carrasco Kind , R. J. Brunner

The current PDF4LHC recommendation to estimate uncertainties due to parton distribution functions (PDFs) in theoretical predictions for LHC processes involves the combination of separate predictions computed using PDF sets from different…

High Energy Physics - Phenomenology · Physics 2015-09-30 Stefano Carrazza , Jose I. Latorre , Juan Rojo , Graeme Watt

This paper describes a lossy method for compressing raw images produced by CCDs or similar devices. The method is very simple: lossy quantization followed by lossless compression using general-purpose compression tools such as gzip and…

Astrophysics · Physics 2007-05-23 Alan M. Watson

In this work, we explore the quantization of diffusion models in extreme compression regimes to reduce model size while maintaining performance. We begin by investigating classical vector quantization but find that diffusion models are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Jie Shao , Hanxiao Zhang , Jianxin Wu

Photometric redshifts play an important role as a measure of distance for various cosmological topics. Spectroscopic redshifts are only available for a very limited number of objects but can be used for creating statistical models. A broad…

Instrumentation and Methods for Astrophysics · Physics 2016-08-30 Kai Lars Polsterer , Antonio D'Isanto , Fabian Gieseke

Soft compression is a lossless image compression method, which is committed to eliminating coding redundancy and spatial redundancy at the same time by adopting locations and shapes of codebook to encode an image from the perspective of…

Information Theory · Computer Science 2020-12-14 Gangtao Xin , Pingyi Fan

The need to analyze the available large synoptic multi-band surveys drives the development of new data-analysis methods. Photometric redshift estimation is one field of application where such new methods improved the results, substantially.…

Instrumentation and Methods for Astrophysics · Physics 2018-01-31 Antonio D'Isanto , Kai Lars Polsterer

Malware analysis is still largely a manual task. This slow and inefficient approach does not scale to the exponential rise in the rate of new unique malware generated. Hence, automating the process as much as possible becomes desirable. In…

Cryptography and Security · Computer Science 2021-03-15 Haoxi Tan , Mahin Chandramohan , Cristina Cifuentes , Guangdong Bai , Ryan K. L. Ko

Structured weight pruning is a representative model compression technique of DNNs to reduce the storage and computation requirements and accelerate inference. An automatic hyperparameter determination process is necessary due to the large…

Machine Learning · Computer Science 2019-09-12 Ning Liu , Xiaolong Ma , Zhiyuan Xu , Yanzhi Wang , Jian Tang , Jieping Ye

Pattern-matching-based document-compression systems (e.g. for faxing) rely on finding a small set of patterns that can be used to represent all of the ink in the document. Finding an optimal set of patterns is NP-hard; previous compression…

Data Structures and Algorithms · Computer Science 2016-01-19 Qin Zhang , John Danskin , Neal Young

We present Colibri, an open-source Python code that provides a general and flexible tool for PDF fits. The code is built so that users can implement their own PDF model, and use the built-in functionalities of Colibri for a fast computation…

High Energy Physics - Phenomenology · Physics 2025-10-07 Mark N. Costantini , Luca Mantani , James M. Moore , Valentina Schutze Sanchez , Maria Ubiali

Many astrophysical analyses depend on estimates of redshifts (a proxy for distance) determined from photometric (i.e., imaging) data alone. Inaccurate estimates of photometric redshift uncertainties can result in large systematic errors.…

Instrumentation and Methods for Astrophysics · Physics 2022-05-31 Biprateep Dey , Jeffrey A. Newman , Brett H. Andrews , Rafael Izbicki , Ann B. Lee , David Zhao , Markus Michael Rau , Alex I. Malz

Knowledge distillation methods compress models by training a student network using the classification outputs of a high quality teacher model, but can fail to effectively transfer the properties of computer vision foundation models from the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Evelyn J. Mannix , Liam Hodgkinson , Howard Bondell

Photometric wide-field surveys are imaging the sky in unprecedented detail. These surveys face a significant challenge in efficiently estimating galactic photometric redshifts while accurately quantifying associated uncertainties. In this…

This paper is dedicated to an efficient compression of weights and optimizer states (called checkpoints) obtained at different stages during a neural network training process. First, we propose a prediction-based compression approach, where…

Machine Learning · Computer Science 2025-06-16 Yuriy Kim , Evgeny Belyaev

The xPDFsuite software program is described. It is for processing and analyzing atomic pair distribution functions (PDF) from X-ray powder diffraction data. It provides a convenient GUI for SrXplanr and PDFgetX3, allowing the users to…

Materials Science · Physics 2015-02-25 Xiaohao Yang , Pavol Juhas , Christopher L. Farrow , Simon J. L. Billinge

A trustworthy estimate of the redshift distribution $n(z)$ is crucial for using weak gravitational lensing and large-scale structure of galaxy catalogs to study cosmology. Spectroscopic redshifts for the dim and numerous galaxies of…

Cosmology and Nongalactic Astrophysics · Physics 2020-07-27 Alex I. Malz , David W. Hogg

One of the most fascinating challenges in the context of parton density function (PDF) is the determination of the best combined PDF uncertainty from individual PDF sets. Since 2014 multiple methodologies have been developed to achieve this…

High Energy Physics - Phenomenology · Physics 2016-05-18 Stefano Carrazza , José I. Latorre
‹ Prev 1 2 3 10 Next ›