An adaptive prediction-based approach to lossless compression of floating-point volume data

Nathaniel Fout, Kwan-Liu Ma

Research output: Contribution to journalArticle

33 Citations (Scopus)

Abstract

In this work, we address the problem of lossless compression of scientific and medical floating-point volume data. We propose two prediction-based compression methods that share a common framework, which consists of a switched prediction scheme wherein the best predictor out of a preset group of linear predictors is selected. Such a scheme is able to adapt to different datasets as well as to varying statistics within the data. The first method, called APE (Adaptive Polynomial Encoder), uses a family of structured interpolating polynomials for prediction, while the second method, which we refer to as ACE (Adaptive Combined Encoder), combines predictors from previous work with the polynomial predictors to yield a more flexible, powerful encoder that is able to effectively decorrelate a wide range of data. In addition, in order to facilitate efficient visualization of compressed data, our scheme provides an option to partition floating-point values in such a way as to provide a progressive representation. We compare our two compressors to existing state-of-the-art lossless floating-point compressors for scientific data, with our data suite including both computer simulations and observational measurements. The results demonstrate that our polynomial predictor, APE, is comparable to previous approaches in terms of speed but achieves better compression rates on average. ACE, our combined predictor, while somewhat slower, is able to achieve the best compression rate on all datasets, with significantly better rates on most of the datasets.

Original languageEnglish (US)
Article number6327234
Pages (from-to)2295-2304
Number of pages10
JournalIEEE Transactions on Visualization and Computer Graphics
Volume18
Issue number12
DOIs
StatePublished - Oct 24 2012

Fingerprint

Polynomials
Compressors
Visualization
Statistics
Computer simulation

Keywords

  • floating-point compression
  • lossless compression
  • Volume compression

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Cite this

An adaptive prediction-based approach to lossless compression of floating-point volume data. / Fout, Nathaniel; Ma, Kwan-Liu.

In: IEEE Transactions on Visualization and Computer Graphics, Vol. 18, No. 12, 6327234, 24.10.2012, p. 2295-2304.

Research output: Contribution to journalArticle

@article{30a80a3ab6634e319a33f61a64bce710,
title = "An adaptive prediction-based approach to lossless compression of floating-point volume data",
abstract = "In this work, we address the problem of lossless compression of scientific and medical floating-point volume data. We propose two prediction-based compression methods that share a common framework, which consists of a switched prediction scheme wherein the best predictor out of a preset group of linear predictors is selected. Such a scheme is able to adapt to different datasets as well as to varying statistics within the data. The first method, called APE (Adaptive Polynomial Encoder), uses a family of structured interpolating polynomials for prediction, while the second method, which we refer to as ACE (Adaptive Combined Encoder), combines predictors from previous work with the polynomial predictors to yield a more flexible, powerful encoder that is able to effectively decorrelate a wide range of data. In addition, in order to facilitate efficient visualization of compressed data, our scheme provides an option to partition floating-point values in such a way as to provide a progressive representation. We compare our two compressors to existing state-of-the-art lossless floating-point compressors for scientific data, with our data suite including both computer simulations and observational measurements. The results demonstrate that our polynomial predictor, APE, is comparable to previous approaches in terms of speed but achieves better compression rates on average. ACE, our combined predictor, while somewhat slower, is able to achieve the best compression rate on all datasets, with significantly better rates on most of the datasets.",
keywords = "floating-point compression, lossless compression, Volume compression",
author = "Nathaniel Fout and Kwan-Liu Ma",
year = "2012",
month = "10",
day = "24",
doi = "10.1109/TVCG.2012.194",
language = "English (US)",
volume = "18",
pages = "2295--2304",
journal = "IEEE Transactions on Visualization and Computer Graphics",
issn = "1077-2626",
publisher = "IEEE Computer Society",
number = "12",

}

TY - JOUR

T1 - An adaptive prediction-based approach to lossless compression of floating-point volume data

AU - Fout, Nathaniel

AU - Ma, Kwan-Liu

PY - 2012/10/24

Y1 - 2012/10/24

N2 - In this work, we address the problem of lossless compression of scientific and medical floating-point volume data. We propose two prediction-based compression methods that share a common framework, which consists of a switched prediction scheme wherein the best predictor out of a preset group of linear predictors is selected. Such a scheme is able to adapt to different datasets as well as to varying statistics within the data. The first method, called APE (Adaptive Polynomial Encoder), uses a family of structured interpolating polynomials for prediction, while the second method, which we refer to as ACE (Adaptive Combined Encoder), combines predictors from previous work with the polynomial predictors to yield a more flexible, powerful encoder that is able to effectively decorrelate a wide range of data. In addition, in order to facilitate efficient visualization of compressed data, our scheme provides an option to partition floating-point values in such a way as to provide a progressive representation. We compare our two compressors to existing state-of-the-art lossless floating-point compressors for scientific data, with our data suite including both computer simulations and observational measurements. The results demonstrate that our polynomial predictor, APE, is comparable to previous approaches in terms of speed but achieves better compression rates on average. ACE, our combined predictor, while somewhat slower, is able to achieve the best compression rate on all datasets, with significantly better rates on most of the datasets.

AB - In this work, we address the problem of lossless compression of scientific and medical floating-point volume data. We propose two prediction-based compression methods that share a common framework, which consists of a switched prediction scheme wherein the best predictor out of a preset group of linear predictors is selected. Such a scheme is able to adapt to different datasets as well as to varying statistics within the data. The first method, called APE (Adaptive Polynomial Encoder), uses a family of structured interpolating polynomials for prediction, while the second method, which we refer to as ACE (Adaptive Combined Encoder), combines predictors from previous work with the polynomial predictors to yield a more flexible, powerful encoder that is able to effectively decorrelate a wide range of data. In addition, in order to facilitate efficient visualization of compressed data, our scheme provides an option to partition floating-point values in such a way as to provide a progressive representation. We compare our two compressors to existing state-of-the-art lossless floating-point compressors for scientific data, with our data suite including both computer simulations and observational measurements. The results demonstrate that our polynomial predictor, APE, is comparable to previous approaches in terms of speed but achieves better compression rates on average. ACE, our combined predictor, while somewhat slower, is able to achieve the best compression rate on all datasets, with significantly better rates on most of the datasets.

KW - floating-point compression

KW - lossless compression

KW - Volume compression

UR - http://www.scopus.com/inward/record.url?scp=84867640676&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84867640676&partnerID=8YFLogxK

U2 - 10.1109/TVCG.2012.194

DO - 10.1109/TVCG.2012.194

M3 - Article

C2 - 26357137

AN - SCOPUS:84867640676

VL - 18

SP - 2295

EP - 2304

JO - IEEE Transactions on Visualization and Computer Graphics

JF - IEEE Transactions on Visualization and Computer Graphics

SN - 1077-2626

IS - 12

M1 - 6327234

ER -