Lossy checkpoint compression in full waveform inversion: a case study with ZFPv0.5.5 and the overthrust model



Kukreja, Navjot ORCID: 0000-0003-0016-3785, Huckelheim, Jan, Louboutin, Mathias, Washbourne, John, Kelly, Paul HJ and Gorman, Gerard J
(2022) Lossy checkpoint compression in full waveform inversion: a case study with ZFPv0.5.5 and the overthrust model. GEOSCIENTIFIC MODEL DEVELOPMENT, 15 (9). pp. 3815-3829.

Access the full-text of this item by clicking on the Open Access link.

Abstract

<jats:p>Abstract. This paper proposes a new method that combines checkpointing methods with error-controlled lossy compression for large-scale high-performance full-waveform inversion (FWI), an inverse problem commonly used in geophysical exploration. This combination can significantly reduce data movement, allowing a reduction in run time as well as peak memory. In the exascale computing era, frequent data transfer (e.g., memory bandwidth, PCIe bandwidth for GPUs, or network) is the performance bottleneck rather than the peak FLOPS of the processing unit. Like many other adjoint-based optimization problems, FWI is costly in terms of the number of floating-point operations, large memory footprint during backpropagation, and data transfer overheads. Past work for adjoint methods has developed checkpointing methods that reduce the peak memory requirements during backpropagation at the cost of additional floating-point computations. Combining this traditional checkpointing with error-controlled lossy compression, we explore the three-way tradeoff between memory, precision, and time to solution. We investigate how approximation errors introduced by lossy compression of the forward solution impact the objective function gradient and final inverted solution. Empirical results from these numerical experiments indicate that high lossy-compression rates (compression factors ranging up to 100) have a relatively minor impact on convergence rates and the quality of the final solution. </jats:p>

Item Type: Article
Divisions: Faculty of Science and Engineering > School of Electrical Engineering, Electronics and Computer Science
Depositing User: Symplectic Admin
Date Deposited: 09 Jun 2022 10:43
Last Modified: 18 Jan 2023 21:00
DOI: 10.5194/gmd-15-3815-2022
Open Access URL: https://gmd.copernicus.org/articles/15/3815/2022/g...
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3156113