PyPOD-GP: Using PyTorch for accelerated chip-level thermal simulation of the GPU

The rising demand for high-performance computing (HPC) has made full-chip dynamic thermal simulation in many-core GPUs critical for optimizing performance and extending device lifespans. Proper orthogonal decomposition (POD) with Galerkin projection (GP) has shown to offer high accuracy and massive runtime improvements over direct numerical simulation (DNS). However, previous implementations of POD-GP use MPI-based libraries like PETSc and FEniCS and face significant runtime bottlenecks. We propose a PyTorch-based POD-GP library (PyPOD-GP), a GPU-optimized library for chip-level thermal simulation. PyPOD-GP achieves over 23.4X speedup in training and over 10X speedup in inference on a GPU with over 13,000 cores, with just 1.2% error over the device layer.

Recommended citation: Neil He, Ming-Cheng Cheng, Yu Liu. "PyPOD-GP: Using PyTorch for accelerated chip-level thermal simulation of the GPU " in SoftwareX. Vol.30, p.102147.
Paper Link | Code Link