Artificial to Spiking Neural Networks Conversion with Calibration in Scientific Machine Learning

Q Zhang, C Wu, A Kahana, GE Karniadakis, Y Kim… - SIAM Journal on …, 2025 - SIAM
SIAM Journal on Scientific Computing, 2025SIAM
We introduce a method to convert physics-informed neural networks (PINNs), commonly
used in scientific machine learning, to spiking neural networks (SNNs), which are expected
to have higher energy efficiency compared to traditional artificial neural networks (ANNs).
We first extend the calibration technique of SNNs to arbitrary activation functions beyond
ReLU, making it more versatile, and we prove a theorem that ensures the effectiveness of
the calibration. We successfully convert PINNs to SNNs, enabling computational efficiency …
Abstract
We introduce a method to convert physics-informed neural networks (PINNs), commonly used in scientific machine learning, to spiking neural networks (SNNs), which are expected to have higher energy efficiency compared to traditional artificial neural networks (ANNs). We first extend the calibration technique of SNNs to arbitrary activation functions beyond ReLU, making it more versatile, and we prove a theorem that ensures the effectiveness of the calibration. We successfully convert PINNs to SNNs, enabling computational efficiency for diverse regression tasks in solving multiple differential equations, including the unsteady Navier–Stokes equations. We demonstrate great gains in terms of overall efficiency, including separable PINNs (SPINNs), which accelerate the training process. Overall, this is the first work of this kind and the proposed method achieves relatively good accuracy with low spike rates.
Society for Industrial and Applied Mathematics
Showing the best result for this search. See all results