Close

Presentation

FlowGuard: Towards Reliable DNN Accelerators via Fine-Grained Fault Tolerance in Systolic Array
DescriptionWith the rapid adoption of Deep Neural Networks (DNNs) in safety-critical systems, ensuring the reliability of DNN hardware accelerators has become essential. Although many fault- tolerant techniques have been proposed for DNN accelerators, they rely on coarse-grained error detection that analyzes the final output of computations (e.g., output activation). This coarse- grained error detection approach delays responses to errors, making it particularly ineffective against propagation errors, which can cause multiple erroneous results with high probability in systolic array (SA)-based DNN accelerators. Furthermore, as these techniques depend on offline profiling, they are limited in accurately detecting and correcting errors during inference. In this paper, we propose Flowguard-SA, a fault-tolerant SA architecture that detects and mitigates propagation errors in a fine-grained manner through online profiling of input data. Flowguard-SA determines the maximum value of the input data online and leverages this value to detect and mitigate errors in the propagated input data within the SA. Experimental results demonstrate that Flowguard-SA achieves an average accuracy improvement of 2.54× at a BER of 1e-6 across various CNN models, compared to existing fault-tolerant techniques, with 1.95% area overhead and 0.66% power overhead compared to a conventional SA.