Sparseloop: An Analytical Approach To Sparse Tensor Accelerator Modeling

In recent years, many accelerators have been proposed to efficiently process sparse tensor algebra applications (e.g., sparse neural networks). However, these proposals are single points in a large and diverse design space. The lack of systematic description and modeling support for these sparse ten...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2022 55th IEEE/ACM International Symposium on Microarchitecture (MICRO) s. 1377 - 1395
Hlavní autoři: Wu, Yannan Nellie, Tsai, Po-An, Parashar, Angshuman, Sze, Vivienne, Emer, Joel S.
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.10.2022
Témata:
Analytical modeling
Analytical models
Computational modeling
Hardware Accelerator
Neural networks
Stochastic processes
Systematics
Taxonomy
Tensor computation
Tensors
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:In recent years, many accelerators have been proposed to efficiently process sparse tensor algebra applications (e.g., sparse neural networks). However, these proposals are single points in a large and diverse design space. The lack of systematic description and modeling support for these sparse tensor accelerators impedes hardware designers from efficient and effective design space exploration. This paper first presents a unified taxonomy to systematically describe the diverse sparse tensor accelerator design space. Based on the proposed taxonomy, it then introduces Sparseloop, the first fast, accurate, and flexible analytical modeling framework to enable early-stage evaluation and exploration of sparse tensor accelerators. Sparseloop comprehends a large set of architecture specifications, including various dataflows and sparse acceleration features (e.g., elimination of zero-based compute). Using these specifications, Sparseloop evaluates a design's processing speed and energy efficiency while accounting for data movement and compute incurred by the employed dataflow, including the savings and overhead introduced by the sparse acceleration features using stochastic density models. Across representative accelerator designs and workloads, Sparseloop achieves over 2000× faster modeling speed than cycle-level simulations, maintains relative performance trends, and achieves 0.1% to 8% average error. The paper also presents example use cases of Sparseloop in different accelerator design flows to reveal important design insights.
DOI:10.1109/MICRO56248.2022.00096