Boosting AI on Semidynamics RISC-V Cores with Custom Tensor Instructions - Roger Espasa & José María Arnau, Semidynamics
This talk will present the new Tensor Instructions developed at Semidynamics. The first key insight will be how to extend the RISC-V ISA to accommodate Tensor Instructions for Artificial Intelligence (AI) and Machine Learning (ML). These instructions are built on top of the RISC-V Vector Extension and use the vector register file for holding tensors. The second insight from this talk will be how to use the new Tensor Instructions to accelerate essential kernels in AI/ML, such as convolutions or fully-connected layers. We will show how popular ML models can leverage the new instructions to achieve significant speedups. Performance results from a real implementation will also be included in the presentation. At Semidynamics we developed a Vector Processing Unit (VPU) fully compliant with the RISC-V Vector Extension 1.0, and we implemented the Tensor Instructions in our VPU. We are looking forward to sharing our experience and results with the RISC-V community.
