The NVIDIA L40S is the company's do-it-all GPU that is for professional visualization, vGPU capabilities, and even AI inference and training. We use Supermicro SYS-521GE-TNRT 8-GPU system to take a look at the NVIDIA L40S vs. the NVIDIA H100 and vs. the NVIDIA A100 to see why this GPU is a different option for model customization, generative AI/ LLM applications, as well as for video.

Thanks to Supermicro and NVIDIA for getting us the hardware to make this possible and flying me out to California for a few hours.

STH Main Site Article: [ Ссылка ]
STH Top 5 Weekly Newsletter: [ Ссылка ]

----------------------------------------------------------------------
Become a STH YT Member and Support Us
----------------------------------------------------------------------
Join STH YouTube membership to support the channel: [ Ссылка ]

STH Merch on Spring: [ Ссылка ]

----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Forums: [ Ссылка ]
Follow on Twitter: [ Ссылка ]
Follow on LinkedIn: [ Ссылка ]
Follow on Facebook: [ Ссылка ]
Follow on Instagram: [ Ссылка ]

----------------------------------------------------------------------
Where to Find The Unit We Purchased
Note we may earn a small commission if you use these links to purchase a product through them.
----------------------------------------------------------------------
- Supermicro eStore: [ Ссылка ]

----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
01:29 NVIDIA SXM5 H100 GPUs versus PCIe and OAM
04:27 Heritage of NVIDIA PCIe GPUs for AI
05:18 NVIDIA L40 vs L40S
06:22 NVIDIA L40S L40 A100 H100 H100 NVL PCIe Comparison Table
12:00 Wrap-up

свернуть