1、Click Cheng, NVIDIA Solution Architect GTC China 2020 IMPROVE GPU UTILIZATION FROM SYSTEM LEVEL 2 WHATS ABOUT THE TALK Welcome Its From system level of NVIDIA perspective, proposed several ways to improve GPU utilization; Discuss several GPU monitoring metrics which reflect real GPU utilization; Int
2、ro each solution mechanism, usage, discuss the benefit in some test cases; Summary different solution positioning, comparison, etc; Its Not Improve GPU utilization from scheduler level; Optimize GPU utilization from coding level; 3 Overview Whats About The Talk GPU Utilization Discussion Multi-Proce
3、ss Service MPS Intro, Usage, Test Cases Multi-Instance GPU MIG Intro, Usage, Test Cases Triton and vGPU Brief Intro, Test Cases Quick Summary OUTLINE 4 OVERVIEW 5 BACKGROUND Why Is This Important GPU is more and more powerful, and more precious. Many applications are benefiting more from more powerful GPU. While for some lower-utilized application, still cant fully utilize GPU powerful computing c