IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python module

max.profiler.gpu

GPU diagnostics API.

This module allows accessing information about GPU(s) on the system. Information can be accessed synchronously or collected in the background for later retrieval.

Monitoring​

GPUDiagContextContext manager providing unified access to GPU diagnostic information across NVIDIA and AMD hardware.
BackgroundRecorderAsynchronous GPU metrics collection and data export capabilities.
GpuStatsRecorderShared contract for a background GPU-stats sampler.

Stats​

GPUStatsGPU state snapshot: memory, utilization, and clock metrics.
MemoryStatsDetailed GPU memory usage statistics including total, free, used, and reserved memory.
UtilizationStatsGPU compute and memory activity utilization percentages.
ClockStatsCurrent and maximum GPU clock rates plus throttle reasons.
ThrottleReasonVendor-neutral reason that a GPU's clock is below its boost ceiling.
HARDWARE_THROTTLE_REASONSThrottle reasons that mean hardware performance-capped the GPU.