nemo-mbridge-perf-cpu-offloading

CPU Offloading References Stable docs: @docs/training/cpu-offloading.md Structured metadata: @skills/nemo-mbridge-perf-cpu-offloading/card.yaml What It Is Two independent mechanisms to move data from GPU to CPU memory: Mechanism Config namespace What gets offloaded PP restriction Activation offloading model.cpu_offloading* Activations (and optionally weights) per transformer layer PP must be 1 Optimizer offloading optimizer.optimizer_cpu_offload Adam optimizer states (momentum + variance) via HybridDeviceOptimizer None Quick Decision Show more Installs 551 Repository nvidia/skills GitHub Stars 1.3K First Seen May 29, 2026 Security Audits Gen Agent Trust Hub Pass Socket Pass Snyk Pass