nemo-mbridge-perf-activation-recompute

Activation Recompute Stable docs: @docs/training/activation-recomputation.md Card: @skills/nemo-mbridge-perf-activation-recompute/card.yaml What It Is Activation recompute trades GPU compute for memory by discarding intermediate activations during the forward pass and recomputing them during backward. Megatron Bridge supports two granularities: Granularity What you specify What gets recomputed Memory savings Compute cost selective recompute_modules list (e.g. core_attn , mlp ) specific submodules within each layer moderate (module-dependent) low to high full recompute_num_layers + recompute_method entire transformer layers (N layers) strongest highest Show more Installs 544 Repository nvidia/skills GitHub Stars 1.3K First Seen May 29, 2026 Security Audits Gen Agent Trust Hub Pass Socket Pass Snyk Pass