nemo-mbridge-perf-tp-dp-comm-overlap

TP / DP / PP Communication Overlap Skill For stable background and recommendation level, see: @docs/training/communication-overlap.md Enablement Minimal Bridge override: from megatron . bridge . training . comm_overlap import CommOverlapConfig cfg . model . tensor_model_parallel_size = 4 cfg . model . sequence_parallel = True cfg . model . pipeline_model_parallel_size = 4 cfg . model . virtual_pipeline_model_parallel_size = 2 Show more Installs 539 Repository nvidia/skills GitHub Stars 1.3K First Seen May 29, 2026 Security Audits Gen Agent Trust Hub Pass Socket Pass Snyk Pass