tao-train-fast-foundation-stereo

Depth Net Fast Stereo Real-time stereo depth estimation using FastFoundationStereo (FFS) — the bp2 commercial distilled variant of FoundationStereo. Predicts disparity maps from rectified stereo image pairs with per-layer pruned widths for real-time inference. The mono / stereo / fast-stereo skills share the unified TAO depth_net CLI; FFS is selected via model.model_type: FastFoundationStereo . FFS differs from FoundationStereo only in pruned per-layer widths and a serialized forward path; everything else (entrypoint, action verbs, dataset classes, deploy chain) is identical to depth-net-stereo . For TAO Deploy TensorRT actions ( gen_trt_engine , TensorRT evaluate , TensorRT inference ), read references/tao-deploy-fast-foundation-stereo.md first. The deploy spec template lives at references/spec_template_deploy.yaml . When to Use Use this skill to train, evaluate, export, or run inference for a TAO FastFoundationStereo model. Two supported use cases: FFS raw-deploy and bp2-finetune flows require a pre-trained bp2 commercial checkpoint ( model_best_bp2_serialize.pth ). The default PyT image does not guarantee that this file is present on disk, so treat the checkpoint path as a required user/registry artifact. If no bp2 checkpoint is available, scratch training is still usable for workflow validation, but the resulting metrics are not representative of the bp2 model. Raw deploy — use the bp2 ckpt as-is. Skip train ; run inference / evaluate / export / gen_trt_engine directly with the bp2 file as the action's checkpoint. Finetune on user data — set train.pretrained_model_path to the bp2 file, train on user data, then verify + deploy on the resulting ckpt. The full 7-action sequence (train → evaluate pyt → inference pyt → export → gen_trt_engine → inference deploy → evaluate deploy) is supported. Train Action Policy Show more Installs 586 Repository nvidia/skills GitHub Stars 1.9K First Seen Jun 8, 2026 Security Audits Gen Agent Trust Hub Pass Socket Pass Snyk Warn