Segment Anything (SAM)

• Original code: https://github.com/facebookresearch/segment-anything at dca509f
• Code licence: Apache-2.0 (permissive); files: LICENSE
• Weights licence: Apache-2.0
• Licence evidence: https://github.com/facebookresearch/segment-anything/blob/main/README.md (License section: model checkpoints and code under Apache 2.0)
• Training data: SA-1B (11M licensed images, 1.1B automatically generated masks) per the paper; the dataset itself is under the SA-1B research licence
• Kernel libraries: dpt_fused
• Variants: sam-vit-b, sam-vit-l, sam-vit-h
• Outputs: pred_masks, iou_scores
• Input size: any H x W >= 1, resized inside to the fixed encoder input 1024x1024 (the default export size)
• Tested up to (portable, fp16, RTX 5060 Ti 16 GB): sam-vit-b 1080x1920 (0.4 GiB peak allocated, 0.5 reserved); sam-vit-l 1080x1920 (0.8 GiB peak allocated, 1.0 reserved); sam-vit-h 1080x1920 (1.5 GiB peak allocated, 1.9 reserved)
• sam-vit-b 1024x1024, first call: portable + torch.compile 15 s (cold Inductor cache), TensorRT fp16 36 s (ONNX + engine).
• sam-vit-b original 1024x1024: torch.autocast(float16) around the call
• sam-vit-l original 1024x1024: torch.autocast(float16) around the call
• sam-vit-h original 1024x1024: torch.autocast(float16) around the call
• sam-vit-b load / first call: original 0.75 s / 0.176 s, portable 0.46 s / 0.048† s, kernels 0.17† s / 0.037† s
• sam-vit-l load / first call: original 1.8 s / 0.268 s, portable 1.21 s / 0.116† s, kernels 0.43† s / 0.081† s
• sam-vit-h load / first call: original 4.61 s / 0.376 s, portable 2.45 s / 0.214† s, kernels 0.89† s / 0.143† s
• † measured in the speed sweep after the portable load (or an earlier size) in the same process: file cache and kernels are warm, so the time is lower than a fresh start.
• Protocol, median of 5 after 3 warm-up, uint8 CUDA input (synthetic for bench_inputs sizes), card defaults; gc before each load; peak = max over the first call and the timed calls

Measured

One point per ground-truth instance (the interior point farthest from the border); IoU of the best-scored of 3 masks / of the single mask. Original = the original code named under Details, same checkpoint and protocol.

Measured on NVIDIA GeForce RTX 5060 Ti, torch 2.14.1+cu130, fastforks 939adfe8, 2026-11-06.

Parity

CPU, float32: max |diff| <= 0.002 vs the original. GPU, float16 (the default), portable and kernels: mean |diff| <= 3 % and p99 <= 15 % of the reference's median |value| (absolute error of the output pred_masks).