Segmentation models
16 segmentation models. Each section says what the model is, whether it may be used commercially and how fast it is; licences and checks are under Details.
Input: one RGB image. Output: per-pixel class labels (logits with logits=True).
Measured on RTX 5060 Ti, torch 2.14.1+cu130; fastforks bench MODEL --size HxW measures yours. The summary uses one input, 1024x2048: kernels time with its speed-up over the faster original run, and kernels peak reserved memory with its ratio to the smaller original one. Where measured (one variant per family), a variant's table also lists portable under torch.compile and the fp16 TensorRT engine of portable (export; memory: the engine's device memory). – = not measured.
Other devices: Apple M1 Pro 16 GB, NVIDIA L4, NVIDIA L40S, NVIDIA A10, NVIDIA A100-SXM4-40GB, NVIDIA RTX PRO 6000; across devices.
| model | commercial | kernels time (ms), speed-up vs original | kernels peak memory (MiB, reserved), ratio to original |
|---|---|---|---|
deeplabv3-r101-d8-ade20k | yes | 20.06, 2.7x | 518, 0.24x |
deeplabv3plus-r101-d8-ade20k | yes | 18.02, 3.0x | 560, 0.28x |
dinov2-b-linear-ade20k | yes | 22.63, 1.8x | 904, 0.41x |
dinov2-l-linear-ade20k | yes | 56.78, 1.7x | 1244, 0.4x |
dinov2-s-linear-ade20k | yes | 12.44, 2.0x | 676, 0.34x |
eomt-l-dinov2-ade20k | yes | 34.99, 1.8x | 1584, 0.45x |
eomt-l-dinov3-ade20k | yes | 38.8, 1.9x | 1584, 0.45x |
fcn-r101-d8-ade20k | yes | 16.65, 2.8x | 478, 0.23x |
hrnet-w48-fcn-ade20k | yes | 11.86, 4.1x | 430, 0.23x |
mask2former-swinl-ade20k | no | 60.44, 2.4x | 1400, 0.38x |
oneformer-swinl-ade20k | yes | 99.95, 2.1x | 2476, 0.32x |
pspnet-r101-d8-ade20k | yes | 24.96, 1.9x | 494, 0.24x |
sapiens-seg-0.3b-goliath | no | 92.56, 1.9x | 1762, 0.65x |
sapiens-seg-1b-goliath | no | 185.2, 1.9x | 3382, 0.57x |
segformer-b0-ade20k (resize 2048x512) | no | 3.479, 5.0x | 238, 0.15x |
segformer-b5-ade20k (resize 2048x640) | no | 25.347, 2.8x | 534, 0.21x |
All models
Modes, licences, training data and outputs per model
Commercial status per variant: yes if the code and the weights licence both allow commercial use (the training data is listed but does not change it; weights without a licence of their own are assumed to carry the code licence); no if either forbids it; unclear for custom licence terms (treat as no).
| model | modes | code licence | weights licence | training data | commercial | outputs |
|---|---|---|---|---|---|---|
deeplabv3-r101-d8-ade20k | portable, kernels | Apache-2.0 | Apache-2.0 | imagenet-1k, ade20k | yes | logits |
deeplabv3plus-r101-d8-ade20k | portable, kernels | Apache-2.0 | Apache-2.0 | imagenet-1k, ade20k | yes | logits |
dinov2-b-linear-ade20k | portable, kernels | Apache-2.0 | Apache-2.0 | lvd-142m, ade20k | yes | logits |
dinov2-l-linear-ade20k | portable, kernels | Apache-2.0 | Apache-2.0 | lvd-142m, ade20k | yes | logits |
dinov2-s-linear-ade20k | portable, kernels | Apache-2.0 | Apache-2.0 | lvd-142m, ade20k | yes | logits |
eomt-l-dinov2-ade20k | portable, kernels | Apache-2.0 | MIT | lvd-142m, ade20k | yes | logits |
eomt-l-dinov3-ade20k | portable, kernels | Apache-2.0 | MIT AND LicenseRef-DINOv3-License | ade20k | yes | logits |
fcn-r101-d8-ade20k | portable, kernels | Apache-2.0 | Apache-2.0 | imagenet-1k, ade20k | yes | logits |
hrnet-w48-fcn-ade20k | portable, kernels | Apache-2.0 | Apache-2.0 | imagenet-1k, ade20k | yes | logits |
mask2former-swinl-ade20k | portable, kernels | Apache-2.0 | CC-BY-NC-4.0 | imagenet-21k, ade20k | no (weights: CC-BY-NC-4.0) | logits |
oneformer-swinl-ade20k | portable, kernels | Apache-2.0 | MIT | imagenet-21k, ade20k | yes | logits |
pspnet-r101-d8-ade20k | portable, kernels | Apache-2.0 | Apache-2.0 | imagenet-1k, ade20k | yes | logits |
sapiens-seg-0.3b-goliath | portable, kernels | CC-BY-NC-4.0 | CC-BY-NC-4.0 | unstated | no (code: CC-BY-NC-4.0 (noncommercial); weights: CC-BY-NC-4.0) | logits |
sapiens-seg-1b-goliath | portable, kernels | CC-BY-NC-4.0 | CC-BY-NC-4.0 | unstated | no (code: CC-BY-NC-4.0 (noncommercial); weights: CC-BY-NC-4.0) | logits |
segformer-b0-ade20k | portable, kernels | Apache-2.0 | LicenseRef-NVIDIA-Source-Code-License-NC | imagenet-1k, ade20k | no (weights: LicenseRef-NVIDIA-Source-Code-License-NC) | logits |
segformer-b5-ade20k | portable, kernels | Apache-2.0 | LicenseRef-NVIDIA-Source-Code-License-NC | imagenet-1k, ade20k | no (weights: LicenseRef-NVIDIA-Source-Code-License-NC) | logits |
Training datasets
| id | dataset | licence | commercial use |
|---|---|---|---|
imagenet-1k | ImageNet-1k (ILSVRC 2012 classification) | LicenseRef-noncommercial | no |
imagenet-21k | ImageNet-21k / ImageNet-22k (full ImageNet, fall 2011 release) | LicenseRef-noncommercial | no |
lvd-142m | LVD-142M (DINOv2's curated web-image set, not released) | not stated | unclear |
ade20k | ADE20K (SceneParsing, 150 classes) | LicenseRef-noncommercial | no |