Models

Segmentation models

16 segmentation models. Each section says what the model is, whether it may be used commercially and how fast it is; licences and checks are under Details.

Input: one RGB image. Output: per-pixel class labels (logits with logits=True).

Measured on RTX 5060 Ti, torch 2.14.1+cu130; fastforks bench MODEL --size HxW measures yours. The summary uses one input, 1024x2048: kernels time with its speed-up over the faster original run, and kernels peak reserved memory with its ratio to the smaller original one. Where measured (one variant per family), a variant's table also lists portable under torch.compile and the fp16 TensorRT engine of portable (export; memory: the engine's device memory). – = not measured.

Other devices: Apple M1 Pro 16 GB, NVIDIA L4, NVIDIA L40S, NVIDIA A10, NVIDIA A100-SXM4-40GB, NVIDIA RTX PRO 6000; across devices.

modelcommercialkernels time (ms),
speed-up vs original
kernels peak memory (MiB, reserved),
ratio to original
deeplabv3-r101-d8-ade20kyes20.06, 2.7x518, 0.24x
deeplabv3plus-r101-d8-ade20kyes18.02, 3.0x560, 0.28x
dinov2-b-linear-ade20kyes22.63, 1.8x904, 0.41x
dinov2-l-linear-ade20kyes56.78, 1.7x1244, 0.4x
dinov2-s-linear-ade20kyes12.44, 2.0x676, 0.34x
eomt-l-dinov2-ade20kyes34.99, 1.8x1584, 0.45x
eomt-l-dinov3-ade20kyes38.8, 1.9x1584, 0.45x
fcn-r101-d8-ade20kyes16.65, 2.8x478, 0.23x
hrnet-w48-fcn-ade20kyes11.86, 4.1x430, 0.23x
mask2former-swinl-ade20kno60.44, 2.4x1400, 0.38x
oneformer-swinl-ade20kyes99.95, 2.1x2476, 0.32x
pspnet-r101-d8-ade20kyes24.96, 1.9x494, 0.24x
sapiens-seg-0.3b-goliathno92.56, 1.9x1762, 0.65x
sapiens-seg-1b-goliathno185.2, 1.9x3382, 0.57x
segformer-b0-ade20k (resize 2048x512)no3.479, 5.0x238, 0.15x
segformer-b5-ade20k (resize 2048x640)no25.347, 2.8x534, 0.21x

All models

Modes, licences, training data and outputs per model

Commercial status per variant: yes if the code and the weights licence both allow commercial use (the training data is listed but does not change it; weights without a licence of their own are assumed to carry the code licence); no if either forbids it; unclear for custom licence terms (treat as no).

modelmodescode licenceweights licencetraining datacommercialoutputs
deeplabv3-r101-d8-ade20kportable, kernelsApache-2.0Apache-2.0imagenet-1k, ade20kyeslogits
deeplabv3plus-r101-d8-ade20kportable, kernelsApache-2.0Apache-2.0imagenet-1k, ade20kyeslogits
dinov2-b-linear-ade20kportable, kernelsApache-2.0Apache-2.0lvd-142m, ade20kyeslogits
dinov2-l-linear-ade20kportable, kernelsApache-2.0Apache-2.0lvd-142m, ade20kyeslogits
dinov2-s-linear-ade20kportable, kernelsApache-2.0Apache-2.0lvd-142m, ade20kyeslogits
eomt-l-dinov2-ade20kportable, kernelsApache-2.0MITlvd-142m, ade20kyeslogits
eomt-l-dinov3-ade20kportable, kernelsApache-2.0MIT AND LicenseRef-DINOv3-Licenseade20kyeslogits
fcn-r101-d8-ade20kportable, kernelsApache-2.0Apache-2.0imagenet-1k, ade20kyeslogits
hrnet-w48-fcn-ade20kportable, kernelsApache-2.0Apache-2.0imagenet-1k, ade20kyeslogits
mask2former-swinl-ade20kportable, kernelsApache-2.0CC-BY-NC-4.0imagenet-21k, ade20kno (weights: CC-BY-NC-4.0)logits
oneformer-swinl-ade20kportable, kernelsApache-2.0MITimagenet-21k, ade20kyeslogits
pspnet-r101-d8-ade20kportable, kernelsApache-2.0Apache-2.0imagenet-1k, ade20kyeslogits
sapiens-seg-0.3b-goliathportable, kernelsCC-BY-NC-4.0CC-BY-NC-4.0unstatedno (code: CC-BY-NC-4.0 (noncommercial); weights: CC-BY-NC-4.0)logits
sapiens-seg-1b-goliathportable, kernelsCC-BY-NC-4.0CC-BY-NC-4.0unstatedno (code: CC-BY-NC-4.0 (noncommercial); weights: CC-BY-NC-4.0)logits
segformer-b0-ade20kportable, kernelsApache-2.0LicenseRef-NVIDIA-Source-Code-License-NCimagenet-1k, ade20kno (weights: LicenseRef-NVIDIA-Source-Code-License-NC)logits
segformer-b5-ade20kportable, kernelsApache-2.0LicenseRef-NVIDIA-Source-Code-License-NCimagenet-1k, ade20kno (weights: LicenseRef-NVIDIA-Source-Code-License-NC)logits

Training datasets

iddatasetlicencecommercial use
imagenet-1kImageNet-1k (ILSVRC 2012 classification)LicenseRef-noncommercialno
imagenet-21kImageNet-21k / ImageNet-22k (full ImageNet, fall 2011 release)LicenseRef-noncommercialno
lvd-142mLVD-142M (DINOv2's curated web-image set, not released)not statedunclear
ade20kADE20K (SceneParsing, 150 classes)LicenseRef-noncommercialno