Microsoft
MIT-licensed cross-platform inference accelerator with hardware-specific execution providers.
ONNX Runtime executes models exported from PyTorch, TensorFlow and Keras, TensorFlow Lite, scikit-learn and other frameworks through the ONNX format. Hardware vendors plug in execution providers such as CUDA and DirectML, which makes it a common portability layer across edge silicon.
Edge device, client PC or server
Specifications taken from current manufacturer documentation and last checked on 2026-09-08.
Source: manufacturer documentation
Specifications are summarised from publicly published manufacturer material and are provided for orientation only. Always confirm current figures directly with the manufacturer before purchasing or designing in.
Official Jetson software stack combining the Linux board support package with CUDA-accelerated AI libraries.
Inference compiler and runtime family that optimises models for NVIDIA GPUs, including Jetson.
Apache 2.0 licensed toolkit for optimising and deploying inference across Intel CPUs, GPUs and NPUs.