Hailo

Hailo Dataflow Compiler

Compiler that maps trained models onto Hailo accelerators, part of the Hailo AI Software Suite.

Compiler log output on a dark screen next to an accelerator module

Overview

The Dataflow Compiler converts models from common machine learning frameworks into binaries for Hailo accelerators. It ships within the Hailo AI Software Suite alongside the HailoRT runtime, the Model Zoo and example applications, and is distributed through the Hailo Developer Zone.

Typical use cases

  • Porting vision models to Hailo silicon
  • Model profiling and optimisation
  • Production build pipelines

Deployment environment

Development host targeting Hailo hardware

Key specifications

Type
Model compiler for Hailo accelerators
Suite components
Dataflow Compiler, HailoRT, Model Zoo, example applications
Framework support
Integrates with common machine learning frameworks
Access
Hailo Developer Zone account required; documented version 3.27.0

Specifications taken from current manufacturer documentation and last checked on 2026-09-08.

Source: manufacturer documentation

Specifications are summarised from publicly published manufacturer material and are provided for orientation only. Always confirm current figures directly with the manufacturer before purchasing or designing in.

Developer workspace with a single-board computer, sensors and code on screen
NVIDIA

NVIDIA JetPack SDK

Official Jetson software stack combining the Linux board support package with CUDA-accelerated AI libraries.

Type
Board support package plus AI software stack
Components
Jetson Linux (bootloader, kernel, Ubuntu, drivers, OTA) and the Jetson AI stack
Targets
NVIDIA Jetson modules and developer kits
Deployment
Development host plus target Jetson device
Jetson application development
Device provisioning and updates
Robotics software stacks
Profiler output on a dark developer screen
NVIDIA

NVIDIA TensorRT

Inference compiler and runtime family that optimises models for NVIDIA GPUs, including Jetson.

Type
Inference compiler and runtime ecosystem
Components
TensorRT compiler, TensorRT-LLM, Model Optimizer, TensorRT for RTX, TensorRT Cloud
Optimisations
Graph optimisation, layer fusion, FP16 and INT8 calibration
Deployment
Jetson device, workstation or GPU server
Latency-critical inference
Local LLM serving on GPUs
Jetson deployment optimisation
Code editor showing a model optimisation script
Intel

Intel OpenVINO toolkit

Apache 2.0 licensed toolkit for optimising and deploying inference across Intel CPUs, GPUs and NPUs.

Type
Model optimisation and inference toolkit
Licence
Apache 2.0
Targets
Intel CPUs, integrated and discrete GPUs, and NPUs
Deployment
Any Intel-based edge client, industrial PC or server
AI PC and client inference
Industrial vision on x86
Model conversion and quantisation