OpenVINO Model Guidance#
The OpenVINO™ toolkit supports most TensorFlow and PyTorch models. The following table lists deep-learning models commonly used in Humanoid Toolkit solutions, and information on how to run them on Intel® platforms:
For Humanoid workflows, complete the platform getting-started guide before installing model dependencies or running these tutorials.
Algorithm |
Description |
Link |
|---|---|---|
YOLOv8 |
CNN-based object detection |
|
YOLOv12 |
CNN-based object detection |
|
MobileNetV2 |
CNN-based object detection |
|
SAM |
Transformer-based segmentation |
|
SAM2 |
Extends SAM to video segmentation and object tracking with cross attention to memory |
|
FastSAM |
Lightweight substitute to SAM |
|
MobileSAM |
Lightweight substitute to SAM (Same model architecture as SAM. See OpenVINO SAM tutorials for model export and application) |
|
U-NET |
CNN-based segmentation and diffusion model |
|
DETR |
Transformer-based object detection |
|
GroundingDino |
Transformer-based object detection |
|
CLIP |
Transformer-based image classification |
|
Qwen2.5VL |
Multimodal large language model |
|
Whisper |
Automatic speech recognition |
|
FunASR |
Automatic speech recognition |
Attention: When following these tutorials for model conversion, ensure that the OpenVINO toolkit version used for model conversion is the same as the runtime version used for inference. Otherwise, unexpected errors may occur, especially if the model is converted using a newer version and the runtime is an older version. See details in Troubleshooting.
Please also find information for the models of imitation learning, grasp generation, simultaneous localization and mapping (SLAM) and bird’s-eye view (BEV):
- Action Chunking with Transformers - ACT
- Visual Servoing - CNS
- Diffusion Policy
- Improved 3D Diffusion Policy (iDP3)
- Feature Extraction Model: SuperPoint
- Feature Tracking Model: LightGlue
- Bird’s Eye View Perception: Fast-BEV
- Monocular Depth Estimation: Depth Anything V2
- Robotics Diffusion Transformer (RDT-1B)