System Requirements#

Hardware, software, and network requirements for deploying Take-Away Order Accuracy.

Hardware Requirements#

Development / Single Station#

Component

Specification

CPU

8+ cores

RAM

16 GB min; 64 GB recommended for production / heavy model export workloads

GPU

Intel® Arc™ A770 (16 GB) or equivalent Intel GPU

Storage

50 GB SSD

Production / Multi-Station#

Component

Specification

CPU

16+ cores

RAM

64 GB

GPU

Intel® Data Center GPU Max (48 GB) — for 4+ concurrent stations

Storage

200 GB NVMe SSD

GPU VRAM guidance: The Qwen2.5-VL-7B INT8 model requires ~8 GB of VRAM. The default cache_size=4 reserves an additional 4 GB VRAM for the KV cache. Total VRAM needed is around 12 GB, which fits in an Intel® Arc™ A770 16 GB. On integrated GPU (iGPU) platforms such as Wildcat Lake and Meteor Lake, the KV cache is drawn from system RAM instead of dedicated VRAM; in such a case, use a smaller value (e.g. CACHE_SIZE=2) to avoid exhausting system RAM. Set export CACHE_SIZE=<N> before running setup_models.sh. For a full per-platform sizing table and step-by-step instructions see ovms-service/README.md — Tuning the KV Cache Size.

Model Export RAM Note: 16 GB system RAM is sufficient for inference-only deployments. For first-time model export (setup_models.sh INT8 quantization), a higher-memory host (48–64 GB recommended) avoids potential OOM and corrupt IR files — export once there and copy ovms-service/models/ to the target system. If you must export on 16 GB, set export CACHE_SIZE=2 first. See ovms-service/README.md — Tuning the KV Cache Size for details.

Software Requirements#

Operating System#

Ubuntu 22.04 LTS is the validated platform (matches the intel/dlstreamer:2025.2.0-ubuntu22 base image).

Container Runtime#

Software

Minimum Version

Docker Engine

24.0

Docker Compose

V2 (2.20+)

GPU Drivers#

Intel GPU drivers must be installed from packages.intel.com. Verify the GPU is accessible to Docker:

ls /dev/dri/
docker run --rm --device /dev/dri intel/openvino_dev:latest python3 -c \
  "from openvino.runtime import Core; print(Core().available_devices)"

Expected output includes GPU.

Network Requirements#

Port Configuration#

Service

Port

Purpose

Order Accuracy API

8000

REST API

OVMS VLM

8001

Model inference

Gradio UI

7860

Web interface

MinIO API

9000

S3-compatible storage

MinIO Console

9001

Storage admin UI

Semantic Service

8080

Semantic matching

RTSP Streamer

8554

Video streaming (parallel mode)

RTSP Requirements (Parallel Mode)#

Requirement

Specification

Protocol

RTSP/RTP over TCP

Codec

H.264

Resolution

720p–1080p

Frame Rate

15–30 FPS

Next Steps#