How to Customize UAV Vision Analytics#
These tutorials cover what can be changed in the application and how: cameras and video sources, detection and captioning models, pipeline definitions, what is drawn on the stream, and the ground station’s live search. For guides on operating the application as shipped (QGroundControl, multi-UAV ground station, deployment modes, troubleshooting), see How-To Guides.
Every change below is applied the same way: edit the file, run
make check-cameras to validate, then make start-rtsp (or disarm/arm) to
restart the affected pipelines.
Camera Management#
Configure the Cameras —
configs/cameras-pymavlink.yaml/cameras-uavsdk.yaml: each camera’s source, detection and captioning devices, models, prompt, and overlay, and how a camera maps to a pipelineRealSense Camera — Use a RealSense or USB webcam as a live camera source
Model and Video Management#
Manage the Detection Model — The bundled YOLO11s model:
make model, where the files live, how the pipelines find them, re-exportModify the Detection Model — Export another Ultralytics size or your own OpenVINO™ IR detector and point cameras at it
Change the Captioning (VLM) Model — The OpenVINO™ IR format
gvagenaineeds, downloading or exporting a different VLM, prompt, and caption lengthChange the Video Source — Switch a camera between a video file, a live camera, and an RTSP stream
Use Your Own Videos — Convert footage with
scripts/convert_video.shand assign it to a camera
Pipeline Management#
Manage Pipelines — Start, stop, and check pipelines: the arm/disarm manager, the per-device script, and the REST API (status, stop, stop all)
Modify Pipelines — The pipeline definition in
configs/config-*.json: element properties, theparametersschema, naming, adding a pipeline
Telemetry Overlay#
Add, Modify, or Remove a Telemetry Overlay Field — Edit the
gvapythonoverlay scripts for Pymavlink / UAVSDK mode
Search Tuning#
Tune VSS Live Search — Result count, relevance filters, indexing rate, retention, and playback previews in
uav-ground-station/.env
If something does not work after a change, start with the common Troubleshooting guide; each page above only lists the symptoms specific to it.