Skip to main content
Ctrl+K

Open Edge Platform

    • Open Edge Platform Overview
    • Metro
    • Manufacturing
    • Retail
    • Robotics
    • Education
    • Health and Life Sciences
    • Federal and Aerospace
    • Libraries, Tools, Services
    • DL Streamer
    • Scenescape
    • ViPPET
    • Edge Microvisor Toolkit
    • Image Composer Tool
  • Open Edge Platform Overview
  • Metro
  • Manufacturing
  • Retail
  • Robotics
  • Education
  • Health and Life Sciences
  • Federal and Aerospace
  • Libraries, Tools, Services
  • DL Streamer
  • Scenescape
  • ViPPET
  • Edge Microvisor Toolkit
  • Image Composer Tool

Section Navigation

  • Metro SDK Manager
  • Metro Analytics Catalog
  • Metro Application Builder

Samples

  • Agentic Predictive Maintenance
    • Get Started
      • System Requirements
    • How It Works
    • Build from Source
    • Training a Defect Detection Model with Intel Geti
    • API Reference
    • Troubleshooting
    • Release Notes
  • Agentic Smart Community
    • Get Started
      • System Requirements
      • Ready-to-Run Demo
    • How It Works
    • How-To Guides
      • Add Swap Space
      • Register a New Use Case
      • MCP Tools Guide
    • API Reference
      • MCP Tools and Resources API
      • MCP Subscription
      • MCP Webhook Event API
      • Dashboard API
      • Videostream Analytics HTTP API
    • Release Notes
  • Enterprise Data Intelligence - Multi-Agent Enterprise Knowledge Assistant
    • Get Started
      • System Requirements
    • Release Notes
  • Image-based Video Search
    • Get Started
      • System Requirements
      • Deploy with Helm
    • How It Works
    • How to use GPU for inference
    • How to use NPU for inference
    • Troubleshooting
    • Release Notes
  • Live Video Alert Agent
    • Get Started
      • System Requirements
      • Build from Source
      • Deploy with Helm
    • How It Works
    • API Reference
    • Known Issues
    • Release Notes
  • Live Video Captioning
    • Get Started
      • System Requirements
      • Model Preparation
      • Build from Source
      • Deploy with Helm Chart
      • Setup Simulated RTSP Stream
      • Testing and Coverage
    • Quick Start: Live Video Captioning
    • How-to Guides
      • Enable Alert Mode
      • Configure Object Detection Pipeline
    • How it Works
    • API Reference
    • Known Issues
    • Release Notes
  • Live Video Captioning RAG
    • Quick Start Guide
    • Get Started
      • System Requirements
      • Build from Source
      • Deploy with Helm Chart
      • Testing and Coverage
    • How It Works
    • API Reference
    • Known Issues
    • Release Notes
  • Live Video Search
    • Get Started
      • System Requirements
      • Build from Source
      • Deploy with Helm* Chart
    • How It Works
    • API Reference
    • Release Notes
  • Smart Building Digital Twin
    • Get Started
      • System Requirements
    • How It Works
    • How to Use the Application
    • Troubleshooting
    • Release Notes
  • Smart Route Planning Agent
    • Get Started
      • System Requirements
      • Build from Source
      • Environment Variables
      • Deploy with Helm
    • Release Notes
  • Smart Traffic Intersection Agent
    • Get Started
      • System Requirements
      • Build from Source
      • Deploy with Helm
      • Deploy with Trusted Compute using Helm
      • Deploy with Trusted Compute
    • API Reference
    • Release Notes
  • Loitering Detection
    • Get Started
      • System Requirements
      • Deploy with Helm
    • How-to Guides
      • Customize the Application
      • Generate and Deploy Offline Package
      • Use GPU for Inference
      • Use NPU for Inference
      • View Open Telemetry Data
      • View System Performance Dashboard
      • Benchmark Performance
      • GPU and NPU Stream Density Benchmark
    • Troubleshooting
    • Release Notes
  • Smart Intersection
    • Get Started
      • System Requirements
      • Deploy with Helm
      • Deploy with Trusted Compute using Helm
      • Deploy with Trusted Compute
    • How It Works
    • How to use GPU for inference
    • How to use NPU for inference
    • RTSP Stream Setup
    • Export and Optimize Geti Model
    • Troubleshooting
    • Release Notes
  • Smart Parking
    • Get Started
      • System Requirements
      • Deploy with Helm
    • How-to Guides
      • Customize the Application
      • Generate and Deploy Offline Package
      • Use GPU for Inference
      • Use NPU for Inference
      • View Open Telemetry Data
      • View System Performance Dashboard
      • Benchmark Performance
      • Demonstrating NPU Value: GPU and NPU Stream Density Benchmark
    • Troubleshooting
    • Release Notes
  • Sensor Fusion for Traffic Management
    • Post-Fusion
      • Get Started
        • Prerequisites
        • System Requirements
      • How it Works
      • Advanced user guide
      • APIs
    • Intermediate Fusion
      • Get Started
      • Prerequisites
      • Testing
      • Training
        • Installation
        • Convert NVIDIA Checkpoint
    • Troubleshooting
    • Release Notes
      • Release Notes 2025
  • Smart NVR
    • Get Started
      • System Requirements
      • Build from Source
      • Deploy with Helm
    • How to Use Smart NVR
    • Development Guide
    • Integrate Scenescape with Smart NVR
    • Multiple Scenescape Deployment
    • API Reference
    • Troubleshooting
    • Release Notes
      • Release Notes 2025
  • Video Processing for NVR
    • Get Started
    • How It Works
    • Release Notes
  • Visual Search and Q&A
    • Get Started Guide
      • System Requirements
      • Deploy with Helm
    • Tutorials
    • Troubleshooting
    • Release Notes
  • VMS Adapter Plugin
    • Get Started
      • System Requirements
      • Build from Source
      • Deploy with Helm
    • How It Works
    • How-To Guides
      • Tutorial: LVC with NX Witness
      • Tutorial: Loitering Detection with NX Witness
      • Run Simultaneous Applications
      • TLS and Certificates
    • API Reference
    • Troubleshooting
    • Release Notes
  • Video Search and Summarization

Software Development

  • OpenVINO Toolkit
  • OpenVINO Model Server
  • DL Streamer
    • Go back to Libraries
    • DL Streamer Overview
    • Installation Guide
      • Install Guide Ubuntu
      • Install Deep Learning Streamer on Ubuntu OS Version 24.04 under WSL2
      • Uninstall Guide Ubuntu
      • Install Guide Windows
      • Uninstall Guide Windows
    • System Requirements
    • Tutorial
    • Using Sample Apps
    • Available Sample Apps
    • Developer Guide
      • Coding Agent
      • Advanced Installation Guide
        • Advanced Installation On Ubuntu - Prerequisites
        • Advanced Installation - Compilation From Source
        • Advanced Installation On Ubuntu - Build Docker Image
        • Advanced Uninstallation On Ubuntu
        • Advanced Installation on Windows - Compilation From Source
        • Advanced Installation on Windows - Install via Command Line
      • Metadata
        • GStreamer Analytics Metadata
        • 3D Sensor Metadata (LiDAR & radar)
        • Watermark Metadata
        • Legacy Analytics Metadata (deprecated)
      • Model Preparation
        • Download and Convert Models
      • OpenVINO Custom Operations Support
      • Model Info Section
      • GStreamer Python Bindings
      • Custom GStreamer Plugin Installation
      • Custom Processing
      • Object Tracking
      • GPU device selection
      • Heterogeneous AI Inference on Intel Core Ultra processors
      • Performance Guide
      • Profiling with Intel VTune™
      • DL Streamer and DeepStream Coexistence
      • Converting NVIDIA DeepStream Pipelines to Deep Learning Streamer Pipeline Framework
      • How to Contribute
        • Coding Style
      • Latency Tracer
      • Model-proc File (legacy)
        • How to Create Model-proc File
      • Optimizer
    • Elements
      • gvadetect
      • gvaclassify
      • gvainference
      • gvamono3d
      • gvatrack
      • gvaaudiodetect
      • gvaaudiotranscribe
      • gvagenai
      • g3dradarprocess
      • g3dlidarsrc
      • g3dlidarparse
      • g3dinference
      • g3dobjectfuser
      • g3drender
      • gvaanalytics
      • gvaattachroi
      • gvafpscounter
      • gvafpsthrottle
      • gvastreammux
      • gvastreamdemux
      • gvametaaggregate
      • gvametaconvert
      • gvametapublish
      • gvapython
      • gvarealsense
      • gvawatermark
      • gvawatermark3d
      • gvamotiondetect
      • GStreamer Elements
        • vacompositor
    • Supported Models
    • API Reference
    • Release Notes
      • Release Notes 2025
      • Release Notes 2024
  • DL Streamer Pipeline Server
    • Get Started
      • System Requirements
      • Environment Variables
      • Build from Source
      • Deploy with Helm
    • How-to Guides
      • Manage Pipeline
      • Autostart Pipelines
      • Change Deep Learning Streamer Pipeline
      • Run Configurable Pipelines
      • Run UDF Pipelines
      • Use CPU for Inference
      • Use GPU or NPU for Inference
      • Use Image File as Source over REST Payload
      • Use RTSP Camera as Source
      • Download and Run YOLO Models
      • Publish Frames to S3 Storage
      • Publish Data over MQTT
      • Publish Metadata to InfluxDB
      • Stream Frames over WebRTC
      • Publish Metadata over ROS2
      • Add System Timestamps to Metadata
    • Advanced User Guide
      • Basic Deep Learning Streamer Pipeline Server Configuration
      • REST API guide
        • REST Endpoints Reference Guide
        • Defining Media Analytics Pipelines
        • Customizing Pipeline Requests
      • Cameras
        • RTSP Cameras
      • File Ingestion
        • Image Ingestion
        • Video Ingestion
        • Multifilesrc Usage
      • User Defined Functions (UDF)
        • UDF Writing Guide
        • Configuring udfloader element
      • Publishers
        • MQTT Publishing via gvapython
        • MQTT Publishing
        • OPCUA Publishing post pipeline execution
        • S3 Frame Storage
      • How To Advanced
        • Object tracking with UDF
        • Enable HTTPS for DL Streamer Pipeline Server (Optional)
        • Performance Analysis (Latency)
        • Pinning the DL Streamer Pipeline Sever to CPU cores
        • Get Tensor Vector Data
        • Run Multistream Pipelines with Shared Model Instance
        • Cross Stream Batching
        • Enable Open Telemetry
        • Working with other services
    • API Reference
    • Troubleshooting
    • Release Notes
      • Release Notes 2025
      • Release Notes 2024

Tools

  • Geti™ Software
  • Visual Pipeline and Platform Evaluation Tool
    • Go back to Libraries
    • ViPPET Overview
    • Installation
      • System Requirements
      • Pre-Installation Steps
      • Use Pre-Built Docker Images
      • Build from Source
      • Installation Troubleshooting
    • Quickstart Guide
      • Vision Use Case
      • GenAI Use Case
      • Motion Detection Use Case
      • Safety and Security Use Case
      • Deploy Time Series Analytics Microservice
    • Input Management
      • Cameras
      • Image Sets
      • Videos
    • Model Management
      • Using Models from Geti
      • Using Models from Hugging Face
    • Working With Pipelines
      • Creating New Pipelines
      • Configuring and Running Pipelines
      • Using Predefined Pipelines
      • Simple vs. Advanced View
    • Benchmarking
      • Performance Testing
      • Stream Density Testing
      • Managing Jobs
      • Benchmark Export
      • Benchmark Suites
    • Architecture
      • VIPPET UI
      • VIPPET Backend
    • Performance Metrics
      • Pipeline Performance
      • System Performance
    • Contributing Guide
      • Backend
      • How to add a new pipeline
      • How to add a new element
      • UI end-to-end tests (Playwright)
    • Troubleshooting
    • Release Notes
      • Release Notes 2026.1
      • Release Notes 2026.0
      • Release Notes 2025.2
    • Get Support
  • Scenescape
    • Go back to Libraries
    • Scenescape Overview
    • Quick Start
    • Installation
    • System Requirements
    • Deploy Scenescape
      • Preparation
      • Deploy on Docker
      • Deploy on Kubernetes
      • Deploy the Demo
    • Use the UI and Online Documentation
    • Build a Scene
      • Create a New Scene
      • Generate a Scene Map
      • Use Different Sensor Types
      • Visualize ROIs and Regions
      • Configure a Hierarchy of Scenes
      • Deploy Multiple Controllers on One Host
      • Configure Geospatial Coordinates
      • Configure Geospatial Map Service API Keys
      • Configure Spatial Analytics
    • Integrate Cameras and Sensors
    • Publish External Source Adapter
    • Calibrate Cameras
      • Use 2D UI for Calibration
      • Use 3D UI for Calibration
      • Automatic Calibration - Visual Features
      • Automatic Calibration - April Tags
    • Work with Spatial Analytics Data
    • Run the LiDAR-Intersection Fusion Demo
    • Analytics
      • Data Formats
      • API Reference
    • Auto Camera Calibration
      • Get Started
        • Build from Source
      • Markerless Camera Calibration
      • API Reference
    • Cluster Analytics
      • Get Started
        • Build from Source
      • How It Works
      • DBSCAN Noise Points
      • Analytics Payload Reference
    • Mapping Service
      • Build from Source
      • API Reference
    • Scene Controller
      • Get Started
        • Build from Source
      • Configure the Tracker
      • 2-Tier Hybrid Search Implementation
      • Pose Adjustment
      • Data Formats
      • API Reference
    • API Reference
    • Defining Object Properties
    • Enabling Re-identification
    • Enabling Observability (Experimental)
    • Integrating Geti™ AI Models
    • Configuring DL Streamer Video Pipeline
    • Model configuration file format
    • Running License Plate Recognition with 3D Object Detection
    • Managing Files in Volumes
    • Controlling Scene Lighting with Physical Light Sensors
    • Viewing Re-identification Metrics
    • Hardening Guide
    • How to Upgrade
    • Converting Bounding Boxes to Normalized Image Space
    • Troubleshooting
    • Release Notes
      • Release Notes 2025

Guides

  • Hardware Partner Workflow
  • Developer Workflow
  • Migrate from NVIDIA
    • Convert Models
    • TensorRT to OpenVINO
    • DeepStream to DL Streamer
    • Migrate from TAO
    • Triton to Model Server
  • Achieve High Performance
    • Optimize Models
    • Optimize Inference
    • Optimize Encoding Decoding
    • Core Pinning on Intel Edge Platforms
    • Profile Applications
  • Improve Security
    • UEFI Secure Boot
    • Install Ubuntu with Full Disk Encryption
    • Total Memory Encryption (TME)
    • Trusted Compute Overview
    • Trusted Compute Smart Intersection
    • Trusted Compute Smart Intersection Agent
    • IFWI Flashing Guide
    • Intel HW Key Generation & Cryptography with OpenSSL
  • Customize Visual AI Kit

Blueprints

  • Blueprint: Critical Infrastructure Predictive Maintenance
    • Vision AI Pipeline
    • Multimodal Pipeline
  • Blueprint: Smart Buildings

---------------

  • Intel® Edge System Qualification
  • Get Help or Contribute
  • Metro AI Suite
  • Live Video Search
  • Release Notes: Live Video Search

Release Notes: Live Video Search#

Version 2026.2.0#

Release Date: September 10, 2026

New:

  • Replaced the legacy vdms-dataprep orchestration with backend-neutral multimodal-dataprep in Docker Compose and Helm.

  • Added an always-on Vector Retriever layer so Video Search no longer accesses a vector database directly.

  • Added selectable VDMS (default) and Milvus backends through VECTORDB_BACKEND for Compose and global.vectordbBackend plus milvus_override.yaml for Helm.

  • Added pinned standalone Milvus/etcd orchestration and updated build, architecture, device, and deployment guidance for both retriever flavors.

  • Replaced the collector/Pipeline Manager WebSocket telemetry path with Metrics Manager for both Docker Compose and Helm, gated by ENABLE_METRICS_MANAGER (default true) in setup.sh and the Makefile. Multimodal DataPrep publishes throughput metrics directly and the UI consumes the same-origin SSE stream through NGINX.

  • Added NPU-capable device orchestration for the VSS search stack used by LVS in Docker Compose setup.

  • Added global.accelGroupIds so the host gids owning /dev/dri (GPU) and /dev/accel (NPU) are injected into the pod supplementalGroups, letting the non-root container open the accelerator device.

  • Added a persistent OpenVINO cache (ovCacheDir, default /app/ov_models/ov_cache) for MME and DataPrep so GPU/NPU model compilation is reused across pod restarts.

  • Exposed asynchronous watcher-batch size, polling interval, and timeout settings for Search MS and Smart NVR continuous ingestion through Compose, Helm, and setup.sh.

  • Added a single, case-insensitive Helm global.pullPolicy override for all application images selected through the LVS, VSS, and Smart NVR stack tags.

Improved:

  • Updated LVS compose deployment to a pure per-component device model (DATAPREP_EMBEDDING_DEVICE, DATAPREP_DETECTION_DEVICE, MME_EMBEDDING_DEVICE; each defaults to CPU) and mounted /dev/accel for NPU execution. Retired the redundant VDMS_DATAPREP_DEVICE baseline.

  • Updated LVS Helm deployment templates and values to a pure per-component device model via global.devices.multimodalEmbedding.* and global.devices.multimodalDataprep.{embedding,detection}.* (each defaults to CPU), retiring the legacy global.gpu.* block to remove device-configuration ambiguity.

  • Removed the ambiguous ENABLE_EMBEDDING_GPU shortcut; indexing and query embedding devices are configured independently with DATAPREP_EMBEDDING_DEVICE and MME_EMBEDDING_DEVICE.

  • Renamed the Compose/setup model input from EMBEDDING_MODEL_NAME to MULTIMODAL_EMBEDDING_MODEL, the DataPrep variables from VDMS_DATAPREP_* to MM_DATAPREP_*, and VDMS_PIPELINE_MANAGER_UPLOAD to VIDEO_UPLOAD_ENDPOINT.

  • Vector Retriever now waits for a healthy Multimodal Embedding service before starting, using a configurable init check (embeddingService.waitForHealthy, healthUrl, healthTimeoutSeconds, retryIntervalSeconds).

  • Multimodal DataPrep waits for Metrics Manager readiness when metrics are enabled, and carries component labels for scheduling.

  • Made Search MS batch-status polling resilient through SEARCH_DATAPREP_POLL_MAX_RETRIES, SEARCH_DATAPREP_POLL_TIMEOUT_MS, and SEARCH_DATAPREP_POLL_RETRY_DELAY_MS.

  • Improved Milvus readiness handling in the Helm deployment.

  • Removed the obsolete vss-collector subchart, telemetry compose overlay, Telegraf configuration, shared signal PVC, and the pod co-location constraint they required.

  • Updated LVS documentation (get-started, deploy-with-helm, how-it-works) with NPU usage guidance, accelerator configuration examples, and Metrics Manager deployment notes.

Fixed:

  • Fixed Docker Compose backend selection so Milvus deployments do not start or depend on the VDMS service, and stale backend containers are removed when switching backends.

  • Corrected the Helm multimodal DataPrep completion-queue default to satisfy the service’s minimum queue size and prevent pod startup validation failures.

  • Aligned the Helm Multimodal Embedding Serving probe timeout with its Compose healthcheck to avoid one-second startup probe timeouts during model loading.

  • Fixed configuration rollouts so a Helm upgrade that changes only ConfigMap values restarts the affected pods; environment variables injected through envFrom previously stayed stale until a manual kubectl rollout restart.

  • Fixed Milvus data persistence so global.keepPvc=true also retains the etcd metadata volume; etcd previously used an ephemeral emptyDir, which orphaned the retained segment data on pod rescheduling or reinstall.

  • Fixed the nvr-event-router container healthcheck, which now bypasses proxy settings instead of relying on curl.

  • Miscellaneous documentation corrections.

Version 2026.1.0#

Release Date: June 17, 2026

New:

  • Deployment with Helm chart.

Known Issues:

  • First‑time model downloads may take several minutes.

  • Time‑range queries require the clock and timezone on the host to be accurate.

Version 1.0.0#

Release Date: April 1, 2026

Live Video Search is a new sample application which implements embedding and visual data ingestion microservices (available in Edge AI Libraries) for processing RTSP camera streams and user query-based search. The application converts the input camera data to embeddings continuously, using models like Clip. The embeddings are stored in a Vector Database (VectorDB ) and enable search on live camera feed and historical video data. A rich UI is provided to configure the camera used for data ingestion, enter the search query, and view telemetry data, currently, for CPU, GPU, and memory utilization. The sample application introduces camera streaming with Frigate.

New:

  • Live Video Search stack integrating Smart NVR with VSS Search.

  • Time‑range filtering in search via UI or natural‑language query parsing.

  • Telemetry visualization in VSS UI for live system performance.

Known Issues/Limitations:

  • Deploy with Helm is not yet supported for Live Video Search.

  • First‑time model downloads may take several minutes.

  • Time‑range queries require the clock and timezone on the host to be accurate.

The application has been validated on Intel® Xeon® 5 + Intel® Arc™ B580 GPU.

On this page
  • Version 2026.2.0
  • Version 2026.1.0
  • Version 1.0.0
Show Source
Enable cookies to use AI chat
Chat is locked. Click the blue chat button, then enable Functional cookies to unlock it.