Live Video Search#
Live Video Search is a Metro AI Suite sample that adapts the Visual Search and Summarization (VSS) pipeline for semantic search on live Frigate streams. The application ingests live camera streams, indexes video segments with embeddings and timestamped camera metadata, and enables you to select cameras, time ranges, and free-text queries. You can retrieve ranked, playable clips with confidence scores and view live system metrics.
Key Features#
Live semantic search over active camera streams.
Time‑range filtering from either the UI or query parsing (for example, “person seen in last 5 minutes”).
Event‑driven ingestion using Smart NVR + Frigate for clip generation.
Unified UI where VSS Search results appear alongside Smart NVR live context.
Core Components#
Live Video Search combines two existing stacks:
Smart NVR (Metro AI Suite)
Frigate NVR ingests live camera streams and emits MQTT events.
NVR Event Router brokers event metadata and clip references.
Reference UI for Smart NVR management.
VSS Search Mode (Edge AI Libraries sample app)
Search‑MS + Multimodal DataPrep + Vector Retriever + VDMS or Milvus VectorDB + Pipeline Manager.
VSS UI for semantic queries and clip playback.
Use Cases#
Operations teams who need to locate recent events across multiple cameras quickly.
Edge deployments where bandwidth or latency constraints prevent cloud‑first analytics.
Safety and compliance scenarios requiring rapid retrieval of recent footage.
Key Behaviors#
Smart NVR‑initiated ingestion sends selected clips directly to VSS Search.
Time‑range filters reduce search scope and improve relevance.
Metrics Manager provides real-time system and DataPrep throughput metrics in the VSS UI.
Documentation#
Get Started
Get Started: Deploy the full stack locally.
System Requirements: Hardware and software prerequisites.
How It Works
Architecture: End‑to‑end architecture and data flow.
Deployment
Build from Source: Build the required images.
Deploy with Helm: Deploy LVS on Kubernetes using Helm profiles.
Usage & API
API Reference: Key endpoints and references.
Release & Support
Release Notes: Updates and fixes.