Virtual Security Guard Agent#

The Virtual Security Guard (VSG) Agent console is the operator interface. It connects to Argus, the VSG agent that runs on a Hermes agent server. The VSG agent searches recorded and live camera footage through Intel’s Video Search and Summarization (VSS) application. The Hermes agent server cannot show video or images, so the VSG agent console displays the agent’s results as match grids for human review, a floorplan route, live camera matches, and PDF incident reports.

Architecture: operator browser, vsg-ui container, Hermes agent, VSS MCP server, VSS gateway and model server

Key Features#

Feature

What it does

Chat-driven search

Describe a person, attach a photo, or both. The VSG agent calls vss_search_video and returns ranked sightings.

Human-in-the-loop review

The console initially shows the top matches; on wide screens, they appear in a 3×2 grid. Operators can reveal up to 20 matches. The operator confirms matches. When a review includes at least one confirmed match, shown unconfirmed matches are sent to Argus as false positives.

Crop and re-search

The operator crops the person from a clip frame in the console. The console sends the crop to VSS, and Argus runs another image search.

Floorplan route

The console draws confirmed sightings in time order from camera to camera on an uploaded floorplan.

Live camera search

After the operator consents, VSS watches live cameras, and the console maintains a live timeline of sightings for each camera.

Incident reports

The VSG agent drafts a report from confirmed sightings; the operator edits it and exports a PDF in the browser.

Grounded results

Grid clips come from actual VSS tool results, not text generated by the model.

Secure by default

The console runs in one read-only, non-root NGINX container with a route allowlist. The Hermes API key never reaches the browser.

Use Cases#

  • Lost or missing person: find where a person was last seen, from a photo or a description.

  • Incident follow-up: reconstruct a subject’s route and hand over a time-ordered PDF report.

  • Live watch: after confirming a subject, watch live cameras for new sightings for a bounded time.

  • Privacy-aware search: the VSG agent describes clothing and movement only. It does not identify people or infer age, gender, or ethnicity.

See Also#