```{eval-rst} .. meta:: :description: Explains the Virtual Security Guard agent architecture and investigation flow. :keywords: Virtual Security Guard, VSS, agent architecture, investigation flow. ``` # How It Works The operator uses the VSG agent console in a browser to interact with **Argus**, the VSG agent. Argus runs on a Hermes agent server, reasons with a local model, and calls VSS tools through the VSS Model Context Protocol (MCP) server. The console renders Argus’s results and lets operators review them. ## Architecture ![Architecture: operator browser, vsg-ui container, Hermes agent, VSS MCP server, VSS gateway, and model server](./_assets/vsg-architecture.svg) | Component | Role | | --- | --- | | vsg-ui | Serves the React application and proxies an allowlist of Hermes and VSS paths. | | Hermes agent server | Runs the VSG agent, keeps one session per investigation, and streams run events over Server-Sent Events (SSE). | | VSG Hermes skills | Provide the `virtual-security-guard` and `vsg-incident-report` skills installed on the Hermes host. | | VSS MCP server | Provides the agent with VSS tools. | | VSS gateway | Stores and indexes footage, runs searches, and serves clips and frames. | | Model server | Provides the LLM used by the VSG agent, such as OpenVINO™ model server. | ## Investigation Flow ![Investigation flow from photo or description to review grid, confirmed sightings, route, live search, and report](./_assets/vsg-investigation-flow.svg) 1. **Search**: The UI uploads the photo to VSS and starts a VSG agent run. The VSG agent calls `vss_search_video`. 2. **Review**: The UI displays VSS results in a grid. The operator confirms the sightings that match. If at least one is confirmed, the other shown matches are sent to Argus as false positives; if none are confirmed, no feedback is sent. 3. **Crop and search again** (optional): The operator can crop a person from a clip and submit the crop as a new image search. The crop becomes the subject image. 4. **Route**: Confirmed sightings from all grids appear in chronological order as a route on the floor plan. 5. **Live search** (optional): When a live camera is connected, the operator can start live search from the route card by clicking the live-search control. The UI polls VSS every 10 seconds. 6. **Report**: The operator can generate a report from the route card. The VSG agent drafts the report, and the browser builds the PDF. ## Learn More - [System Requirements](./get-started/system-requirements.md) - [Get Started](./get-started.md) - [Known Issues](./known-issues.md) - [Release Notes](./release-notes.md)