# Benchmarking

ViPPET provides two benchmarking modes for evaluating AI inference pipeline performance on Intel® hardware:

- **Performance Testing** — Run one or more pipelines with a fixed number of streams and measure throughput
  (FPS), system utilization, and optionally latency in real time.
- **Density Testing** — Automatically find the maximum number of concurrent streams that maintain a target
  FPS floor, using an exponential-growth and binary-search algorithm.

Both modes share a common execution configuration and report results through the same job management system.

## Key concepts

| Concept             | Description                                                                          |
|---------------------|--------------------------------------------------------------------------------------|
| **Total FPS**       | Aggregate frames per second across all active streams                                |
| **Per Stream FPS**  | Average FPS per individual stream (Total FPS ÷ stream count)                         |
| **FPS Floor**       | Minimum acceptable per-stream FPS used as the pass/fail threshold in density testing |
| **Stream Rate**     | Percentage of total streams allocated to each pipeline (must sum to 100%)            |
| **Output Mode**     | Controls whether output video is saved to file, streamed live, or disabled           |
| **Latency Metrics** | Optional end-to-end pipeline latency measurement (avg/min/max) reported per interval |

## Workflow overview

1. **Configure** — Select pipelines, set stream counts or density parameters, and choose output options.
2. **Run** — Start the test; ViPPET creates a job and begins executing pipelines as subprocesses.
3. **Monitor** — Real-time system metrics (CPU, GPU, NPU, memory, power) and pipeline metrics (FPS)
   are displayed in the dashboard while the job runs.
4. **Review results** — When the job completes, view final FPS and output videos in the job detail view.


:::{toctree}
:hidden:

./benchmarking/performance-testing
./benchmarking/density-testing
./benchmarking/managing-jobs

:::