Get Started with Scene Controller#
Prerequisites#
The hardware platform must be at least a 10th Generation Intel® Core™ i5 Processor or Intel® Xeon® Scalable processor, with at least 8+GB of RAM and 64+GB of storage.
Run the service using Docker#
Navigate to the Directory:
cd scenescape
Generate secrets:
make init-secretsStart the service: Start the service using docker run:
docker run --rm \ --init \ --network scenescape \ -v scenescape_vol-media:/home/scenescape/SceneScape/media \ -v $(pwd)/controller/config/tracker-config.json:/home/scenescape/SceneScape/tracker-config.json \ -v $(pwd)/controller/config/reid-config.json:/home/scenescape/SceneScape/reid-config.json \ -v $(pwd)/controller/config/pose-adjustment-route.json:/home/scenescape/SceneScape/pose-adjustment-route.json \ -v $(pwd)/manager/secrets/certs/scenescape-ca.pem:/run/secrets/certs/scenescape-ca.pem:ro \ -v $(pwd)/manager/secrets/django:/run/secrets/django:ro \ -v $(pwd)/manager/secrets/controller.auth:/run/secrets/controller.auth:ro \ --name scene \ scenescape-controller \ controller \ --broker broker.scenescape.intel.com \ --tracker_config_file /home/scenescape/SceneScape/tracker-config.json \ --reid_config_file /home/scenescape/SceneScape/reid-config.json \ --ntp ntpserv
Note: The
sceneservice depends on thebroker,webandntpservservices. Before starting this container, ensure that:The broker service at
broker.scenescape.intel.comis up and reachable.The web service at
https://web.scenescape.intel.com:443is accessible.The ntpserv service at
udp://<host-ip>:123whihc maps to port123/udpinside the container.
Verify the service: Check that the service is running:
docker psStop the service:
docker stop scene
Access scene controller output through MQTT:
Refer to scene-controller-api.yaml on how to access scene controller output
Refer to scene controller sequence diagram
Running in Analytics-Only Mode#
Analytics-only mode allows the Scene Controller to consume tracked objects from a separate Tracker service via MQTT instead of performing tracking internally. This is useful for distributed deployments where tracking and analytics are handled by separate services.
Enable analytics-only mode:
Add the
--analytics-onlyflag to the docker run command:docker run --rm \ --init \ --network scenescape \ -v scenescape_vol-media:/home/scenescape/SceneScape/media \ -v $(pwd)/controller/config/tracker-config.json:/home/scenescape/SceneScape/tracker-config.json \ -v $(pwd)/manager/secrets/certs/scenescape-ca.pem:/run/secrets/certs/scenescape-ca.pem:ro \ -v $(pwd)/manager/secrets/django:/run/secrets/django:ro \ -v $(pwd)/manager/secrets/controller.auth:/run/secrets/controller.auth:ro \ --name scene \ scenescape-controller \ controller \ --broker broker.scenescape.intel.com \ --ntp ntpserv \ --analytics-only
Alternatively, use the environment variable:
docker run --rm \ --init \ --network scenescape \ -e CONTROLLER_ENABLE_ANALYTICS_ONLY=true \ -v scenescape_vol-media:/home/scenescape/SceneScape/media \ -v $(pwd)/controller/config/tracker-config.json:/home/scenescape/SceneScape/tracker-config.json \ -v $(pwd)/manager/secrets/certs/scenescape-ca.pem:/run/secrets/certs/scenescape-ca.pem:ro \ -v $(pwd)/manager/secrets/django:/run/secrets/django:ro \ -v $(pwd)/manager/secrets/controller.auth:/run/secrets/controller.auth:ro \ --name scene \ scenescape-controller \ controller \ --broker broker.scenescape.intel.com \ --ntp ntpserv
Note: In analytics-only mode (experimental feature):
The tracker is not initialized
Camera and scene detection data processing is skipped
The controller subscribes to tracked object data from MQTT topics published by the Tracker service
Analytics processing (regions, tripwires, sensors) continues to function normally
camera_boundsare computed via projection for objects that include asizefield in the incoming tracker MQTT data;projected=trueentries appear in the regulated outputChild scenes are not supported in analytics-only mode
Sensors in Scene not supported and attribute persistence across moving objects not supported on data/scene MQTT topic (data available on events topic)
The following object fields are not available on
eventtopic:similarity,entered,exitedThe following object fields are not available on
data/regulatedtopic:similarity
Enabling Pose Adjustment#
When using a pose estimation model (e.g. yolo11n-pose) in the DL Streamer video pipeline, the Scene Controller can use pose keypoints to refine bounding boxes for supported detection types before projecting them into world coordinates. This improves localization accuracy. The feature is disabled by default.
Enable pose adjustment via CLI flag:
Add the
--pose-adjustmentflag to the docker run command:docker run --rm \ --init \ --network scenescape \ -v scenescape_vol-media:/home/scenescape/SceneScape/media \ -v $(pwd)/controller/config/tracker-config.json:/home/scenescape/SceneScape/tracker-config.json \ -v $(pwd)/controller/config/reid-config.json:/home/scenescape/SceneScape/reid-config.json \ -v $(pwd)/manager/secrets/certs/scenescape-ca.pem:/run/secrets/certs/scenescape-ca.pem:ro \ -v $(pwd)/manager/secrets/django:/run/secrets/django:ro \ -v $(pwd)/manager/secrets/controller.auth:/run/secrets/controller.auth:ro \ --name scene \ scenescape-controller \ controller \ --broker broker.scenescape.intel.com \ --tracker_config_file /home/scenescape/SceneScape/tracker-config.json \ --reid_config_file /home/scenescape/SceneScape/reid-config.json \ --pose_adjustment_config_file /home/scenescape/SceneScape/pose-adjustment-route.json \ --ntp ntpserv \ --pose-adjustment
Alternatively, use the environment variable:
docker run --rm \ --init \ --network scenescape \ -e CONTROLLER_ENABLE_POSE_ADJUSTMENT=true \ -v scenescape_vol-media:/home/scenescape/SceneScape/media \ -v $(pwd)/controller/config/tracker-config.json:/home/scenescape/SceneScape/tracker-config.json \ -v $(pwd)/controller/config/reid-config.json:/home/scenescape/SceneScape/reid-config.json \ -v $(pwd)/controller/config/pose-adjustment-route.json:/home/scenescape/SceneScape/pose-adjustment-route.json \ -v $(pwd)/manager/secrets/certs/scenescape-ca.pem:/run/secrets/certs/scenescape-ca.pem:ro \ -v $(pwd)/manager/secrets/django:/run/secrets/django:ro \ -v $(pwd)/manager/secrets/controller.auth:/run/secrets/controller.auth:ro \ --name scene \ scenescape-controller \ controller \ --broker broker.scenescape.intel.com \ --tracker_config_file /home/scenescape/SceneScape/tracker-config.json \ --reid_config_file /home/scenescape/SceneScape/reid-config.json \ --pose_adjustment_config_file /home/scenescape/SceneScape/pose-adjustment-route.json \ --ntp ntpserv
Configure label routing via
pose-adjustment-route.json:{ "person": ["human", "pedestrian"] }
Note: This feature requires the DL Streamer video pipeline to use a pose estimation model (e.g.
yolo11n-pose) that provides keypoint data. See the DL Streamer Pipeline Server documentation for pipeline setup instructions.