Release Notes 2024#

Version 2024.3.0#

New

Title

High-level description

GStreamer 1.24.10

Updated GStreamer to the 1.24.10 version

Documentation for MQTT

Documentation for MQTT updated

Added support for numactl

Added support for numactl in the docker image

Enabled Intel® Core™ Ultra Processors (Series 2) (formerly codenamed Lunar Lake)

Validated with Ubuntu 24.04, 6.12.3-061203-generic

Version 2024.2.2#

New

Title

High-level description

Installation of DL Streamer Pipeline Framework from Debian packages using APT repository

Support for apt-get install has been added.

Yolo11s-pose support

Added support for Yolo11s-pose model.

Change in gvafpscounter element

Reset FPS counters whenever a stream is added/removed.

OpenVINO updated

OpenVINO updated to the 2024.5 version.

GStreamer 1.24.9

Updated GStreamer to the 1.24.9 version.

NPU 1.10.0

NPU drivers updated to NPU 1.10.0 version.

Bugs fixing

Fixed issue with failing performance tests ; Fixed fuzzy tests ; Enabled debug mode ; Created TLS configuration that allows for secure communication between DL Streamer and MQTT broker; Fixed python error: init_threadstate: thread state already initialized; Fixed problem with DLS compilation / GSTreamer base plugin error.; Fixed issue with sample_test: python_draw_face_attributes on Ubuntu 24.04; Fixed issue with sample_test: gvapython cpu/gpu on Ubuntu 24.04

Version 2024.2.1#

New

Title

High-level description

Update NPU drivers to version 1.8.0

Update NPU driver version inside docker images

Yolo 11

Added support for YOLO 11 model (CPU and GPU only)

GStreamer

GStreamer updated to the 1.24.8 version

Fix Github issue: #440

gvapython error: Fatal Python error: init_threadstate: thread state already initialized

Version 2024.2.0#

New

Title

High-level description

New models support: Yolov10 for GPU, DeepLabv3

Support for most recent Yolov10 model for GPU and DeepLabv3 (semantic segmentation)

UTC format for timestamp

Timestamp can be shown in UTC format based on system time with option to synchronize it from NTP server

OpenVINO 2024.4 support

Update to latest version of OpenVINO

GStreamer 1.24.7 support

Update to latest version of GStreamer

Intel® NPU 1.6.0 driver support

Support for newer version of Intel® NPU Linux driver

Simplified installation process for option#1 (i.e. Ubuntu packages) via script

Development of the script that enhances user experience during installation of DL Streamer with usage of option#1.

Documentation improvements

Descriptions enhancements in various points.

(Preview feature) Simplified installation process for option#2 via script

Development of the script that enhances user experience during installation of DL Streamer with usage of option#2..

Fixed

Issue

Issue Description

Github issue: #431

WARNING: erroneous pipeline: no element “gvadetect”

Github issue: #433

WARNING: erroneous pipeline: no element “gvaattachroi” inside Docker image 2024.1.2-dev-ubuntu24

Github issue: #434

Proper way to use object-class under gvadetect

Github issue: #435

No such element or plugin ‘gvadetect’

Internal findings

installation via option#3 documentation fixes; fixed hangs on MTL NPU for INT8 models; fixed issues with using 4xFlex170 system

Version 2024.1.2#

New

Title

High-level description

New models support: Yolov10 for CPU only,Yolov8 instance segmentation

Support for most recent Yolov10 model for CPU and extension for Yolov8

New elements: gvaattachroi including documentation update + samples)

Added element documentation and sample development which introduces ability to define the area of interest on which the inference should be performed

OpenVINO 2024.3 support

Update to latest version of OpenVINO

GStreamer 1.24.6 support

Update to latest version of GStreamer

Ubuntu 24.04 support

Support for newer version of Ubuntu

Documentation updates for DeepStream to DL Streamer migration process

Updates to the migration process from Deep Stream

Documentation improvements

Descriptions enhancements in various points

[Preview feature] Simplified installation process for option#1 via script

Development of the script that enhances user experience during installation of DL Streamer with usage of option#1

Fixed

Issue

Issue Description

#425

when using inference-region=roi-list vs full-frame in my classification pipeline, classification data does not get published

#432

Installation issues with gst-ugly plugins

#397

Installation Error DL Streamer - Both Debian Packages and Compile from Sources

Internal findings

custom efficientnetb0 fix, issue with selection region before inference, Geti classification model fix, dGPU vah264enc element not found error fix, sample: face_detection_and_classifiation fix

Version 2024.1.1#

New

Title

High-level description

Missing git package

Git package added to DL Streamer docker runtime image

VTune when running DL Streamer

Publish instructions to install and run VTune to analyze media + gpu when running DL Streamer

Update NPU drivers to version 1.5.0

Update NPU driver version inside docker images

Instance_segmentation sample

Add new Mask-RCNN segmentation sample

Documentation updates

Enhance Performance Guide and Model Preparation section

Fix samples errors

Fixed errors on action_recognition, geti, yolo and ffmpeg (customer issue) samples

Fix memory grow with meta_overlay

Fix for Meta Overlay memory leak with DLS Arch 2.0

Fix pipeline which failed to start with mobilenet-v2-1.0-224 model

Fix batch-size error -> with yolov8 model and other yolo models

Version 2024.1.0#

New

Title

High-level description

Switch to ‘gst-va’ as default processing path instead of ‘gst-vaapi’

Switch to ‘gst-va’ as default processing path instead of ‘gst-vaapi’

Add support for ‘gst-qsv’ plugins

Add support for ‘qsv’ plugins

New public ONNX models: Centerface and HSEmotion

New public ONNX models: Centerface and HSEmotion

Update Gstreamer version to the latest one (current 1.24)

Update Gstreamer version to the latest one (1.24.4)

Update OpenVINO version to latest one (2024.2.0)

Update OpenVINO version to latest one (2024.2.0)

Release docker images on DockerHUB: runtime and dev

Release docker images on DockerHUB: runtime and dev

Bugs fixing

Bug fixed: GPU not detected in Docker container Dlstreamer - MTL platform; Updated docker images with proper GPU and NPU packages; yolo5 model failed with batch-size >1; Remove excessive ‘mbind failed:…’ warning logs

Documentation updates

Added sample applications for Mask-RCNN instance segmentation. Added list of supported models from Open Model Zoo and public repos. Added scripts to generate DL Streamer-consumable models from public repos. Document usage of ModelAPI properties in OpenVINO IR (model.xml) instead of creating custom model_proc files. Updated installation instructions for docker images.

Fixed

Issue #

Issue Description

Fix

Affected platforms

421

Can we specify the IOU threshold in yolov8 post-process json like yolov5?

Same solution as in #394

All

420

there is a customer’s detect model need to support

Support for Centerface and HSEmotion added

All

Version 2024.0.2#

New

Title

High-level description

Support for ‘gst-va’ in addition to ‘gst-vaapi’

Support for ‘gst-va’ in addition to ‘gst-vaapi’

Add support for EfficentNetv2 (classification), MaskRCNN (instance segmentation) and Yolo8-OBB (oriented bounding box)

New classification model supported EfficentNetv2, new instance segmentation model supported MaskRCNN and oriented bounding box model as well added Yolo8-OBB

Support additional GETI models: segmentation, obb

GETI public models support added

Generalized method to deploy new models without need for model-proc file

Support model information embedded into AI model descriptors according to OpenVINO Model API

Release docker images on DockerHUB: runtime

Added docker images on DockerHUB: runtime

Added support for OpenVINO 2024.1.0

Added support for OpenVINO 2024.1.0

Fixed

Issue #

Issue Description

Fix

Affected platforms

407

EfficientNet-B1 support

We do not plan to support older DL Streamer releases with API1.0, I highly recommend to switch to newer version compatible with latest OpenVINO

All

410

cant run againts my camera feed

Config error, user opened a new issue for tracking the yolo issue and was able to see cameras now

All

412

with Docker cmd, cant create and dowload models inside docker

Config error. Without $ sign, when assigning a value (using $ to retrieve the value of a variable, e.g. to print the value): `$ export MODELS_PATH=/home/dlstreamer/temp/models1

All

413

ffmpeg_openvino build failed, LibAV

Possible config error, missing libraries but no feedback given for 2 weeks so the issue was closed

All

415

cant run against Efficientnet-b0 due to model exceeds allowable size of 10MB

Resolved, user was able to get it running with last suggestion to use implemented RealSense specific gstreamer plugins, like •https://github.com/WKDSMRT/realsense-gstreamer => realsensesrc •https://gitlab.com/aivero/legacy/public/gstreamer/gst-realsense => realsensesrc A couple years old…

All

416

detection with yolo not available on latest

Continue with “merged” command-line, using videobox and or videomixer (or many different other ways from the internet). You might need to start again… and checking the setup on your HOST. I’m using Ubuntu 22.04LTS. Created a non-root-user. Adding the user to video and render groups. Installed docker and configured to use Docker as non-root (without using “sudo” when using “docker run”). Before starting the container, I just call xhost +. Passing the render-group-id to “docker run” (in my case --group-add=110) docker run -it --net=host --device=/dev/dri --device=/dev/video0 --device=/dev/video1 --group-add=110 -v ~/.Xauthority:/home/dlstreamer/.Xauthority -v /tmp/.X11-unix -e DISPLAY=$DISPLAY -v /dev/bus/usb dlstreamer /bin/bash (not using -u 0 --privileged)

All

Version 2024.0.1#

New

Title

High-level description

Add support for latest Ultralytics YOLO models

Add support for latest Ultralytics YOLO models: -v7, -v8, -v9

Add support for YOLOX models

Add support for YOLOX models

Support deployment of GETI-trained models

Support models trained by GETI v1.8: bounding-box detection and classification (single and multi-label)

Automatic pre-/post-processing based on model descriptor

Automatic pre-/post-processing based on model descriptor (model-proc file not required): yolov8, yolov9 and GETI

Docker image size reduction

Reduced docker image size generated from the published docker file

Fixed

Issue #

Issue Description

Fix

Affected platforms

390

How to install packages with sudo inside the docker container intel/dlstreamer:latest

start the container as mentioned above with root-user (-u 0) docker run -it -u 0 --rm… and then are able to update binaries

All

392

installation error dlstreamer with openvino 2023.2

2024.0 version supports API 2.0 so I highly recommend to check it and in case if this problem is still valid please raise new issue

All

393

Debian file location for DL Streamer 2022.3

Error no longer occurring for user

All

394

Custom YoloV5m Accuracy Drop in dlstreamer with model proc

Procedure to transform crowdhuman_yolov5m.pt model to the openvino version that can be used directly in DL Streamer with Yolo_v7 converter (no layer cutting required) * git clone https://github.com/ultralytics/yolov5 * cd yolov5 * pip install -r requirements.txt openvino-dev * python export.py --weights crowdhuman_yolov5m.pt --include openvino

All

396

Segfault when reuse same model with same model-instance-id.

2024.0 version supports API 2.0 so I highly recommend to check it and in case if this problem is still valid please raise new issue

All

404

How to generate model proc file for yolov8?

Added as a feature in this release

All

406

yolox support

Added as a feature in this release

All

409

ERROR: from element /GstPipeline:pipeline0/GstGvaDetect:gvadetect0: base_inference plugin initialization failed

Suggested temporarily - to use a root-user when running the container image, like docker run -it -u 0 [... .add here your other parameters.. ...], to get more permissions

All

Version 2024.0#

New

Title

High-level description

Intel® Core™ Ultra processors NPU support

Inference on NPU devices has been added, validated with Intel(R) Core(TM) Ultra 7 155H

Compatibility with OpenVINO™ Toolkit 2024.0

Pipeline Framework has been updated to use the 2024.0.0 version of the OpenVINO™ Toolkit

Compatibility with GStreamer 1.22.9

Pipeline Framework has been updated to use GStreamer framework version 1.22.9

Updated to FFmpeg 6.1.1

Updated FFmpeg from 5.1.3 to 6.1.1

Performance optimizations

8% geomean gain across tested scenarios, up to 50% performance gain in multi-stream scenarios

Docker image replaced with Docker file

Ubuntu 22.04 docker file is released instead of docker image.

Additional Information#

System Requirements#

Please refer to DL Streamer documentation.

Installation Notes#

There are several installation options for Pipeline Framework:

  1. Install Pipeline Framework from pre-built Debian packages

  2. Build Docker image from docker file and run Docker image

  3. Build Pipeline Framework from source code

For more detailed instructions please refer to DL Streamer Pipeline Framework installation guide.

Samples#

The samples folder in DL Streamer Pipeline Framework repository contains command line, C++ and Python examples.