Release Notes 2024#
Version 2024.3.0#
New
Title |
High-level description |
|---|---|
GStreamer 1.24.10 |
Updated GStreamer to the 1.24.10 version |
Documentation for MQTT |
Documentation for MQTT updated |
Added support for numactl |
Added support for numactl in the docker image |
Enabled Intel® Core™ Ultra Processors (Series 2) (formerly codenamed Lunar Lake) |
Validated with Ubuntu 24.04, 6.12.3-061203-generic |
Version 2024.2.2#
New
Title |
High-level description |
|---|---|
Installation of DL Streamer Pipeline Framework from Debian packages using APT repository |
Support for apt-get install has been added. |
Yolo11s-pose support |
Added support for Yolo11s-pose model. |
Change in gvafpscounter element |
Reset FPS counters whenever a stream is added/removed. |
OpenVINO updated |
OpenVINO updated to the 2024.5 version. |
GStreamer 1.24.9 |
Updated GStreamer to the 1.24.9 version. |
NPU 1.10.0 |
NPU drivers updated to NPU 1.10.0 version. |
Bugs fixing |
Fixed issue with failing performance tests ; Fixed fuzzy tests ; Enabled debug mode ; Created TLS configuration that allows for secure communication between DL Streamer and MQTT broker; Fixed python error: init_threadstate: thread state already initialized; Fixed problem with DLS compilation / GSTreamer base plugin error.; Fixed issue with sample_test: python_draw_face_attributes on Ubuntu 24.04; Fixed issue with sample_test: gvapython cpu/gpu on Ubuntu 24.04 |
Version 2024.2.1#
New
Title |
High-level description |
|---|---|
Update NPU drivers to version 1.8.0 |
Update NPU driver version inside docker images |
Yolo 11 |
Added support for YOLO 11 model (CPU and GPU only) |
GStreamer |
GStreamer updated to the 1.24.8 version |
Fix Github issue: #440 |
gvapython error: Fatal Python error: init_threadstate: thread state already initialized |
Version 2024.2.0#
New
Title |
High-level description |
|---|---|
New models support: Yolov10 for GPU, DeepLabv3 |
Support for most recent Yolov10 model for GPU and DeepLabv3 (semantic segmentation) |
UTC format for timestamp |
Timestamp can be shown in UTC format based on system time with option to synchronize it from NTP server |
OpenVINO 2024.4 support |
Update to latest version of OpenVINO |
GStreamer 1.24.7 support |
Update to latest version of GStreamer |
Intel® NPU 1.6.0 driver support |
Support for newer version of Intel® NPU Linux driver |
Simplified installation process for option#1 (i.e. Ubuntu packages) via script |
Development of the script that enhances user experience during installation of DL Streamer with usage of option#1. |
Documentation improvements |
Descriptions enhancements in various points. |
(Preview feature) Simplified installation process for option#2 via script |
Development of the script that enhances user experience during installation of DL Streamer with usage of option#2.. |
Fixed
Issue |
Issue Description |
|---|---|
Github issue: #431 |
WARNING: erroneous pipeline: no element “gvadetect” |
Github issue: #433 |
WARNING: erroneous pipeline: no element “gvaattachroi” inside Docker image 2024.1.2-dev-ubuntu24 |
Github issue: #434 |
Proper way to use object-class under gvadetect |
Github issue: #435 |
No such element or plugin ‘gvadetect’ |
Internal findings |
installation via option#3 documentation fixes; fixed hangs on MTL NPU for INT8 models; fixed issues with using 4xFlex170 system |
Version 2024.1.2#
New
Title |
High-level description |
|---|---|
New models support: Yolov10 for CPU only,Yolov8 instance segmentation |
Support for most recent Yolov10 model for CPU and extension for Yolov8 |
New elements: gvaattachroi including documentation update + samples) |
Added element documentation and sample development which introduces ability to define the area of interest on which the inference should be performed |
OpenVINO 2024.3 support |
Update to latest version of OpenVINO |
GStreamer 1.24.6 support |
Update to latest version of GStreamer |
Ubuntu 24.04 support |
Support for newer version of Ubuntu |
Documentation updates for DeepStream to DL Streamer migration process |
Updates to the migration process from Deep Stream |
Documentation improvements |
Descriptions enhancements in various points |
[Preview feature] Simplified installation process for option#1 via script |
Development of the script that enhances user experience during installation of DL Streamer with usage of option#1 |
Fixed
Issue |
Issue Description |
|---|---|
when using inference-region=roi-list vs full-frame in my classification pipeline, classification data does not get published |
|
Installation issues with gst-ugly plugins |
|
Installation Error DL Streamer - Both Debian Packages and Compile from Sources |
|
Internal findings |
custom efficientnetb0 fix, issue with selection region before inference, Geti classification model fix, dGPU vah264enc element not found error fix, sample: face_detection_and_classifiation fix |
Version 2024.1.1#
New
Title |
High-level description |
|---|---|
Missing git package |
Git package added to DL Streamer docker runtime image |
VTune when running DL Streamer |
Publish instructions to install and run VTune to analyze media + gpu when running DL Streamer |
Update NPU drivers to version 1.5.0 |
Update NPU driver version inside docker images |
Instance_segmentation sample |
Add new Mask-RCNN segmentation sample |
Documentation updates |
Enhance Performance Guide and Model Preparation section |
Fix samples errors |
Fixed errors on action_recognition, geti, yolo and ffmpeg (customer issue) samples |
Fix memory grow with |
Fix for Meta Overlay memory leak with DLS Arch 2.0 |
Fix pipeline which failed to start with mobilenet-v2-1.0-224 model |
|
Fix batch-size error -> with yolov8 model and other yolo models |
Version 2024.1.0#
New
Title |
High-level description |
|---|---|
Switch to ‘gst-va’ as default processing path instead of ‘gst-vaapi’ |
Switch to ‘gst-va’ as default processing path instead of ‘gst-vaapi’ |
Add support for ‘gst-qsv’ plugins |
Add support for ‘qsv’ plugins |
New public ONNX models: Centerface and HSEmotion |
New public ONNX models: Centerface and HSEmotion |
Update Gstreamer version to the latest one (current 1.24) |
Update Gstreamer version to the latest one (1.24.4) |
Update OpenVINO version to latest one (2024.2.0) |
Update OpenVINO version to latest one (2024.2.0) |
Release docker images on DockerHUB: runtime and dev |
Release docker images on DockerHUB: runtime and dev |
Bugs fixing |
Bug fixed: GPU not detected in Docker container Dlstreamer - MTL platform; Updated docker images with proper GPU and NPU packages; yolo5 model failed with batch-size >1; Remove excessive ‘mbind failed:…’ warning logs |
Documentation updates |
Added sample applications for Mask-RCNN instance segmentation. Added list of supported models from Open Model Zoo and public repos. Added scripts to generate DL Streamer-consumable models from public repos. Document usage of ModelAPI properties in OpenVINO IR (model.xml) instead of creating custom model_proc files. Updated installation instructions for docker images. |
Fixed
Issue # |
Issue Description |
Fix |
Affected platforms |
|---|---|---|---|
421 |
Can we specify the IOU threshold in yolov8 post-process json like yolov5? |
Same solution as in #394 |
All |
420 |
Support for Centerface and HSEmotion added |
All |
Version 2024.0.2#
New
Title |
High-level description |
|---|---|
Support for ‘gst-va’ in addition to ‘gst-vaapi’ |
Support for ‘gst-va’ in addition to ‘gst-vaapi’ |
Add support for EfficentNetv2 (classification), MaskRCNN (instance segmentation) and Yolo8-OBB (oriented bounding box) |
New classification model supported EfficentNetv2, new instance segmentation model supported MaskRCNN and oriented bounding box model as well added Yolo8-OBB |
Support additional GETI models: segmentation, obb |
GETI public models support added |
Generalized method to deploy new models without need for model-proc file |
Support model information embedded into AI model descriptors according to OpenVINO Model API |
Release docker images on DockerHUB: runtime |
Added docker images on DockerHUB: runtime |
Added support for OpenVINO 2024.1.0 |
Added support for OpenVINO 2024.1.0 |
Fixed
Issue # |
Issue Description |
Fix |
Affected platforms |
|---|---|---|---|
407 |
We do not plan to support older DL Streamer releases with API1.0, I highly recommend to switch to newer version compatible with latest OpenVINO |
All |
|
410 |
Config error, user opened a new issue for tracking the yolo issue and was able to see cameras now |
All |
|
412 |
with Docker cmd, cant create and dowload models inside docker |
Config error. Without $ sign, when assigning a value (using $ to retrieve the value of a variable, e.g. to print the value): `$ export MODELS_PATH=/home/dlstreamer/temp/models1 |
All |
413 |
Possible config error, missing libraries but no feedback given for 2 weeks so the issue was closed |
All |
|
415 |
cant run against Efficientnet-b0 due to model exceeds allowable size of 10MB |
Resolved, user was able to get it running with last suggestion to use implemented RealSense specific gstreamer plugins, like •https://github.com/WKDSMRT/realsense-gstreamer => |
All |
416 |
Continue with “merged” command-line, using |
All |
Version 2024.0.1#
New
Title |
High-level description |
|---|---|
Add support for latest Ultralytics YOLO models |
Add support for latest Ultralytics YOLO models: -v7, -v8, -v9 |
Add support for YOLOX models |
Add support for YOLOX models |
Support deployment of GETI-trained models |
Support models trained by GETI v1.8: bounding-box detection and classification (single and multi-label) |
Automatic pre-/post-processing based on model descriptor |
Automatic pre-/post-processing based on model descriptor (model-proc file not required): yolov8, yolov9 and GETI |
Docker image size reduction |
Reduced docker image size generated from the published docker file |
Fixed
Issue # |
Issue Description |
Fix |
Affected platforms |
|---|---|---|---|
390 |
How to install packages with sudo inside the docker container intel/dlstreamer:latest |
start the container as mentioned above with root-user |
All |
392 |
2024.0 version supports API 2.0 so I highly recommend to check it and in case if this problem is still valid please raise new issue |
All |
|
393 |
Error no longer occurring for user |
All |
|
394 |
Procedure to transform crowdhuman_yolov5m.pt model to the openvino version that can be used directly in DL Streamer with Yolo_v7 converter (no layer cutting required) * |
All |
|
396 |
2024.0 version supports API 2.0 so I highly recommend to check it and in case if this problem is still valid please raise new issue |
All |
|
404 |
Added as a feature in this release |
All |
|
406 |
Added as a feature in this release |
All |
|
409 |
Suggested temporarily - to use a root-user when running the container image, like |
All |
Version 2024.0#
New
Title |
High-level description |
|---|---|
Intel® Core™ Ultra processors NPU support |
Inference on NPU devices has been added, validated with Intel(R) Core(TM) Ultra 7 155H |
Compatibility with OpenVINO™ Toolkit 2024.0 |
Pipeline Framework has been updated to use the 2024.0.0 version of the OpenVINO™ Toolkit |
Compatibility with GStreamer 1.22.9 |
Pipeline Framework has been updated to use GStreamer framework version 1.22.9 |
Updated to FFmpeg 6.1.1 |
Updated FFmpeg from 5.1.3 to 6.1.1 |
Performance optimizations |
8% geomean gain across tested scenarios, up to 50% performance gain in multi-stream scenarios |
Docker image replaced with Docker file |
Ubuntu 22.04 docker file is released instead of docker image. |
Additional Information#
System Requirements#
Please refer to DL Streamer documentation.
Installation Notes#
There are several installation options for Pipeline Framework:
Install Pipeline Framework from pre-built Debian packages
Build Docker image from docker file and run Docker image
Build Pipeline Framework from source code
For more detailed instructions please refer to DL Streamer Pipeline Framework installation guide.
Samples#
The samples folder in DL Streamer Pipeline Framework repository contains command line, C++ and Python examples.