DeepStream Python Apps

• DeepStream Python Apps
  • Setup
  • Python Bindings
    • Python Bindings Breaking API Change
  • Sample Applications

Setup

Once you have DeepStreamSDK pre-requisites and DeepStreamSDK installed on the system, navigate to <DS_ROOT>/sources/ dir which is /opt/nvidia/deepstream/deepstream/sources/ and git clone deepstream_python_apps repo here.

The latest bindings can be installed from release section. You can also build the bindings from source using the instructions in the bindings readme if needed.

Python Bindings

DeepStream pipelines can be constructed using Gst Python, the GStreamer framework's Python bindings. For accessing DeepStream MetaData, Python bindings are provided as part of this repository. This module is generated using Pybind11.

These bindings support a Python interface to the MetaData structures and functions. Usage of this interface is documented in the HOW-TO Guide and demonstrated in the sample applications.

Python Bindings Breaking API Change

The binding for function alloc_nvds_event_msg_meta() now expects a NvDsUserMeta pointer which the NvDsEventMsgMeta is associated with. Please refer to deepstream-test4 and bindschema.cpp for reference.

Sample Applications

Sample applications provided here demonstrate how to work with DeepStream pipelines using Python.
The sample applications require MetaData Bindings to work.

To run the sample applications or write your own, please consult the HOW-TO Guide

We currently provide the following sample applications:

• deepstream-test1 -- 4-class object detection pipeline, also demonstrates support for new nvstreammux
• deepstream-test2 -- 4-class object detection, tracking and attribute classification pipeline
• deepstream-test3 -- multi-stream pipeline performing 4-class object detection, also supports triton inference server, no-display mode, file-loop and silent mode
• deepstream-test4 -- msgbroker for sending analytics results to the cloud
• deepstream-imagedata-multistream -- multi-stream pipeline with access to image buffers
• deepstream-ssd-parser -- SSD model inference via Triton server with output parsing in Python
• deepstream-test1-usbcam -- deepstream-test1 pipeline with USB camera input
• deepstream-test1-rtsp-out -- deepstream-test1 pipeline with RTSP output, demonstrates adding software encoder option to support Jetson Orin Nano
• deepstream-opticalflow -- optical flow and visualization pipeline with flow vectors returned in NumPy array
• deepstream-segmentation -- NOT CURRENTLY SUPPORTED IN DS 7.1 segmentation and visualization pipeline with segmentation mask returned in NumPy array
• deepstream-nvdsanalytics -- multistream pipeline with analytics plugin
• runtime_source_add_delete -- add/delete source streams at runtime
• deepstream-imagedata-multistream-redaction -- multi-stream pipeline with face detection and redaction
• deepstream-rtsp-in-rtsp-out -- multi-stream pipeline with RTSP input/output - has command line option "--rtsp-ts" for configuring the RTSP source to attach the timestamp rather than the streammux
• deepstream-preprocess-test -- multi-stream pipeline using nvdspreprocess plugin with custom ROIs
• deepstream-demux-multi-in-multi-out -- multi-stream pipeline using nvstreamdemux plugin to generated separate buffer outputs
• deepstream-imagedata-multistream-cupy -- access imagedata buffer from GPU in a multistream source as CuPy array - x86 only
• deepstream-segmask -- NOT CURRENTLY SUPPORTED IN DS 7.1 access and interpret segmentation mask information from NvOSD_MaskParams
• deepstream-custom-binding-test -- demonstrate usage of NvDsUserMeta for attaching custom data structure - see also the Custom User Meta Guide

Detailed application information is provided in each application's subdirectory under apps.