cudacodec writer output video with invalid frame count using python #3556
Description
System information (version)
General configuration for OpenCV 4.8.0 =====================================
Version control: 4.8.0 Extra modules: Location (extra): /root/opencv-python/opencv_contrib/modules Version control (extra): 4.8.0
Platform: Timestamp: 2023-08-30T00:38:34Z Host: Linux 6.4.4-arch1-1 x86_64 CMake: 3.27.2
CMake generator: Ninja CMake build tool: /usr/bin/ninja Configuration: RELEASE CPU/HW features: Baseline: SSE SSE2 SSE3 requested: SSE3
Dispatched code generation: SSE4_1 SSE4_2 FP16 AVX AVX2 AVX512_SKX requested: SSE4_1 SSE4_2 AVX FP16 AVX2 AVX512_SKX SSE4_1 (13 files): + SSSE3 SSE4_1
SSE4_2 (1 files): + SSSE3 SSE4_1 POPCNT SSE4_2 FP16 (0 files): + SSSE3 SSE4_1 POPCNT SSE4_2 FP16 AVX
AVX (3 files): + SSSE3 SSE4_1 POPCNT SSE4_2 AVX AVX2 (25 files): + SSSE3 SSE4_1 POPCNT SSE4_2 FP16 FMA3 AVX AVX2 AVX512_SKX (2 files): + SSSE3 SSE4_1 POPCNT SSE4_2 FP16 FMA3 AVX AVX2 AVX_512F AVX512_COMMON AVX512_SKX
C/C++: [70/1946] Built as dynamic libs?: NO
C++ standard: 11
C++ Compiler: /usr/bin/g++-10 (ver 10.5.0)
C++ flags (Release): -fsigned-char -W -Wall -Wreturn-type -Wnon-virtual-dtor -Waddress -Wsequence-point -Wformat -Wformat-security -Wmissing-declarations -Wundef -Winit-self -Wpointer-arith -Wshadow -Wsign-promo -Wuninitialized -Wsuggest-override -Wno-delete-non-virtual-dtor -Wno-comment -Wimplicit-fallthrough=3 -Wno-strict-overflow -fdiagnostics-show-option -Wno-long-long -pthread -fomit-frame-pointer -ffunction-sections -fdata-sections -msse -msse2 -msse3 -fvisibility=hidden -fvisibility-inlines-hidden -O3 -DNDEBUG -DNDEBUG
C++ flags (Debug): -fsigned-char -W -Wall -Wreturn-type -Wnon-virtual-dtor -Waddress -Wsequence-point -Wformat -Wformat-security -Wmissing-declarations -Wundef -Winit-self -Wpointer-arith -Wshadow -Wsign-promo -Wuninitialized -Wsuggest-override -Wno-delete-non-virtual-dtor -Wno-comment -Wimplicit-fallthrough=3 -Wno-strict-overflow -fdiagnostics-show-option -Wno-long-long -pthread -fomit-frame-pointer -ffunction-sections -fdata-sections -msse -msse2 -msse3 -fvisibility=hidden -fvisibility-inlines-hidden -g -O0 -DDEBUG -D_DEBUG
C Compiler: /usr/bin/gcc-10
C flags (Release): -fsigned-char -W -Wall -Wreturn-type -Waddress -Wsequence-point -Wformat -Wformat-security -Wmissing-declarations -Wmissing-prototypes -Wstrict-prototypes -Wundef -Winit-self -Wpointer-arith -Wshadow -Wuninitialized -Wno-comment -Wimplicit-fallthrough=3 -Wno-strict-overflow -fdiagnostics-show-option -Wno-long-long -pthread -fomit-frame-pointer -ffunction-sections -fdata-sections -msse -msse2 -msse3 -fvisibility=hidden -O3 -DNDEBUG -DNDEBUG
C flags (Debug): -fsigned-char -W -Wall -Wreturn-type -Waddress -Wsequence-point -Wformat -Wformat-security -Wmissing-declarations -Wmissing-prototypes -Wstrict-prototypes -Wundef -Winit-self -Wpointer-arith -Wshadow -Wuninitialized -Wno-comment -Wimplicit-fallthrough=3 -Wno-strict-overflow -fdiagnostics-show-option -Wno-long-long -pthread -fomit-frame-pointer -ffunction-sections -fdata-sections -msse -msse2 -msse3 -fvisibility=hidden -g -O0 -DDEBUG -D_DEBUG
Linker flags (Release): -Wl,--exclude-libs,libippicv.a -Wl,--exclude-libs,libippiw.a -Wl,--gc-sections -Wl,--as-needed -Wl,--no-undefined
Linker flags (Debug): -Wl,--exclude-libs,libippicv.a -Wl,--exclude-libs,libippiw.a -Wl,--gc-sections -Wl,--as-needed -Wl,--no-undefined
ccache: NO
Precompiled headers: NO
Extra dependencies: va va-drm /usr/lib/x86_64-linux-gnu/libjpeg.so /usr/lib/x86_64-linux-gnu/libpng.so /usr/lib/x86_64-linux-gnu/libz.so /usr/lib/x86_64-linux-gnu/libcuda.so /usr/lib/libnvcuvid.so /usr/lib/libnvidia-encode.so m pthread cudart_static dl rt nppc nppial nppicc nppidei nppif nppig nppim nppist nppisu nppitc npps cublas cudnn cufft -L/usr/lib/x86_64-linux-gnu
3rdparty dependencies: ittnotify libwebp libtiff libopenjp2 IlmImf ippiw ippicv
OpenCV modules: To be built: core cudaarithm cudacodec cudaimgproc cudawarping cudev highgui imgcodecs imgproc python3 video videoio Disabled: freetype world
Disabled by dependency: aruco bgsegm bioinspired calib3d ccalib cudabgsegm cudafeatures2d cudafilters cudalegacy cudaobjdetect cudaoptflow cudastereo datasets dnn dnn_objdetect dnn_superres dpm face features2d flann fuzzy gapi hfs img_hash intensity_transform java_bindings_generator js_bindings_generator line_descriptor mcc ml objc_bindings_generator objdetect optflow phase_unwrapping photo plot python_tests quality rapid reg rgbd saliency shape stereo stitching structured_light superres surface_matching text tracking videostab wechat_qrcode xfeatures2d ximgproc xobjdetect xphoto
Unavailable: alphamat cvv hdf java julia matlab ovis python2 sfm ts viz
Applications: -
Documentation: NO
Non-free algorithms: YES
GUI: NONE
VTK support: NO
Media I/O:
ZLib: /usr/lib/x86_64-linux-gnu/libz.so (ver 1.2.11)
JPEG: /usr/lib/x86_64-linux-gnu/libjpeg.so (ver 80)
WEBP: build (ver encoder: 0x020f)
PNG: /usr/lib/x86_64-linux-gnu/libpng.so (ver 1.6.37)
TIFF: build (ver 42 - 4.2.0)
JPEG 2000: build (ver 2.5.0)
OpenEXR: build (ver 2.3.0)
HDR: YES
SUNRASTER: YES
PXM: YES
PFM: YES
Video I/O:
DC1394: YES (2.2.6)
FFMPEG: YES
avcodec: YES (58.134.100)
avformat: YES (58.76.100)
avutil: YES (56.70.100)
swscale: YES (5.9.100)
avresample: NO
GStreamer: NO
v4l/v4l2: YES (linux/videodev2.h)
Parallel framework: TBB (ver 2021.5 interface 12050)
Trace: YES (with Intel ITT)
Other third-party libraries:
Intel IPP: 2021.8 [2021.8.0]
at: /root/opencv-python/_skbuild/linux-x86_64-3.10/cmake-build/3rdparty/ippicv/ippicv_lnx/icv
Intel IPP IW: sources (2021.8.0)
at: /root/opencv-python/_skbuild/linux-x86_64-3.10/cmake-build/3rdparty/ippicv/ippicv_lnx/iw
VA: YES
Lapack: NO
Eigen: NO
Custom HAL: NO
Protobuf: build (3.19.1)
Flatbuffers: builtin/3rdparty (23.5.9)
NVIDIA CUDA: YES (ver 11.5, CUFFT CUBLAS NVCUVID NVCUVENC)
NVIDIA GPU arch: 75
NVIDIA PTX archs:
cuDNN: YES (ver 8.2.4)
OpenCL: YES (INTELVA)
Include path: /root/opencv-python/opencv/3rdparty/include/opencl/1.2
Link libraries: Dynamic load
Python 3:
Interpreter: /usr/bin/python3 (ver 3.10.12)
Libraries: /usr/lib/x86_64-linux-gnu/libpython3.10.so (ver 3.10.12)
numpy: /tmp/pip-build-env-1zh6oawl/overlay/local/lib/python3.10/dist-packages/numpy/core/include (ver 1.21.2)
install path: python/cv2/python-3
Python (for build): /usr/bin/python3
Install to: /root/opencv-python/_skbuild/linux-x86_64-3.10/cmake-install
Detailed description
The output video from cudacodec writer has invalid frame count, which caused failed to open by some video players like VLC.
Steps to reproduce
Install dependencies in ubuntu-22.04:
apt-get update
DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends gcc-10 g++-10 nvidia-driver-535 nvidia-cuda-toolkit nvidia-cudnn git libx264-dev libx265-dev cmake wget unzip yasm pkg-config libswscale-dev libtbb2 libtbb-dev libjpeg-dev libpng-dev libavformat-dev libpq-dev libass-dev libdc1394-dev libfreetype6-dev libva-dev libvdpau-dev libvorbis-dev libxcb1-dev libxcb-shm0-dev libxcb-xfixes0-dev libsdl2-dev liblapack-dev libblas-dev ninja-build
DEBIAN_FRONTEND=noninteractive /usr/sbin/update-nvidia-cudnn -u
Download Video_Codec_SDK_12.1.14.zip from nvidia website, copy .so and .h file to /usr/lib and /usr/include/
Compile with opencv-python, and latest opencv and opencv_contrib code
git clone https://github.com/opencv/opencv-python.git
git checkout tags/76 -b 4.8.0.76
cd opencv-python
sed -i -e "133,134d;153,154d" setup.py
git submodule update --init --recursive --depth=1
cd opencv
git checkout 4.x
git pull
cd opencv_contrib
git checkout 4.x
git pull
export CC="gcc-10"
export CXX="g++-10"
export ENABLE_HEADLESS=1
export ENABLE_CONTRIB=1
export CMAKE_ARGS="-DCMAKE_BUILD_PARALLEL_LEVEL=8 -DCMAKE_BUILD_TYPE=RELEASE -DWITH_CUDA=ON -DWITH_CUDNN=ON -DCUDA_ARCH_BIN=7.5 -DWITH_CUBLAS=ON -DWITH_TBB=ON -DOPENCV_DNN_CUDA=ON -DWITH_NVCUVID=ON -DWITH_NVCUVENC=ON -DOPENCV_ENABLE_NONFREE=ON -DWITH_FFMPEG=ON -DINSTALL_C_EXAMPLES=OFF -DBUILD_EXAMPLES=OFF -DBUILD_PERF_TESTS=OFF -DBUILD_TESTS=OFF -DBUILD_JAVA=OFF -DBUILD_OBJC=OFF -DPYTHON3_LIMITED_API=ON -DBUILD_LIST=core,imgcodecs,videoio,cudaarithm,cudaimgproc,cudawarping,cudev,cudacodec,video,highgui,python3,python_bindings_generator"
python3 -m pip wheel . --verbose
Download testing video:
wget https://sample-videos.com/video123/mp4/720/big_buck_bunny_720p_10mb.mp4
Testing code named as test_opencv_gpu.py
import cv2
import sys
import ipdb
import time
t1 = time.time()
codec = cv2.cudacodec.H264
color_format = cv2.cudacodec.COLOR_FORMAT_BGR
reader = cv2.VideoCapture(sys.argv[1])
print("input_fps", reader.get(cv2.CAP_PROP_FPS))
print("input_frame_count", reader.get(cv2.CAP_PROP_FRAME_COUNT))
reader.release()
reader = cv2.cudacodec.createVideoReader(sys.argv[1])
reader.set(color_format)
format = reader.format()
fps = format.fps
height = format.height
width = format.width
assert fps != 0, "FPS of input video is 0"
encoder_params_in = cv2.cudacodec.EncoderParams()
stream = cv2.cuda.Stream()
out_path = sys.argv[1][:-4] + "_gpu_out.mp4"
writer = cv2.cudacodec.createVideoWriter(out_path, (width, height), codec, fps=fps, colorFormat=color_format, params=encoder_params_in, stream=stream)
while True:
ret, frame = reader.nextFrame()
if not ret or frame is None:
break
writer.write(frame)
writer.release()
del reader
reader = cv2.VideoCapture(out_path)
print("fps", reader.get(cv2.CAP_PROP_FPS))
print("frame_count", reader.get(cv2.CAP_PROP_FRAME_COUNT))
reader.release()
print(time.time() - t1)
Run the testing code:
./test_opencv_gpu.py big_buck_bunny_720p_10mb.mp4
The frame_count for output video is -192153584101141.0
-->
Issue submission checklist
- [x ] I report the issue, it's not a question
- [x ] I checked the problem with documentation, FAQ, open issues,
forum.opencv.org, Stack Overflow, etc and have not found any solution - [x ] I updated to the latest OpenCV version and the issue is still there
- [x ] There is reproducer code and related data files: videos, images, onnx, etc