Best export settings for minimal quality loss with NVENC

  • Hello!

    I've been trying to find the best encoding settings using the NVENC H264 encoder with Voukoder but I haven't had much luck since I can't keep the original quality after encoding even with higher bitrate than the original recording.

    My original recordings are with Nvidia shadowplay which uses the exact same NVENC H264 codec to record the videos so I am wondering if there are specific encoder settings I need to use to maintain the best quality possible after re-encoding the original video in premiere pro?

    The settings I am using for the encoder are the Slow preset, High profile and Constant Quantizer at 16

  • I use some special settings to bump up the quality.

    Please tryout these settings, if you are on a Turing-GFX:

    4 B-Frames

    3 REF

    B-Ref Middle

    64 lookahead

    AQ temp & spacial

    Try these on Pascal:

    Slow

    3 B-Frames

    32 lookahead

    AQ temp & spacial

  • I tried the Pascal settings u mentioned since I have a 1080Ti. It looks very close to the original but I still lose some shadow details in the new video compared to the original but I'm guessing it's impossible to not lose quality which is kind of sad.

    I've uploaded 2 pictures, the first one is the original and the second is the rendered video and you can see the lost shadow details in the second one, especially the text in the middle of the carriage where it says "LANNAHECHEE"

    Original

    Render

  • Sorry for the slow answer, I need to turn on notifications via mail.

    You have a really dark video and modern compression via H.264/265 tends to sacrifice data in low lit parts of the image. I've not experienced in compressing game footage (I'm professionally working with realworld camera footage and animated graphics). Maybe NVENC is bad for this type of footage. Have you tried using normal CPU x264 with Voukoder or outside Premiere Pro with Handbrake and 'slower' settings?

    I know, if you take time to compress a video, it will get better or smaller, depending on your preference. NVENC has a more restricted type of functions and x264 (CPU encoding) can use much more functions to compress the videofiles.

  • i use this setting on voukoder 7.1 and exoprt mp4 but when play movi after forward or backward video, video play some delay !

    anyone can help me for best setting for export " HEVC nvidia NVENC " format for good Quality?

    i render most video via premiere12(2018) FullHD 29.97 Frame MP4 Foramt

  • javad490 you can try to decrease the Max GOP Size, say, to match your FPS value, in order to improve your seek performance. Keep in mind though that this will increase your file size.

    It's probably better to use VBR instead of CBR. I usually use CQP18 as I prefer to target quality rather than file size.

    AFAIK, GTX 1050 does not support b-frames for HEVC encoding, so you might want to stick to AVC with 3 b-frames instead.

    Your RC Lookahead is too high.

    Personally, I wouldn't use b-frames as references, especially for CQP encodes.

    3 Mal editiert, zuletzt von dr0 (24. Januar 2021 um 16:20)