Hi,
You've actually already discovered the important part yourself. Let me try to explain why it behaves the way it does, and answer your final question.
1. Why AMF replaces HLG with PQ and drops the matrix
This is a limitation of the AMD AMF HEVC encoder itself, not of Voukoder or your Scene setup. The color node in your Scene (range: tv, matrix: bt2020nc, primaries: bt2020, transfer: arib-std-b67) is correct — that's exactly what you want. But hevc_amf doesn't reliably write the VUI color signalling into the bitstream:
- It tends to hardcode/assume PQ (SMPTE ST 2084) for 10-bit BT.2020 HDR, which is why HLG comes out as PQ.
- It frequently omits the matrix coefficients (bt2020nc) altogether.
The reason it "just works" in the Voukoder Pro Transcoder is that a transcode copies the color metadata straight from the source and hands ffmpeg an already-tagged stream. When rendering from Vegas, Vegas feeds raw frames into Voukoder, so the color tagging has to be produced by the encoder — and AMF doesn't do it correctly. Changing the Vegas "Scene / Video Input" color params won't fix it because the problem is downstream at the AMF encode stage.
So this is not something you're doing wrong. AMF simply can't tag HLG properly here.
2. Your x265 approach is the correct fix
What you did is exactly right:
colorprim=bt2020:colormatrix=bt2020nc:transfer=arib-std-b67
Those three params write the VUI signalling explicitly into the stream, which is why the metadata now matches the original. arib-std-b67 is HLG, so that's correct. Adding level=5.1:profile=main10:tier=high to match the source's Main 10@L5.1@High is fine too (note the source is actually L5.1, as you found — L5 vs L5.1 only changes the declared level ceiling, it doesn't affect image quality).
One small note: you have both colorprim=... in the params string and the color values set in the Scene input node. That's fine — they're consistent — but the x265 param string is what ultimately guarantees the tags in the output.
3. Your actual question: is the rendered file "close to the original"?
A few things to separate here:
- Metadata: With the x265 params above, yes — your output carries the same color primaries / transfer / matrix as the source, so players will interpret HLG correctly and the colors will be right.
- Quality: With crf=15, preset=slow, profile=main10 (10-bit), you're encoding at very high quality — visually this will be effectively indistinguishable from the ~80 Mb/s source for archival/viewing. Understand that it is still a re-encode, not a lossless copy: the frames pass Vegas → (your project is 32-bit float, ACES, Rec.2020 HLG view transform) → Voukoder → x265. So it's a new generation, not a bit-for-bit copy of the original. For "archival + viewing" that's a perfectly reasonable tradeoff, and CRF 15 slow is more than enough.
- One thing worth checking: your Vegas project is set to full ACES pipeline (ACES 1.2, ACES2065-1, Rec.2020 HLG 1000 nits view transform). That's a real color transform, so the rendered pixels are the result of that pipeline, not the untouched camera pixels. If your goal is a faithful archive of the original look, consider whether you actually want ACES in the chain, or whether a simpler HLG (Rec.2020) project setup that passes the material through more directly is closer to your intent. Keep your render profile's YCbCr output at Limited to match the source (Limited/tv) — don't switch to Full, or the levels won't match the original.
Short version: AMF can't tag HLG correctly from a Vegas render — that's an encoder limitation, not your fault. Your x265 + transfer=arib-std-b67:colorprim=bt2020:colormatrix=bt2020nc route is the right way to get matching metadata, and at CRF 15 / slow / 10-bit the quality is excellent for archival, keeping in mind it's still a re-encode (and your ACES view transform does alter the pixels).
Hope that helps!