if i understand you want to use the Nvidia NVENC, in this case it's not the question if CRF or VBR ist better because Nvidia NVENC ONLY support CBR, VBR and CQP !! Yes with software encoder it's CRF but this doesn't work with NVENC.
For good quality with NVENC (as i wrote) it's necessary to use the lastest Gen of GPU. That means your graphicard must have an GPU of minimum the 6th Gen. -> Turing TU10x/116 or Ampere.
If your card (GTX1050) do not have that, i would not recommend to use NVENC.
Turing or Ampere make a big step to higher quality und less datarate. Only with this GPU types you don't need software encoder at high bitrates.
Yeah, you're quite right.