Start here.
https://git.collinwebdesigns.de/oscar.krause/fastapi-dls
https://github.com/mbilker/vgpu_unlock-rs

Consumer cards can be unlocked with
https://github.com/VGPU-Community-Drivers/vGPU-Unlock-patcher

If you don't want to use nvidia-vgpu-util, you can pass the entire P100 to a single VM and then
partition it inside the guest OS using NVIDIA's software. However, this is less
efficient for multi-VM setups. It also meant that when for whatever reason it went downhill
we had to actually reboot the whole VM to un-fsck the GPU back to life.
Might have been bug, this was a couple of years ago I did this.
Funny thing is, money wasn't the problem. The company burned money
by the boatloads. The problem was, it wasn't acceptable that the performance was handled by a
third party's license server. NVIDIA said, LALALALA... so this became a thing.


Troubleshooting Common Issues

"No vGPU capable GPU found":
Ensure Above 4G Decoding is enabled in BIOS.
Check that nvidia-vgpu-mgr-dkms is loaded: lsmod | grep nvidia_vgpu.
Some older P100s require a specific firmware update <-- Crucial

Driver Version Mismatch:
Proxmox 8/9 uses newer kernels (6.x). Ensure your NVIDIA driver version supports the kernel.
Use apt install nvidia-driver from the non-free repo for compatibility.

Last time I did this was a couple of years ago, pretty sure

Last piece of advice:
I'm a guy on the internet, BE REALLY sure you understand what's going on.
Nvidia doesn't agree with this. (Oh noz) Really sure there is a
helper script for Proxmox that does it all for you, understand why it
isn't hosted by the helper scripts repo :)

nvidia-smi vgpu
nvtop
nvitop
lscpi

Are your friends.
Have fun !