API tools faq
paste
kaleb112494

Proxmox GPU Passthrough Research

kaleb112494
May 4th, 2021 (edited)
266
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 4.98 KB | None | 0 0
raw download clone embed print report
  1. Hardware
  2. Supermicro X8DTU-F
  3. Dual X5660
  4. 12 x 4GB DDR3 ECC Registered Memory
  5. Quadro K600 for testing, will be using a 1660 Super if I can get it to work
  6.  
  7. 201.conf
  8. agent: 1
  9. bootdisk: scsi0
  10. cores: 4
  11. cpu: kvm64,hidden=1
  12. ide0: local:iso/virtio-win-0.1.190-1.iso,media=cdrom,size=489986K
  13. ide2: local:iso/Windows20H2.iso,media=cdrom
  14. machine: q35
  15. memory: 8192
  16. name: Resolume
  17. net0: e1000=XX:XX:XX:19:33:CE,bridge=vmbr0,firewall=1
  18. numa: 0
  19. onboot: 1
  20. ostype: win10
  21. scsi0: local-lvm:vm-201-disk-0,size=60G,ssd=1
  22. scsihw: virtio-scsi-pci
  23. smbios1: uuid=xxxxxxxx-xxxx-xxxx-b584-f113be3df141
  24. sockets: 2
  25. vga: virtio
  26. vmgenid: xxxxxxxx-xxxx-xxxx-b6b4-5b1887fea1f3
  27.  
  28.  
  29. /etc/modules
  30. vfio
  31. vfio_iommu_type1
  32. vfio_pci
  33. VFIO_virqfd
  34.  
  35. /etc/default/grub snippet
  36. >GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on pcie_acs_override=downstream,multifunction video=efifb:eek:ff"
  37.  
  38. root@supermicro:~# find /sys/kernel/iommu_groups/ -type l/sys/kernel/iommu_groups/17/devices/0000:00:16.6
  39. /sys/kernel/iommu_groups/35/devices/0000:ff:03.4
  40. /sys/kernel/iommu_groups/35/devices/0000:ff:03.2
  41. /sys/kernel/iommu_groups/35/devices/0000:ff:03.0
  42. /sys/kernel/iommu_groups/35/devices/0000:ff:03.1
  43. /sys/kernel/iommu_groups/7/devices/0000:00:14.0
  44. /sys/kernel/iommu_groups/25/devices/0000:04:00.0 <---- this is the GPU and IOMMU group that it is in
  45.  
  46. dmesg | grep -e vfio
  47. [ 16.690787] vfio-pci 0000:04:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=none
  48. [ 17.974314] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  49. [ 96.586906] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  50. [ 397.915975] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  51. [ 566.967014] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  52. [ 610.308009] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  53. [ 672.697241] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  54. [ 710.465964] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  55. [ 729.538206] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  56. [ 1598.189897] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  57.  
  58. /etc/modprobe.d/vfio.conf - didn't exist, created it with "#thisisatest," did not change the outcome
  59.  
  60. >find /sys/kernel/iommu_groups/ -type l shows device in IOMMU Group 25
  61.  
  62. dmesg | grep 'remapping' OR dmesg | grep -e DMAR -e IOMMU - Both produce the same outcome
  63. [ 0.476130] DMAR-IR: This system BIOS has enabled interrupt remapping
  64. interrupt remapping is being disabled. Please
  65. [ 17.974314] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  66. [ 96.586906] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  67. [ 397.915975] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  68. [ 566.967014] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  69. [ 610.308009] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  70. [ 672.697241] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  71. [ 710.465964] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  72. [ 729.538206] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  73. [ 1598.189897] vfio_iommu_type1_attach_group: No interrupt remapping support. Use the module param "allow_unsafe_interrupts" to enable VFIO IOMMU support on this platform
  74.  
  75. Updated BIOS, IPMI firmware, and installed iucode-tool, which updated the microcode for the X5660's
  76.  
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!