API tools faq
paste
Guest User

Untitled

a guest
Mar 22nd, 2026
374
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 8.82 KB | None | 0 0
raw download clone embed print report
  1. Runtime Model Quant Test Size Speed Depth
  2. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 512 783.72 0
  3. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 1024 786.34 0
  4. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 2048 785.08 0
  5. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 4096 779.33 0
  6. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 8192 768.68 0
  7. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 16384 745.61 0
  8. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 32768 703.8 0
  9. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 65536 633.23 0
  10. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 128 103.33 0
  11. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 256 103.43 0
  12. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 512 103.33 0
  13. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 1024 103.04 0
  14. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 2048 102.85 0
  15. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 4096 102.47 0
  16. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 pp 512 708.58 0
  17. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 pp 1024 700.21 0
  18. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 pp 2048 694.58 0
  19. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 pp 4096 685.51 0
  20. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 pp 8192 670.28 0
  21. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 pp 16384 643.05 0
  22. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 pp 32768 593.8 0
  23. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 pp 65536 516.02 0
  24. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 tg 128 55.22 0
  25. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 tg 256 55.51 0
  26. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 tg 512 55.55 0
  27. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 tg 1024 54.72 0
  28. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 tg 2048 54.65 0
  29. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 tg 4096 54.47 0
  30. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 pp 512 201.14 0
  31. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 pp 1024 201.66 0
  32. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 pp 2048 199.42 0
  33. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 pp 4096 196.85 0
  34. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 pp 8192 193.61 0
  35. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 pp 16384 185.99 0
  36. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 pp 32768 173.76 0
  37. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 tg 128 26.4 0
  38. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 tg 256 26.58 0
  39. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 tg 512 26.31 0
  40. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 tg 1024 26.38 0
  41. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 tg 2048 26.28 0
  42. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 tg 4096 26.31 0
  43. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 pp 512 209.06 0
  44. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 pp 1024 208.65 0
  45. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 pp 2048 207.76 0
  46. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 pp 4096 205.83 0
  47. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 pp 8192 201.82 0
  48. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 pp 16384 193.99 0
  49. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 pp 32768 176.69 0
  50. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 tg 128 19.03 0
  51. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 tg 256 18.98 0
  52. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 tg 512 18.92 0
  53. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 tg 1024 18.89 0
  54. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 tg 2048 18.75 0
  55. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 tg 4096 18.67 0
  56. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 512 770.49 0
  57. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 1024 771.86 0
  58. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 2048 768.78 0
  59. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 4096 756.64 0
  60. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 8192 729.41 0
  61. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 16384 678.05 0
  62. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 32768 600.73 0
  63. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 65536 496.73 0
  64. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 128 104.58 0
  65. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 256 104.72 0
  66. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 512 104.62 0
  67. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 1024 103.74 0
  68. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 2048 103.09 0
  69. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 4096 102.25 0
  70. Vulkan Qwen3.5 9B Bartowski Q8_0 pp 512 871.17 0
  71. Vulkan Qwen3.5 9B Bartowski Q8_0 pp 1024 866.22 0
  72. Vulkan Qwen3.5 9B Bartowski Q8_0 pp 2048 851.2 0
  73. Vulkan Qwen3.5 9B Bartowski Q8_0 pp 4096 805.52 0
  74. Vulkan Qwen3.5 9B Bartowski Q8_0 pp 8192 727.07 0
  75. Vulkan Qwen3.5 9B Bartowski Q8_0 pp 16384 606.66 0
  76. Vulkan Qwen3.5 9B Bartowski Q8_0 pp 32768 447.76 0
  77. Vulkan Qwen3.5 9B Bartowski Q8_0 pp 65536 285.32 0
  78. Vulkan Qwen3.5 9B Bartowski Q8_0 tg 128 62.06 0
  79. Vulkan Qwen3.5 9B Bartowski Q8_0 tg 256 62.06 0
  80. Vulkan Qwen3.5 9B Bartowski Q8_0 tg 512 61.83 0
  81. Vulkan Qwen3.5 9B Bartowski Q8_0 tg 1024 61.57 0
  82. Vulkan Qwen3.5 9B Bartowski Q8_0 tg 2048 61.1 0
  83. Vulkan Qwen3.5 9B Bartowski Q8_0 tg 4096 60.39 0
  84. Vulkan Qwen3.5 122B Bartowski Q4_0 pp 512 185.38 0
  85. Vulkan Qwen3.5 122B Bartowski Q4_0 pp 1024 185.46 0
  86. Vulkan Qwen3.5 122B Bartowski Q4_0 pp 2048 183.47 0
  87. Vulkan Qwen3.5 122B Bartowski Q4_0 pp 4096 180.61 0
  88. Vulkan Qwen3.5 122B Bartowski Q4_0 pp 8192 175.06 0
  89. Vulkan Qwen3.5 122B Bartowski Q4_0 pp 16384 163.05 0
  90. Vulkan Qwen3.5 122B Bartowski Q4_0 pp 32768 143.66 0
  91. Vulkan Qwen3.5 122B Bartowski Q4_0 tg 128 20.07 0
  92. Vulkan Qwen3.5 122B Bartowski Q4_0 tg 256 19.93 0
  93. Vulkan Qwen3.5 122B Bartowski Q4_0 tg 512 19.94 0
  94. Vulkan Qwen3.5 122B Bartowski Q4_0 tg 1024 19.86 0
  95. Vulkan Qwen3.5 122B Bartowski Q4_0 tg 2048 19.69 0
  96. Vulkan Qwen3.5 122B Bartowski Q4_0 tg 4096 19.7 0
  97. Vulkan Qwen3.5 27B Bartowski Q8_0 pp 512 252.68 0
  98. Vulkan Qwen3.5 27B Bartowski Q8_0 pp 1024 250.68 0
  99. Vulkan Qwen3.5 27B Bartowski Q8_0 pp 2048 246.47 0
  100. Vulkan Qwen3.5 27B Bartowski Q8_0 pp 4096 233.48 0
  101. Vulkan Qwen3.5 27B Bartowski Q8_0 pp 8192 211.73 0
  102. Vulkan Qwen3.5 27B Bartowski Q8_0 pp 16384 175.4 0
  103. Vulkan Qwen3.5 27B Bartowski Q8_0 pp 32768 128.72 0
  104. Vulkan Qwen3.5 27B Bartowski Q8_0 tg 128 20.73 0
  105. Vulkan Qwen3.5 27B Bartowski Q8_0 tg 256 20.73 0
  106. Vulkan Qwen3.5 27B Bartowski Q8_0 tg 512 19.86 0
  107. Vulkan Qwen3.5 27B Bartowski Q8_0 tg 1024 19.52 0
  108. Vulkan Qwen3.5 27B Bartowski Q8_0 tg 2048 19.52 0
  109. Vulkan Qwen3.5 27B Bartowski Q8_0 tg 4096 19.02 0
  110. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 256 101.31 4096
  111. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 256 97.13 16384
  112. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 256 92.24 32768
  113. Vulkan Qwen3.5 9B Bartowski Q8_0 tg 256 60.37 4096
  114. Vulkan Qwen3.5 9B Bartowski Q8_0 tg 256 56.55 16384
  115. Vulkan Qwen3.5 9B Bartowski Q8_0 tg 256 53.59 32768
  116. Vulkan Qwen3.5 122B Bartowski Q4_0 tg 256 19.66 4096
  117. Vulkan Qwen3.5 122B Bartowski Q4_0 tg 256 19.05 16384
  118. Vulkan Qwen3.5 122B Bartowski Q4_0 tg 256 18.41 32768
  119. Vulkan Qwen3.5 27B Bartowski Q8_0 tg 256 20.43 4096
  120. Vulkan Qwen3.5 27B Bartowski Q8_0 tg 256 19.74 16384
  121. Vulkan Qwen3.5 27B Bartowski Q8_0 tg 256 18.69 32768
  122. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 512 724.62 4096
  123. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 512 602.03 16384
  124. Vulkan Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 512 489.11 32768
  125. Vulkan Qwen3.5 9B Bartowski Q8_0 pp 512 727.99 4096
  126. Vulkan Qwen3.5 9B Bartowski Q8_0 pp 512 432.2 16384
  127. Vulkan Qwen3.5 9B Bartowski Q8_0 pp 512 277.78 32768
  128. Vulkan Qwen3.5 122B Bartowski Q4_0 pp 512 172.84 4096
  129. Vulkan Qwen3.5 122B Bartowski Q4_0 pp 512 142.88 16384
  130. Vulkan Qwen3.5 122B Bartowski Q4_0 pp 512 113.16 32768
  131. Vulkan Qwen3.5 27B Bartowski Q8_0 pp 512 214.74 4096
  132. Vulkan Qwen3.5 27B Bartowski Q8_0 pp 512 127.44 16384
  133. Vulkan Qwen3.5 27B Bartowski Q8_0 pp 512 82.88 32768
  134. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 256 101.63 4096
  135. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 256 99.03 16384
  136. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M tg 256 95.87 32768
  137. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 tg 256 55.11 4096
  138. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 tg 256 52.79 16384
  139. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 tg 256 50.64 32768
  140. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 tg 256 25.86 4096
  141. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 tg 256 25.42 16384
  142. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 tg 256 24.65 32768
  143. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 tg 256 18.93 4096
  144. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 tg 256 17.85 16384
  145. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 tg 256 16.79 32768
  146. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 512 761.26 4096
  147. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 512 691.31 16384
  148. ROCm 7.13 Nemotron-Cascade-2 mradermacher il-Q5_K_M pp 512 625.66 32768
  149. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 pp 512 660.78 4096
  150. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 pp 512 585.29 16384
  151. ROCm 7.13 Qwen3.5 9B Bartowski Q8_0 pp 512 512.29 32768
  152. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 pp 512 192.8 4096
  153. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 pp 512 172.32 16384
  154. ROCm 7.13 Qwen3.5 122B Bartowski Q4_0 pp 512 153.16 32768
  155. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 pp 512 200.74 4096
  156. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 pp 512 179.76 16384
  157. ROCm 7.13 Qwen3.5 27B Bartowski Q8_0 pp 512 157.99 32768
  158.  
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!