Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- | Model Filename / Variant | Size (GB) | K Quant | V Quant | Mean PPL (Q) | Mean KLD | Median KLD | Max KLD | 99.9% KLD | Same Top P (%) | Runtime (min) |
- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
- | Qwen3.8-27B-UD-Q4_K_M (unsloth) | 15.3 | q8_0 | q8_0 | 6.8237 ± 0.093 | 0.008847 ± 0.0002 | 0.003642 | 4.919496 | 0.297416 | 95.873 ± 0.110% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_M (unsloth) | 15.3 | f16 | f16 | 6.8269 ± 0.093 | 0.008875 ± 0.0002 | 0.003662 | 4.964757 | 0.299405 | 95.849 ± 0.110% | 0.73 |
- | Qwen3.8-27B-UD-Q4_K_M (unsloth) | 15.3 | q5_1 | q5_1 | 6.8287 ± 0.093 | 0.009371 ± 0.0002 | 0.003857 | 4.709406 | 0.298116 | 95.839 ± 0.111% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_M (unsloth) | 15.3 | q5_0 | q5_0 | 6.8258 ± 0.093 | 0.009451 ± 0.0002 | 0.003933 | 3.598356 | 0.324881 | 95.778 ± 0.111% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_M (unsloth) | 15.3 | q8_0 | q4_0 | 6.8314 ± 0.093 | 0.009873 ± 0.0002 | 0.004301 | 3.224432 | 0.325572 | 95.555 ± 0.114% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_M (unsloth) | 15.3 | q4_0 | q8_0 | 6.8266 ± 0.093 | 0.010067 ± 0.0003 | 0.004165 | 6.282758 | 0.357943 | 95.631 ± 0.113% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_M (unsloth) | 15.3 | q4_1 | q4_1 | 6.8325 ± 0.093 | 0.010451 ± 0.0002 | 0.004575 | 3.825402 | 0.319808 | 95.435 ± 0.116% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_M (unsloth) | 15.3 | iq4_nl | iq4_nl | 6.8338 ± 0.093 | 0.010565 ± 0.0001 | 0.004588 | 0.851124 | 0.345468 | 95.607 ± 0.113% | 1.79 |
- | Qwen3.8-27B-UD-Q4_K_M (unsloth) | 15.3 | q4_0 | q4_0 | 6.8321 ± 0.093 | 0.010928 ± 0.0002 | 0.004813 | 4.313780 | 0.353770 | 95.196 ± 0.118% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_S (unsloth) | 14.3 | f16 | f16 | 6.8272 ± 0.093 | 0.011700 ± 0.0003 | 0.004677 | 5.616367 | 0.441457 | 95.334 ± 0.117% | 0.7 |
- | Qwen3.8-27B-UD-Q4_K_S (unsloth) | 14.3 | q8_0 | q8_0 | 6.8253 ± 0.093 | 0.011705 ± 0.0002 | 0.004694 | 4.122599 | 0.450199 | 95.276 ± 0.117% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_S (unsloth) | 14.3 | q5_1 | q5_1 | 6.8308 ± 0.093 | 0.012038 ± 0.0002 | 0.004894 | 5.398950 | 0.432611 | 95.172 ± 0.119% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_S (unsloth) | 14.3 | q5_0 | q5_0 | 6.8267 ± 0.093 | 0.012196 ± 0.0003 | 0.004990 | 5.605931 | 0.445620 | 95.067 ± 0.120% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_S (unsloth) | 14.3 | q4_0 | q8_0 | 6.8273 ± 0.093 | 0.012634 ± 0.0002 | 0.005270 | 4.542372 | 0.459628 | 94.966 ± 0.121% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_S (unsloth) | 14.3 | q8_0 | q4_0 | 6.8365 ± 0.093 | 0.012764 ± 0.0003 | 0.005324 | 5.098486 | 0.487108 | 95.104 ± 0.119% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_S (unsloth) | 14.3 | q4_1 | q4_1 | 6.8349 ± 0.093 | 0.013172 ± 0.0003 | 0.005565 | 4.922796 | 0.458074 | 94.801 ± 0.123% | 0.65 |
- | Qwen3.8-27B-UD-Q4_K_S (unsloth) | 14.3 | iq4_nl | iq4_nl | 6.8357 ± 0.093 | 0.013415 ± 0.0003 | 0.005653 | 6.222702 | 0.452246 | 94.972 ± 0.121% | 1.79 |
- | Qwen3.8-27B-UD-Q4_K_S (unsloth) | 14.3 | q4_0 | q4_0 | 6.8416 ± 0.093 | 0.013975 ± 0.0003 | 0.005928 | 4.848670 | 0.524592 | 94.939 ± 0.121% | 0.65 |
- | Qwen3.8-27B-UD-IQ4_XS (unsloth) | 13.3 | f16 | f16 | 6.8606 ± 0.093 | 0.016597 ± 0.0002 | 0.007235 | 1.821994 | 0.515714 | 94.265 ± 0.129% | 0.68 |
- | Qwen3.8-27B-UD-IQ4_XS (unsloth) | 13.3 | q8_0 | q8_0 | 6.8583 ± 0.093 | 0.016610 ± 0.0002 | 0.007248 | 1.707722 | 0.563280 | 94.222 ± 0.129% | 0.64 |
- | Qwen3.8-27B-UD-IQ4_XS (unsloth) | 13.3 | q5_1 | q5_1 | 6.8592 ± 0.093 | 0.016903 ± 0.0002 | 0.007483 | 1.808558 | 0.537109 | 94.240 ± 0.129% | 0.63 |
- | Qwen3.8-27B-UD-IQ4_XS (unsloth) | 13.3 | q5_0 | q5_0 | 6.8676 ± 0.094 | 0.017230 ± 0.0003 | 0.007566 | 2.472012 | 0.603393 | 94.176 ± 0.130% | 0.63 |
- | Qwen3.8-27B-UD-IQ4_XS (unsloth) | 13.3 | q8_0 | q4_0 | 6.8659 ± 0.094 | 0.017485 ± 0.0002 | 0.007997 | 1.951297 | 0.569576 | 94.044 ± 0.131% | 0.63 |
- | Qwen3.8-27B-UD-IQ4_XS (unsloth) | 13.3 | q4_0 | q8_0 | 6.8609 ± 0.093 | 0.017855 ± 0.0003 | 0.007835 | 4.628562 | 0.575157 | 94.035 ± 0.131% | 0.63 |
- | Qwen3.8-27B-UD-IQ4_XS (unsloth) | 13.3 | iq4_nl | iq4_nl | 6.8601 ± 0.093 | 0.018234 ± 0.0003 | 0.008217 | 2.253756 | 0.571357 | 93.903 ± 0.132% | 1.78 |
- | Qwen3.8-27B-UD-IQ4_XS (unsloth) | 13.3 | q4_1 | q4_1 | 6.8682 ± 0.094 | 0.018363 ± 0.0003 | 0.008243 | 2.456636 | 0.603094 | 93.974 ± 0.132% | 0.63 |
- | Qwen3.8-27B-UD-IQ4_XS (unsloth) | 13.3 | q4_0 | q4_0 | 6.8688 ± 0.094 | 0.018690 ± 0.0003 | 0.008535 | 2.203364 | 0.551287 | 93.854 ± 0.133% | 0.63 |
- | Swift-1.5-Qwen3.8-27B-IQ4_XS (ukisai) | 14.4 | q8_0 | q8_0 | 6.9439 ± 0.097 | 0.020848 ± 0.0004 | 0.010089 | 6.132513 | 0.574327 | 94.225 ± 0.129% | 0.61 |
- | Swift-1.5-Qwen3.8-27B-IQ4_XS (ukisai) | 14.4 | f16 | f16 | 6.9424 ± 0.097 | 0.020889 ± 0.0004 | 0.010112 | 6.248155 | 0.570804 | 94.216 ± 0.129% | 0.69 |
- | Swift-1.5-Qwen3.8-27B-IQ4_XS (ukisai) | 14.4 | q5_1 | q5_1 | 6.9432 ± 0.097 | 0.021214 ± 0.0003 | 0.010311 | 5.347429 | 0.618490 | 94.179 ± 0.130% | 0.61 |
- | Swift-1.5-Qwen3.8-27B-IQ4_XS (ukisai) | 14.4 | q5_0 | q5_0 | 6.9426 ± 0.097 | 0.021351 ± 0.0004 | 0.010398 | 7.281919 | 0.575734 | 94.084 ± 0.131% | 0.61 |
- | Swift-1.5-Qwen3.8-27B-IQ4_XS (ukisai) | 14.4 | q8_0 | q4_0 | 6.9533 ± 0.097 | 0.021765 ± 0.0004 | 0.010689 | 6.475499 | 0.580621 | 94.017 ± 0.131% | 0.61 |
- | Swift-1.5-Qwen3.8-27B-IQ4_XS (ukisai) | 14.4 | q4_0 | q8_0 | 6.9497 ± 0.097 | 0.021838 ± 0.0004 | 0.010691 | 7.823622 | 0.627416 | 94.047 ± 0.131% | 0.61 |
- | Swift-1.5-Qwen3.8-27B-IQ4_XS (ukisai) | 14.4 | q4_1 | q4_1 | 6.9582 ± 0.097 | 0.022211 ± 0.0003 | 0.011067 | 5.850184 | 0.604349 | 93.925 ± 0.132% | 0.61 |
- | Swift-1.5-Qwen3.8-27B-IQ4_XS (ukisai) | 14.4 | iq4_nl | iq4_nl | 6.9483 ± 0.097 | 0.022266 ± 0.0004 | 0.011093 | 6.576514 | 0.594937 | 93.958 ± 0.132% | 1.76 |
- | Swift-1.5-Qwen3.8-27B-IQ4_XS (ukisai) | 14.4 | q4_0 | q4_0 | 6.9553 ± 0.097 | 0.022686 ± 0.0004 | 0.011223 | 7.068694 | 0.603566 | 93.836 ± 0.133% | 0.61 |
- | Qwen3.8-27B-UD-Q3_K_XL (unsloth) | 12.2 | f16 | f16 | 6.9260 ± 0.095 | 0.024517 ± 0.0004 | 0.010544 | 6.592310 | 0.849271 | 93.116 ± 0.140% | 0.7 |
- | Qwen3.8-27B-UD-Q3_K_XL (unsloth) | 12.2 | q8_0 | q8_0 | 6.9257 ± 0.095 | 0.024568 ± 0.0004 | 0.010501 | 5.994165 | 0.867886 | 93.097 ± 0.140% | 0.64 |
- | Qwen3.8-27B-UD-Q3_K_XL (unsloth) | 12.2 | q5_1 | q5_1 | 6.9252 ± 0.095 | 0.024999 ± 0.0004 | 0.010776 | 5.987267 | 0.847112 | 93.042 ± 0.141% | 0.65 |
- | Qwen3.8-27B-UD-Q3_K_XL (unsloth) | 12.2 | q5_0 | q5_0 | 6.9305 ± 0.095 | 0.025019 ± 0.0004 | 0.010873 | 5.504411 | 0.818684 | 92.987 ± 0.141% | 0.65 |
- | Qwen3.8-27B-UD-Q3_K_XL (unsloth) | 12.2 | q8_0 | q4_0 | 6.9327 ± 0.095 | 0.025592 ± 0.0004 | 0.011134 | 6.294165 | 0.829699 | 92.926 ± 0.142% | 0.64 |
- | Qwen3.8-27B-UD-Q3_K_XL (unsloth) | 12.2 | q4_0 | q8_0 | 6.9370 ± 0.095 | 0.025678 ± 0.0004 | 0.011117 | 6.504186 | 0.845478 | 93.079 ± 0.140% | 0.66 |
- | Qwen3.8-27B-UD-Q3_K_XL (unsloth) | 12.2 | q4_1 | q4_1 | 6.9312 ± 0.095 | 0.026071 ± 0.0004 | 0.011502 | 3.887645 | 0.843956 | 92.858 ± 0.143% | 0.65 |
- | Qwen3.8-27B-UD-Q3_K_XL (unsloth) | 12.2 | iq4_nl | iq4_nl | 6.9278 ± 0.095 | 0.026320 ± 0.0004 | 0.011609 | 6.978329 | 0.841281 | 92.865 ± 0.142% | 1.85 |
- | Qwen3.8-27B-UD-Q3_K_XL (unsloth) | 12.2 | q4_0 | q4_0 | 6.9385 ± 0.095 | 0.026493 ± 0.0004 | 0.011785 | 2.580674 | 0.879806 | 92.819 ± 0.143% | 0.66 |
- | Qwen3.8-27B-IQ4_XS_4BPW (Bucoid) | 13 | q8_0 | q8_0 | 6.9347 ± 0.095 | 0.029712 ± 0.0005 | 0.015375 | 8.060397 | 0.953367 | 92.105 ± 0.149% | 0.63 |
- | Qwen3.8-27B-IQ4_XS_4BPW (Bucoid) | 13 | f16 | f16 | 6.9327 ± 0.095 | 0.029805 ± 0.0005 | 0.015384 | 8.646362 | 0.906947 | 92.028 ± 0.150% | 0.67 |
- | Qwen3.8-27B-IQ4_XS_4BPW (Bucoid) | 13 | q5_1 | q5_1 | 6.9335 ± 0.095 | 0.030062 ± 0.0005 | 0.015598 | 8.578476 | 0.880405 | 91.979 ± 0.150% | 0.63 |
- | Qwen3.8-27B-IQ4_XS_4BPW (Bucoid) | 13 | q5_0 | q5_0 | 6.9373 ± 0.095 | 0.030320 ± 0.0005 | 0.015510 | 10.085545 | 0.912647 | 91.918 ± 0.151% | 0.64 |
- | Qwen3.8-27B-IQ4_XS_4BPW (Bucoid) | 13 | q8_0 | q4_0 | 6.9398 ± 0.095 | 0.030760 ± 0.0005 | 0.016009 | 8.405207 | 0.935106 | 91.939 ± 0.151% | 0.62 |
- | Qwen3.8-27B-IQ4_XS_4BPW (Bucoid) | 13 | q4_0 | q8_0 | 6.9433 ± 0.095 | 0.030876 ± 0.0005 | 0.015937 | 6.673501 | 0.914148 | 91.857 ± 0.151% | 0.64 |
- | Qwen3.8-27B-IQ4_XS_4BPW (Bucoid) | 13 | iq4_nl | iq4_nl | 6.9355 ± 0.095 | 0.031412 ± 0.0005 | 0.016296 | 8.992964 | 0.941713 | 91.725 ± 0.152% | 1.82 |
- | Qwen3.8-27B-IQ4_XS_4BPW (Bucoid) | 13 | q4_1 | q4_1 | 6.9474 ± 0.095 | 0.031428 ± 0.0005 | 0.016327 | 8.724589 | 0.953107 | 91.710 ± 0.153% | 0.64 |
- | Qwen3.8-27B-IQ4_XS_4BPW (Bucoid) | 13 | q4_0 | q4_0 | 6.9503 ± 0.095 | 0.031927 ± 0.0005 | 0.016582 | 7.906580 | 0.966220 | 91.771 ± 0.152% | 0.63 |
- | Qwen3.8-27B-ZB4.00-MIN-v5.1-IQ4_XS (tooltd) | 12.7 | f16 | f16 | 6.9654 ± 0.096 | 0.031962 ± 0.0005 | 0.013171 | 7.731379 | 1.083164 | 92.485 ± 0.146% | 0.62 |
- | Qwen3.8-27B-ZB4.00-MIN-v5.1-IQ4_XS (tooltd) | 12.7 | q8_0 | q8_0 | 6.9623 ± 0.096 | 0.032024 ± 0.0005 | 0.013194 | 7.337140 | 1.089844 | 92.500 ± 0.146% | 0.62 |
- | Qwen3.8-27B-ZB4.00-MIN-v5.1-IQ4_XS (tooltd) | 12.7 | q5_1 | q5_1 | 6.9665 ± 0.096 | 0.032373 ± 0.0005 | 0.013355 | 7.018212 | 1.130413 | 92.488 ± 0.146% | 0.62 |
- | Qwen3.8-27B-ZB4.00-MIN-v5.1-IQ4_XS (tooltd) | 12.7 | q5_0 | q5_0 | 6.9702 ± 0.096 | 0.032527 ± 0.0005 | 0.013443 | 6.892870 | 1.097103 | 92.359 ± 0.147% | 0.62 |
- | Qwen3.8-27B-ZB4.00-MIN-v5.1-IQ4_XS (tooltd) | 12.7 | q4_0 | q8_0 | 6.9700 ± 0.096 | 0.032848 ± 0.0005 | 0.013705 | 6.674183 | 1.077957 | 92.387 ± 0.147% | 0.62 |
- | Qwen3.8-27B-ZB4.00-MIN-v5.1-IQ4_XS (tooltd) | 12.7 | q8_0 | q4_0 | 6.9702 ± 0.096 | 0.032918 ± 0.0005 | 0.013871 | 6.800940 | 1.135530 | 92.420 ± 0.147% | 0.62 |
- | Qwen3.8-27B-ZB4.00-MIN-v5.1-IQ4_XS (tooltd) | 12.7 | q4_1 | q4_1 | 6.9774 ± 0.096 | 0.033570 ± 0.0005 | 0.014213 | 6.977862 | 1.158631 | 92.255 ± 0.148% | 0.62 |
- | Qwen3.8-27B-ZB4.00-MIN-v5.1-IQ4_XS (tooltd) | 12.7 | iq4_nl | iq4_nl | 6.9698 ± 0.096 | 0.033868 ± 0.0005 | 0.014209 | 6.716412 | 1.072559 | 92.111 ± 0.149% | 1.79 |
- | Qwen3.8-27B-ZB4.00-MIN-v5.1-IQ4_XS (tooltd) | 12.7 | q4_0 | q4_0 | 6.9774 ± 0.096 | 0.034114 ± 0.0005 | 0.014383 | 7.182491 | 1.156909 | 92.154 ± 0.149% | 0.62 |
- | Qwen3.8-27B-UD-IQ3_S (unsloth) | 11.2 | q8_0 | q8_0 | 6.9347 ± 0.095 | 0.036577 ± 0.0005 | 0.015704 | 4.273646 | 1.189303 | 91.572 ± 0.154% | 0.67 |
- | Qwen3.8-27B-UD-IQ3_S (unsloth) | 11.2 | f16 | f16 | 6.9319 ± 0.095 | 0.036594 ± 0.0005 | 0.015673 | 5.080226 | 1.188518 | 91.700 ± 0.153% | 0.7 |
- | Qwen3.8-27B-UD-IQ3_S (unsloth) | 11.2 | q5_0 | q5_0 | 6.9403 ± 0.095 | 0.037047 ± 0.0005 | 0.016019 | 5.577809 | 1.172827 | 91.513 ± 0.154% | 0.66 |
- | Qwen3.8-27B-UD-IQ3_S (unsloth) | 11.2 | q5_1 | q5_1 | 6.9347 ± 0.095 | 0.037160 ± 0.0005 | 0.015858 | 4.464072 | 1.166470 | 91.562 ± 0.154% | 0.67 |
- | Qwen3.8-27B-UD-IQ3_S (unsloth) | 11.2 | q4_0 | q8_0 | 6.9447 ± 0.095 | 0.037497 ± 0.0005 | 0.016256 | 4.038139 | 1.223980 | 91.504 ± 0.154% | 0.67 |
- | Qwen3.8-27B-UD-IQ3_S (unsloth) | 11.2 | q8_0 | q4_0 | 6.9464 ± 0.095 | 0.037712 ± 0.0006 | 0.016217 | 5.804875 | 1.220384 | 91.483 ± 0.155% | 0.67 |
- | Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-NEO-LOW-MTP-IQ4_XS (DavidAU) | 14.3 | f16 | f16 | 6.7564 ± 0.091 | 0.037722 ± 0.0007 | 0.018418 | 10.567255 | 1.048534 | 91.608 ± 0.153% | 0.68 |
- | Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-NEO-LOW-MTP-IQ4_XS (DavidAU) | 14.3 | q8_0 | q8_0 | 6.7574 ± 0.091 | 0.037759 ± 0.0007 | 0.018496 | 10.622008 | 1.075391 | 91.667 ± 0.153% | 0.63 |
- | Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-NEO-LOW-MTP-IQ4_XS (DavidAU) | 14.3 | q5_1 | q5_1 | 6.7612 ± 0.091 | 0.037954 ± 0.0007 | 0.018649 | 10.574921 | 1.061410 | 91.566 ± 0.154% | 0.62 |
- | Qwen3.8-27B-UD-IQ3_S (unsloth) | 11.2 | iq4_nl | iq4_nl | 6.9439 ± 0.095 | 0.038099 ± 0.0005 | 0.016639 | 6.721085 | 1.215010 | 91.486 ± 0.154% | 1.84 |
- | Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-NEO-LOW-MTP-IQ4_XS (DavidAU) | 14.3 | q5_0 | q5_0 | 6.7600 ± 0.091 | 0.038254 ± 0.0007 | 0.018791 | 10.633440 | 1.119017 | 91.608 ± 0.153% | 0.62 |
- | Qwen3.8-27B-UD-IQ3_S (unsloth) | 11.2 | q4_1 | q4_1 | 6.9502 ± 0.095 | 0.038320 ± 0.0006 | 0.016695 | 6.031168 | 1.315532 | 91.474 ± 0.155% | 0.66 |
- | Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-NEO-LOW-MTP-IQ4_XS (DavidAU) | 14.3 | q4_0 | q8_0 | 6.7607 ± 0.091 | 0.038555 ± 0.0007 | 0.019110 | 10.572721 | 1.118265 | 91.630 ± 0.153% | 0.64 |
- | Qwen3.8-27B-UD-IQ3_S (unsloth) | 11.2 | q4_0 | q4_0 | 6.9515 ± 0.095 | 0.038614 ± 0.0006 | 0.016888 | 4.464805 | 1.228502 | 91.357 ± 0.156% | 0.66 |
- | Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-NEO-LOW-MTP-IQ4_XS (DavidAU) | 14.3 | q8_0 | q4_0 | 6.7639 ± 0.091 | 0.038618 ± 0.0007 | 0.019151 | 10.671036 | 1.090172 | 91.566 ± 0.154% | 0.62 |
- | Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-NEO-LOW-MTP-IQ4_XS (DavidAU) | 14.3 | iq4_nl | iq4_nl | 6.7633 ± 0.091 | 0.039210 ± 0.0007 | 0.019442 | 10.620037 | 1.090456 | 91.385 ± 0.155% | 1.79 |
- | Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-NEO-LOW-MTP-IQ4_XS (DavidAU) | 14.3 | q4_1 | q4_1 | 6.7661 ± 0.091 | 0.039256 ± 0.0007 | 0.019481 | 10.639537 | 1.096374 | 91.474 ± 0.155% | 0.62 |
- | Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-NEO-LOW-MTP-IQ4_XS (DavidAU) | 14.3 | q4_0 | q4_0 | 6.7701 ± 0.091 | 0.039640 ± 0.0007 | 0.019748 | 10.592617 | 1.108622 | 91.278 ± 0.156% | 0.63 |
- | Swift-1.5-Qwen3.8-27B-Q3_K_L (ukisai) | 13.2 | f16 | f16 | 7.0711 ± 0.099 | 0.046287 ± 0.0006 | 0.022405 | 3.585678 | 1.379588 | 90.803 ± 0.160% | 0.85 |
- | Swift-1.5-Qwen3.8-27B-Q3_K_L (ukisai) | 13.2 | q8_0 | q8_0 | 7.0751 ± 0.099 | 0.046403 ± 0.0006 | 0.022493 | 3.535374 | 1.415447 | 90.861 ± 0.160% | 0.77 |
- | Swift-1.5-Qwen3.8-27B-Q3_K_L (ukisai) | 13.2 | q5_1 | q5_1 | 7.0718 ± 0.099 | 0.046954 ± 0.0006 | 0.022673 | 3.921165 | 1.507218 | 90.833 ± 0.160% | 0.77 |
- | Swift-1.5-Qwen3.8-27B-Q3_K_L (ukisai) | 13.2 | q5_0 | q5_0 | 7.0709 ± 0.099 | 0.046965 ± 0.0006 | 0.022872 | 3.677389 | 1.492923 | 90.741 ± 0.160% | 0.77 |
- | Swift-1.5-Qwen3.8-27B-Q3_K_L (ukisai) | 13.2 | q4_0 | q8_0 | 7.0760 ± 0.099 | 0.047175 ± 0.0006 | 0.022935 | 6.127980 | 1.367599 | 90.790 ± 0.160% | 0.76 |
- | Qwen3.8-27B-GSQ-RCO-BuffedMod-IQ3_S_XL-mtp-IQ4XS (tooltd) | 11.5 | q8_0 | q8_0 | 6.9085 ± 0.094 | 0.047297 ± 0.0008 | 0.018667 | 10.492402 | 1.589791 | 90.778 ± 0.160% | 0.66 |
- | Qwen3.8-27B-GSQ-RCO-BuffedMod-IQ3_S_XL-mtp-IQ4XS (tooltd) | 11.5 | f16 | f16 | 6.9064 ± 0.094 | 0.047339 ± 0.0008 | 0.018592 | 10.694853 | 1.592370 | 90.757 ± 0.160% | 0.7 |
- | Swift-1.5-Qwen3.8-27B-Q3_K_L (ukisai) | 13.2 | q8_0 | q4_0 | 7.0767 ± 0.099 | 0.047376 ± 0.0006 | 0.023065 | 5.058563 | 1.349689 | 90.634 ± 0.161% | 0.77 |
- | Qwen3.8-27B-APEX-I-Mini (mudler) | 13 | q8_0 | q8_0 | 7.0466 ± 0.097 | 0.047411 ± 0.0008 | 0.020212 | 7.606431 | 1.622219 | 90.610 ± 0.161% | 0.72 |
- | Qwen3.8-27B-APEX-I-Mini (mudler) | 13 | f16 | f16 | 7.0443 ± 0.097 | 0.047617 ± 0.0008 | 0.020063 | 8.187284 | 1.656135 | 90.512 ± 0.162% | 0.77 |
- | Qwen3.8-27B-GSQ-RCO-BuffedMod-IQ3_S_XL-mtp-IQ4XS (tooltd) | 11.5 | q5_1 | q5_1 | 6.9112 ± 0.094 | 0.047687 ± 0.0008 | 0.018899 | 10.637869 | 1.490795 | 90.631 ± 0.161% | 0.66 |
- | Qwen3.8-27B-GSQ-RCO-BuffedMod-IQ3_S_XL-mtp-IQ4XS (tooltd) | 11.5 | q5_0 | q5_0 | 6.9107 ± 0.094 | 0.047910 ± 0.0008 | 0.018817 | 10.532406 | 1.576718 | 90.766 ± 0.160% | 0.66 |
- | Swift-1.5-Qwen3.8-27B-Q3_K_L (ukisai) | 13.2 | iq4_nl | iq4_nl | 7.0786 ± 0.099 | 0.047913 ± 0.0006 | 0.023258 | 3.927384 | 1.490171 | 90.689 ± 0.161% | 2.22 |
- | Qwen3.8-27B-APEX-I-Mini (mudler) | 13 | q5_0 | q5_0 | 7.0498 ± 0.097 | 0.047948 ± 0.0008 | 0.020304 | 7.552265 | 1.646817 | 90.631 ± 0.161% | 0.72 |
- | Swift-1.5-Qwen3.8-27B-Q3_K_L (ukisai) | 13.2 | q4_0 | q4_0 | 7.0775 ± 0.099 | 0.047978 ± 0.0006 | 0.023488 | 4.504662 | 1.435362 | 90.646 ± 0.161% | 0.76 |
- | Swift-1.5-Qwen3.8-27B-Q3_K_L (ukisai) | 13.2 | q4_1 | q4_1 | 7.0789 ± 0.099 | 0.047988 ± 0.0006 | 0.023487 | 6.769585 | 1.471775 | 90.613 ± 0.161% | 0.77 |
- | Qwen3.8-27B-APEX-I-Mini (mudler) | 13 | q5_1 | q5_1 | 7.0405 ± 0.097 | 0.048003 ± 0.0008 | 0.020395 | 9.263995 | 1.630491 | 90.551 ± 0.162% | 0.72 |
- | Qwen3.8-27B-GSQ-RCO-BuffedMod-IQ3_S_XL-mtp-IQ4XS (tooltd) | 11.5 | q8_0 | q4_0 | 6.9111 ± 0.094 | 0.048050 ± 0.0008 | 0.019249 | 10.078137 | 1.563746 | 90.616 ± 0.161% | 0.66 |
- | Qwen3.8-27B-GSQ-RCO-BuffedMod-IQ3_S_XL-mtp-IQ4XS (tooltd) | 11.5 | q4_0 | q8_0 | 6.9131 ± 0.094 | 0.048118 ± 0.0008 | 0.019054 | 10.419346 | 1.582051 | 90.628 ± 0.161% | 0.66 |
- | Qwen3.8-27B-APEX-I-Mini (mudler) | 13 | q8_0 | q4_0 | 7.0513 ± 0.097 | 0.048347 ± 0.0008 | 0.020696 | 8.839714 | 1.755560 | 90.484 ± 0.162% | 0.72 |
- | Qwen3.8-27B-APEX-I-Mini (mudler) | 13 | q4_0 | q8_0 | 7.0501 ± 0.097 | 0.048388 ± 0.0008 | 0.020654 | 8.146633 | 1.711444 | 90.395 ± 0.163% | 0.72 |
- | Qwen3.8-27B-GSQ-RCO-BuffedMod-IQ3_S_XL-mtp-IQ4XS (tooltd) | 11.5 | q4_0 | q4_0 | 6.9175 ± 0.094 | 0.048678 ± 0.0008 | 0.019651 | 10.125332 | 1.563393 | 90.591 ± 0.162% | 0.66 |
- | Qwen3.8-27B-GSQ-RCO-BuffedMod-IQ3_S_XL-mtp-IQ4XS (tooltd) | 11.5 | q4_1 | q4_1 | 6.9138 ± 0.094 | 0.048756 ± 0.0008 | 0.019571 | 10.644201 | 1.566374 | 90.588 ± 0.162% | 0.66 |
- | Qwen3.8-27B-APEX-I-Mini (mudler) | 13 | q4_1 | q4_1 | 7.0543 ± 0.097 | 0.048781 ± 0.0008 | 0.021065 | 8.487473 | 1.652710 | 90.499 ± 0.162% | 0.72 |
- | Qwen3.8-27B-APEX-I-Mini (mudler) | 13 | iq4_nl | iq4_nl | 7.0471 ± 0.097 | 0.048790 ± 0.0008 | 0.021070 | 7.509651 | 1.689672 | 90.450 ± 0.163% | 1.9 |
- | Qwen3.8-27B-GSQ-RCO-BuffedMod-IQ3_S_XL-mtp-IQ4XS (tooltd) | 11.5 | iq4_nl | iq4_nl | 6.9192 ± 0.094 | 0.048953 ± 0.0008 | 0.019480 | 10.653313 | 1.634551 | 90.545 ± 0.162% | 1.81 |
- | Qwen3.8-27B-APEX-I-Mini (mudler) | 13 | q4_0 | q4_0 | 7.0552 ± 0.097 | 0.049142 ± 0.0008 | 0.021240 | 8.091666 | 1.686665 | 90.334 ± 0.164% | 0.72 |
- | Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ISTA-DASLab) | 11.3 | q8_0 | q8_0 | 6.9408 ± 0.094 | 0.051023 ± 0.0008 | 0.022533 | 10.509739 | 1.579878 | 89.838 ± 0.167% | 0.66 |
- | Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ISTA-DASLab) | 11.3 | f16 | f16 | 6.9385 ± 0.094 | 0.051059 ± 0.0008 | 0.022473 | 10.717685 | 1.548342 | 89.853 ± 0.167% | 0.7 |
- | Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ISTA-DASLab) | 11.3 | q5_1 | q5_1 | 6.9437 ± 0.095 | 0.051413 ± 0.0008 | 0.022822 | 10.652600 | 1.503427 | 89.779 ± 0.168% | 0.66 |
- | Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ISTA-DASLab) | 11.3 | q5_0 | q5_0 | 6.9425 ± 0.094 | 0.051632 ± 0.0008 | 0.022894 | 10.553084 | 1.583453 | 89.770 ± 0.168% | 0.66 |
- | Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ISTA-DASLab) | 11.3 | q8_0 | q4_0 | 6.9430 ± 0.094 | 0.051740 ± 0.0008 | 0.023049 | 10.098853 | 1.538702 | 89.724 ± 0.168% | 0.66 |
- | Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ISTA-DASLab) | 11.3 | q4_0 | q8_0 | 6.9451 ± 0.095 | 0.051844 ± 0.0008 | 0.023067 | 10.443992 | 1.544394 | 89.755 ± 0.168% | 0.66 |
- | Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ISTA-DASLab) | 11.3 | q4_0 | q4_0 | 6.9492 ± 0.095 | 0.052384 ± 0.0008 | 0.023645 | 10.150134 | 1.530442 | 89.749 ± 0.168% | 0.66 |
- | Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ISTA-DASLab) | 11.3 | q4_1 | q4_1 | 6.9461 ± 0.095 | 0.052467 ± 0.0008 | 0.023512 | 10.658152 | 1.555273 | 89.773 ± 0.168% | 0.66 |
- | Qwen3.8-27B-i1-IQ4_XS-GGUF-Smaller (jrell) | 12.6 | q8_0 | q8_0 | 7.0911 ± 0.095 | 0.052485 ± 0.0007 | 0.026318 | 5.937257 | 1.636172 | 90.254 ± 0.164% | 0.66 |
- | Qwen3.8-27B-i1-IQ4_XS-GGUF-Smaller (jrell) | 12.6 | f16 | f16 | 7.0926 ± 0.095 | 0.052495 ± 0.0007 | 0.026388 | 5.896824 | 1.605479 | 90.245 ± 0.164% | 0.71 |
- | Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ISTA-DASLab) | 11.3 | iq4_nl | iq4_nl | 6.9517 ± 0.095 | 0.052668 ± 0.0008 | 0.023418 | 10.697522 | 1.596355 | 89.577 ± 0.169% | 1.82 |
- | Qwen3.8-27B-i1-IQ4_XS-GGUF-Smaller (jrell) | 12.6 | q5_0 | q5_0 | 7.0994 ± 0.096 | 0.052739 ± 0.0007 | 0.026578 | 6.150114 | 1.565084 | 90.147 ± 0.165% | 0.65 |
- | Qwen3.8-27B-i1-IQ4_XS-GGUF-Smaller (jrell) | 12.6 | q5_1 | q5_1 | 7.0951 ± 0.095 | 0.052844 ± 0.0007 | 0.026416 | 5.986764 | 1.628285 | 90.162 ± 0.165% | 0.65 |
- | Qwen3.8-27B-i1-IQ4_XS-GGUF-Smaller (jrell) | 12.6 | q4_0 | q8_0 | 7.0962 ± 0.096 | 0.053376 ± 0.0007 | 0.026860 | 6.264628 | 1.549208 | 90.052 ± 0.166% | 0.65 |
- | Qwen3.8-27B-i1-IQ4_XS-GGUF-Smaller (jrell) | 12.6 | q8_0 | q4_0 | 7.0971 ± 0.095 | 0.053607 ± 0.0007 | 0.027084 | 6.131801 | 1.665811 | 90.119 ± 0.165% | 0.65 |
- | Qwen3.8-27B-i1-IQ4_XS-GGUF-Smaller (jrell) | 12.6 | iq4_nl | iq4_nl | 7.1005 ± 0.096 | 0.053972 ± 0.0007 | 0.027417 | 6.544214 | 1.633110 | 89.991 ± 0.166% | 1.83 |
- | Qwen3.8-27B-i1-IQ4_XS-GGUF-Smaller (jrell) | 12.6 | q4_1 | q4_1 | 7.0986 ± 0.096 | 0.054011 ± 0.0007 | 0.027122 | 7.432982 | 1.683128 | 90.178 ± 0.165% | 0.65 |
- | Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ukisai) | 11.3 | f16 | f16 | 7.1064 ± 0.099 | 0.054119 ± 0.0007 | 0.027153 | 5.949461 | 1.385570 | 89.789 ± 0.168% | 0.7 |
- | Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ukisai) | 11.3 | q8_0 | q8_0 | 7.1076 ± 0.099 | 0.054234 ± 0.0007 | 0.027072 | 4.875017 | 1.443708 | 89.789 ± 0.168% | 0.66 |
- | Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ukisai) | 11.3 | q5_1 | q5_1 | 7.1073 ± 0.099 | 0.054300 ± 0.0007 | 0.027424 | 4.621498 | 1.374283 | 89.782 ± 0.168% | 0.66 |
- | Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ukisai) | 11.3 | q5_0 | q5_0 | 7.1108 ± 0.099 | 0.054541 ± 0.0007 | 0.027261 | 4.832465 | 1.377615 | 89.746 ± 0.168% | 0.66 |
- | Qwen3.8-27B-i1-IQ4_XS-GGUF-Smaller (jrell) | 12.6 | q4_0 | q4_0 | 7.1019 ± 0.096 | 0.054694 ± 0.0007 | 0.027801 | 7.018937 | 1.614090 | 89.881 ± 0.167% | 0.65 |
- | Qwen3.8-27B-UD-IQ3_XXS (unsloth) | 10.2 | q8_0 | q8_0 | 7.0616 ± 0.097 | 0.054772 ± 0.0007 | 0.025322 | 5.754051 | 1.798853 | 89.412 ± 0.170% | 0.66 |
- | Qwen3.8-27B-UD-IQ3_XXS (unsloth) | 10.2 | f16 | f16 | 7.0624 ± 0.097 | 0.054823 ± 0.0007 | 0.025359 | 5.734837 | 1.797484 | 89.482 ± 0.170% | 0.71 |
- | Qwen3.8-27B-UD-IQ3_XXS (unsloth) | 10.2 | q5_1 | q5_1 | 7.0602 ± 0.097 | 0.054951 ± 0.0007 | 0.025497 | 5.757519 | 1.724980 | 89.421 ± 0.170% | 0.66 |
- | Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ukisai) | 11.3 | q8_0 | q4_0 | 7.1124 ± 0.099 | 0.055151 ± 0.0007 | 0.027701 | 4.581676 | 1.448943 | 89.666 ± 0.168% | 0.66 |
- | Qwen3.8-27B-UD-IQ3_XXS (unsloth) | 10.2 | q5_0 | q5_0 | 7.0613 ± 0.097 | 0.055197 ± 0.0007 | 0.025665 | 5.718489 | 1.734449 | 89.473 ± 0.170% | 0.66 |
- | Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ukisai) | 11.3 | iq4_nl | iq4_nl | 7.1165 ± 0.099 | 0.055402 ± 0.0007 | 0.027944 | 4.629771 | 1.359403 | 89.691 ± 0.168% | 1.81 |
- | Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ukisai) | 11.3 | q4_0 | q8_0 | 7.1161 ± 0.100 | 0.055484 ± 0.0007 | 0.027767 | 6.169522 | 1.409552 | 89.605 ± 0.169% | 0.66 |
- | Qwen3.8-27B-UD-IQ3_XXS (unsloth) | 10.2 | q4_0 | q8_0 | 7.0614 ± 0.097 | 0.055759 ± 0.0007 | 0.025917 | 5.576365 | 1.819632 | 89.445 ± 0.170% | 0.66 |
- | Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ukisai) | 11.3 | q4_1 | q4_1 | 7.1159 ± 0.100 | 0.055810 ± 0.0007 | 0.028049 | 4.740774 | 1.438216 | 89.688 ± 0.168% | 0.66 |
- | Qwen3.8-27B-UD-IQ3_XXS (unsloth) | 10.2 | q8_0 | q4_0 | 7.0687 ± 0.097 | 0.055907 ± 0.0007 | 0.026077 | 5.560360 | 1.716689 | 89.344 ± 0.171% | 0.66 |
- | Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp (ukisai) | 11.3 | q4_0 | q4_0 | 7.1182 ± 0.100 | 0.056382 ± 0.0007 | 0.028362 | 4.286423 | 1.477353 | 89.461 ± 0.170% | 0.66 |
- | Qwen3.8-27B-UD-IQ3_XXS (unsloth) | 10.2 | q4_1 | q4_1 | 7.0650 ± 0.097 | 0.056398 ± 0.0007 | 0.026294 | 5.675381 | 1.758763 | 89.360 ± 0.171% | 0.66 |
- | Qwen3.8-27B-UD-IQ3_XXS (unsloth) | 10.2 | iq4_nl | iq4_nl | 7.0686 ± 0.097 | 0.056520 ± 0.0008 | 0.026454 | 7.594811 | 1.682251 | 89.338 ± 0.171% | 1.82 |
- | Qwen3.8-27B-UD-IQ3_XXS (unsloth) | 10.2 | q4_0 | q4_0 | 7.0751 ± 0.097 | 0.057054 ± 0.0008 | 0.026597 | 5.961148 | 1.744126 | 89.256 ± 0.171% | 0.66 |
- | Swift-1.5-Qwen3.8-27B-IQ3_XXS (ukisai) | 11.5 | q8_0 | q8_0 | 7.2038 ± 0.100 | 0.075865 ± 0.0010 | 0.034077 | 7.316985 | 2.613428 | 88.349 ± 0.178% | 0.63 |
- | Swift-1.5-Qwen3.8-27B-IQ3_XXS (ukisai) | 11.5 | f16 | f16 | 7.2047 ± 0.100 | 0.076079 ± 0.0011 | 0.034180 | 7.230812 | 2.599016 | 88.505 ± 0.177% | 0.67 |
- | Swift-1.5-Qwen3.8-27B-IQ3_XXS (ukisai) | 11.5 | q5_1 | q5_1 | 7.2084 ± 0.100 | 0.076343 ± 0.0011 | 0.034362 | 7.081675 | 2.588227 | 88.438 ± 0.177% | 0.63 |
- | Swift-1.5-Qwen3.8-27B-IQ3_XXS (ukisai) | 11.5 | q5_0 | q5_0 | 7.2079 ± 0.100 | 0.076419 ± 0.0011 | 0.034324 | 7.331481 | 2.703590 | 88.367 ± 0.177% | 0.63 |
- | Swift-1.5-Qwen3.8-27B-IQ3_XXS (ukisai) | 11.5 | q8_0 | q4_0 | 7.2160 ± 0.100 | 0.076946 ± 0.0011 | 0.034796 | 7.076584 | 2.655256 | 88.425 ± 0.177% | 0.63 |
- | Swift-1.5-Qwen3.8-27B-IQ3_XXS (ukisai) | 11.5 | q4_0 | q8_0 | 7.2145 ± 0.100 | 0.077012 ± 0.0011 | 0.034843 | 7.473155 | 2.595413 | 88.297 ± 0.178% | 0.63 |
- | Swift-1.5-Qwen3.8-27B-IQ3_XXS (ukisai) | 11.5 | q4_1 | q4_1 | 7.2190 ± 0.100 | 0.077344 ± 0.0011 | 0.035126 | 7.020099 | 2.580184 | 88.303 ± 0.178% | 0.63 |
- | Swift-1.5-Qwen3.8-27B-IQ3_XXS (ukisai) | 11.5 | iq4_nl | iq4_nl | 7.2143 ± 0.100 | 0.077687 ± 0.0011 | 0.035115 | 7.261626 | 2.610012 | 88.290 ± 0.178% | 1.78 |
- | Swift-1.5-Qwen3.8-27B-IQ3_XXS (ukisai) | 11.5 | q4_0 | q4_0 | 7.2243 ± 0.101 | 0.077989 ± 0.0011 | 0.035553 | 8.358528 | 2.583631 | 88.214 ± 0.178% | 0.63 |
- | Qwen3.8-27B-APEX-I-Nano (mudler) | 10.5 | q8_0 | q8_0 | 7.4426 ± 0.104 | 0.119205 ± 0.0014 | 0.054558 | 6.701290 | 3.360874 | 85.398 ± 0.195% | 0.72 |
- | Qwen3.8-27B-APEX-I-Nano (mudler) | 10.5 | f16 | f16 | 7.4447 ± 0.104 | 0.119257 ± 0.0014 | 0.054427 | 6.670489 | 3.345367 | 85.303 ± 0.196% | 0.76 |
- | Qwen3.8-27B-APEX-I-Nano (mudler) | 10.5 | q5_0 | q5_0 | 7.4430 ± 0.104 | 0.119539 ± 0.0014 | 0.054885 | 6.638590 | 3.239870 | 85.224 ± 0.196% | 0.73 |
- | Qwen3.8-27B-APEX-I-Nano (mudler) | 10.5 | q5_1 | q5_1 | 7.4494 ± 0.104 | 0.119893 ± 0.0015 | 0.054840 | 6.748462 | 3.288106 | 85.309 ± 0.196% | 0.72 |
- | Qwen3.8-27B-APEX-I-Nano (mudler) | 10.5 | q8_0 | q4_0 | 7.4514 ± 0.104 | 0.120076 ± 0.0014 | 0.055512 | 6.506629 | 3.318967 | 85.224 ± 0.196% | 0.73 |
- | Qwen3.8-27B-APEX-I-Nano (mudler) | 10.5 | q4_0 | q8_0 | 7.4495 ± 0.104 | 0.120110 ± 0.0014 | 0.055338 | 6.689425 | 3.172599 | 85.156 ± 0.197% | 0.72 |
- | Qwen3.8-27B-APEX-I-Nano (mudler) | 10.5 | q4_1 | q4_1 | 7.4538 ± 0.104 | 0.120784 ± 0.0014 | 0.055372 | 6.633016 | 3.389553 | 85.169 ± 0.197% | 0.73 |
- | Qwen3.8-27B-APEX-I-Nano (mudler) | 10.5 | q4_0 | q4_0 | 7.4573 ± 0.104 | 0.120996 ± 0.0014 | 0.055951 | 7.184918 | 3.266879 | 85.123 ± 0.197% | 0.71 |
- | Qwen3.8-27B-APEX-I-Nano (mudler) | 10.5 | iq4_nl | iq4_nl | 7.4495 ± 0.104 | 0.121089 ± 0.0015 | 0.055789 | 6.717171 | 3.225901 | 85.070 ± 0.197% | 1.89 |
- | Qwen3.8-27B-UD-IQ2_XXS (unsloth) | 6.8 | q8_0 | q8_0 | 8.0601 ± 0.111 | 0.215543 ± 0.0023 | 0.111697 | 10.664585 | 4.983377 | 79.997 ± 0.221% | 0.66 |
- | Qwen3.8-27B-UD-IQ2_XXS (unsloth) | 6.8 | f16 | f16 | 8.0638 ± 0.111 | 0.215660 ± 0.0023 | 0.111970 | 10.237658 | 5.106472 | 79.939 ± 0.222% | 0.69 |
- | Qwen3.8-27B-UD-IQ2_XXS (unsloth) | 6.8 | q5_1 | q5_1 | 8.0609 ± 0.111 | 0.215841 ± 0.0023 | 0.112240 | 10.521098 | 4.970475 | 80.074 ± 0.221% | 0.65 |
- | Qwen3.8-27B-UD-IQ2_XXS (unsloth) | 6.8 | q5_0 | q5_0 | 8.0635 ± 0.111 | 0.215984 ± 0.0023 | 0.112481 | 10.693390 | 5.024749 | 80.018 ± 0.221% | 0.65 |
- | Qwen3.8-27B-UD-IQ2_XXS (unsloth) | 6.8 | q4_0 | q8_0 | 8.0674 ± 0.111 | 0.216324 ± 0.0022 | 0.113150 | 10.049559 | 5.008525 | 80.012 ± 0.221% | 0.66 |
- | Qwen3.8-27B-UD-IQ2_XXS (unsloth) | 6.8 | q8_0 | q4_0 | 8.0725 ± 0.112 | 0.216940 ± 0.0023 | 0.112926 | 10.863952 | 5.242304 | 80.064 ± 0.221% | 0.67 |
- | Qwen3.8-27B-UD-IQ2_XXS (unsloth) | 6.8 | q4_1 | q4_1 | 8.0692 ± 0.111 | 0.217074 ± 0.0023 | 0.113493 | 10.459407 | 5.047160 | 80.046 ± 0.221% | 0.66 |
- | Qwen3.8-27B-UD-IQ2_XXS (unsloth) | 6.8 | q4_0 | q4_0 | 8.0800 ± 0.112 | 0.217378 ± 0.0023 | 0.113971 | 10.429963 | 4.947471 | 79.871 ± 0.222% | 0.66 |
- | Qwen3.8-27B-UD-IQ2_XXS (unsloth) | 6.8 | iq4_nl | iq4_nl | 8.0876 ± 0.112 | 0.217889 ± 0.0023 | 0.113306 | 9.586375 | 5.121786 | 79.957 ± 0.222% | 1.83 |
- | Qwen3.8-27B-UD-IQ1_M (unsloth) | 6.3 | f16 | f16 | 8.5357 ± 0.118 | 0.282888 ± 0.0027 | 0.152506 | 10.606192 | 5.504893 | 77.316 ± 0.232% | 0.69 |
- | Qwen3.8-27B-UD-IQ1_M (unsloth) | 6.3 | q8_0 | q8_0 | 8.5411 ± 0.118 | 0.282969 ± 0.0027 | 0.152983 | 10.438630 | 5.446317 | 77.237 ± 0.232% | 0.66 |
- | Qwen3.8-27B-UD-IQ1_M (unsloth) | 6.3 | q5_1 | q5_1 | 8.5415 ± 0.118 | 0.283277 ± 0.0027 | 0.153328 | 10.409711 | 5.555089 | 77.218 ± 0.232% | 0.66 |
- | Qwen3.8-27B-UD-IQ1_M (unsloth) | 6.3 | q5_0 | q5_0 | 8.5448 ± 0.118 | 0.283850 ± 0.0027 | 0.152866 | 10.554780 | 5.525351 | 77.240 ± 0.232% | 0.66 |
- | Qwen3.8-27B-UD-IQ1_M (unsloth) | 6.3 | q8_0 | q4_0 | 8.5513 ± 0.118 | 0.284235 ± 0.0027 | 0.154047 | 10.708457 | 5.613781 | 77.270 ± 0.232% | 0.66 |
- | Qwen3.8-27B-UD-IQ1_M (unsloth) | 6.3 | q4_0 | q8_0 | 8.5569 ± 0.118 | 0.284423 ± 0.0027 | 0.152997 | 10.283100 | 5.538948 | 77.169 ± 0.232% | 0.66 |
- | Qwen3.8-27B-UD-IQ1_M (unsloth) | 6.3 | q4_1 | q4_1 | 8.5483 ± 0.118 | 0.284648 ± 0.0027 | 0.154201 | 10.267186 | 5.575212 | 77.292 ± 0.232% | 0.66 |
- | Qwen3.8-27B-UD-IQ1_M (unsloth) | 6.3 | iq4_nl | iq4_nl | 8.5585 ± 0.118 | 0.284784 ± 0.0027 | 0.154437 | 10.409517 | 5.630311 | 77.163 ± 0.232% | 1.82 |
- | Qwen3.8-27B-UD-IQ1_M (unsloth) | 6.3 | q4_0 | q4_0 | 8.5714 ± 0.118 | 0.285386 ± 0.0027 | 0.154507 | 10.564988 | 5.509305 | 77.249 ± 0.232% | 0.66 |
- | Ternary-Bonsai-2-27B-PQ2_0 (prism-ml) | 6.7 | f16 | f16 | 9.0535 ± 0.133 | 0.346367 ± 0.0033 | 0.185353 | 11.756362 | 6.012563 | 76.612 ± 0.234% | 0.64 |
- | Ternary-Bonsai-2-27B-PQ2_0 (prism-ml) | 6.7 | q8_0 | q8_0 | 9.0541 ± 0.133 | 0.346444 ± 0.0033 | 0.185354 | 11.767037 | 6.143119 | 76.550 ± 0.235% | 0.61 |
- | Ternary-Bonsai-2-27B-PQ2_0 (prism-ml) | 6.7 | q5_1 | q5_1 | 9.0536 ± 0.133 | 0.346636 ± 0.0033 | 0.185491 | 11.786319 | 6.103146 | 76.661 ± 0.234% | 2.45 |
- | Ternary-Bonsai-2-27B-PQ2_0 (prism-ml) | 6.7 | q5_0 | q5_0 | 9.0598 ± 0.133 | 0.346813 ± 0.0033 | 0.185603 | 11.753962 | 6.125248 | 76.553 ± 0.235% | 2.38 |
- | Ternary-Bonsai-2-27B-PQ2_0 (prism-ml) | 6.7 | q4_0 | q8_0 | 9.0590 ± 0.133 | 0.347121 ± 0.0033 | 0.185447 | 11.686278 | 6.137334 | 76.535 ± 0.235% | 1.7 |
- | Ternary-Bonsai-2-27B-PQ2_0 (prism-ml) | 6.7 | q8_0 | q4_0 | 9.0633 ± 0.133 | 0.347365 ± 0.0033 | 0.186138 | 11.833688 | 6.063123 | 76.541 ± 0.235% | 1.74 |
- | Ternary-Bonsai-2-27B-PQ2_0 (prism-ml) | 6.7 | q4_1 | q4_1 | 9.0716 ± 0.133 | 0.347666 ± 0.0033 | 0.186189 | 11.601852 | 6.080475 | 76.544 ± 0.235% | 1.95 |
- | Ternary-Bonsai-2-27B-PQ2_0 (prism-ml) | 6.7 | iq4_nl | iq4_nl | 9.0744 ± 0.133 | 0.347874 ± 0.0033 | 0.186348 | 11.862578 | 6.020070 | 76.510 ± 0.235% | 1.75 |
- | Ternary-Bonsai-2-27B-PQ2_0 (prism-ml) | 6.7 | q4_0 | q4_0 | 9.0721 ± 0.133 | 0.348225 ± 0.0033 | 0.186120 | 11.797215 | 6.096482 | 76.409 ± 0.235% | 0.61 |
Advertisement
Add Comment
Please, Sign In to add comment