Guest User

Untitled

a guest
Sep 4th, 2023
748
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 5.02 KB | None | 0 0
  1. Due to hardware limitation, some merge was done in 2 part.
  2.  
  3. - Recreate (private) ReML: Mythologic (v2) (Chronos/Hermes/Airboros)
  4. => Replacing Chronos by The-Face-Of-Goonery/Chronos-Beluga-v2-13bfp16 (0.30)
  5. => Replacing Airoboros by jondurbin/airoboros-l2-13b-2.1 (last version) (0.40)
  6. => Keeping NousResearch/Nous-Hermes-Llama2-13b (0.30)
  7.  
  8. Part 1: python ties_merge.py TheBloke/Llama-2-13B-fp16 ./ReML-L2-13B-part1 --merge The-Face-Of-Goonery/Chronos-Beluga-v2-13bfp16 --density 0.42 --merge jondurbin/airoboros-l2-13b-2.1 --density 0.56 --cuda
  9.  
  10. Part 2: python ties_merge.py TheBloke/Llama-2-13B-fp16 ./ReML-L2-13B --merge NousResearch/Nous-Hermes-Llama2-13b --density 0.30 --merge Undi95/ReML-L2-13B-part1 --density 0.70 --cuda
  11.  
  12. With that :
  13. - Recreate (private for now) ReMM: MythoMax (v2) (Mythologic/Huginn v1)
  14. => Replacing Mythologic by the one above (0.5)
  15. => Replacing Huginn by The-Face-Of-Goonery/Huginn-13b-v1.2 (hottest) (0.5)
  16.  
  17. python ties_merge.py TheBloke/Llama-2-13B-fp16 ./ReMM-L2-13B --merge Undi95/Mythologic-L2-v2-13B --density 0.50 --merge The-Face-Of-Goonery/Huginn-13b-v1.2 --density 0.50 --cuda
  18.  
  19. Last mix :
  20. - MythoMax (v2) (Base) (0.66)
  21. - Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged (Llama Chat Uncensored) (0.25)
  22. - KoboldAI/LLAMA2-13B-Holodeck-1 (0.09)
  23.  
  24. Part 1: python ties_merge.py TheBloke/Llama-2-13B-fp16 ./MLewdBase-L2-13B-part1 --merge Undi95/ReMM-L2-13B --density 0.88 --merge KoboldAI/LLAMA2-13B-Holodeck-1 --density 0.12 --cuda
  25.  
  26. Part 2: python ties_merge.py TheBloke/Llama-2-13B-fp16 ./MLewdBase-L2-13B --merge Undi95/MLewdBase-L2-13B-part1 --density 0.75 --merge Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged --density 0.25 --cuda
  27.  
  28. Final touch :
  29. - Applying LoRA: nRuaif/Kimiko-v2-13B at (0.15) weight
  30. => Result: MLewd-L2-13B-v1-1
  31.  
  32.  
  33. ================== RETRY ===========================
  34.  
  35.  
  36. Last mix :
  37. - ReMM (Base) (0.57)
  38. - Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged (Llama Chat Uncensored) (0.35)
  39. - KoboldAI/LLAMA2-13B-Holodeck-1 (0.08)
  40.  
  41. Part 1: python ties_merge.py TheBloke/Llama-2-13B-fp16 ./MLewdBase-L2-13B-part1 --merge Undi95/ReMM-L2-13B --density 0.88 --merge KoboldAI/LLAMA2-13B-Holodeck-1 --density 0.12 --cuda
  42.  
  43. Part 2: python ties_merge.py TheBloke/Llama-2-13B-fp16 ./MLewdBase-L2-13B --merge Undi95/MLewdBase-L2-13B-part1 --density 0.65 --merge Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged --density 0.35 --cuda
  44.  
  45. (MLewd-L2-13B-v1-2 got disqualified)
  46.  
  47. - Applying LoRA: nRuaif/Kimiko-v2-13B at (0.24) weight on MLewd-L2-13B-v1-1
  48. => Result: MLewd-L2-13B-v1-3
  49.  
  50. Remix:
  51. - Undi95/MLewd-L2-13B-v1-3 (0.81)
  52. - kajdun/iubaris-13b-v3 (0.9)
  53. - IkariDev/Athena-v1 (0.10)
  54.  
  55. Part 1 : !python ties_merge.py TheBloke/Llama-2-13B-fp16 ./MLewd-L2-13B-v1-4-part1 --merge Undi95/MLewd-L2-13B-v1-3 --density 0.90 --merge kajdun/iubaris-13b-v3 --density 0.10 --cuda
  56. Part 2 : !python ties_merge.py TheBloke/Llama-2-13B-fp16 ./MLewd-L2-13B-v1-4 --merge Undi95/MLewd-L2-13B-v1-4-part1 --density 0.90 --merge IkariDev/Athena-v1 --density 0.10 --cuda
  57. => Result: MLewd-L2-13B-v1-4
  58.  
  59. Hopeless attempt:
  60. - Undi95/MLewd-L2-13B-v1-4 (0.81)
  61. - Sao10K/Stheno-Inverted-L2-13B (0.10)
  62.  
  63. (MLewd-L2-13B-v1-5 got disqualified)
  64.  
  65. !python ties_merge.py TheBloke/Llama-2-13B-fp16 ./MLewd-L2-13B-v1-6 --merge Undi95/MLewd-L2-13B-v1-4 --density 0.90 --merge Sao10K/Stheno-Inverted-L2-13B --density 0.10 --cuda
  66. => Result: MLewd-L2-13B-v1-6
  67.  
  68. ================== ERP RANKING ===========================
  69.  
  70. 19.42 | MLewd-L2-13B-v1-3.q5_K_M.gguf (-> Best)
  71. 19.25 | MLewd-L2-13B-v1-1.q5_K_M.gguf
  72. 18.58 | MLewd-L2-13B-v1-5.q5_K_M.gguf
  73. 18.25 | MLewd-L2-13B-v1-2.q5 K M.gguf
  74. 17.92 | MLewd-L2-13B-v1-6.q5 K M.aauf
  75. 17.92 | MLewd-L2-13B-v1-4.q5_K_M.gguf
  76.  
  77. ================== existential crisis ===========================
  78.  
  79. What do I do with my life ? Do I really need Lewd ?
  80. Yes. Yes ? No. Yes. Maybe. Yes. Lewd. It's been 3 days.
  81. Help me. I'm horny.
  82.  
  83. ================== RETRY 2 ===========================
  84.  
  85. Mix:
  86. - Undi95/MLewd-L2-13B-v1-3 (0.82)
  87. - Sao10K/Stheno-Inverted-L2-13B (0.18)
  88.  
  89. !python ties_merge.py TheBloke/Llama-2-13B-fp16 ./MLewd-L2-13B-v1-7 --merge Undi95/MLewd-L2-13B-v1-3 --density 0.82 --merge Sao10K/Stheno-Inverted-L2-13B --density 0.18 --cuda
  90. => Result: MLewd-L2-13B-v1-7
  91.  
  92.  
  93. Final touch (trying my best here) :
  94.  
  95. Trial1: MLewd-L2-13B-v1-7 (0.77) + usernamedesu/MythKimikoBlue-Mix-v2-lora (LoRA 0.23) => MLewd-L2-13B-v1-7-TRY
  96. Trial2: MLewd-L2-13B-v1-7 (0.77) + zarakiquemparte/PIPPA-ShareGPT-Subset-QLora-13b (LoRA 0.23) => MLewd-L2-13B-v1-7-TRY2
  97.  
  98. Endmysuffering v69: MLewd-L2-13B-v1-7-TRY (0.80) + zarakiquemparte/PIPPA-ShareGPT-Subset-QLora-13b (LoRA 0.20)
  99. => MLewd-L2-13B-v1-8
  100.  
  101. Endmysuffering v96: MLewd-L2-13B-v1-7-TRY2 (0.80) + usernamedesu/MythKimikoBlue-Mix-v2-lora (LoRA 0.20)
  102. => MLewd-L2-13B-v1-8-2
  103.  
  104. FINAL : MLewd-L2-13B-v1-7-TRY2 (0.82) + BluemoonRP (0.18)
  105. (LoRA 0.20) => MLewd-L2-13B-v1-8-3
  106.  
  107.  
  108.  
  109. Undi95/MLewd-L2-13B-v1-3 (0.82) + zarakiquemparte/PIPPA-ShareGPT-Subset-QLora-13b (0.18) = MLewd-L2-13B-v1-3-PIPPA
  110.  
  111. Undi95/ReMM-L2-13B (0.82) + zarakiquemparte/PIPPA-ShareGPT-Subset-QLora-13b (0.18) = ReMM-L2-13B-PIPPA
Add Comment
Please, Sign In to add comment