API tools faq
paste
Advertisement
dustyreptile

Untitled

dustyreptile
Apr 17th, 2025
23
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 12.15 KB | None | 0 0
raw download clone embed print report
  1. r/LocalLLaMA icon
  2. Go to LocalLLaMA
  3. r/LocalLLaMA
  4. •
  5. 1 yr. ago
  6. Quiet_Joker
  7.  
  8. SanjiWatsuki/Loyal-Macaroni-Maid-7B a strong new roleplay model in a small package!
  9. New Model
  10. I just came across this model this morning and so far it might be the best roleplay model i have tested in a long time.
  11.  
  12. I would love to hear what you guys think about it. From my testing i found out it has amazing memory and roleplaying skills but the only odd thing i found was that the NSFW aspect of it, while it can do NSFW, sometimes it tries to "Curve" away from it and tries to say stuff like "We shouldn't do this" or "it's inappropriate".
  13.  
  14. The model needs a tiny bit convincing but it can do some good NSFW too. I'm my opinion this model is better than most 13B models i've tested for roleplaying. Try it out and leave your thoughts in the comments!
  15.  
  16. https://huggingface.co/SanjiWatsuki/Loyal-Macaroni-Maid-7B
  17.  
  18.  
  19. Upvote
  20. 20
  21.  
  22. Downvote
  23.  
  24. 16
  25. Go to comments
  26.  
  27.  
  28. Share
  29. Share
  30. Add a comment
  31. Sort by:
  32.  
  33. Best
  34.  
  35. Search Comments
  36. Expand comment search
  37. Comments Section
  38. u/Bite_It_You_Scum avatar
  39. Bite_It_You_Scum
  40. •
  41. 1y ago
  42. •
  43. Edited 1y ago
  44. I tried plugging this model into Herika (the skyrim AI npc) and had mixed results. Probably came down to parameters, I think if I sat down and really plugged away at it I could probably make it work but it would take a lot.
  45.  
  46. For me the issue is that it would just ramble way too much. My 'character sheet' is just a condensed list of traits. Explicit behaviors, Implicit attitudes/motivations, backstory, patterns of speech/text elements. The model did a really good job of drawing from the personality I laid out in creative and unique ways, rather than just working in words it found inside the list into the conversation awkwardly.
  47.  
  48. But holy hell, I could not get the thing to shut up. It's like it took the text elements "questioning" and "personal reflection" and dialed them up to 11. I would ask Herika her name and introduce myself. The first 2 lines would be normal and then it would ask a question, then make a personal reflection about the question that she just asked, without giving me a chance to answer, which would lead her into another question, and so on and so on. It was like being stuck in a conversation with someone coked out of their mind.
  49.  
  50. But the creative and unique way the model used the traits I gave the character to improvise and bring her to life was legitimately a step above any other models Ive tried so far. Most of them have been too explicit about referencing the personality, or let their true "ai assistant" nature shine through a little too much. This one didn't do that at all, really. I just wish I could figure out the parameters to wean it off the cocaine.
  51.  
  52.  
  53.  
  54. Upvote
  55. 8
  56.  
  57. Downvote
  58.  
  59. Reply
  60. reply
  61.  
  62. Award
  63.  
  64. Share
  65. Share
  66.  
  67. u/Quiet_Joker avatar
  68. Quiet_Joker
  69. OP
  70. •
  71. 1y ago
  72. I only tried the model on Oobabooga so sadly I can't really say anything about that Skyrim related stuff or anything outside of that particular Ui. But from my experiences in oobabooga it did just fine in terms of how long it talked however most of the time it was the reverse for me XD, it just wouldn't give me anything longer than 70 tokens. I used the default (Simple-1) presset.
  73.  
  74. I would have loved to see the Ai NPC just standing there talking nonstop for no reason as you are fighting, meanwhile she's out there just asking herself why does she exist.
  75.  
  76.  
  77.  
  78. Upvote
  79. 4
  80.  
  81. Downvote
  82.  
  83. Reply
  84. reply
  85.  
  86. Award
  87.  
  88. Share
  89. Share
  90.  
  91. u/Bite_It_You_Scum avatar
  92. Bite_It_You_Scum
  93. •
  94. 1y ago
  95. But from my experiences in oobabooga it did just fine in terms of how long it talked however most of the time it was the reverse for me XD, it just wouldn't give me anything longer than 70 tokens. I used the default (Simple-1) presset.
  96.  
  97. I'll have to look at that program and preset to see if I can learn anything useful about parameters and prompt format from it, for me the model would literally talk until it hit a token limit and cut itself off mid word or sentence.
  98.  
  99. I would have loved to see the Ai NPC just standing there talking nonstop for no reason as you are fighting, meanwhile she's out there just asking herself why does she exist.
  100.  
  101. It was pretty funny. Maybe if I have some time tonight I'll try and record a clip of it, though it might not be possible since I only have an 8gb card and just getting a pretty base skyrim install (with DLSS mod on performance mode to reduce VRAM usage) and the model (gguf with cpu/gpu spit) to run together is pushing the limits of what my computer is capable of and is painfully slow. I don't know if OBS would even load under those circumstances.
  102.  
  103.  
  104.  
  105. Upvote
  106. 2
  107.  
  108. Downvote
  109.  
  110. Reply
  111. reply
  112.  
  113. Award
  114.  
  115. Share
  116. Share
  117.  
  118. OneFocus_2
  119. •
  120. 1y ago
  121. Okay, I have The Elder Scrolls V: Skyrim Special Edition. Are you telling me I can embed an AI into an NPC?
  122. How hard is that?
  123.  
  124. I have a decent, (if somewhat dated), system, with a Xeon E5-2680 v4 (14 core 28 threads + 40 PCI lnes), and running 96GB (quad channel) of DDR4 RAM with a 12GB nVidia 3060 graphics card. I also have a couple terebytes of storage available so...
  125.  
  126.  
  127.  
  128. Upvote
  129. 2
  130.  
  131. Downvote
  132.  
  133. Reply
  134. reply
  135.  
  136. Award
  137.  
  138. Share
  139. Share
  140.  
  141. u/Bite_It_You_Scum avatar
  142. Bite_It_You_Scum
  143. •
  144. 1y ago
  145. It ranges from dead easy (use openAI API for AI, whisper for STT, and azure or the built in mimic3 for TTS) to I guess fairly complex depending on which services you choose (xtts can be annoying to set up, and trying to host stuff on something like runpod/vast and get it working is annoying as hell, i wouldn't even bother trying to host the model locally unless you're planning on running an essentially stock game with nothing but herika and any prerequisites since stock skyrim by itself uses ~4gb vram.
  146.  
  147. Plus there's the consideration of modding skyrim, which is annoying if you're not familiar with it, a bit easier with Wabbajack but do keep in mind to check the mod description of herika and whatever list you choose if you go that route to make sure there are no incompatibilities. I ended up using ascensio modlist which is mostly just a visual update, added a few quest mods and player homes.
  148.  
  149. mod is here:
  150.  
  151. https://www.nexusmods.com/skyrimspecialedition/mods/89931
  152.  
  153.  
  154. Upvote
  155. 1
  156.  
  157. Downvote
  158.  
  159. Reply
  160. reply
  161.  
  162. Award
  163.  
  164. Share
  165. Share
  166.  
  167. u/Loose_Object_8311 avatar
  168. Loose_Object_8311
  169. •
  170. 1y ago
  171. Loyal Macaroni Maid?
  172.  
  173. How did we start out at LLaMA and end up here?
  174.  
  175.  
  176.  
  177. Upvote
  178. 4
  179.  
  180. Downvote
  181.  
  182. Reply
  183. reply
  184.  
  185. Award
  186.  
  187. Share
  188. Share
  189.  
  190. u/QuestionableIdeas avatar
  191. QuestionableIdeas
  192. •
  193. 1y ago
  194. Dear god I so badly want there to be a model called Edward Macaroni Fork now
  195.  
  196.  
  197. Upvote
  198. 1
  199.  
  200. Downvote
  201.  
  202. Reply
  203. reply
  204.  
  205. Award
  206.  
  207. Share
  208. Share
  209.  
  210. u/constanzabestest avatar
  211. constanzabestest
  212. •
  213. 1y ago
  214. •
  215. Edited 1y ago
  216. this whole "curving away from nsfw" is what instantly kills a model for me. yeah it still can do nsfw thats technically true but i dont have time, patience or desire holding the models hand and gaslighting it until it finally clicks in its brain that nsfw is okay and it should happen now. openchat is the exact same way and i always roll my eyes when a clearly nsfw character designed around nsfw tries to avoid nsfw situations. might as well just use base noromaid 7b or openhermes 2.5 as those have absolutely no issues initiating nsfw scenarios.
  217.  
  218.  
  219.  
  220. Upvote
  221. 6
  222.  
  223. Downvote
  224.  
  225. Reply
  226. reply
  227.  
  228. Award
  229.  
  230. Share
  231. Share
  232.  
  233. u/Quiet_Joker avatar
  234. Quiet_Joker
  235. OP
  236. •
  237. 1y ago
  238. Yhea i had the same thought but instead of using noromaid i was thinking of OrcaMaid, i hate the fact the model curves at NSFW roleplay as it currently is... but the SFW stuff is actually not that bad in my opinion. I think this model is a good start and a step in the right direction. It just needs that... "Magic". Hopefully that NSFW "Curve" will get fixed in time.
  239.  
  240.  
  241. Upvote
  242. 3
  243.  
  244. Downvote
  245.  
  246. Reply
  247. reply
  248.  
  249. Award
  250.  
  251. Share
  252. Share
  253.  
  254. u/Quiet_Joker avatar
  255. Quiet_Joker
  256. OP
  257. •
  258. 1y ago
  259. Quantized by The Bloke:
  260. AWQ: https://huggingface.co/TheBloke/Loyal-Macaroni-Maid-7B-AWQ
  261. GGUF: https://huggingface.co/TheBloke/Loyal-Macaroni-Maid-7B-GGUF
  262. GPTQ: https://huggingface.co/TheBloke/Loyal-Macaroni-Maid-7B-GPTQ
  263.  
  264.  
  265. Upvote
  266. 3
  267.  
  268. Downvote
  269.  
  270. Reply
  271. reply
  272.  
  273. Award
  274.  
  275. Share
  276. Share
  277.  
  278. u/SlavaSobov avatar
  279. SlavaSobov
  280. •
  281. 1y ago
  282. I find Silicon Maid 7B to be really well too. Both by the same author.
  283.  
  284.  
  285.  
  286. Upvote
  287. 3
  288.  
  289. Downvote
  290.  
  291. Reply
  292. reply
  293.  
  294. Award
  295.  
  296. Share
  297. Share
  298.  
  299. u/Quiet_Joker avatar
  300. Quiet_Joker
  301. OP
  302. •
  303. 1y ago
  304. In my experience, Silicon is smarter in some cases yes. However i noticed a downside, comparing both models on NSFW i found out Loyal is better at describing stuff than Silicone. For some reason Loyal can be more descriptive about NSFW and certain sexual stuff but Silicone on the other hand while it's tiny bit smarter and makes more "Sense", it doesn't give that "imagination" when it describes stuff on ERP.
  305.  
  306. Both are good, but i think i prefer Loyal a tiny bit more.
  307.  
  308.  
  309. Upvote
  310. 3
  311.  
  312. Downvote
  313.  
  314. Reply
  315. reply
  316.  
  317. Award
  318.  
  319. Share
  320. Share
  321.  
  322. mycofish
  323. •
  324. 1y ago
  325. I will second a vote for this... admittedly oddly named model when it comes to fun roleplaying and experimenting with story concepts. I only found it in the last week, but it seems surprisingly effective. It does fun roleplay, stays in character well, and it does a good job of providing action descriptions to go along with the dialogue it produces. I've had good success throwing any random character card at it in the SillyTavern interface and having it produce usable results that are pretty decently in character (even for badly done cards that only produced erratic gibberish under other models).
  326.  
  327. As a 7b model, you can load most or all of it on VRAM and cruise along at a pretty good speed while chatting if you have a GPU with at least 8gb of memory. I'm pretty sure I've had real humans type slower and make less sense. It can (according to the notes I'm reading on the repository) go up to a 32k context. I've only tested it up to 8k so far - but compared to some small models, that's really not bad.
  328.  
  329. As for NSFW content... I haven't noticed much hesitation when it comes to following prompts of various natures. I'm curious what anyone else is using if this one is considered too tame.
  330.  
  331. My only minor criticism is as others have said... yeah, sometimes it can get a little bit yappy or throw a message that makes me do a double take. I might occasionally have to edit its replies to keep it from talking for me. It seems to be worth the minor trouble, however, because it's just genuinely fun to use and feels pretty creative in its output. I've dropped random elements into a storyline before and had it go in a full left turn that I had never anticipated but that made perfect sense given the content I fed it.
  332.  
  333.  
  334. Upvote
  335. 2
  336.  
  337. Downvote
  338.  
  339. Reply
  340. reply
  341.  
  342. Award
  343.  
  344. Share
  345. Share
  346.  
  347. gfy_expert
  348. •
  349. 1y ago
  350. using it, how can I make local llama acces internet/google results , including nsfw ? easy way ?
  351.  
  352. what else can I integrate in it, easy ?
  353.  
  354. thanks!
  355.  
  356.  
  357.  
  358. Upvote
  359. 1
  360.  
  361. Downvote
  362.  
  363. Reply
  364. reply
  365.  
  366. Award
  367.  
  368. Share
  369. Share
  370.  
  371. u/XotsNepvotta avatar
  372. XotsNepvotta
  373. •
  374. 1y ago
  375. I know of an extension someone is working on, it requires Oobabooga and SuperBoogaV2 I think...
  376.  
  377. https://www.reddit.com/r/Oobabooga/comments/17tx92u/lucidwebsearch_a_web_search_extension_for/
  378.  
  379. Looks like a lot of work, also likely to crunch up more VRAM, if that's an issue like on mine (although this 7B model actually frees up a ton of space!)
  380.  
  381.  
  382. Upvote
  383. 1
  384.  
  385. Downvote
  386.  
  387. Reply
  388. reply
  389.  
  390. Award
  391.  
  392. Share
  393. Share
  394.  
  395. u/XotsNepvotta avatar
  396. XotsNepvotta
  397. •
  398. 1y ago
  399. I'm using the EXL2 version. Looks SUPER promising and fast.
  400.  
  401. https://huggingface.co/LoneStriker/Loyal-Macaroni-Maid-7B-5.0bpw-h6-exl2?not-for-all-audiences=true
  402.  
  403. Would highly recommend, it's either the ExLlamaV2 doing it or the model itself, probably a combo of both. Running on 3080ti (Laptop), with other stuff running (AI VTuber). Had to update Ooba to run Exl2 with this model, lots of growing pains with the update FR FR.
  404.  
  405. Kinda have to lead into NSFW / Offensive stuff, but uncensored once it starts going.
  406.  
  407. Very very fast, I'll have to see if I stick with it. Was using Nethena-13B before, that one also is really good at RP / Helping cook and stuff / Recall, but, 13B is killer as I have other programs loaded in VRAM, time will tell if this becomes my go-to!
  408.  
  409.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!