ziptie build parts

# Parts + Cost

690€ - GPU1: used RTX 3090 (MSI Ventus RTX 3090 3x 24G, ~300W)
	Needs 2 PCIe 8pins.
660€ - GPU2: used RTX 3090 (Nvidia RTX 3090 Gainward Phantom GS, ~300W)
	Needs 3 PCIe 8pins, pretty terrible.
280€ - GPU3: new Nvidia RTX 3060 12GB (~175W)
	I got mine with the PC, not sure which model. The price is a current one, back then it was more expensive because it was the time when you only got a GPU by offering your firstborn’s soul.
	Needs 1 PCIe 8pin.
147€ - PSU: be quiet! Pure Power 12 M (1000 W)
	This PSU would be very underpowered, but it works fine since the GPUs are power limited. The PC doesn’t die if I forget to apply the power limit, since the GPUs aren’t used at 100% at once.
10€ - 600w -> pcie power cable
	Magic adapter “600w connector>PCIe 8pin”, because otherwise I’d have too few PCIe 8pins. I couldn't find one myself so I poked BeQuiet! and they sent me one from another manufacturer. Pretty nice of them. They also included a warning not to attach so many 3090s to their 1000w psu.
100€ - Mainboard: ASUS TUF B450-PLUS GAMING II
13€ - pcie power splitter: COMeap GPU VGA PCIe 8-pin to 2X 8 Pin (6 + 2) Y-splitter extension cable 23 cm (9 inches)
	I read that you should never use those because they can get hot and break your GPU. Since the GPU is power limited, that didn't seem to be a problem. I touched it to see if it was getting hot, but nothing. Maybe also because it's connected to the GPU that has 3 PCIe slots when 2 might also almost be enough.
6€ - Zipties
	Were a lot cheaper than any mount that I could find. And actually, I didn't really find a mount for the hard drive side of my case.
19€ - Riser cable: DELOCK 41426 Delock Riser Card PCIe x1 > PCIe x16 with 60 cm USB cable
110€  - SSD: CRUCIAL P3 Plus, 2 TB SSD M.2
70€ - CPU: AMD Ryzen 5 3600, 6x 3600 MHz
50€ - CPU Water cooling: BoostBoxx Liquid B120 water cooling
8€ - GPU holder: Uyubao GPU, Aluminium, L(74mm-120mm)
	Not 100% necessary but makes me sleep better.
~135€ - RAM: 64 GB (2x32GB) + 16 GB (2x8GB)
	Dunno the correct prices, I had some lying around. Not that much needed I guess.
110€ - Case: be quiet! Silent Base 601
26€ - Case fans: be quiet! Silent Wings 3

# Random Notes

- Removing the power limit doesn’t increase generation time noticeably.
- My monitor cable attached to 3060, so the PC draws a bit less power in idle.
- I’m mostly using the AI for roleplaying so gpu has ~1-2min time to cool down between generations. It would also be fine with a few seconds cooldown so the hot spot doesn’t burn, but running all the time might cause it to throttle. Or I’d have to replace the thermal paste.
- Nice addon: I can run Mistral 123b-3.0 with 16k context on the two 3090s so friends can use it, and still have the 3060 to play games and do other stuff.
- Mistral Large 123b is a lot smarter at/above 3.0bpw than below.
- The mainboard/case also fits two 3090s above each other, but they are only a millimeter apart then. I still used it for quite a bit like that.
- The 3060 was the first GPU I had, so picking that was not a choice. If you already got two 3090s, you might rather get a 4060ti 16gb or sth.
- My main reason to get the 3060 back in was to run mistral-123b at 16k context and at at least 3.0bpw (below that it gets a lot more stupid). This won’t work on 2x3090, because you’re missing that 1GB of VRAM that your desktop uses. If your CPU has an integrated GPU, you can attach your monitor to the mainboard, thus saving that 1 GB and you’re good to go with your 2x3090 setup. Or maybe if you’re using a linux server without a desktop.

Hope that helps somebody make their weird AI build! <3