I was all excited about having 2.5Gb networking and even a single 10Gb port and then I have to go and watch this. Sigh.
Updated proposed network diagram now that I have a 2.5Gb switch and the additional nab6 lite mini PC. It's a managed switch so the plan is to create a storage VLAN which the proxmox nodes can use for Ceph (just the 3 nodes in the office, not the one in the living room), speedier back ups and replication between truenas and synology. I'd still need to get a 10Gb NIC for truenas (got the Synology one but they will have to run at 2.5Gb at the switch only has a single 10Gb port). The more I look at the diagram the more I think "just get a proper rack and unifi gear like the Pro Max switch and Max gateway and do it all properly in the office" but then money...
Not what I was expecting, but if it works. I don't have Offfice, but I've never thought of doing it on a spreadsheet. I've made them in the past and always hated the way they turned out, maybe I'll give Google Sheets a go.
I was not expecting this either. Don't tempt me, not that I ever need anyone else to tempt me. The Ubiquiti Pro Max 16 feels like a nice half measure. It'll sit on top of the lack rack next to my PC, had 4 2.5Gb ports for the proxmox cluster (leaving one spare) and 2 10Gb ports for the storage servers. That could be job done then. It's a shame TP-Link don't have a similar switch as keeping everything Omada would be useful, but then again if we ever find a new house that's when I'd like to go all in on a proper rack and Ubiquiti. So I guess getting the Pro Max 16 is both finishing the project and planning for the future - flawless logic!
Do I need to repeat myself? I'm quite happy with my setup so far. I'll create a thread once I've put another hole in the wall to run the power and wired in my Virgin router properly.
It comes with wall mounting brackets as well so it doesn't even have to go in or on top of the lack rack.
Challenge accepted. I just need to find out where I can buy one from. Ubiquity only had it on its EU store.
OK, taken the plunge and bought the switch direct from the EU store. After this weekend NO MORE HARDWARE CHANGES. I shouldn't have to make any more tbh I'll be having a fairly decent clear out next week to recoup some money.
Damn it, I didn't think about this possibly back firing and making me skint. Please peddle your wares on a different forum.
1000043749 by meandmymouth posted 11 Aug 2024 at 12:10 Switch is in and cables are relatively tidy where possible. I've also had a slight rearrangement and now the rack lookalike this. 1000043750 by meandmymouth posted 11 Aug 2024 at 12:10 I think I can focus on the software side of things now.
I've had a little hardware reorganisation. Firstly, replaced the managed tp-link switch with an omada managed switch so now the router, switch and AP can all be managed together. Secondly, Synology now connected to the other 10Gb port on the ubiquiti switch, freeing up a 2.5Gb port. Finally, main rig is now in the NR200P Max case, which is nice and tidy. Smaller case but can fit bigger GPUs. I've also put the 4060Ti in the main rig and Titan Xp on the AI rig. Software. As mentioned, router, switch and AP all centrally managed now through the omada controller. The ubiquiti pro max 16 seems to work fine as well so while it's a bit of a pain to manage 2 ecosystems it could be worse. It's giving me experience working with both so benefit there. VLANs starting to get set up and deployed NginxProxyManager to an LXC in the new DMZ so happy that that works. New VLANs to be created, services migrated to updated VMs/LXCs which will all be managed via ansible (probably). I'd use terraform as well for proxmox but the provider is a pain. Progress is happening, slowly.
