It's time I put together a substantial multi CPU machine to move into the bigadv-16 era! I was toying with dual Xeon E5 2670's, but it seems the general route is quad G34 Opterons, mainly on cost grounds, is that right? The former I can cope with, but the latter is out of my area of knowledge - if I've trawled my threads correctly, some of you guys have gone down this route. Therefore, I'm after some advice on such a build if possible ....
Hi Jon, A lot depends on your budget and asthetic requirements. I ended up with some used mid range chips (6174s) off ebay, GSkill 1333 CL7 memory and no case. The m/b is one of the Supermicros for which the boys at [H] have created an OC BIOS. The whole thing came to almost £3K although I did buy 64GB of memory for BOINC when you'd get by with 16 x 1GB sticks for folding. There are cost variations on most of the parts that will provide a delta to the speed or effort required. For example, a good deal on 6128s (octo cores) can be around £100 each whereas 6174s (dodeca cores) are typically closer to £400 each after duty etc. As you can see, built for speed rather than looks Bob
I eventually went down this route to do something a little bit different, but if you can put together a dual Xeon system, the quad G34 Opteron build will be no trouble. It seems that like Bulldozer CPUs, the Opteron 6200 series give no more PPD than the equivalent 6100s, but use significantly more power. I decided to concentrate on a low power machine, which I don't have completely running yet*, but my two cents worth is ... +1 Supermicro board with the [H] bios. The memory on those boards runs quicker if all four slots per CPU are populated, but the total memory doesn't have to be very high for folding. I got some low profile, low voltage Samsung. I have in mind that the memory timings can be adjusted with the [H] bios, which can yield a few more PPD. The glut of cheap Opteron 6100s on eBay seems to be over, so it principally comes down to how much you want to spend and how long are you prepared to wait. I may have a spare set of 8-cores soon, let me know if you're interested. {*The problem is that one of my 12 cores CPUs isn't recognised. I've still got to discover if its the CPU or the board that is faulty. So I'll be running at reduced capacity for the Chimps Challenge, and RMA later}
Chris - it looks like I will be going down the Supermicro quad socket route from what I've read/heard, and I think your post has helped confirm this. Cheers.
Good stuff Jon, I actually have a suitable 4U HP case that will accommodate one of these Supermicro boards as I was planning to go the same route myself after packing in GPU folding but I just don't have the cash to get the project started at the moment I'm keeping the case though as its rare as rocking and I might just do it next year.... I'm not even sure what form factor these boards are lol. Oh and I think you should do a built thread Doc
For the first foray down this route, the build log will be very, very short indeed - in fact, I can summarise it here; contact an IT solutions company, spec a rig, place an order, take reciept of new machine - job done
would love to build [and have] a rig like that... wouldn't love the leccy bill so much though... but it'd give me something to do... good luck with your build/purchase
I had it mind to do this about a year and a half ago, but didn't have the funds at the time .... This is all about leccy - actually reducing it drammatically, as it will enable me to forgo all the GPU Folding (this rig should use less juice than one of my GPU Folding rigs).
Well, after a few teething troubles, my first venture into the multiple CPU socket world is in business - quad Opteron 6134's (see progress in the sig)
seconded. Shame you haven;t done a build and/or log to follow. I've found a similar topic article over on Overclockers and that's really whet my appetite to do something similar - for my SQL server/Folding project.
As mentioned earlier in the thread, there was no build log ..... As for piccy's ... it's not very exciting to look at (it's got nothing on phoenicis's stirling effort!), as it's basically a very large (rack-mountable) tower just like this;
Got my 48 cores folding (Opteron 6166 at 1.8GHz), and here are some numbers - P6901: TPF 08:08, PPD ~254000, power 394W P6903: TPF 17:10, PPD 371182, power 395W P6904: TPF 24:53, PPD 349300, power 396W Hopefully a little overclock will take me past the 1000 PPD/W mark.