IBM

Thinking of grabbing a POWER server - Page 1

So my Core2Duo FreeBSD box burned itself up this morning ( I have horrible luck with x86 hardware )

I posted a thread on a developer site requesting suggestions of alternatives to the x86 garbage running rampant.

After wading through accusations of computer abuse, x86 and Windows fanboyism and generally unhelpful responses, I got one possible solution: An IBM POWER server with a video card thrown in.

Which brings me to the question I will ask here - can someone tell me if this is viable? If so, what models should I look for secondhand? I'm not going for any old Apple hardware, since I just got away from that for good. I'd rather not go POWER out of all RISCS but between it, ARM and Loongson, it seems pretty clear who's the best here.
:fuel: 900MHz 4GB
IBM POWER support in FreeBSD is at best tier-2 platform: http://www.freebsd.org/platforms/ppc.html
Expect a bit / a lot of work to get it working.
Torfinn
Erhmmm... you're thinking of grabbing a POWER box to explicitly run FreeBSD... or do you just need a box to run some service or to function as a daily driver workstation?

If to run FreeBSD... perhaps a recent-ish SPARC box? On the other hand, you could just also admit that desktop hardware is x86. Over. Out. Done. Dusted. Buy yourself some new x86 junk, restore your backups and immediately start putting pennies into the when-shit-happens-again fund.
jimmer wrote: Erhmmm... you're thinking of grabbing a POWER box to explicitly run FreeBSD... or do you just need a box to run some service or to function as a daily driver workstation?

If to run FreeBSD... perhaps a recent-ish SPARC box? On the other hand, you could just also admit that desktop hardware is x86. Over. Out. Done. Dusted. Buy yourself some new x86 junk, restore your backups and immediately start putting pennies into the when-shit-happens-again fund.


I agree, while x86 is far from perfect, it does (like everything) fulfill a purpose.
:Indigo: 33mhz R3k/48mb/XS24 :Indy: 150mhz R4400/256mb/XL24 :Fuel: 600mhz R14kA/2gb/V10 Image 8x1.4ghz Itanium 2/8GB :O3x08R: 32x600mhz R14kA/24GB :Tezro: 4x700mhz R16k/8GB/V12/DCD/SAS/FC/DM5 (2x) :O3x0: 4x700mhz R16k/4GB :PrismDT: 2x1.6ghz 8mb/12gb/SAS/2xFGL
Not necessarily to run FreeBSD, another BSD is also totally acceptable here. I hadn't really thought of SPARC though... does anyone here have firsthand experience with a box that would be usable as a daily driver? I used FreeBSD on a PowerMac G5, which I ditched due to lack of upgradeability, heat output and just the fact that I despise Apple. And my SPARC experience is minimal at best, but my Ultra 5 was a huge disappointment in the performance department so hence why its not listed in my lineup anymore.

I'm done with x86 hardware dying and costing me $300, $400+ to replace. This box lasted a scant three weeks of being on 24/7, that is just pitiful. I'm not willing to continue to play Intel and AMD's games of planned obsolescence either.
:fuel: 900MHz 4GB
I sympathize greatly, and I know the desire to run a RISC workstation, but I would strongly recommend against this. First, POWER:

- IBM boxes run two things well: AIX and Linux (and then really only RHEL, though CRUX PPC should be okay). The *BSDs on ofppc have issues and don't support all the hardware. AIX has not been a good workstation OS since 5L, and not arguably even then. And then you still have to deal with endian problems in the huge body of Linux software written as if only one architecture exists, though this is coming to an end with ppc64le and POWER8.
- IBM POWER hardware runs hot and heavy. This 2-way 4.2GHz POWER6, throttled down, still draws around 300W and it will heat a room just as well as the G5. In fact, it's worse than the G5, because there's no liquid cooling, and even with the baffle on a deskside unit it's loud. The newest POWER7 machines are better, but good luck trying to find one at a reasonable price from a reseller, and you can forget buying from IBM directly. My POWER6, which is 2008-era, would still sell for several thousand in 2014 (I bought it for $10K in 2010). When it blew its system backplane, it was $1700 to fix and a whole lot of cussing at IBM's CUoD hardware lockout (see my thread on why IBM sucks).

It's a fast number cruncher and I love AIX jackboots, which is why I have it. But it would be horrible as a workstation.

I don't know much about modern SPARC hardware, but I can't imagine the situation with SPARC boxes and Solaris is substantially different.

As much as it pains me to say it, the last great, useable, powerful RISC workstation was the quad G5. :( And then, only in OS X. I really wish there were a better option too.
smit happens.

:Fuel: bigred , 900MHz R16K, 4GB RAM, V12 DCD, 6.5.30
:Indy: indy , 150MHz R4400SC, 256MB RAM, XL24, 6.5.10
:Indigo2IMP: purplehaze , 175MHz R10000, Solid IMPACT
probably posted from Image bruce , Quad 2.5GHz PowerPC 970MP, 16GB RAM, Mac OS X 10.4.11
plus IBM POWER6 p520 * Apple Network Server 500 * HP C8000 * BeBox * Solbourne S3000 * Commodore 128 * many more...
TeamBlackFox wrote: I hadn't really thought of SPARC though... does anyone here have firsthand experience with a box that would be usable as a daily driver? [...] but my Ultra 5 was a huge disappointment in the performance department so hence why its not listed in my lineup anymore.


I dont have experience with recent SPARC hardware but 25 years ago I lurved my old SPARC stuff: SS2, SS20, IPX. My experience aside, it's clear that your RISC options are limited to SPARC, POWER or PA-RISC. You asked for something else than POWER, I gave you SPARC :)

TeamBlackFox wrote: I'm done with x86 hardware dying and costing me $300, $400+ to replace. This box lasted a scant three weeks of being on 24/7, that is just pitiful. I'm not willing to continue to play Intel and AMD's games of planned obsolescence either.


Interesting, my experience have been quite the opposite. My AMD Athlon II X4 620 cpu with stock cooler on an ASUS 760G-based motherboard in a no-name pee-cee case 24/7 has been running trouble-free for almost 5 years. I bought it because it was the first sub-100-units-of-money-quad-core CPU, and I figured that four cores at 2.6GHz would last me at least 5 years. They have and to be honest for my needs it's still fine.

Nonetheless, I've been eyeing the Dell XPS 1810/1820 or considering having a go at casemodding a fanboi 'modern' SGI Workstation. But I digress.
:Fuel: redbox 800Mhz 4Gb V12
TeamBlackFox wrote: I'm done with x86 hardware dying and costing me $300, $400+ to replace. This box lasted a scant three weeks of being on 24/7, that is just pitiful. I'm not willing to continue to play Intel and AMD's games of planned obsolescence either.


Bear in mind that this is more down to bad luck and the quality of individual components than anything else. There's a huge gulf of reliability between the good and bad bits. We have dozens of servers where I work that are x86 and have been running for 6+ years 24/7 without a single hiccup. A lot of it depends on the level of kit you buy. Get a half-decent PSU, motherboard and RAM and you should have many years of reliable service. Buy a crap board or a cheapo PSU and you're far more likely to have issues.

Basically, it's the individual components themselves, not the architecture itself which is the problem.

By the way, another option is a PowerPC based Mac of course if you're wanting to avoid the x86 world of things - assuming you're not requiring new kit of course!
Systems in use:
:Indigo2IMP: - Nitrogen : R10000 195MHz CPU, 384MB RAM, SolidIMPACT Graphics, 36GB 15k HDD & 300GB 10k HDD, 100Mb/s NIC, New/quiet fans, IRIX 6.5.22
:Fuel: - Lithium : R14000 600MHz CPU, 4GB RAM, V10 Graphics, 36GB 15k HDD & 300GB 10k HDD, 1Gb/s NIC, New/quiet fans, IRIX 6.5.30
Other system in storage: :O2: R5000 200MHz, 224MB RAM, 72GB 15k HDD, PSU fan mod, IRIX 6.5.30
Not getting a PowerPC Mac. As I sold the last of my Apple kit to ClassicHasClass I'm sworn off Apple indefinitely. I need something newer than that, that runs cooler, and is of better quality.

I always have my SparcStation 20, but hell if I'm running that for my main workstation - Mima is faster than that slug.

Classic, I do see your point. I'll have to look at SPARC or ARM gear then, and if I can't find anything there, I guess fuck it, I won't have a modern workstation and I'll stick to SGIs.

Keep in mind folks I do work for Dell, and I have to help maintain about 40k servers in a data center outside of DC. I replace more CPUs and motherboards next to hard disk drives than any other parts. These are Xeon and Opteron servers so they're supposed to be the best of the best, but I'll tell you that the build quality isn't any better - it takes a 6-man crew, including myself, to barely keep the 99% uptime SLA we have with our customer and its all because Dell/Intel/AMD send us so much bum hardware its not even funny. Out of an order of 10 motherboards, we have roughly 1-2 in that batch that will not work. CPUs tend to not be DOA, but I swear we burn through CPUs as our third or fourth most common part to replace.
:fuel: 900MHz 4GB
TeamBlackFox wrote: Not getting a PowerPC Mac. As I sold the last of my Apple kit to ClassicHasClass I'm sworn off Apple indefinitely. I need something newer than that, that runs cooler, and is of better quality.

I always have my SparcStation 20, but hell if I'm running that for my main workstation - Mima is faster than that slug.

Classic, I do see your point. I'll have to look at SPARC or ARM gear then, and if I can't find anything there, I guess fuck it, I won't have a modern workstation and I'll stick to SGIs.

Keep in mind folks I do work for Dell, and I have to help maintain about 40k servers in a data center outside of DC. I replace more CPUs and motherboards next to hard disk drives than any other parts. These are Xeon and Opteron servers so they're supposed to be the best of the best, but I'll tell you that the build quality isn't any better - it takes a 6-man crew, including myself, to barely keep the 99% uptime SLA we have with our customer and its all because Dell/Intel/AMD send us so much bum hardware its not even funny. Out of an order of 10 motherboards, we have roughly 1-2 in that batch that will not work. CPUs tend to not be DOA, but I swear we burn through CPUs as our third or fourth most common part to replace.


Modern Oracle SPARC kit is expensive and underpowered (generally worse than midrange to high-end Xeons.) The situation with the pre-Niagara stuff was worse - the Ultra 45 (last of the SPARC workstations) was substantially worse on performance than the contemporary Opteron-based Sun Ultra 40.

Nvidia provides some degree of GPU drivers now for Linux/PPC if you ask nicely. It's likely for little-endian only, which means Ubuntu and SLES (for whatever reason, RHEL 7 is still big-endian.) Power7 machines are decent on power consumption and can be had (entry-level) for about US$2k for second-hand blades - assuming you have a chassis. Rack machines are, and will continue being, more expensive - often moreso than the chassis and blades combined. i don't understand why, but there it is.

For a desktop, x86 is likely still the best option available - it has a large existing base of software and driver support, and performance is excellent.
Yeah Kira after my experiences with it I'll be getting a Sun Blade 2500. I'm less concerned with power and more concerned with reliability really. x86 is obsolete and poor quality at this point.
:fuel: 900MHz 4GB
TeamBlackFox wrote: x86 is obsolete


Based on what? Relative to what?
Its been obsolete since the 386 - its dedication to backwards compatibility has held innovation in the software side of things back, and it is still designed around the same architecture which points to days where memory was expensive, and having everything done on the CPU was ideal. Look around today, its the only CISC architecture still actively developed, unless you somehow count Itanium, and that isn't nicknamed Itanic for anything other than its massive failure in the marketplace. ARM, MIPS and other RISC architectures have long overtaken the mobile market, and even today, if you compare the same class of Intel CPU to ARM and MIPS equivalents, the x86 produces about the same amount of output within a margin of 5%, but it consumes 30-40% more power and costs significantly more. Plus, x86-native architectures all seem to blow don't they?

DOS, WIndows and GNU/Linux were first designed on the x86 ISA, and they all share a common trait - they're horribly engineered masses of conflicting ideals held together with duct tape. Can't necessarily blame it on the CPU, but its funny to me nonetheless.

Anyways back to topic. I'm either going to find a RISC workstation to work with, or pretty soon the only modern workstation I'll be using is at work!
:fuel: 900MHz 4GB
Oh boy.

TeamBlackFox wrote: Its been obsolete since the 386 - its dedication to backwards compatibility has held innovation in the software side of things back, and it is still designed around the same architecture which points to days where memory was expensive, and having everything done on the CPU was ideal.
Like what features?

Look around today, its the only CISC architecture still actively developed, unless you somehow count Itanium, and that isn't nicknamed Itanic for anything other than its massive failure in the marketplace.


The various mainframe architectures will be surprised to hear this - as will the Renesas RX, the 8051, etc. Additionally, Itanium was (if anything) hyper-RISC - rigidly fixed-length, rigidly load-store, and in-order, with a lot of internal machine state exposed. The fact that you think it was CISC speaks volumes about your familiarity with the platform. And by the way, Itanium was outselling SPARC for quite a while. "Massive failure" indeed.

ARM, MIPS and other RISC architectures have long overtaken the mobile market, and even today, if you compare the same class of Intel CPU to ARM and MIPS equivalents, the x86 produces about the same amount of output within a margin of 5%, but it consumes 30-40% more power and costs significantly more.


ARM, MIPS, et al have absorbed their share of CISC-isms and are no longer RISC in the original sense of the word; for instance, both ARM and MIPS have variable-length extensions (Thumb/Thumb2 and MIPS16 respectively.) x86 being less efficient is essentially a myth at this point - see this for an example of in-depth analysis with a proper test bench.

Plus, x86-native architectures all seem to blow don't they?


And yet 2.8GHz, 15-core Xeon outperforms[1][2] a 16-core 3.7GHz SPARC64 - quite likely at substantially lower power, given that SPARC64 chips have historically been hanging out up around 200W. Funny, that.

Now let's talk about obsolescence. Oracle SPARC has no SIMD past VIS (64-bit SIMD - MMX-class.) It has an encoding that limits it to 32 GPRs without extremely nasty tricks like those introduced by Fujitsu in HPC-ACE. It has register windows, which significantly increase the complexity of modern register rename in out-of-order designs. And you're calling x86 obsolete?

The moral of the story here is that ISA is basically irrelevant unless it exposes interesting microarchitectural functionality - like explicit support for multithreading, speculation, or instruction parallelism. ISA is like what style of columns you put on the porch of your house - it may influence the way the house is built, but ultimately it's not what makes the house solid or not.

[1] http://spec.org/cpu2006/results/res2014 ... 29190.html vs http://spec.org/cpu2006/results/res2014 ... 28687.html
[2] http://www.tpc.org/tpch/results/tpch_re ... =114041601 vs http://www.tpc.org/tpch/results/tpch_re ... =114020603
You went over my head there to be honest - I stay out of low level talk because I honestly was never formally educated in it.

You're correct on most of your points - I see that I should have qualified my statements to narrow my scope:

x86_64 is the only CISC architecture in use and actively developed within the realm of the consumer market that I can actually reach with my relatively modest income. 68k has been halted since the mid 1990s, VAX is no longer developed etc.

I'm not even going for SPARC specifically either, but I do want to make the point that I've have had a total of 8 x86 based computers, and all but two failed within a year. One of them that survived was a Pentium 4, and while it survived, it struggled with everything I threw at it moreorless. The other was a MacBook Pro Retina, which kept kernel panicking and because BSD didn't run stable on it, I sold it off for $1000, less than 2 years into ownership. All other machines I owned under the x86 ISA failed within 6 months of continued, 24/7 usage in one way or another, including one in a rack fire that also consumed two XServe G4s I had in the cage and *nearly* consumed some hardware I had rented.

After this desktop I had melted itself and warped the motherboard, I'm fucking done. Never had a SINGLE failure from a RISC based device of any kind. Thats why I started this thread, to see if a POWER server was viable. Then I was looking at the late model Sun Ultras and the Sun Blades, but now I'm just considering screwing it all and staying within the scope of retro RISC and 68k computers.
:fuel: 900MHz 4GB
TeamBlackFox wrote: You went over my head there to be honest - I stay out of low level talk because I honestly was never formally educated in it.

You're correct on most of your points - I see that I should have qualified my statements to narrow my scope:

x86_64 is the only CISC architecture in use and actively developed within the realm of the consumer market that I can actually reach with my relatively modest income. 68k has been halted since the mid 1990s, VAX is no longer developed etc.

I'm not even going for SPARC specifically either, but I do want to make the point that I've have had a total of 8 x86 based computers, and all but two failed within a year. One of them that survived was a Pentium 4, and while it survived, it struggled with everything I threw at it moreorless. The other was a MacBook Pro Retina, which kept kernel panicking and because BSD didn't run stable on it, I sold it off for $1000, less than 2 years into ownership. All other machines I owned under the x86 ISA failed within 6 months of continued, 24/7 usage in one way or another, including one in a rack fire that also consumed two XServe G4s I had in the cage and *nearly* consumed some hardware I had rented.

After this desktop I had melted itself and warped the motherboard, I'm fucking done. Never had a SINGLE failure from a RISC based device of any kind. Thats why I started this thread, to see if a POWER server was viable. Then I was looking at the late model Sun Ultras and the Sun Blades, but now I'm just considering screwing it all and staying within the scope of retro RISC and 68k computers.


Assuming the issue is related to the ISA of the processors is an interesting conclusion.

Do you still maintain that x86 is obsolete, by the way? And have you found any evidence to support it yet?
You have some impressively bad luck with some hardware there. I built a machine with a left over Intel core i5 to be a freenas box. I used the cheapest MSI motherboard you can imagine - just whatever I could get for ~$50 at Frys when I picked up the i7 which replaced the i5 in my desktop. The FreeNAS machine currently reports it's been running for 323 days! I set it on the floor in my living room - booted from a USB key and it serves up a mirror pair of surveillance seagate 1TB drives. Point being cheap works fine sometimes - now I'm not driving that CPU 95% all day long. I could give you a half dozen examples of my systems running flawless - but you've heard that already.

I found a Sun Blade 1000 for free on craigslist and couldn't help myself - I haven't had a chance to spend any time on it yet, but I'll be running Solaris on it so for whatever that's worth.

If you do want a power6 machine, 520s are starting to show up on ebay for ~$1000 give or take - but you know that won't have a graphics card, and it won't have a rail kit. I use AIX on power at work and we have graphics on one 520 and it runs CDE and honestly - I'd rather use anything else. Actually the drives and sas cage/backplane were scavenged to build up a 550 instead, so it doesn't do anything right now.
>You have some impressively bad luck with some hardware there.
That I do, with Intel/AMD chips at least!

> Point being cheap works fine sometimes - now I'm not driving that CPU 95% all day long.
Neither am I. When I wasn't awake or someone wasn't scheduled to slogin and run some builds ( I have a few people who were using it to run some x86_64 builds at night ) it sat idle.

>I found a Sun Blade 1000 for free on craigslist and couldn't help myself - I haven't had a chance to spend any time on it yet, but I'll be running Solaris on it so for whatever that's worth.

Nice find! Let me know how that turns out.

>If you do want a power6 machine, 520s are starting to show up on ebay for ~$1000 give or take
Unfortunately for myself thats more than I'm able to spend, but that may change soon.

> it runs CDE
I don't blame your feelings towards AIX. As I said I'd probably slap NetBSD on it and use that. I'm probably not going the POWER route
:fuel: 900MHz 4GB
Look, I get your feelings; I've had this fight on another board that shall remain nameless. And for a time the PowerPC workstation form factor was still doing quite well compared to x86 workstations. Unfortunately, that time was around 2008. My 2007 C2D Mac mini gets walloped by the 2005 quad G5 on some tasks, but easily cruises by it in others, and by 2008 there wasn't much question. I despise the x86 ISA as well, but Intel has had a lot of money and time to invest in making it run well despite its warts, and in fairness to Intel they've tried to kill it at least three times (iAPX432, i860/960, Itanium) and the market wouldn't let them. So I can't really blame them anymore though I used to.

This isn't to say that a RISC workstation is useless in this day and age (my quad is still my daily driver, and does all my tasks except TurboTax and Android development), but all the current RISC hardware you will buy will be server oriented, so you'll be going a few years back for something useful. Unfortunately, the most powerful and still useful RISC workstation that does, you know, client workstation applications, was the one you sold me last week.

An SGI with Irix will still be a decent machine as a workstation, but for web browsing you might want to keep a Linux or BSD box in the closet to run Firefox/whatever and use the SGI as an Xterm for that purpose. You could even run the assisting box on ARM if you like. The Fuel should do the trick just fine. I like the Tez, but it's a loud and hot machine, and there are faster loud and hot machines for general purpose usage. Or you could install *BSD on the SGI, but that takes all the fun out of it! :D

The $1000 p520s are stripper units, and none of them are deskside, which means they're going to be even noisier (you can't install a baffle on them and their fans run faster). If you decide to go lower than that, say a POWER5 or even a POWER4, remember that the 970 is not only a POWER4 derivative, it has AltiVec and they don't! IBM didn't add VMX/AltiVec to "big POWER" until POWER6.

I just don't think POWER is going to do the job for you here, and that's coming from someone who's been a pro-PowerPC bigot for a very long time.
smit happens.

:Fuel: bigred , 900MHz R16K, 4GB RAM, V12 DCD, 6.5.30
:Indy: indy , 150MHz R4400SC, 256MB RAM, XL24, 6.5.10
:Indigo2IMP: purplehaze , 175MHz R10000, Solid IMPACT
probably posted from Image bruce , Quad 2.5GHz PowerPC 970MP, 16GB RAM, Mac OS X 10.4.11
plus IBM POWER6 p520 * Apple Network Server 500 * HP C8000 * BeBox * Solbourne S3000 * Commodore 128 * many more...
ClassicHasClass wrote: I despise the x86 ISA as well, but Intel has had a lot of money and time to invest in making it run well despite its warts, and in fairness to Intel they've tried to kill it at least three times (iAPX432, i860/960, Itanium) and the market wouldn't let them. So I can't really blame them anymore though I used to.


Offtopic historical note: 860 and 960 were completely distinct designs. 960 was a combination of a Berkeley RISC with some concepts from the iAPX 432 - notably, in the beginning, tagged memory; on the other hand, 860 was an odd proto-VLIW chip with no relation whatsoever to the 960 and an emphasis on HPC and graphics.