We have some devices in our server room in our office that due to the AC not running full blast on nights and Sundays, can get a little warm, even with spot cooling. To ensure better air flow, I’ve added a hi-tech piece of equipment to a PowerMac G4.

I normally would have added a PCI slot fan, but this server doesn’t have any available.
Posted by Brian Blood as Hardware, Servers at 10:52 AM UTC
No Comments »
Many years ago, before there were Xserves, in an attempt to save rack space in our cabinets, we experimented with ripping the guts out of a PowerMac G4 and stuffing them into a 2U server case. Here is a photo of one of those attempts:

It worked out fairly well and we had a couple of these running for several years.
The main piece to the puzzle was finding the right L riser card to give us access to the AGP slot and 2 of the PCI slots, one for a secondary Ethernet card and another for an ATTO SCSI card.
Posted by Brian Blood as Colocation, Hardware, Servers at 10:15 AM UTC
No Comments »
In our previous adventures with Mac Minis as “blade” servers, I thought we might try installing Ubuntu/Debian on an Intel MacMini and seeing how the system performed against an OS X client based system.
Well, we did that and about a week later we wiped the machine and imaged off one of the other Minis and set it back up under OS X.
We had one of our techs scour all he could find on the net about installing Linux on an Intel MacMini and the biggest hurdle was getting something working in the EFI realm.
We ended up using rEFIt, a project on sourceforge, to allow us to dual boot into either Debian or Tiger. This had some issues, but in the end it worked out ok.
The USB Ethernet adapter also worked rather well right out of the box.
No, the real kicker was the on-board gigabit ethernet which is used on the backside primarily for database access. The Mini uses the Yukon based chipset for it’s GigE port and and this combination with the default ethernet driver installed by Debian induces a flow-control hang under certain loads.
Marcus Bointon hinted as much in comment #6 to my original article and so when the Debian Mini developed problems communication over that interface, I was pretty sure where to look.
Debian by default picks the “sky2″ driver for that PHY and it wasn’t cutting the mustard. Apparently this bug has been around for a couple of years (the chipset is also used on some other system boards) and the “workaround” is to recompile a different ethernet driver into the kernel and it solves the issue. Since running Debian on this system was merely a trial, we decided to punt instead of sinking more time in tinkering with it.
Under Debian, the Mini did actually perform about 10% better than when it was running Tiger. Ultimately, the OS turned out to not be the biggest factor in getting more performance out of the load balanced system as a whole. Tuning Apache and making some other improvements to the web application proved to be far more useful.
Posted by Brian Blood as Hardware, Linux, Servers at 11:57 PM UTC
No Comments »
Server Monitor is an application that allows you to monitor the health of several Xserves over the network:

Sometimes the application gets a bit cranky about the connections it makes to the servers and reports that it can’t communicate or as you see here in the picture “reply not understood”. So we don’t really use it for serious monitoring other than as a cursory glance usually to check some items.
However, Apple really takes the cake with this knowledge-base article:
Xserve: Server Monitor does not authenticate with server over subnet
in which they claim that the way to fix the problems with their SOFTWARE, is to:
- Make the necessary changes to the username or password using Server Monitor.
- Quit Server Monitor.
- Shut down the Xserve that is the target of these changes.
- Remove the power cord from the back of the Xserve.
- Wait 30 seconds and plug the power cord back in.
- Power the server back on.
This sounds suspiciously similar to something an old tech friend of mine once told me:
There are sound scientifically proven reasons why one must sometimes sacrifice a chicken in order to get a SCSI chain to work.
Ugh.
Posted by Brian Blood as Colocation, Hardware, OS X Server, Servers, Soap Box at 11:33 PM UTC
No Comments »
I forgot that I had my 2GB MicroCenter USB flash drive in the pocket of my sweat pants and they got put into the wash by my wife.
I was searching and searching the whole house trying to find it.
Finally, my wife pulled it out of the dryer, I plugged it into our Philips DVP5982 1080p Upscaling DVD Player and worked perfectly.
Amazing.
Posted by Brian Blood as Hardware at 10:38 PM UTC
No Comments »
In the past couple of months, we’ve started to see the IBM/Hitachi 180 GB drives that came with the Apple Hard drive modules for the Xserve G4 and ATA Xraids fail.
We always have these in a software mirror RAID, so we don’t have any data loss, but we are proactively starting to replace these drives with new Seagate 250GB drives. These drives not only have better caches, but run cooler and with less power usage.
Posted by Brian Blood as Hardware, Servers at 9:15 AM UTC
3 Comments »
It has come to my attention that the thumbscrews on the front panel of Xserves are a very important component of the overall structural integrity of the rack mounting system. they not only keep the Xserve from coming out of the case, but they also secure the forward portion of the server to the mounted top case. I’ve seen many Xserves that seemed as if they could pop out of their cases due to a small amount of bowing in the case. Having the thumbscrews tightened down adds another vertical support component.

Posted by Brian Blood as Colocation, Hardware, Servers at 11:54 AM UTC
No Comments »
Was reading this article today on Google’s initiative to expand the economics of alternative energy:
Google expands into alternative energy
MICHAEL LIEDTKE, AP Business Writer
I love this paragraph here:
Toward that end, Google aims to produce one gigabyte of power from renewable energy at prices below the rates of electricity generated at coal-burning plants. One gigabyte power would be enough to supply the needs of a city the size of San Francisco.
I’m not exactly sure what one “gigabyte” of power is, but if Google is using them, I’m sure it’s a lot.
I wonder if it’s comparable to the power you can generate by tapping into a clock tower that’s about to be struck by lightning.
Semi-related is the speculation that Google is building their own 10Gbit optical switches.
Guess they’ll combine their gigabytes of power with the gigabits of light. See: I knew lightning would be in there somewhere!
Posted by Brian Blood as Hardware, Soap Box at 9:14 AM UTC
No Comments »
Every time we setup a server for a client, we always specify, at the minimum, mirrored drive pairs for boot and for data.
How those pairs are created has varied depending on the hardware involved.
PowerMac G5s (having only 2 native internal bays) get either a software RAID pair or a hardware RAID card. Or they get a drive bracket installed to increase internal capacity.
Xserve G4s are always built with 2 software RAID mirrors as the four bays in that system and not ability to use a hardware RAID card make it the most natural setup. Usually 2 x 60GB drives for the Boot and whatever size for the Data is appropriate for the application. A system where there will lost of media files will tend to get 2 x 500GB, otherwise, 2 x 250GB is now the sweet spot for longevity and reliability.
Xserve G5s I really don’t see any use in deploying if you aren’t using the Apple Hardware RAID card, but that also has some issues as well.
PowerMac G4s (yes we still use these) are a different story. With their 4 internal bays (5 if you want to squeeze one into where the Zip drive was spec’d to go, gives you a lot of options. We use PowerMac G4s almost exclusively at our office for things like development servers, log processing, internal project management, etc… Most of these have been with us for quite some time and have gone from one version of the OS to another as time progresses.
For some reason, I guess penuriousness is the most likely culprit, the boot drives on these systems were never more than whatever IDE drive we threw in at the point of setup. No mirroring or redundancy at all. Our data drives tended to be pairs of Ultra 2/3 SCSI disks software mirrored together.
Well I was determined that we should follow our own advice, so I’ve been on a crusade of upgrading/migrating disks/partitions/sharepoints on our internal servers so that all systems enjoy mirrored goodness.
I like the RAID cards over software RAID for 2 reasons: 1. I can easily partition the “disk” presented by the RAID card to the OS; 2. No hit on the CPU (which on a faster machine would be negligible) for performing the mirroring.
In the end, we’ve used the following devices/setups:
- ACARD AEC-6880M in mirror mode with 2 x 400GB IDE – PowerMac G4/500DP
- ACARD AEC-6890M in mirror mode with 2 x 320GB SATA – PowerMac G4/500DP
We still use 10K and 15K rpm SCSI disks in these systems to hold speed critical data like MySQL tables.
For some clients we’ve used:
- ACARD AEC-6880M in mirror mode with 2 x 250GB IDE – PowerMac G4/500DP
- ACARD AEC-6890M in mirror mode with 2 x 400GB SATA – PowerMac G5 DP
- HighPoint Tech RocketRAID 2224 with X4 external enclosure connected by Infiniband (This was FAST)
We have seen some issues with the ACARD devices, but we’re leaning towards power supply problems more than anything directly wrong with the cards. Definitely flash the cards to the latest firmware before deploying is a good tip.
As for drives, I tend to spec Seagate drives almost exclusively these days.
A mishmash of ideas and technologies, but with the inexpensive options available today, there really isn’t any reason to deploy anything (even user desktops) without some redundancy. An extra $150 at the initial setup (drive, card, whatever) can save you and your employee a lot of time (meaning money if you bill for your time) down the road when a drive WILL fail.
Posted by Brian Blood as Hardware, Servers at 1:39 PM UTC
No Comments »
So, we’ve recently purchased a Xserve G5 so that we can upgrade the hardware that our mail server runs on from a Dual G4 Xserve.
The machine purchased came with a single 80GB SATA Drive Module, so I purchased two more ADMs from a supplier along with 3 of the Seagate ES (Enterprise Series) SATA drives at 320GB in size.
We also had been planning on upgrading a customers Xserve G5 that has a Hardware RAID PCI card and 3 x 80GB drives to 3 x 400 as they will be using this as a media server in their application.
We had quite a bit of trouble getting the LSI/Megaraid card to work reliably with these three drives.
I had done some research into the issue by searching my archives of the Apple OS X Server Mailing List, and found some statements that non-Apple firmware drives do not work with that RAID card. After some empirical testing we have confirmed this to a 100% certainty. So, if you are looking to upgrade drives in your Xserve G5 RAID set, you will need to find and install drives with Apple firmware. One possible source is that the Xserve RAID does NOT have this restriction and that you might be able to swap out drives that are in that device that have Apple Firmware and use them in the Xserve G5. Of course you’ve now created an “unsupported configuration” with your Xserve RAID and that’s a choice you can make.
The main symptoms we’ve been seeing is that the megaraid card doesn’t register itself with the system soon enough from a cold boot. And when it does, it does not (using the -showdevices command) show any of the drives attached to it. Warm booting after that sometimes will get the card and drives to show up, but after creating a RAID set and shutting down/rebooting, you have the same problems and the card starts sounding it’s alarm. Basically, totally unreliable as a subsystem. We’ve tried different cards, different Xserve G5s, different cables, different drives. Only one combination worked just as you would expect it to: Apple firmware Xserve drives.
Unfortunately, we’ve probably spent WAY more time in learning this tidbit than we would have saved if we had merely purchased Apple drives to begin with.
There is a possible source of bare SATA drives from Apple: Their 500GB drive they sell to be installed in the MacPro. It is $330 though, but that is cheaper than one with a new ADM.
UPDATE: I shared this blog post with a colleague who has an Xserve G5 and uses the RAID card and I knew that saying “100%” was going to be a mistake. He is using non-Apple Maxtor 300GB drives in his setup and reports no problems.
UPDATE: I did find 4 – 500GB SATA drives that had been pulled from MacPro machines. These looked to be good Seagate drives and they had the Apple logo. $100 each. Got them in, connected them up and unfortunately, the machine exhibited mostly the same symptoms as when the drives were not Apple drives. So I ordered some more 250GB drives from a source that has Xserve parts and threw them in. Worked.
Posted by Brian Blood as Hardware, Servers at 3:09 PM UTC
No Comments »