Let The Testing Begin

I decided that I needed to do some testing to determine how these machines worked when put in close proximity with each other. The first step was to find a rack solution that would allow me to get as many as possible per rack unit. These were a few shelving makers in the market space, but they all had either a 2 machine per 1U solution (80 machines per cabinet), or an 8 machine per 5U solution (64 machines per cabinet). I thought this number was way too low, so I contacted one of the vendors (H-Squared) and spoke to the owner, he told me they had been mulling over a design that would allow 4 mini’s per 1U, without restricting airflow to any of the machines, I immediately asked if I could beta test 5 prototypes, he said “Sure, right after I finish hand making them for you!”

In the mean time I had to order some test Mac Mini’s. I used the online configuration tool from Apple, but soon learned that I couldn’t get a Mac Mini with 16GB of RAM, so I decided to order the Mac Mini Server Core i7 chip with a 256GB SSD and 4GB of RAM (I would swap out those RAM chips for 16GB of Kingston memory once the machines arrived)

The final configuration of the Mac Mini’s is:

Mac Mini Server Core i7 Quad Core Processor
16GB RAM
256GB SSD (Solid State Drive)
In a week, the shelving arrived and I was ready to do some scaled testing.

I commandeered some space in a rack and placed the 16 machines in their new cozy shelving and proceeded to run non-stop testing for days. The results of which were surprising. It turns out the Mac Mini’s run pretty hot, with the CPU core temps at 210 degrees and the rest of the machine at 150, but these temps didn’t set off any alarms, nor were the fans running at top speed. I also ran the same tests with 8 Mac Mini’s in the 8 across racking configuration with similar resuls. At this point I was convinced that I was going to try to stuff 160 Mac Mini’s into a single cabinet…. I might be crazy, but this is going to be fun.

Here are some pictures of the shelving::

 

20120918-082747 copy 20120918-082825 copy

How many can I fit in a rack

“How Many can I fit in a rack?”  This became the main question. I had been used to putting 40 XServe’s in a single rack netting me 320 cores per rack, but I wanted to do better.  I began thinking that this may not be such a bad thing after all.  The XServe’s were limited to a single machine per rack unit “U”, but I may be able to get multiple Mac Mini’s per “U”.  The Xserve’s were very power hungry, requiring powerful Power distribution units (PDU’s), while the Mac Mini’s sipped the juice. The XServe’s ran hot, the Mini’s were cool. So, the question became, “Just how many can I fit in a rack?”

Oh No

Now that Apple has eliminated the XServe, and I can no longer find them in the marketplace I need to come up with a way to get the same or better CPU core density into a standard 2′ by 2′ datacenter rack. (A Datacenter Rack is a cabinet that has 44 spaces, or horizontal units inside, each unit is referred to as a “U”. Computer manufacturers measure the height of their servers in “U”, so some servers are 1 “U” like the XServe). In the past this would have been easy, I would call Apple and order 40 top of the line multi-core XServe’s and simply build the rack with 40 servers, each with 2 quad core processors, but now Apple is calling the Mac Mini it’s new server. This poses some issues for me.

1. The Mac Mini is not a server grade hardware package

2. It only has a single power supply

3. No IPMI (Out of Band Remote Management)

But, It’s the only option, and we need Macintosh processing BAD!!!

Mac Mini Mania

The problem, how do we build a high density Macintosh rack, with as many cores as possible, that occupies a single rack footprint, now that Apple has eliminated the Xserve.

The solution, stuff as many of the highest powered Mac Mini servers as you possibly can into a standard data center rack.

In this blog, I will outline the process I developed to get as many Mac Minis as I can into a single 2′ x 2′ datacenter footprint.