, ,

Power and Cooling (Multiple-Computer Installations)

This article applies to groups of computers which consume 1,000+ Watts of electricity. Review your quote or contact us to determine how much your systems will require (the power and cooling numbers are typically listed at the end of the quote – below the total cost of the system).

Acoustic Considerations – Fan Noise

Microway’s server systems provide intelligent cooling fans which ramp up and down with system load. However, most systems are very high-density with more than 1,000 Watts consumed per rack unit. Cooling such systems requires high-speed fans which generate significant noise. Most cluster systems will generate 60 dB to 80 dB. This noise level may be subject to safety regulations (e.g., OSHA) and will be audible from other offices in the building. It is recommended that your cluster be placed in a location designed for servers.

If noise is a concern, many of Microway’s workstations – most notably the WhisperStation – are designed to be very quiet and comfortable for an office environment. Quiet HPC Clusters built from Microway WhisperStations are available. If you have any concerns, discuss these matters with your salesperson. In general, if it’s not a WhisperStation you should consider whether the system is appropriate for a lab or office environment.

Power

Microway servers feature auto-switching power supplies which accept both 120V and 208V power, so there are a variety of options when powering multiple computers. The most common electrical circuits are pictured below. Your salesperson can provide a customized recommendation including the rackmount cabinet, power distribution units and optional UPS backup power.

In general, 208V is recommended over 120V. Using 208V allows more systems to run on a single circuit, and each system runs several percent more efficiently.
Diagram of common high power electrical receptacles

120V 20A NEMA 5-20 and L5-20 Electrical Outlets

After a 20% de-rating for safety, these circuits supply up to 1,920 Watts of power.

120V 30A NEMA L5-30 Electrical Outlets

After a 20% de-rating for safety, these circuits supply up to 2,880 Watts of power.

208V 20A NEMA L6-20 Electrical Outlets

After a 20% de-rating for safety, these circuits supply up to 3,328 Watts of power.

208V 30A NEMA L6-30 Electrical Outlets

After a 20% de-rating for safety, these circuits supply up to 4,992 Watts of power.

3-Phase 208V NEMA L21-20 Electrical Outlets

After safety de-rating, these circuits supply up to 5,700 Watts of power.

3-Phase 208V CS 8365 Electrical Outlets

After safety de-rating, these circuits supply up to 14,400 Watts of power. Depending upon which PDU is selected, the actual load on each PDU may need to be less – 10kW, 12.6kW or 14.4kW.

Before assuming a particular circuit layout will be sufficient for your new equipment, review:

  • Is other equipment already connected to the electrical circuit? It is common for multiple outlets to connect to the same circuit, so don’t assume that an empty outlet means power is available. You will need to perform an inventory of the power required by your existing equipment.
  • Particularly for smaller circuits: will you be able to evenly split your servers across multiple circuits? Three 1,000W systems will not successfully connect to two 1,500W circuits. Determine how much electricians will charge for installation of multiple circuits, because it is likely that a single large circuit will be a better choice.

Cooling

Groups of computers typically require special cooling arrangements – your building air-conditioning is designed for offices and will not be able to keep up with the load of compute servers. Note that some facilities reduce or shut down air-conditioning during holidays and weekends. Systems will overheat if they are run in a closed room without sufficient cooling.

A server room or datacenter is the best location for your systems. Microway servers and clusters are designed for installation in industry-standard rackmount cabinets, so you should have no concern when using your own cabinets. We can also provide cabinets with network and power cables pre-wired.

Many facilities specify a maximum power load per rackmount cabinet. You may be restricted to only 7kW or 10kW per cabinet, which would result in racks which are only half-filled. To be certain, present the cooling requirements (provided by your salesperson) to your facilities manager. Your facilities personnel will have details on the cooling load limitations of the datacenter/server room.

You May Also Like

  • Knowledge Center

    Common Maintenance Tasks (Clusters)

    The following items should be completed to maintain the health of your Linux cluster. For servers and workstations, please see Common Maintenance Tasks (Workstations and Servers). Backup non-replaceable data Remember that RAID is not a replacement for backups. If your system is stolen, hacked or started on fire, your data will be gone forever. Automate this…

  • Knowledge Center

    Detailed Specifications of the “Ice Lake SP” Intel Xeon Processor Scalable Family CPUs

    This article provides in-depth discussion and analysis of the 10nm Intel Xeon Processor Scalable Family (formerly codenamed “Ice Lake-SP” or “Ice Lake Scalable Processor”). These processors replace the previous 14nm “Cascade Lake-SP” microarchitecture and are available for sale as of April 6, 2021. The “Ice Lake SP” CPUs are the 3rd generation of Intel’s Xeon…

  • Knowledge Center

    Detailed Specifications of the AMD EPYC “Milan” CPUs

    This article provides in-depth discussion and analysis of the 7nm AMD EPYC processor (codenamed “Milan” and based on AMD’s Zen3 architecture). EPYC “Milan” processors replace the previous “Rome” processors and are available for sale as of March 15th, 2021. These new CPUs are the third iteration of AMD’s EPYC server processor family. They are compatible…