This family of Myrinet-2000 switch products is recommended for clusters with 128 or more hosts, or that may grow to this size. These are the switches that are used, for example, in the MareNostrum cluster, the fastest cluster in the world, #5 in the Nov-06 TOP500 list, 2560 IBM JS21 BladeCenter hosts plus 82 additional switch connections to file servers.

These products are highly modular, and include a complete set of enterprise features. Here is a list of all of the available components, with links to descriptions and specifications:

The enclosures provide the mechanical housing, power, cooling, network monitoring, status display, and a backplane into which you can plug up to 21 line cards. The left-most line-card slot is reserved for the M3-MONITOR monitoring line card, which is included with the enclosure. The remaining 20 line-card slots are used for the line cards listed. The monitoring line card and other line cards may be "hot swapped" -- replaced without turning the power off. The dual redundant power supplies (optionally up to 4 power supplies) are also individually hot-swappable. The two fan units, each with dual series fans, are hot-swappable. The rack-mount kit is a pair of telescoping shelf brackets to support the enclosure in standard 19-inch racks. Both for cooling and to contain EMI, any unused line-card slot must contain an M3-AIRDAM blank line card.

Common configurations include:

• Clos256: 256 host ports, no inter-switch ports. The line cards in an M3-CLOS-ENCL-B, left to right, are 1 M3-MONITOR, 8 M3-SW32-16F, 4 M3-2SW32, 8 M3-SW32-16F. The list price of the components for this configuration (shown in the photo to the right) is $80,000 ($312.50 per host port). For fewer than 256 host ports, substitute M3-AIRDAM blank line cards for M3-SW32-16F line cards.
• Clos256+256: 256 host ports, 256 interswitch ports on 64 quad-fiber ports. The line cards in an M3-CLOS-ENCL-B, left to right, are 1 M3-MONITOR, 8 M3-SW32-16F, 4 M3-4SW32-16Q, 8 M3-SW32-16F. The list price of the components for this configuration is $128,000.
• Spine768: 6 quad (24) 32-port switches presented on 192 quad-fiber ports (768 ports total). This configuration may be used as the spine for 3 Clos256+256 units. The line cards in an M3-SPINE-ENCL-B, left to right, are 1 M3-MONITOR, 6 repetitions of 1 M3-4SW32-16Q and 1 M3-THRU-16Q, and 8 M3-AIRDAM. The list price of the components for this configuration is $157,600.
• Spine1024: 8 quad (32) 32-port switches presented on 256 quad-fiber ports (1024 ports total). This configuration may be used as the spine for 4 Clos256+256 units. The line cards in an M3-SPINE-ENCL-B, left to right, are 1 M3-MONITOR, 8 repetitions of 1 M3-4SW32-16Q and 1 M3-THRU-16Q, and 4 M3-AIRDAM. The list price of the components for this configuration is $205,200.
• Spine1280: 10 quad (40) 32-port switches presented on 320 quad-fiber ports (1280 ports total). This configuration may be used as the spine for 5 Clos256+256 units. The line cards in an M3-SPINE-ENCL-B, left to right, are 1 M3-MONITOR, and 10 repetitions of 1 M3-4SW32-16Q and 1 M3-THRU-16Q. The list price of the components for this configuration is $252,800.

Configurations for more than 256 hosts up to 512 hosts are a special case. Contact sales@myri.com for efficient implementations.

Last updated: 5 January 2007