One of the reasons Huawei is far ahead of Nvidia on cost competitiveness of cluster systems is both their last (384 matrix) and current (950 based) clusters are containerized and don’t need buildings. Nvidia B200 and later systems require liquid cooling with heavy duty single story floors purposed built with embedded liquid cooling pipes in them. This is usually a $10b premium per gw of compute in building, not including the ability to reuse any other building/datacenter with older nvidia systems.
One of the reasons Huawei is far ahead of Nvidia on cost competitiveness of cluster systems is both their last (384 matrix) and current (950 based) clusters are containerized and don’t need buildings. Nvidia B200 and later systems require liquid cooling with heavy duty single story floors purposed built with embedded liquid cooling pipes in them. This is usually a $10b premium per gw of compute in building, not including the ability to reuse any other building/datacenter with older nvidia systems.