Infrastructure¶
The main components of the maxwell cluster are
- fast dedicated storage (cluster file-systems)
- fast, low-latency network (infiniband)
- high-memory compute nodes with substantial number of GPGPUs
The pages give a very brief overview on the corresponding components and their status (where possible).
Summary of infrastructure¶
| Compute | specs | Infiniband | specs | Storage | specs | ||
|---|---|---|---|---|---|---|---|
| CPU+GPU nodes | 946 | root switches | 6 | GPFS exfel | ~60 PB | ||
| Total number of cores with hyperthreading | 96872 | top switches | 12 | GPFS petra3 | 30 PB | ||
| Total number of PHYSICAL cores | 48564 | leaf switches | 42 | GPFS cfel | 1.6 PB | ||
| Theoretical CPU peak performance | 1889 TFlops | IB cables (#) | ~1500 | GPFS cssb | 11 PB | ||
| Total RAM | 532 TB | IB cables (length) | ~10km | DUST | 3 PB | ||
| GPU nodes | 201 | ||||||
| Total number of GPUs | 404 | ||||||
| Theoretical GPU peak performance | 3026 TFlops | ||||||
| Total peak performance | 4915 TFlops |
Adding resources to maxwell: It's well possible to add for example groups resources to maxwell. Please get in touch maxwell.service@desy.de for details. Keep in mind that we will need to impose certain constraints to keep the cluster as little heterogeneous as feasible.