VSC-2 – retired

VSC-2 is retired, it went out of service by the end of December 2018.

 

VSC-2 was installed in May 2011 at the Arsenal TU building (Objekt 214) in Vienna by Opens external link in new windowMEGWARE Computer.

It consisted of 1314 nodes, each with 2 processors (AMD Opteron 6132 HE, 2.2 GHz, 8 cores) with QDR InfiniBand.

 

Opens external link in new windowVSC-2 in the TOP500 list (Rank 56 in June 2011)

 

Press coverage on VSC-2

VSC-2 – Hard- and Software

  • operating system: Linux (Scientific Linux 6.0)

  • batch system: Oracle Grid Engine

  • compilers and software: Intel compiler (Fortran, C/C++), GNU compilers (g77, gfortran, gcc), debugging (gdb, idb), Intel_MKL, Intel_MPI, Open_MPI, additional applications installed on request

  • 1314 compute nodes SlashFive (Megware)
    each equipped with 2 processors (AMD Opteron Magny Cours 6132HE, 2.2 GHz, 8 cores)
    32 GByte of memory (8 x 4 GByte ECC DDR3) and a 16 GByte SSD disk
    network adapters: 1 x InfiniBand QDR and 2 x Gigabit Ethernet LAN
    total number of available processor cores = 21,024 and total memory = 42 TByte

  • interconnect: InfiniBand QDR (40 Gbit/s)
    88 switches Voltaire Grid Director 4036 with 36 ports per switch
    fat-tree topology with 2 sub-networks (possibility of extension by a third sub-network)
    8 root switches plus 12 spine and 28 edge switches in each sub-network
    providing 672 ports per sub-network, that is 1344 ports in total

  • parallel file system (Fraunhofer FHGFS) as temporary file space for running jobs:
    12 storage servers each equipped with 2 processors (Intel Xeon E5620 Westmere, 2.4GHz, 4 cores)
    48 GByte of memory (6 x 8 GB ECC DDR3)
    network adapters: 1 x InfiniBand QDR and 2 x Gigabit Ethernet LAN
    redundant power supply
    disks: 5 x 300 Gbyte SAS for the operating system and
    12 x 2 TByte SAS disks for each of the storage servers in the Fraunhofer FHGFS
    accumulated I/O bandwidths of the FHGFS = 6000 MByte/s

  • user home file system (NFS) for permanent storage of user data:
    2 NFS servers each equipped with 2 processors (Intel Xeon E5620 Westmere, 2.4GHz, 4 cores)
    48 GByte of memory (6 x 8 GB ECC DDR3)
    network adapters: 1 x InfiniBand QDR and 2 x Gigabit Ethernet LAN
    redundant power supply
    disks: 5 x 300 Gbyte SAS for the operating system and
    24 x 2 TByte disks in RAID 5 

  • 3 login servers and 2 master nodes Saxonide 6100 Dual Opteron (Megware)
    each equipped with 2 processors (AMD Opteron Magny Cours 6132HE, 2.2 GHz, 8 cores)
    32 GByte of memory (8 x 4 GByte ECC DDR3)
    disks: 300 GByte in RAID 1
    network adapters: 1 x InfiniBand QDR and 2 x Gigabit Ethernet LAN
    redundant power supply

  • management software: ClustWare-Appliance (Megware)

  • 2 Gigabit Ethernet networks for management

  • 30 racks cooled by Knürr CoolTherm® – water cooled back-doors with 17 kW cooling power each