Navigation

Search

CADRE

Computation and Data Resource Exchange

Rivanna Research Computing Cluster

Summary

Access Options

FastX Client (GNOME, KDE), or SSH (terminal)

Computational Capacity Over 7,000 cores
Access Networks

Access points into the cluster are 10G: access paths to leased-storage locations are relatively fast (~350 MB/s), most clients connecting wirelessly or by means of a gigE network connection will experience inbound+outbound transfer rates of about 40-80 MB/sec

Internal Networks

inbound+outbound maximum network-IO throughput rate of about 5,600 MB/sec for all Infiniband connected nodes, the rate is about 120 MB/sec for up to 4,800 MB/s worth of evenly distributed network activity on all non-Infiniband connected nodes. All nodes use the best-available internal network to access /scratch (large shared storage)

Memory Capacity

Highest possible core:GB-memory ratio on a single node is 1:1000, most nodes have at least 128GB

Storage Options
  • Lustre storage as /scratch (1.44 PB short-term capacity)
  • Value storage volumes
  • Enterprise storage volumes
  • Swift containers

Distinguishing Features

  • 5 large-memory compute-nodes with 1,024 GB of DDR-4 RAM installed per server
  • 4,800 core homogenous set of computational resources interconnected by a low latency FDR Infiniband network
  • 56-Gbps Access to the Lustre storage (/scratch)
  • 2 NVIDIA K20 GPUs
  • 8 Knights Landing nodes, with 256 hyper-threaded cores per node
  • Largest concentration of centrally managed computing capacity at UVA

 

Detailed Interactive & Compute Node Specifications

Qty Base Micro architecture Cores Per Node GB RAM Per Node MHz Processor Speed Memory Speed Internal Network (gbps) UVA Network (gpbs) Queue Assignment(s)
4
Sandy Bridge
20
64
2,500
DDR3-1866
56
10 (direct)
none (interactive nodes)
240
Sandy Bridge
20
128
2,500
DDR3-1866
56
10 (routed)
serial and parallel
2
Sandy Bridge
16
256
2,600
DDR3-1600
40
10 (routed)
gpu
5
Sandy Bridge
16
1,024
2,600
DDR4-1866
56
10 (routed)
largemem
11
Sandy Bridge
16
128
2,700
DDR3-1600
1
1 (routed)
economy
4
Nehalem
8
48
2,400
DDR3-1066
1
1 (routed)
economy
22
Nehalem
12
96
2,530
DDR3-1333
1
1 (routed)
economy
7
Nehalem
12
96
2,670
DDR3-1333
1
1 (routed)
economy
58
Nehalem
8
48
2,670
DDR3-1333
1
1 (routed)
economy
11
Bulldozer
16
16
2,000
DDR3-1333
1
1 (routed)
economy
8
Knights Landing
64 (256)
208
1,300 
DDR4-1200
56
10 (routed)
development