Leviathan User Usage

Refresh
Reading the columns
CPU

A live sample, not a lifetime average. The collector reads /proc twice a second apart and reports the difference, so this is what the user is running now — unlike ps -eo pcpu, where a job that pinned a core for six hours and then went idle still reports a huge number.

100% is one hardware thread fully busy. It is not a share of the machine: a leviathan reports 32 threads, so it tops out at 3200%. The figure under each percentage is the same number divided by 100, and it covers the whole fleet. Expanding a user's row breaks it down by leviathan: how many threads they are using on each machine they are logged into, next to what they have resident there. A host at 0.0 is one they are logged into with nothing running.

Memory

PSS (proportional set size): a page shared between several of a user's processes is divided among them. So a forked R job counts its shared memory once across all its workers rather than once per worker, which is the figure you want when deciding who is actually filling the box.

Load (1 / 5 / 15m)

The Unix load average: how many processes are using a CPU or waiting for one, averaged over the last 1, 5 and 15 minutes. On Linux it also counts processes blocked on uninterruptible I/O.

It is a count, not a percentage — compare it against the host's thread count. On a leviathan (32 threads):

~4Nearly idle
~32Fully busy, nothing queueing — ideal
~64Twice as much runnable work as there are threads; everything runs at roughly half speed
~256Badly oversubscribed — someone likely launched a job with the wrong core count

The three numbers show direction. 120 / 40 / 15 means load spiked in the last minute; 15 / 40 / 120 means a big job just finished and the box is draining. Equal numbers mean steady state.

High load with low CPU is an I/O problem, not a CPU one. Because uninterruptible I/O wait counts toward load, a stuck NFS mount to the NAS can drive load into the hundreds while the CPU column sits near zero. That combination is the most useful thing this column tells you.

Snapshot age

Nothing here is live-streamed. Each host writes its own snapshot from cron once a minute; this page fetches all 11 of them in parallel when you load it and stores nothing. So an age of a few seconds up to a minute is normal, and the CPU numbers can be up to a minute behind what is happening right now.

Past 10 minutes a host is flagged stale — its collector has most likely stopped. A host that could not be reached at all is marked down and is left out of every total on this page.

Hosts reporting
11 / 11
Active users
59
1465 processes
CPU in use
54.8 / 352 threads
Memory in use
107.1 GB / 1.6 TB
Usage by user CPU 100% = one thread. Memory is PSS.
User CPU Memory Procs Hosts
ahribeir 3085.8%
30.9 threads
8.5 GB
59 leviathan6
seunghwn 798.0%
8.0 threads
2.1 GB
10 leviathan3
arosenga 792.1%
7.9 threads
55.1 GB
62 leviathan5, leviathan2, leviathan4, leviathan1
Host CPU Threads Memory Procs Top command
leviathan5 200.0% 2.0 31.1 GB 50 python
leviathan2 198.0% 2.0 8.3 GB 4 python
leviathan4 198.0% 2.0 2.3 GB 4 python
leviathan1 196.1% 2.0 13.4 GB 4 python
jinoojwcho 786.4%
7.9 threads
7.3 GB
43 leviathan1, leviathan7, leviathan9
Host CPU Threads Memory Procs Top command
leviathan1 786.4% 7.9 7.3 GB 22 MATLAB
leviathan7 0.0% 0.0 22.3 MB 11 bash
leviathan9 0.0% 0.0 20.0 MB 10 bash
zlai2 3.9%
0.0 threads
3.0 GB
98 leviathan7, leviathan1, leviathan2, leviathan10
Host CPU Threads Memory Procs Top command
leviathan7 2.9% 0.0 1.5 GB 35 claude
leviathan1 1.0% 0.0 1.2 GB 33 claude
leviathan2 0.0% 0.0 19.5 MB 12 bash
leviathan10 0.0% 0.0 177.5 MB 18 bash
ajshen 3.0%
0.0 threads
415.6 MB
15 leviathan3
ltesta 2.0%
0.0 threads
2.4 GB
28 leviathan10
plerdput 1.9%
0.0 threads
2.0 GB
84 leviathan1, leviathan2, leviathan7, leviathan9, leviathan10, leviathan11
Host CPU Threads Memory Procs Top command
leviathan1 1.9% 0.0 1.8 GB 34 R
leviathan2 0.0% 0.0 15.2 MB 13 xdg-permission-
leviathan7 0.0% 0.0 16.4 MB 9 bash
leviathan9 0.0% 0.0 10.6 MB 9 dbus-daemon
leviathan10 0.0% 0.0 230.1 MB 10 R
leviathan11 0.0% 0.0 18.3 MB 9 bash
diegomar 1.0%
0.0 threads
88.5 MB
19 leviathan2
jelrod 1.0%
0.0 threads
51.8 MB
27 leviathan2, leviathan1
Host CPU Threads Memory Procs Top command
leviathan2 1.0% 0.0 29.1 MB 15 cp
leviathan1 0.0% 0.0 22.7 MB 12 bash
ngocminn 0.0%
0.0 threads
8.3 GB
13 leviathan11
cynthia7 0.0%
0.0 threads
7.9 GB
2 leviathan4
lenalian 0.0%
0.0 threads
4.4 GB
31 leviathan3, leviathan8
Host CPU Threads Memory Procs Top command
leviathan3 0.0% 0.0 269.6 MB 21 sleep
leviathan8 0.0% 0.0 4.2 GB 10 python
austinfe 0.0%
0.0 threads
1.1 GB
1 leviathan3
pallotey 0.0%
0.0 threads
805.7 MB
31 leviathan1, leviathan10
Host CPU Threads Memory Procs Top command
leviathan1 0.0% 0.0 396.4 MB 19 sleep
leviathan10 0.0% 0.0 409.3 MB 12 claude
aliceliu 0.0%
0.0 threads
621.8 MB
26 leviathan1
ecucuzze 0.0%
0.0 threads
559.7 MB
5 leviathan3
gthivier 0.0%
0.0 threads
382.8 MB
15 leviathan7
ozh 0.0%
0.0 threads
245.2 MB
79 leviathan1, leviathan3, leviathan4, leviathan6, leviathan8, leviathan9
Host CPU Threads Memory Procs Top command
leviathan1 0.0% 0.0 14.3 MB 11 code-2242ebbb54
leviathan3 0.0% 0.0 32.7 MB 11 code-110a328ea5
leviathan4 0.0% 0.0 22.2 MB 13 bash
leviathan6 0.0% 0.0 72.9 MB 19 code-e646868227
leviathan8 0.0% 0.0 24.6 MB 14 bash
leviathan9 0.0% 0.0 78.5 MB 11 code-a44adf7f53
agw2 0.0%
0.0 threads
228.9 MB
58 leviathan6, leviathan7, leviathan9, leviathan10, leviathan11
Host CPU Threads Memory Procs Top command
leviathan6 0.0% 0.0 26.2 MB 12 bash
leviathan7 0.0% 0.0 33.8 MB 10 bash
leviathan9 0.0% 0.0 62.1 MB 14 bash
leviathan10 0.0% 0.0 58.7 MB 12 bash
leviathan11 0.0% 0.0 48.0 MB 10 code-a44adf7f53
scolando 0.0%
0.0 threads
210.2 MB
56 leviathan1, leviathan3, leviathan4
Host CPU Threads Memory Procs Top command
leviathan1 0.0% 0.0 9.4 MB 14 bash
leviathan3 0.0% 0.0 176.0 MB 30 code-645f29cc31
leviathan4 0.0% 0.0 24.8 MB 12 code-2d0b7506a3
haolee 0.0%
0.0 threads
196.1 MB
11 leviathan11
lpreimes 0.0%
0.0 threads
159.8 MB
43 leviathan3, leviathan7, leviathan9
Host CPU Threads Memory Procs Top command
leviathan3 0.0% 0.0 48.9 MB 14 code-110a328ea5
leviathan7 0.0% 0.0 27.9 MB 9 code-f6cfa2ea24
leviathan9 0.0% 0.0 83.0 MB 20 code-110a328ea5
mwieckso 0.0%
0.0 threads
159.0 MB
97 leviathan7, leviathan9, leviathan10, leviathan11
Host CPU Threads Memory Procs Top command
leviathan7 0.0% 0.0 33.5 MB 24 bash
leviathan9 0.0% 0.0 18.6 MB 27 bash
leviathan10 0.0% 0.0 28.6 MB 24 bash
leviathan11 0.0% 0.0 78.2 MB 22 bash
efranke 0.0%
0.0 threads
72.7 MB
33 leviathan1, leviathan3, leviathan7
Host CPU Threads Memory Procs Top command
leviathan1 0.0% 0.0 10.3 MB 12 bash
leviathan3 0.0% 0.0 42.6 MB 12 code-125df4672b
leviathan7 0.0% 0.0 19.8 MB 9 bash
junheeo 0.0%
0.0 threads
71.1 MB
41 leviathan3, leviathan7, leviathan9, leviathan11
Host CPU Threads Memory Procs Top command
leviathan3 0.0% 0.0 16.4 MB 12 bash
leviathan7 0.0% 0.0 16.8 MB 9 bash
leviathan9 0.0% 0.0 10.5 MB 9 bash
leviathan11 0.0% 0.0 27.4 MB 11 vim
jcarzon 0.0%
0.0 threads
66.5 MB
43 leviathan3, leviathan7, leviathan9, leviathan10
Host CPU Threads Memory Procs Top command
leviathan3 0.0% 0.0 18.3 MB 12 bash
leviathan7 0.0% 0.0 18.1 MB 11 bash
leviathan9 0.0% 0.0 15.0 MB 11 bash
leviathan10 0.0% 0.0 15.1 MB 9 bash
axin 0.0%
0.0 threads
65.6 MB
39 leviathan3, leviathan4, leviathan5
Host CPU Threads Memory Procs Top command
leviathan3 0.0% 0.0 18.5 MB 12 bash
leviathan4 0.0% 0.0 23.4 MB 14 bash
leviathan5 0.0% 0.0 23.7 MB 13 bash
woonyouc 0.0%
0.0 threads
63.1 MB
36 leviathan7, leviathan9, leviathan10, leviathan11
Host CPU Threads Memory Procs Top command
leviathan7 0.0% 0.0 17.0 MB 9 bash
leviathan9 0.0% 0.0 11.8 MB 9 bash
leviathan10 0.0% 0.0 14.7 MB 9 bash
leviathan11 0.0% 0.0 19.6 MB 9 bash
dhuertao 0.0%
0.0 threads
50.6 MB
33 leviathan2, leviathan3, leviathan7
Host CPU Threads Memory Procs Top command
leviathan2 0.0% 0.0 16.8 MB 12 bash
leviathan3 0.0% 0.0 17.1 MB 12 bash
leviathan7 0.0% 0.0 16.8 MB 9 bash
mlc2 0.0%
0.0 threads
43.5 MB
12 leviathan6
tsaidi 0.0%
0.0 threads
39.4 MB
9 leviathan10
ctokubo 0.0%
0.0 threads
32.5 MB
8 leviathan7
ftownes 0.0%
0.0 threads
25.0 MB
11 leviathan3
jdaliere 0.0%
0.0 threads
23.3 MB
11 leviathan2
general 0.0%
0.0 threads
23.2 MB
11 leviathan5
minghao3 0.0%
0.0 threads
22.1 MB
12 leviathan1
davidwec 0.0%
0.0 threads
20.1 MB
11 leviathan1
mmellors 0.0%
0.0 threads
20.1 MB
11 leviathan1
akanupar 0.0%
0.0 threads
20.1 MB
11 leviathan1
jeremyl2 0.0%
0.0 threads
20.0 MB
11 leviathan1
mohanx 0.0%
0.0 threads
19.9 MB
11 leviathan1
ziqiliu2 0.0%
0.0 threads
19.2 MB
13 leviathan2
ahou 0.0%
0.0 threads
18.9 MB
11 leviathan1
aprilgen 0.0%
0.0 threads
18.9 MB
11 leviathan1
jlzhao2 0.0%
0.0 threads
18.6 MB
11 leviathan1
sukwook 0.0%
0.0 threads
18.4 MB
11 leviathan1
dtpham 0.0%
0.0 threads
17.9 MB
11 leviathan1
srayal 0.0%
0.0 threads
17.8 MB
11 leviathan1
clarenc2 0.0%
0.0 threads
17.8 MB
11 leviathan1
eyw2 0.0%
0.0 threads
17.5 MB
11 leviathan1
bcheung2 0.0%
0.0 threads
17.0 MB
11 leviathan1
sambutle 0.0%
0.0 threads
16.2 MB
11 leviathan1
namoyaw 0.0%
0.0 threads
16.0 MB
13 leviathan1
opersin 0.0%
0.0 threads
15.8 MB
11 leviathan1
lujingz 0.0%
0.0 threads
15.4 MB
17 leviathan1
yingzhu4 0.0%
0.0 threads
15.2 MB
11 leviathan1
gmena 0.0%
0.0 threads
13.7 MB
12 leviathan1
dansong 0.0%
0.0 threads
6.8 MB
11 leviathan1
Hosts
Host CPU Memory used Users Snapshot age
leviathan1
32 threads
985.4% of 3200%
29.0 GB / 123.4 GB
10.12 / 10.39 / 10.97 32 26s ago
leviathan2
32 threads
200.0% of 3200%
12.1 GB / 123.4 GB
3.47 / 3.41 / 3.28 8 26s ago
leviathan3
32 threads
801.0% of 3200%
8.8 GB / 123.4 GB
8.0 / 8.02 / 8.09 14 26s ago
leviathan4
32 threads
198.0% of 3200%
13.9 GB / 123.4 GB
2.0 / 2.0 / 2.0 5 26s ago
leviathan5
32 threads
200.0% of 3200%
33.7 GB / 123.4 GB
2.06 / 2.08 / 2.07 3 26s ago
leviathan6
32 threads
3085.8% of 3200%
12.7 GB / 123.4 GB
34.43 / 28.45 / 14.89 4 26s ago
leviathan7
32 threads
2.9% of 3200%
9.7 GB / 186.3 GB
0.03 / 0.35 / 1.12 13 26s ago
leviathan8
32 threads
0.0% of 3200%
8.3 GB / 186.3 GB
3.01 / 3.04 / 3.0 2 26s ago
leviathan9
32 threads
0.0% of 3200%
4.2 GB / 186.3 GB
0.01 / 0.02 / 0.0 9 26s ago
leviathan10
32 threads
2.0% of 3200%
14.4 GB / 186.3 GB
0.06 / 0.02 / 0.11 9 26s ago
leviathan11
32 threads
0.0% of 3200%
18.8 GB / 186.3 GB
0.06 / 0.03 / 0.01 7 26s ago