Serving data from the Marine Institute (Ireland)
Brought to you by the Marine Institute(Ireland)
|
Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland) |
Brought to you by the Marine Institute(Ireland) |
Current time is 2020-04-01T19:36:36+00:00
Startup was at 2020-03-18T07:02:05+00:00
Last major LoadDatasets started 14m 55s ago and finished after 150 seconds.
nGridDatasets = 9
nTableDatasets = 36
nTotalDatasets = 45
n Datasets Failed To Load (in the last major LoadDatasets) = 0
Response Failed Time (since last major LoadDatasets) n = 5, median ~= 1 ms
Response Failed Time (since last Daily Report) n = 630, median ~= 8 ms
Response Failed Time (since startup) n = 17577, median ~= 24 ms
Response Succeeded Time (since last major LoadDatasets) n = 86, median ~= 49 ms
Response Succeeded Time (since last Daily Report) n = 5073, median ~= 48 ms
Response Succeeded Time (since startup) n = 115244, median ~= 39 ms
TaskThread has finished 0 out of 0 tasks. Currently, no task is running.
TaskThread Failed Time (since last Daily Report) n = 0
TaskThread Failed Time (since startup) n = 0
TaskThread Succeeded Time (since last Daily Report) n = 0
TaskThread Succeeded Time (since startup) n = 0
Number of threads: Tomcat-waiting=0, inotify=0, other=66
MemoryInUse= 932 MB (highWaterMark= 3325 MB) (Xmx ~= 5888 MB)
Major LoadDatasets Time Series: MLD Datasets Loaded Requests (medianTime in seconds) Number of Threads Memory (MB)
timestamp time nTry nFail nTotal nSuccess (median) nFailed (median) tomWait inotify other inUse highWater
2020-04-01T19:24:06+00:00 145s 6 0 45 64 ( 0) 4 ( 0) 0 0 67 81 3325
2020-04-01T19:09:27+00:00 166s 7 0 45 143 ( 0) 6 ( 0) 0 0 67 81 3325
2020-04-01T18:54:30+00:00 170s 7 0 45 68 ( 0) 10 ( 0) 0 0 68 82 3325
2020-04-01T18:39:17+00:00 157s 8 0 45 85 ( 0) 17 ( 0) 0 0 67 81 3325
2020-04-01T18:24:03+00:00 143s 6 0 45 131 ( 0) 14 ( 0) 0 0 67 81 3325
2020-04-01T18:09:14+00:00 154s 7 0 45 79 ( 0) 17 ( 0) 0 0 67 81 3325
2020-04-01T17:54:27+00:00 166s 8 0 45 111 ( 0) 7 ( 0) 0 0 74 74 3325
2020-04-01T17:39:16+00:00 156s 6 0 45 81 ( 0) 6 ( 0) 0 0 67 78 3325
2020-04-01T17:24:11+00:00 151s 8 0 45 46 ( 0) 3 ( 0) 0 0 67 81 3325
2020-04-01T17:09:21+00:00 161s 7 0 45 103 ( 0) 6 ( 0) 0 0 67 80 3325
2020-04-01T16:54:26+00:00 166s 8 0 45 143 ( 0) 13 ( 0) 0 0 68 82 3325
2020-04-01T16:39:07+00:00 147s 6 0 45 46 ( 0) 16 ( 0) 0 0 67 81 3325
2020-04-01T16:24:15+00:00 155s 6 0 45 104 ( 0) 6 ( 0) 0 0 67 108 3325
2020-04-01T16:09:25+00:00 165s 11 0 45 167 ( 0) 26 ( 0) 0 0 67 80 3325
2020-04-01T15:54:45+00:00 186s 7 0 45 67 ( 0) 3 ( 0) 0 0 68 80 3325
2020-04-01T15:39:43+00:00 184s 6 0 45 123 ( 0) 8 ( 0) 0 0 67 284 3325
2020-04-01T15:24:23+00:00 163s 6 0 45 131 ( 0) 32 ( 0) 0 0 68 81 3325
2020-04-01T15:09:44+00:00 185s 7 0 45 312 ( 0) 34 ( 0) 0 0 67 79 3325
2020-04-01T14:54:48+00:00 188s 9 0 45 205 ( 0) 16 ( 0) 0 0 76 65 3325
2020-04-01T14:39:29+00:00 170s 7 0 45 84 ( 0) 7 ( 0) 0 0 67 78 3325
2020-04-01T14:24:15+00:00 156s 6 0 45 117 ( 0) 10 ( 0) 0 0 67 80 3325
2020-04-01T14:09:20+00:00 161s 7 0 45 110 ( 0) 11 ( 0) 0 0 67 79 3325
2020-04-01T13:54:56+00:00 197s 7 0 45 110 ( 0) 18 ( 0) 0 0 67 75 3325
2020-04-01T13:39:30+00:00 171s 8 0 45 121 ( 0) 10 ( 0) 0 0 67 80 3325
2020-04-01T13:24:11+00:00 152s 6 0 45 91 ( 0) 13 ( 0) 0 0 67 81 3325
2020-04-01T13:09:17+00:00 158s 7 0 45 83 ( 0) 6 ( 0) 0 0 67 64 3325
2020-04-01T12:54:25+00:00 166s 7 0 45 126 ( 0) 47 ( 0) 0 0 68 81 3325
2020-04-01T12:39:14+00:00 155s 12 0 45 114 ( 0) 47 ( 0) 0 0 67 81 3325
2020-04-01T12:24:00+00:00 142s 6 0 45 88 ( 0) 6 ( 0) 0 0 67 81 3325
2020-04-01T12:09:10+00:00 151s 7 0 45 57 ( 0) 11 ( 0) 0 0 67 81 3325
2020-04-01T11:54:27+00:00 169s 7 0 45 103 ( 0) 28 ( 0) 0 0 68 79 3325
2020-04-01T11:39:19+00:00 161s 8 0 45 90 ( 0) 5 ( 0) 0 0 67 81 3325
2020-04-01T11:24:07+00:00 149s 7 0 45 46 ( 0) 3 ( 0) 0 0 67 81 3325
2020-04-01T11:09:18+00:00 159s 7 0 45 73 ( 0) 4 ( 0) 0 0 67 80 3325
2020-04-01T10:54:29+00:00 171s 7 0 45 120 ( 0) 12 ( 0) 0 0 68 74 3325
2020-04-01T10:39:08+00:00 150s 8 0 45 118 ( 0) 8 ( 0) 0 0 67 81 3325
2020-04-01T10:24:02+00:00 144s 6 0 45 84 ( 0) 5 ( 0) 0 0 67 81 3325
2020-04-01T10:09:16+00:00 157s 6 0 45 69 ( 0) 9 ( 0) 0 0 67 81 3325
2020-04-01T09:54:32+00:00 174s 8 0 45 66 ( 0) 10 ( 0) 0 0 68 82 3325
2020-04-01T09:39:13+00:00 155s 6 0 45 120 ( 0) 27 ( 0) 0 0 67 92 3325
2020-04-01T09:24:10+00:00 152s 8 0 45 87 ( 0) 9 ( 0) 0 0 67 81 3325
2020-04-01T09:09:06+00:00 148s 6 0 45 67 ( 0) 9 ( 0) 0 0 67 81 3325
2020-04-01T08:54:21+00:00 163s 7 0 45 92 ( 0) 5 ( 0) 0 0 68 80 3325
2020-04-01T08:39:33+00:00 175s 7 0 45 109 ( 0) 8 ( 0) 0 0 67 74 3325
2020-04-01T08:24:23+00:00 165s 7 0 45 107 ( 0) 7 ( 0) 0 0 68 81 3325
2020-04-01T08:10:50+00:00 253s 25 0 45 85 ( 0) 22 ( 0) 0 0 67 72 3325
2020-04-01T07:54:18+00:00 161s 8 0 45 61 ( 0) 10 ( 0) 0 0 68 81 3325
2020-04-01T07:39:25+00:00 167s 7 0 45 97 ( 0) 9 ( 0) 0 0 67 131 3325
2020-04-01T07:24:17+00:00 160s 6 0 45 83 ( 0) 5 ( 0) 0 0 68 83 3325
2020-04-01T07:09:14+00:00 157s 11 0 45 60 ( 0) 10 ( 0) 0 0 67 80 3325
2020-04-01T06:54:21+00:00 164s 8 0 45 89 ( 0) 11 ( 0) 0 0 68 77 3325
2020-04-01T06:39:24+00:00 166s 7 0 45 54 ( 0) 4 ( 0) 0 0 67 82 3325
2020-04-01T06:24:23+00:00 166s 6 0 45 75 ( 0) 4 ( 0) 0 0 68 81 3325
2020-04-01T06:09:18+00:00 161s 8 0 45 161 ( 0) 10 ( 0) 0 0 67 82 3325
2020-04-01T05:54:15+00:00 158s 8 0 45 74 ( 0) 8 ( 0) 0 0 67 81 3325
2020-04-01T05:39:25+00:00 168s 7 0 45 68 ( 0) 8 ( 0) 0 0 67 82 3325
2020-04-01T05:24:19+00:00 163s 6 0 45 85 ( 0) 9 ( 0) 0 0 68 81 3325
2020-04-01T05:09:14+00:00 158s 6 0 45 65 ( 0) 23 ( 0) 0 0 67 80 3325
2020-04-01T04:54:17+00:00 161s 9 0 45 109 ( 0) 19 ( 0) 0 0 67 79 3325
2020-04-01T04:39:25+00:00 169s 7 0 45 93 ( 0) 4 ( 0) 0 0 67 77 3325
2020-04-01T04:24:17+00:00 161s 5 0 45 122 ( 0) 14 ( 0) 0 0 68 74 3325
2020-04-01T04:10:29+00:00 233s 7 0 45 202 ( 1) 7 ( 0) 0 0 68 170 3325
2020-04-01T03:54:25+00:00 170s 9 0 45 88 ( 0) 12 ( 0) 0 0 68 81 3325
2020-04-01T03:39:29+00:00 174s 7 0 45 56 ( 0) 18 ( 0) 0 0 67 81 3325
2020-04-01T03:24:13+00:00 157s 6 0 45 97 ( 0) 11 ( 0) 0 0 67 79 3325
2020-04-01T03:09:23+00:00 168s 6 0 45 71 ( 0) 4 ( 0) 0 0 67 81 3325
2020-04-01T02:54:22+00:00 167s 9 0 45 49 ( 0) 3 ( 0) 0 0 68 81 3325
2020-04-01T02:39:29+00:00 174s 8 0 45 80 ( 0) 5 ( 0) 0 0 67 82 3325
2020-04-01T02:24:09+00:00 154s 6 0 45 51 ( 0) 3 ( 0) 0 0 67 81 3325
2020-04-01T02:09:18+00:00 163s 6 0 45 70 ( 0) 4 ( 0) 0 0 67 81 3325
2020-04-01T01:54:14+00:00 159s 10 0 45 74 ( 0) 8 ( 0) 0 0 67 81 3325
2020-04-01T01:39:24+00:00 169s 7 0 45 51 ( 0) 5 ( 0) 0 0 67 82 3325
2020-04-01T01:24:19+00:00 164s 6 0 45 67 ( 0) 4 ( 0) 0 0 68 81 3325
2020-04-01T01:09:20+00:00 166s 6 0 45 64 ( 0) 8 ( 0) 0 0 67 82 3325
2020-04-01T00:54:11+00:00 157s 7 0 45 49 ( 0) 3 ( 0) 0 0 67 81 3325
2020-04-01T00:39:28+00:00 173s 9 0 45 72 ( 0) 4 ( 0) 0 0 67 82 3325
2020-04-01T00:24:23+00:00 168s 7 0 45 85 ( 0) 18 ( 0) 0 0 68 81 3325
2020-04-01T00:09:14+00:00 160s 7 0 45 91 ( 0) 12 ( 0) 0 0 67 81 3325
2020-03-31T23:54:15+00:00 160s 7 0 45 62 ( 0) 4 ( 0) 0 0 67 81 3325
2020-03-31T23:39:24+00:00 170s 7 0 45 49 ( 0) 3 ( 0) 0 0 67 82 3325
2020-03-31T23:24:20+00:00 166s 8 0 45 111 ( 0) 27 ( 0) 0 0 68 81 3325
2020-03-31T23:09:17+00:00 162s 6 0 45 52 ( 0) 6 ( 0) 0 0 67 82 3325
2020-03-31T22:54:23+00:00 168s 7 0 45 49 ( 0) 3 ( 0) 0 0 68 82 3325
2020-03-31T22:39:30+00:00 176s 7 0 45 91 ( 0) 15 ( 0) 0 0 67 82 3325
2020-03-31T22:24:19+00:00 165s 8 0 45 365 ( 0) 3 ( 0) 0 0 68 82 3325
2020-03-31T22:09:14+00:00 160s 6 0 45 47 ( 0) 3 ( 0) 0 0 67 81 3325
2020-03-31T21:54:19+00:00 165s 7 0 45 127 ( 0) 10 ( 0) 0 0 73 81 3325
2020-03-31T21:39:28+00:00 174s 7 0 45 68 ( 0) 5 ( 0) 0 0 67 81 3325
2020-03-31T21:24:16+00:00 162s 8 0 45 85 ( 0) 7 ( 0) 0 0 67 81 3325
2020-03-31T21:09:13+00:00 160s 6 0 45 84 ( 0) 21 ( 0) 0 0 68 65 3325
2020-03-31T20:54:16+00:00 162s 7 0 45 78 ( 0) 6 ( 0) 0 0 67 81 3325
2020-03-31T20:39:31+00:00 178s 7 0 45 86 ( 0) 7 ( 0) 0 0 67 84 3325
2020-03-31T20:24:04+00:00 150s 6 0 45 76 ( 0) 6 ( 0) 0 0 67 80 3325
2020-03-31T20:09:20+00:00 166s 9 0 45 114 ( 0) 8 ( 0) 0 0 67 76 3325
2020-03-31T19:54:13+00:00 159s 7 0 45 95 ( 0) 5 ( 0) 0 0 67 81 3325
2020-03-31T19:39:41+00:00 187s 8 0 45 108 ( 0) 16 ( 0) 0 0 67 81 3325
2020-03-31T19:24:16+00:00 162s 6 0 45 108 ( 0) 19 ( 0) 0 0 67 81 3325
2020-03-31T19:09:21+00:00 168s 8 0 45 119 ( 0) 17 ( 0) 0 0 71 81 3325
2020-03-31T18:54:21+00:00 167s 9 0 45 89 ( 0) 10 ( 0) 0 0 68 80 3325
2020-03-31T18:39:29+00:00 176s 7 0 45 163 ( 0) 6 ( 0) 0 0 67 82 3325
Major LoadDatasets Times Distribution (since last Daily Report):
n = 49, median ~= 210000 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 49
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Major LoadDatasets Times Distribution (since startup):
n = 1394, median ~= 210129 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 1392
<= 10 min: 2
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since last Daily Report):
n = 1, median ~= 75 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 1
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since startup):
n = 33, median ~= 168 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 9
<= 200 ms: 11
<= 500 ms: 5
<= 1 s: 3
<= 2 s: 3
<= 5 s: 2
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last major LoadDatasets):
n = 5, median ~= 1 ms
0 ms: 2
1 ms: 1
2 ms: 0
<= 5 ms: 1
<= 10 ms: 1
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last Daily Report):
n = 630, median ~= 8 ms
0 ms: 145
1 ms: 90
2 ms: 2
<= 5 ms: 55
<= 10 ms: 43
<= 20 ms: 13
<= 50 ms: 92
<= 100 ms: 23
<= 200 ms: 73
<= 500 ms: 44
<= 1 s: 18
<= 2 s: 27
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 5
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since startup):
n = 17577, median ~= 24 ms
0 ms: 3211
1 ms: 1868
2 ms: 656
<= 5 ms: 1680
<= 10 ms: 491
<= 20 ms: 312
<= 50 ms: 3896
<= 100 ms: 952
<= 200 ms: 2058
<= 500 ms: 1539
<= 1 s: 509
<= 2 s: 232
<= 5 s: 51
<= 10 s: 6
<= 20 s: 6
<= 1 min: 79
<= 2 min: 26
<= 5 min: 3
<= 10 min: 1
<= 20 min: 0
<= 1 hr: 1
> 1 hr: 0
Response Succeeded Time Distribution (since last major LoadDatasets):
n = 86, median ~= 49 ms
0 ms: 6
1 ms: 1
2 ms: 5
<= 5 ms: 2
<= 10 ms: 8
<= 20 ms: 0
<= 50 ms: 22
<= 100 ms: 5
<= 200 ms: 7
<= 500 ms: 6
<= 1 s: 6
<= 2 s: 7
<= 5 s: 7
<= 10 s: 4
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last Daily Report):
n = 5073, median ~= 48 ms
0 ms: 310
1 ms: 155
2 ms: 213
<= 5 ms: 249
<= 10 ms: 295
<= 20 ms: 152
<= 50 ms: 1246
<= 100 ms: 390
<= 200 ms: 581
<= 500 ms: 408
<= 1 s: 457
<= 2 s: 274
<= 5 s: 221
<= 10 s: 110
<= 20 s: 9
<= 1 min: 1
<= 2 min: 0
<= 5 min: 2
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since startup):
n = 115244, median ~= 39 ms
0 ms: 8136
1 ms: 4937
2 ms: 5966
<= 5 ms: 6374
<= 10 ms: 7991
<= 20 ms: 6069
<= 50 ms: 28999
<= 100 ms: 7931
<= 200 ms: 12800
<= 500 ms: 8223
<= 1 s: 5593
<= 2 s: 4294
<= 5 s: 3046
<= 10 s: 4499
<= 20 s: 258
<= 1 min: 63
<= 2 min: 20
<= 5 min: 23
<= 10 min: 22
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
TaskThread Failed Time Distribution (since last Daily Report):
n = 0
TaskThread Failed Time Distribution (since startup):
n = 0
TaskThread Succeeded Time Distribution (since last Daily Report):
n = 0
TaskThread Succeeded Time Distribution (since startup):
n = 0
SgtMap topography nFromCache=19 nNotFromCache=368
GSHHS: nCached=100 of 100, nCoarse=1896, nSuccesses=2433, nTossed=816
NationalBoundaries: nCached=100 of 100, nCoarse=304, nSuccesses=638, nTossed=69
StateBoundaries: nCached=100 of 100, nCoarse=218, nSuccesses=624, nTossed=59
Rivers: nCached=100 of 100, nCoarse=293, nSuccesses=638, nTossed=69
bufferedImage isAccelerated=[unknown]
Number of threads: Tomcat-waiting=0, inotify=0, other=66
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)
#1 Thread[AsyncFileHandlerWriter-1867750575,5,main] TIMED_WAITING daemon
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.6/java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:513)
java.base@11.0.6/java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:675)
app//org.apache.juli.AsyncFileHandler$LoggerThread.run(AsyncFileHandler.java:159)
#2 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#3 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#4 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#5 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#6 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#7 Thread[cluster1-nio-worker-4,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#8 Thread[cluster1-nio-worker-5,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#9 Thread[cluster1-nio-worker-6,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#10 Thread[cluster1-nio-worker-7,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#11 Thread[cluster1-reconnection-0,5,main] WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#12 Thread[cluster1-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#13 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#14 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.6/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#15 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#16 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#17 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#18 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#19 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#20 Thread[cluster2-nio-worker-4,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#21 Thread[cluster2-nio-worker-5,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#22 Thread[cluster2-nio-worker-6,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#23 Thread[cluster2-nio-worker-7,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#24 Thread[cluster2-reconnection-0,5,main] TIMED_WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#25 Thread[cluster2-reconnection-1,5,main] WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#26 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#27 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.6/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#28 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#29 Thread[cluster3-nio-worker-0,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#30 Thread[cluster3-nio-worker-1,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#31 Thread[cluster3-nio-worker-2,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#32 Thread[cluster3-nio-worker-3,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#33 Thread[cluster3-nio-worker-4,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#34 Thread[cluster3-nio-worker-5,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#35 Thread[cluster3-nio-worker-6,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#36 Thread[cluster3-nio-worker-7,5,main] RUNNABLE
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#37 Thread[cluster3-reconnection-0,5,main] TIMED_WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#38 Thread[cluster3-reconnection-1,5,main] WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#39 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.6/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#40 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.6/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#41 Thread[Common-Cleaner,8,InnocuousThreadGroup] TIMED_WAITING daemon
java.base@11.0.6/java.lang.Object.wait(Native Method)
java.base@11.0.6/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.6/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
java.base@11.0.6/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
#42 Thread[ContainerBackgroundProcessor[StandardEngine[Catalina]],5,main] TIMED_WAITING daemon
java.base@11.0.6/java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1365)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#43 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#44 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.6/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.6/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#45 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.6/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.6/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#46 Thread[Finalizer,8,system] WAITING daemon
java.base@11.0.6/java.lang.Object.wait(Native Method)
java.base@11.0.6/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.6/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.base@11.0.6/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
#47 Thread[http-nio-8080-Acceptor-0,5,main] RUNNABLE daemon
java.base@11.0.6/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
java.base@11.0.6/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
java.base@11.0.6/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:446)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:70)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:95)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#48 Thread[http-nio-8080-AsyncTimeout,5,main] TIMED_WAITING daemon
java.base@11.0.6/java.lang.Thread.sleep(Native Method)
org.apache.coyote.AbstractProtocol$AsyncTimeout.run(AbstractProtocol.java:1113)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#49 Thread[http-nio-8080-ClientPoller-0,5,main] RUNNABLE daemon
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#50 Thread[http-nio-8080-ClientPoller-1,5,main] RUNNABLE daemon
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#51 Thread[http-nio-8080-exec-4137,5,main] RUNNABLE daemon
java.base@11.0.6/java.lang.Thread.dumpThreads(Native Method)
java.base@11.0.6/java.lang.Thread.getAllStackTraces(Thread.java:1657)
com.cohort.util.MustBe.allStackTraces(MustBe.java:353)
gov.noaa.pfel.erddap.Erddap.doStatus(Erddap.java:3178)
gov.noaa.pfel.erddap.Erddap.doGet(Erddap.java:595)
javax.servlet.http.HttpServlet.service(HttpServlet.java:634)
javax.servlet.http.HttpServlet.service(HttpServlet.java:741)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:668)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:770)
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415)
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#52 Thread[http-nio-8080-exec-4149,5,main] WAITING daemon
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#53 Thread[http-nio-8080-exec-4150,5,main] WAITING daemon
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#54 Thread[http-nio-8080-exec-4152,5,main] WAITING daemon
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#55 Thread[http-nio-8080-exec-4157,5,main] WAITING daemon
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#56 Thread[http-nio-8080-exec-4158,5,main] WAITING daemon
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#57 Thread[http-nio-8080-exec-4159,5,main] WAITING daemon
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#58 Thread[http-nio-8080-exec-4160,5,main] WAITING daemon
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#59 Thread[http-nio-8080-exec-4161,5,main] WAITING daemon
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#60 Thread[http-nio-8080-exec-4162,5,main] WAITING daemon
java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#61 Thread[Java2D Disposer,10,system] WAITING daemon
java.base@11.0.6/java.lang.Object.wait(Native Method)
java.base@11.0.6/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.6/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.desktop@11.0.6/sun.java2d.Disposer.run(Disposer.java:144)
java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
#62 Thread[main,5,main] RUNNABLE
java.base@11.0.6/java.net.PlainSocketImpl.socketAccept(Native Method)
java.base@11.0.6/java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:458)
java.base@11.0.6/java.net.ServerSocket.implAccept(ServerSocket.java:565)
java.base@11.0.6/java.net.ServerSocket.accept(ServerSocket.java:533)
org.apache.catalina.core.StandardServer.await(StandardServer.java:447)
org.apache.catalina.startup.Catalina.await(Catalina.java:770)
org.apache.catalina.startup.Catalina.start(Catalina.java:716)
java.base@11.0.6/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
java.base@11.0.6/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
java.base@11.0.6/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.base@11.0.6/java.lang.reflect.Method.invoke(Method.java:566)
app//org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:350)
app//org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:492)
#63 Thread[NioBlockingSelector.BlockPoller-1,5,main] RUNNABLE daemon
java.base@11.0.6/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.6/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(NioBlockingSelector.java:298)
#64 Thread[Reference Handler,10,system] RUNNABLE daemon
java.base@11.0.6/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
java.base@11.0.6/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
java.base@11.0.6/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
#65 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.base@11.0.6/java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:282)
#66 Thread[Signal Dispatcher,9,system] RUNNABLE daemon