Serving data from the Marine Institute (Ireland)
Brought to you by the Marine Institute(Ireland)
|
Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland) |
Brought to you by the Marine Institute(Ireland) |
Current time is 2021-01-28T01:06:06+00:00
Startup was at 2021-01-15T07:01:28+00:00
Last major LoadDatasets started 9m 1s ago and finished after 360 seconds.
nGridDatasets = 9
nTableDatasets = 44
nTotalDatasets = 53
n Datasets Failed To Load (in the last major LoadDatasets) = 0
Response Failed Time (since last major LoadDatasets) n = 5, median ~= 0 ms
Response Failed Time (since last Daily Report) n = 1222, median ~= 20 ms
Response Failed Time (since startup) n = 37850, median ~= 0 ms
Response Succeeded Time (since last major LoadDatasets) n = 25, median ~= 4 ms
Response Succeeded Time (since last Daily Report) n = 19133, median ~= 84 ms
Response Succeeded Time (since startup) n = 272330, median ~= 19 ms
TaskThread has finished 0 out of 0 tasks. Currently, no task is running.
TaskThread Failed Time (since last Daily Report) n = 0
TaskThread Failed Time (since startup) n = 0
TaskThread Succeeded Time (since last Daily Report) n = 0
TaskThread Succeeded Time (since startup) n = 0
Number of threads: Tomcat-waiting=0, inotify=0, other=67
MemoryInUse= 949 MB (highWaterMark= 1981 MB) (Xmx ~= 5888 MB)
Major LoadDatasets Time Series: MLD Datasets Loaded Requests (medianTime in seconds) Number of Threads Memory (MB)
timestamp time nTry nFail nTotal nSuccess (median) nFailed (median) tomWait inotify other inUse highWater
2021-01-28T01:03:02+00:00 357s 7 0 53 66 ( 0) 3 ( 0) 0 0 68 97 1981
2021-01-28T00:47:14+00:00 309s 7 0 53 31 ( 0) 3 ( 0) 0 0 68 98 1981
2021-01-28T00:34:24+00:00 439s 6 0 53 96 ( 0) 16 ( 0) 0 0 68 94 1981
2021-01-28T00:17:32+00:00 328s 7 0 53 62 ( 0) 7 ( 0) 0 0 68 98 1981
2021-01-28T00:03:07+00:00 362s 6 0 53 103 ( 0) 17 ( 0) 0 0 68 96 1981
2021-01-27T23:49:52+00:00 467s 6 0 53 85 ( 0) 13 ( 0) 0 0 68 130 1981
2021-01-27T23:35:26+00:00 502s 8 0 53 344 ( 0) 15 ( 0) 0 0 68 144 1981
2021-01-27T23:17:24+00:00 319s 7 0 53 70 ( 0) 14 ( 0) 0 0 68 99 1981
2021-01-27T23:02:23+00:00 318s 7 0 53 92 ( 0) 16 ( 0) 0 0 68 95 1981
2021-01-27T22:47:29+00:00 325s 6 0 53 68 ( 0) 9 ( 0) 0 0 68 99 1981
2021-01-27T22:32:35+00:00 330s 8 0 53 108 ( 0) 12 ( 0) 0 0 68 97 1981
2021-01-27T22:17:25+00:00 321s 8 0 53 95 ( 0) 17 ( 0) 0 0 68 97 1981
2021-01-27T22:03:08+00:00 364s 7 0 53 62 ( 0) 7 ( 0) 0 0 68 98 1981
2021-01-27T21:47:19+00:00 314s 6 0 53 161 ( 0) 15 ( 0) 0 0 68 97 1981
2021-01-27T21:32:41+00:00 337s 6 0 53 305 ( 0) 71 ( 0) 0 0 68 96 1981
2021-01-27T21:17:32+00:00 327s 8 0 53 71 ( 0) 8 ( 0) 0 0 68 99 1981
2021-01-27T21:03:57+00:00 413s 7 0 53 92 ( 0) 9 ( 0) 0 0 68 102 1981
2021-01-27T20:47:13+00:00 308s 6 0 53 150 ( 0) 23 ( 0) 0 0 68 99 1981
2021-01-27T20:32:42+00:00 338s 7 0 53 115 ( 0) 21 ( 0) 0 0 68 98 1981
2021-01-27T20:17:27+00:00 323s 9 0 53 46 ( 0) 5 ( 0) 0 0 68 99 1981
2021-01-27T20:02:57+00:00 353s 7 0 53 80 ( 0) 5 ( 0) 0 0 68 98 1981
2021-01-27T19:47:31+00:00 327s 6 0 53 132 ( 0) 17 ( 0) 0 0 68 98 1981
2021-01-27T19:32:28+00:00 324s 6 0 53 207 ( 0) 9 ( 0) 0 0 68 98 1981
2021-01-27T19:17:44+00:00 340s 7 0 53 82 ( 0) 19 ( 0) 0 0 68 99 1981
2021-01-27T19:03:14+00:00 371s 12 0 53 144 ( 0) 25 ( 0) 0 0 68 98 1981
2021-01-27T18:47:36+00:00 333s 6 0 53 45 ( 0) 12 ( 0) 0 0 68 99 1981
2021-01-27T18:32:36+00:00 332s 6 0 53 119 ( 0) 6 ( 0) 0 0 68 97 1981
2021-01-27T18:17:30+00:00 326s 7 0 53 138 ( 0) 13 ( 0) 0 0 68 96 1981
2021-01-27T18:03:10+00:00 367s 10 0 53 205 ( 0) 22 ( 0) 0 0 68 95 1981
2021-01-27T17:47:46+00:00 342s 6 0 53 148 ( 0) 31 ( 0) 0 0 69 98 1981
2021-01-27T17:32:23+00:00 320s 6 0 53 50 ( 0) 5 ( 0) 0 0 68 98 1981
2021-01-27T17:17:43+00:00 339s 7 0 53 76 ( 0) 6 ( 0) 0 0 69 99 1981
2021-01-27T17:02:57+00:00 353s 9 0 53 123 ( 0) 7 ( 0) 0 0 68 98 1981
2021-01-27T16:47:14+00:00 311s 6 0 53 106 ( 0) 5 ( 0) 0 0 69 96 1981
2021-01-27T16:32:04+00:00 301s 6 0 53 180 ( 0) 18 ( 0) 0 0 68 87 1981
2021-01-27T16:17:53+00:00 350s 7 0 53 228 ( 0) 27 ( 0) 0 0 68 141 1981
2021-01-27T16:02:46+00:00 343s 10 0 53 170 ( 0) 19 ( 0) 0 0 68 102 1981
2021-01-27T15:47:38+00:00 335s 6 0 53 147 ( 0) 15 ( 0) 0 0 68 98 1981
2021-01-27T15:32:37+00:00 334s 6 0 53 170 ( 0) 17 ( 0) 0 0 68 96 1981
2021-01-27T15:18:31+00:00 388s 8 0 53 109 ( 0) 17 ( 0) 0 0 68 130 1981
2021-01-27T15:02:28+00:00 326s 7 0 53 76 ( 0) 12 ( 0) 0 0 68 97 1981
2021-01-27T14:47:38+00:00 335s 8 0 53 145 ( 0) 17 ( 0) 0 0 68 96 1981
2021-01-27T14:32:22+00:00 319s 7 0 53 138 ( 0) 23 ( 0) 0 0 68 97 1981
2021-01-27T14:17:41+00:00 338s 7 0 53 99 ( 0) 24 ( 0) 0 0 68 99 1981
2021-01-27T14:03:02+00:00 360s 9 0 53 58 ( 0) 10 ( 0) 0 0 69 98 1981
2021-01-27T13:47:38+00:00 336s 6 0 53 179 ( 0) 29 ( 0) 0 0 68 98 1981
2021-01-27T13:32:32+00:00 330s 8 0 53 112 ( 0) 20 ( 0) 0 0 68 97 1981
2021-01-27T13:17:28+00:00 326s 6 0 53 99 ( 0) 18 ( 0) 0 0 68 98 1981
2021-01-27T13:02:48+00:00 346s 8 0 53 178 ( 0) 33 ( 0) 0 0 75 97 1981
2021-01-27T12:47:46+00:00 344s 6 0 53 188 ( 0) 17 ( 0) 0 0 69 99 1981
2021-01-27T12:32:09+00:00 307s 8 0 53 134 ( 0) 27 ( 0) 0 0 68 192 1981
2021-01-27T12:17:14+00:00 312s 6 0 53 76 ( 0) 13 ( 0) 0 0 68 98 1981
2021-01-27T12:03:54+00:00 412s 7 0 53 264 ( 0) 28 ( 0) 0 0 68 97 1981
2021-01-27T11:47:30+00:00 328s 7 0 53 171 ( 0) 19 ( 0) 0 0 85 98 1981
2021-01-27T11:32:29+00:00 327s 6 0 53 531 ( 0) 16 ( 0) 0 0 71 96 1981
2021-01-27T11:17:28+00:00 326s 8 0 53 331 ( 0) 16 ( 0) 0 0 82 96 1981
2021-01-27T11:02:49+00:00 347s 7 0 53 358 ( 0) 12 ( 0) 0 0 83 95 1981
2021-01-27T10:47:22+00:00 320s 7 0 53 498 ( 0) 15 ( 0) 0 0 75 93 1981
2021-01-27T10:32:22+00:00 320s 6 0 53 202 ( 0) 23 ( 0) 0 0 70 82 1981
2021-01-27T10:17:28+00:00 326s 6 0 53 104 ( 0) 13 ( 0) 0 0 68 86 1981
2021-01-27T10:03:06+00:00 365s 10 0 53 171 ( 0) 18 ( 0) 0 0 68 84 1981
2021-01-27T09:47:05+00:00 304s 7 0 53 926 ( 0) 39 ( 0) 0 0 68 82 1981
2021-01-27T09:32:40+00:00 339s 6 0 53 5289 ( 0) 23 ( 0) 0 0 85 82 1981
2021-01-27T09:17:37+00:00 336s 6 0 53 2931 ( 0) 11 ( 0) 0 0 69 732 1981
2021-01-27T09:03:20+00:00 379s 7 0 53 144 ( 0) 26 ( 0) 0 0 68 84 1981
2021-01-27T08:47:20+00:00 318s 8 0 53 68 ( 0) 6 ( 0) 0 0 68 86 1981
2021-01-27T08:37:15+00:00 614s 26 0 53 176 ( 0) 23 ( 0) 0 0 68 86 1981
2021-01-27T08:17:51+00:00 349s 7 0 53 121 ( 0) 32 ( 0) 0 0 68 86 1981
2021-01-27T08:02:58+00:00 357s 7 0 53 122 ( 0) 14 ( 0) 0 0 68 85 1981
2021-01-27T07:46:48+00:00 288s 6 0 53 95 ( 0) 17 ( 0) 0 0 68 84 1981
2021-01-27T07:33:20+00:00 380s 8 0 53 156 ( 0) 17 ( 0) 0 0 68 136 1981
2021-01-27T07:17:21+00:00 320s 6 0 53 87 ( 0) 12 ( 0) 0 0 68 85 1981
2021-01-27T07:02:32+00:00 333s 7 0 53 99 ( 0) 35 ( 0) 0 0 68 85 1981
2021-01-27T06:47:07+00:00 308s 9 0 53 80 ( 0) 6 ( 0) 0 0 68 86 1981
2021-01-27T06:32:33+00:00 334s 8 0 53 93 ( 0) 15 ( 0) 0 0 68 84 1981
2021-01-27T06:17:55+00:00 356s 6 0 53 125 ( 0) 12 ( 0) 0 0 68 80 1981
2021-01-27T06:02:59+00:00 361s 7 0 53 219 ( 0) 23 ( 0) 0 0 71 80 1981
2021-01-27T05:47:24+00:00 325s 8 0 53 92 ( 0) 4 ( 0) 0 0 70 164 1981
2021-01-27T05:32:26+00:00 327s 8 0 53 93 ( 0) 9 ( 0) 0 0 68 80 1981
2021-01-27T05:17:04+00:00 305s 5 0 53 170 ( 0) 11 ( 0) 0 0 68 81 1981
2021-01-27T05:03:05+00:00 367s 7 0 53 83 ( 0) 20 ( 0) 0 0 69 84 1981
2021-01-27T04:47:20+00:00 322s 6 0 53 68 ( 0) 15 ( 0) 0 0 68 86 1981
2021-01-27T04:32:33+00:00 334s 7 0 53 70 ( 0) 12 ( 0) 0 0 68 83 1981
2021-01-27T04:17:25+00:00 327s 8 0 53 46 ( 0) 11 ( 0) 0 0 68 86 1981
2021-01-27T04:02:40+00:00 342s 8 0 53 57 ( 0) 6 ( 0) 0 0 68 85 1981
2021-01-27T03:47:16+00:00 318s 6 0 53 53 ( 0) 4 ( 0) 0 0 68 86 1981
2021-01-27T03:32:20+00:00 322s 7 0 53 42 ( 0) 4 ( 0) 0 0 68 82 1981
2021-01-27T03:17:23+00:00 325s 6 0 53 51 ( 0) 5 ( 0) 0 0 68 86 1981
2021-01-27T03:03:13+00:00 375s 10 0 53 68 ( 0) 6 ( 0) 0 0 69 85 1981
2021-01-27T02:47:09+00:00 311s 6 0 53 59 ( 0) 7 ( 0) 0 0 68 84 1981
2021-01-27T02:32:19+00:00 321s 7 0 53 48 ( 0) 8 ( 0) 0 0 68 163 1981
2021-01-27T02:17:05+00:00 307s 7 0 53 69 ( 0) 10 ( 0) 0 0 76 85 1981
2021-01-27T02:02:54+00:00 357s 8 0 53 94 ( 0) 11 ( 0) 0 0 69 86 1981
2021-01-27T01:47:13+00:00 316s 9 0 53 52 ( 0) 3 ( 0) 0 0 68 86 1981
2021-01-27T01:32:12+00:00 314s 10 0 53 61 ( 0) 4 ( 0) 0 0 68 75 1981
2021-01-27T01:17:21+00:00 323s 6 0 53 45 ( 0) 4 ( 0) 0 0 68 86 1981
2021-01-27T01:02:25+00:00 328s 7 0 53 77 ( 0) 51 ( 0) 0 0 69 84 1981
2021-01-27T00:47:04+00:00 307s 6 0 53 41 ( 0) 6 ( 0) 0 0 68 86 1981
2021-01-27T00:32:25+00:00 328s 9 0 53 66 ( 0) 47 ( 0) 0 0 69 85 1981
2021-01-27T00:17:22+00:00 325s 6 0 53 87 ( 0) 53 ( 0) 0 0 68 86 1981
Major LoadDatasets Times Distribution (since last Daily Report):
n = 72, median ~= 450000 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 1
<= 10 min: 70
<= 20 min: 1
<= 1 hr: 0
> 1 hr: 0
Major LoadDatasets Times Distribution (since startup):
n = 1224, median ~= 286405 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 662
<= 10 min: 559
<= 20 min: 3
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since last Daily Report):
n = 2, median ~= 350 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 2
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since startup):
n = 34, median ~= 243 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 5
<= 200 ms: 11
<= 500 ms: 7
<= 1 s: 3
<= 2 s: 6
<= 5 s: 2
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last major LoadDatasets):
n = 5, median ~= 0 ms
0 ms: 5
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last Daily Report):
n = 1222, median ~= 20 ms
0 ms: 356
1 ms: 152
2 ms: 4
<= 5 ms: 55
<= 10 ms: 24
<= 20 ms: 18
<= 50 ms: 276
<= 100 ms: 142
<= 200 ms: 76
<= 500 ms: 62
<= 1 s: 21
<= 2 s: 15
<= 5 s: 13
<= 10 s: 1
<= 20 s: 1
<= 1 min: 2
<= 2 min: 3
<= 5 min: 1
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since startup):
n = 37850, median ~= 0 ms
0 ms: 17348
1 ms: 11315
2 ms: 332
<= 5 ms: 655
<= 10 ms: 385
<= 20 ms: 311
<= 50 ms: 2931
<= 100 ms: 2057
<= 200 ms: 859
<= 500 ms: 577
<= 1 s: 273
<= 2 s: 358
<= 5 s: 237
<= 10 s: 17
<= 20 s: 30
<= 1 min: 80
<= 2 min: 55
<= 5 min: 26
<= 10 min: 3
<= 20 min: 0
<= 1 hr: 1
> 1 hr: 0
Response Succeeded Time Distribution (since last major LoadDatasets):
n = 25, median ~= 4 ms
0 ms: 4
1 ms: 2
2 ms: 2
<= 5 ms: 7
<= 10 ms: 1
<= 20 ms: 0
<= 50 ms: 3
<= 100 ms: 2
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 2
<= 5 s: 1
<= 10 s: 1
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last Daily Report):
n = 19133, median ~= 84 ms
0 ms: 1659
1 ms: 441
2 ms: 401
<= 5 ms: 643
<= 10 ms: 423
<= 20 ms: 986
<= 50 ms: 2269
<= 100 ms: 4056
<= 200 ms: 3787
<= 500 ms: 3191
<= 1 s: 308
<= 2 s: 259
<= 5 s: 598
<= 10 s: 37
<= 20 s: 41
<= 1 min: 26
<= 2 min: 0
<= 5 min: 3
<= 10 min: 5
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since startup):
n = 272330, median ~= 19 ms
0 ms: 12993
1 ms: 10147
2 ms: 19085
<= 5 ms: 42090
<= 10 ms: 8408
<= 20 ms: 49638
<= 50 ms: 28356
<= 100 ms: 35664
<= 200 ms: 24529
<= 500 ms: 24169
<= 1 s: 3959
<= 2 s: 3544
<= 5 s: 8051
<= 10 s: 653
<= 20 s: 581
<= 1 min: 407
<= 2 min: 24
<= 5 min: 18
<= 10 min: 14
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
TaskThread Failed Time Distribution (since last Daily Report):
n = 0
TaskThread Failed Time Distribution (since startup):
n = 0
TaskThread Succeeded Time Distribution (since last Daily Report):
n = 0
TaskThread Succeeded Time Distribution (since startup):
n = 0
SgtMap topography nFromCache=23 nNotFromCache=332
GSHHS: nCached=100 of 100, nCoarse=1668, nSuccesses=1556, nTossed=856
NationalBoundaries: nCached=100 of 100, nCoarse=250, nSuccesses=388, nTossed=87
StateBoundaries: nCached=100 of 100, nCoarse=201, nSuccesses=388, nTossed=77
Rivers: nCached=100 of 100, nCoarse=249, nSuccesses=387, nTossed=88
bufferedImage isAccelerated=[unknown]
Number of threads: Tomcat-waiting=0, inotify=0, other=67
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)
#1 Thread[AsyncFileHandlerWriter-2046562095,5,main] TIMED_WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:513)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:675)
app//org.apache.juli.AsyncFileHandler$LoggerThread.run(AsyncFileHandler.java:159)
#2 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#3 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#4 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#5 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#6 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#7 Thread[cluster1-nio-worker-4,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#8 Thread[cluster1-nio-worker-5,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#9 Thread[cluster1-nio-worker-6,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#10 Thread[cluster1-nio-worker-7,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#11 Thread[cluster1-reconnection-0,5,main] WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#12 Thread[cluster1-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#13 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#14 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#15 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#16 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#17 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#18 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#19 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#20 Thread[cluster2-nio-worker-4,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#21 Thread[cluster2-nio-worker-5,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#22 Thread[cluster2-nio-worker-6,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#23 Thread[cluster2-nio-worker-7,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#24 Thread[cluster2-reconnection-0,5,main] WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#25 Thread[cluster2-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#26 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#27 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#28 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#29 Thread[cluster3-nio-worker-0,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#30 Thread[cluster3-nio-worker-1,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#31 Thread[cluster3-nio-worker-2,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#32 Thread[cluster3-nio-worker-3,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#33 Thread[cluster3-nio-worker-4,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#34 Thread[cluster3-nio-worker-5,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#35 Thread[cluster3-nio-worker-6,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#36 Thread[cluster3-nio-worker-7,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#37 Thread[cluster3-reconnection-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#38 Thread[cluster3-reconnection-1,5,main] WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#39 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#40 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#41 Thread[Common-Cleaner,8,InnocuousThreadGroup] TIMED_WAITING daemon
java.base@11.0.9.1/java.lang.Object.wait(Native Method)
java.base@11.0.9.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.9.1/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
java.base@11.0.9.1/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
#42 Thread[ContainerBackgroundProcessor[StandardEngine[Catalina]],5,main] TIMED_WAITING daemon
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1365)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#43 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#44 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#45 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#46 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#47 Thread[Finalizer,8,system] WAITING daemon
java.base@11.0.9.1/java.lang.Object.wait(Native Method)
java.base@11.0.9.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.9.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.base@11.0.9.1/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
#48 Thread[http-nio-8080-Acceptor-0,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
java.base@11.0.9.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
java.base@11.0.9.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:446)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:70)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:95)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#49 Thread[http-nio-8080-AsyncTimeout,5,main] TIMED_WAITING daemon
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
org.apache.coyote.AbstractProtocol$AsyncTimeout.run(AbstractProtocol.java:1113)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#50 Thread[http-nio-8080-ClientPoller-0,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#51 Thread[http-nio-8080-ClientPoller-1,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#52 Thread[http-nio-8080-exec-10593,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#53 Thread[http-nio-8080-exec-10643,5,main] RUNNABLE daemon
java.base@11.0.9.1/java.lang.Thread.dumpThreads(Native Method)
java.base@11.0.9.1/java.lang.Thread.getAllStackTraces(Thread.java:1658)
com.cohort.util.MustBe.allStackTraces(MustBe.java:353)
gov.noaa.pfel.erddap.Erddap.doStatus(Erddap.java:3178)
gov.noaa.pfel.erddap.Erddap.doGet(Erddap.java:595)
javax.servlet.http.HttpServlet.service(HttpServlet.java:634)
javax.servlet.http.HttpServlet.service(HttpServlet.java:741)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:668)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:770)
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415)
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#54 Thread[http-nio-8080-exec-10650,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#55 Thread[http-nio-8080-exec-10651,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#56 Thread[http-nio-8080-exec-10664,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#57 Thread[http-nio-8080-exec-10666,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#58 Thread[http-nio-8080-exec-10667,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#59 Thread[http-nio-8080-exec-10668,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#60 Thread[http-nio-8080-exec-10673,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#61 Thread[http-nio-8080-exec-10674,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#62 Thread[Java2D Disposer,10,system] WAITING daemon
java.base@11.0.9.1/java.lang.Object.wait(Native Method)
java.base@11.0.9.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.9.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.desktop@11.0.9.1/sun.java2d.Disposer.run(Disposer.java:144)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
#63 Thread[main,5,main] RUNNABLE
java.base@11.0.9.1/java.net.PlainSocketImpl.socketAccept(Native Method)
java.base@11.0.9.1/java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:458)
java.base@11.0.9.1/java.net.ServerSocket.implAccept(ServerSocket.java:565)
java.base@11.0.9.1/java.net.ServerSocket.accept(ServerSocket.java:533)
org.apache.catalina.core.StandardServer.await(StandardServer.java:447)
org.apache.catalina.startup.Catalina.await(Catalina.java:770)
org.apache.catalina.startup.Catalina.start(Catalina.java:716)
java.base@11.0.9.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
java.base@11.0.9.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
java.base@11.0.9.1/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.base@11.0.9.1/java.lang.reflect.Method.invoke(Method.java:566)
app//org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:350)
app//org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:492)
#64 Thread[NioBlockingSelector.BlockPoller-1,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(NioBlockingSelector.java:298)
#65 Thread[Reference Handler,10,system] RUNNABLE daemon
java.base@11.0.9.1/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
java.base@11.0.9.1/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
java.base@11.0.9.1/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
#66 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:282)
#67 Thread[Signal Dispatcher,9,system] RUNNABLE daemon