Serving data from the Marine Institute (Ireland)
Brought to you by the Marine Institute(Ireland)
|
Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland) |
Brought to you by the Marine Institute(Ireland) |
Current time is 2020-08-08T11:10:27+00:00
Startup was at 2020-07-22T07:01:20+00:00
Last major LoadDatasets started 7m 59s ago and finished after 230 seconds.
nGridDatasets = 9
nTableDatasets = 40
nTotalDatasets = 49
n Datasets Failed To Load (in the last major LoadDatasets) = 0
Response Failed Time (since last major LoadDatasets) n = 1, median ~= 1 ms
Response Failed Time (since last Daily Report) n = 276, median ~= 56 ms
Response Failed Time (since startup) n = 41724, median ~= 5 ms
Response Succeeded Time (since last major LoadDatasets) n = 22, median ~= 17 ms
Response Succeeded Time (since last Daily Report) n = 3143, median ~= 20 ms
Response Succeeded Time (since startup) n = 333461, median ~= 15 ms
TaskThread has finished 0 out of 0 tasks. Currently, no task is running.
TaskThread Failed Time (since last Daily Report) n = 0
TaskThread Failed Time (since startup) n = 0
TaskThread Succeeded Time (since last Daily Report) n = 0
TaskThread Succeeded Time (since startup) n = 0
Number of threads: Tomcat-waiting=0, inotify=0, other=66
MemoryInUse= 135 MB (highWaterMark= 1842 MB) (Xmx ~= 5888 MB)
Major LoadDatasets Time Series: MLD Datasets Loaded Requests (medianTime in seconds) Number of Threads Memory (MB)
timestamp time nTry nFail nTotal nSuccess (median) nFailed (median) tomWait inotify other inUse highWater
2020-08-08T11:06:16+00:00 228s 6 0 49 161 ( 0) 9 ( 0) 0 0 67 89 1842
2020-08-08T10:52:05+00:00 277s 7 0 49 162 ( 0) 41 ( 0) 0 0 68 86 1842
2020-08-08T10:36:22+00:00 235s 6 0 49 163 ( 0) 62 ( 0) 0 0 67 86 1842
2020-08-08T10:21:31+00:00 244s 9 0 49 213 ( 0) 7 ( 0) 0 0 67 86 1842
2020-08-08T10:06:24+00:00 237s 6 0 49 162 ( 0) 13 ( 0) 0 0 75 86 1842
2020-08-08T09:51:56+00:00 269s 6 0 49 274 ( 0) 20 ( 0) 0 0 67 86 1842
2020-08-08T09:39:39+00:00 432s 18 0 49 189 ( 0) 6 ( 0) 0 0 67 86 1842
2020-08-08T09:21:32+00:00 245s 7 0 49 167 ( 0) 28 ( 0) 0 0 67 85 1842
2020-08-08T09:07:35+00:00 308s 16 0 49 215 ( 0) 5 ( 0) 0 0 67 84 1842
2020-08-08T08:51:40+00:00 253s 7 0 49 211 ( 0) 21 ( 0) 0 0 67 86 1842
2020-08-08T08:36:20+00:00 233s 6 0 49 190 ( 0) 8 ( 0) 0 0 67 85 1842
2020-08-08T08:21:38+00:00 252s 7 0 49 215 ( 0) 18 ( 0) 0 0 67 83 1842
2020-08-08T08:06:35+00:00 248s 6 0 49 160 ( 0) 10 ( 0) 0 0 67 87 1842
2020-08-08T07:52:00+00:00 274s 9 0 49 186 ( 0) 5 ( 0) 0 0 68 86 1842
2020-08-08T07:36:20+00:00 233s 6 0 49 216 ( 0) 14 ( 0) 0 0 67 88 1842
2020-08-08T07:21:36+00:00 249s 7 0 49 237 ( 0) 8 ( 0) 0 0 67 84 1842
2020-08-08T07:06:23+00:00 237s 6 0 49 157 ( 0) 5 ( 0) 0 0 67 84 1842
2020-08-08T06:52:03+00:00 276s 10 0 49 194 ( 0) 10 ( 0) 0 0 68 77 1842
2020-08-08T06:36:17+00:00 231s 6 0 49 112 ( 0) 3 ( 0) 0 0 67 87 1842
2020-08-08T06:21:36+00:00 250s 7 0 49 144 ( 0) 24 ( 0) 0 0 67 86 1842
2020-08-08T06:06:39+00:00 253s 6 0 49 153 ( 0) 25 ( 0) 0 0 67 84 1842
2020-08-08T05:51:41+00:00 255s 7 0 49 124 ( 0) 15 ( 0) 0 0 67 94 1842
2020-08-08T05:36:19+00:00 233s 8 0 49 123 ( 0) 4 ( 0) 0 0 67 87 1842
2020-08-08T05:21:20+00:00 234s 8 0 49 93 ( 0) 4 ( 0) 0 0 67 88 1842
2020-08-08T05:06:23+00:00 237s 6 0 49 114 ( 0) 3 ( 0) 0 0 67 74 1842
2020-08-08T04:51:45+00:00 259s 7 0 49 89 ( 0) 4 ( 0) 0 0 67 96 1842
2020-08-08T04:36:19+00:00 233s 7 0 49 126 ( 0) 10 ( 0) 0 0 67 84 1842
2020-08-08T04:21:29+00:00 244s 9 0 49 103 ( 0) 7 ( 0) 0 0 67 79 1842
2020-08-08T04:06:40+00:00 254s 6 0 49 139 ( 0) 3 ( 0) 0 0 67 257 1842
2020-08-08T03:51:44+00:00 259s 7 0 49 127 ( 0) 11 ( 0) 0 0 67 86 1842
2020-08-08T03:36:28+00:00 242s 6 0 49 167 ( 0) 6 ( 0) 0 0 67 85 1842
2020-08-08T03:21:33+00:00 248s 7 0 49 139 ( 0) 7 ( 0) 0 0 67 86 1842
2020-08-08T03:06:42+00:00 256s 8 0 49 141 ( 0) 4 ( 0) 0 0 67 85 1842
2020-08-08T02:51:52+00:00 267s 7 0 49 131 ( 0) 4 ( 0) 0 0 67 87 1842
2020-08-08T02:36:19+00:00 234s 6 0 49 132 ( 0) 7 ( 0) 0 0 67 86 1842
2020-08-08T02:21:47+00:00 262s 7 0 49 135 ( 0) 6 ( 0) 0 0 67 85 1842
2020-08-08T02:06:40+00:00 255s 6 0 49 135 ( 0) 4 ( 0) 0 0 67 86 1842
2020-08-08T01:51:58+00:00 273s 9 0 49 119 ( 0) 5 ( 0) 0 0 68 92 1842
2020-08-08T01:36:27+00:00 242s 9 0 49 123 ( 0) 5 ( 0) 0 0 67 85 1842
2020-08-08T01:21:38+00:00 253s 7 0 49 105 ( 0) 4 ( 0) 0 0 67 86 1842
2020-08-08T01:06:48+00:00 263s 8 0 49 150 ( 0) 5 ( 0) 0 0 67 86 1842
2020-08-08T00:51:37+00:00 253s 7 0 49 127 ( 0) 6 ( 0) 0 0 67 86 1842
2020-08-08T00:36:44+00:00 260s 8 0 49 139 ( 0) 6 ( 0) 0 0 67 85 1842
2020-08-08T00:21:26+00:00 241s 7 0 49 111 ( 0) 4 ( 0) 0 0 67 86 1842
2020-08-08T00:06:50+00:00 266s 6 0 49 149 ( 0) 7 ( 0) 0 0 67 85 1842
2020-08-07T23:52:02+00:00 277s 8 0 49 132 ( 0) 6 ( 0) 0 0 68 88 1842
2020-08-07T23:36:21+00:00 236s 6 0 49 142 ( 0) 4 ( 0) 0 0 67 87 1842
2020-08-07T23:21:42+00:00 257s 9 0 49 137 ( 0) 4 ( 0) 0 0 67 86 1842
2020-08-07T23:06:31+00:00 247s 6 0 49 135 ( 0) 6 ( 0) 0 0 67 87 1842
2020-08-07T22:51:52+00:00 268s 7 0 49 139 ( 0) 5 ( 0) 0 0 67 85 1842
2020-08-07T22:36:42+00:00 258s 6 0 49 177 ( 0) 10 ( 0) 0 0 67 88 1842
2020-08-07T22:21:42+00:00 258s 7 0 49 174 ( 0) 13 ( 0) 0 0 70 74 1842
2020-08-07T22:06:35+00:00 251s 8 0 49 153 ( 0) 5 ( 0) 0 0 67 86 1842
2020-08-07T21:51:46+00:00 262s 7 0 49 183 ( 0) 16 ( 0) 0 0 67 84 1842
2020-08-07T21:36:31+00:00 247s 6 0 49 170 ( 0) 9 ( 0) 0 0 67 86 1842
2020-08-07T21:21:42+00:00 258s 7 0 49 183 ( 0) 12 ( 0) 0 0 68 86 1842
2020-08-07T21:06:54+00:00 271s 6 0 49 289 ( 0) 9 ( 0) 0 0 68 85 1842
2020-08-07T20:51:53+00:00 270s 10 0 49 174 ( 0) 7 ( 0) 0 0 67 86 1842
2020-08-07T20:36:24+00:00 240s 8 0 49 128 ( 0) 7 ( 0) 0 0 67 86 1842
2020-08-07T20:21:31+00:00 247s 7 0 49 161 ( 0) 11 ( 0) 0 0 67 86 1842
2020-08-07T20:06:33+00:00 250s 6 0 49 160 ( 0) 3 ( 0) 0 0 67 87 1842
2020-08-07T19:51:58+00:00 274s 7 0 49 161 ( 0) 13 ( 0) 0 0 68 91 1842
2020-08-07T19:36:14+00:00 231s 8 0 49 124 ( 0) 4 ( 0) 0 0 67 87 1842
2020-08-07T19:21:38+00:00 255s 8 0 49 162 ( 0) 15 ( 0) 0 0 67 86 1842
2020-08-07T19:06:30+00:00 247s 6 0 49 227 ( 0) 6 ( 0) 0 0 67 87 1842
2020-08-07T18:51:40+00:00 258s 8 0 49 153 ( 0) 9 ( 0) 0 0 67 87 1842
2020-08-07T18:36:25+00:00 243s 8 0 49 145 ( 0) 9 ( 0) 0 0 74 86 1842
2020-08-07T18:21:15+00:00 232s 7 0 49 222 ( 0) 150 ( 0) 0 0 67 86 1842
2020-08-07T18:06:49+00:00 267s 6 0 49 200 ( 0) 137 ( 0) 0 0 67 86 1842
2020-08-07T17:51:55+00:00 272s 7 0 49 253 ( 0) 14 ( 0) 0 0 67 86 1842
2020-08-07T17:36:27+00:00 245s 6 0 49 188 ( 0) 3 ( 0) 0 0 67 87 1842
2020-08-07T17:21:39+00:00 256s 9 0 49 181 ( 0) 61 ( 0) 0 0 67 86 1842
2020-08-07T17:06:24+00:00 242s 5 0 49 265 ( 0) 135 ( 0) 0 0 67 90 1842
2020-08-07T16:53:04+00:00 342s 7 0 49 289 ( 0) 105 ( 0) 0 0 67 86 1842
2020-08-07T16:36:25+00:00 243s 8 0 49 134 ( 0) 5 ( 0) 0 0 67 87 1842
2020-08-07T16:21:26+00:00 244s 6 0 49 573 ( 0) 13 ( 0) 0 0 67 85 1842
2020-08-07T16:08:28+00:00 365s 9 0 49 499 ( 0) 11 ( 0) 0 0 69 85 1842
2020-08-07T15:51:38+00:00 256s 7 0 49 127 ( 0) 4 ( 0) 0 0 67 85 1842
2020-08-07T15:36:37+00:00 254s 6 0 49 245 ( 0) 11 ( 0) 0 0 67 85 1842
2020-08-07T15:21:41+00:00 259s 7 0 49 176 ( 0) 10 ( 0) 0 0 67 86 1842
2020-08-07T15:06:28+00:00 246s 6 0 49 203 ( 0) 4 ( 0) 0 0 67 84 1842
2020-08-07T14:51:43+00:00 261s 9 0 49 291 ( 0) 143 ( 0) 0 0 67 86 1842
2020-08-07T14:36:24+00:00 242s 6 0 49 192 ( 0) 5 ( 0) 0 0 67 85 1842
2020-08-07T14:21:35+00:00 253s 7 0 49 205 ( 0) 11 ( 0) 0 0 67 86 1842
2020-08-07T14:06:12+00:00 230s 6 0 49 248 ( 0) 3 ( 0) 0 0 67 85 1842
2020-08-07T13:52:04+00:00 282s 7 0 49 550 ( 0) 12 ( 0) 0 0 71 85 1842
2020-08-07T13:36:26+00:00 245s 8 0 49 652 ( 0) 4 ( 0) 0 0 68 86 1842
2020-08-07T13:21:26+00:00 244s 7 0 49 317 ( 0) 8 ( 0) 0 0 68 87 1842
2020-08-07T13:06:34+00:00 253s 7 0 49 382 ( 0) 16 ( 0) 0 0 73 86 1842
2020-08-07T12:51:52+00:00 270s 7 0 49 355 ( 0) 14 ( 0) 0 0 67 86 1842
2020-08-07T12:36:27+00:00 245s 6 0 49 307 ( 0) 9 ( 0) 0 0 67 83 1842
2020-08-07T12:21:46+00:00 264s 10 0 49 303 ( 0) 13 ( 0) 0 0 72 84 1842
2020-08-07T12:06:19+00:00 238s 6 0 49 175 ( 0) 5 ( 0) 0 0 67 82 1842
2020-08-07T11:51:40+00:00 259s 8 0 49 216 ( 0) 4 ( 0) 0 0 67 85 1842
2020-08-07T11:36:17+00:00 236s 6 0 49 226 ( 0) 10 ( 0) 0 0 74 86 1842
2020-08-07T11:21:29+00:00 248s 9 0 49 162 ( 0) 10 ( 0) 0 0 67 86 1842
2020-08-07T11:06:33+00:00 252s 6 0 49 248 ( 0) 18 ( 0) 0 0 75 530 1842
2020-08-07T10:51:50+00:00 269s 7 0 49 305 ( 0) 5 ( 0) 0 0 67 81 1842
2020-08-07T10:36:23+00:00 243s 6 0 49 350 ( 0) 9 ( 0) 0 0 68 283 1842
2020-08-07T10:21:22+00:00 241s 9 0 49 177 ( 0) 9 ( 0) 0 0 67 87 1842
Major LoadDatasets Times Distribution (since last Daily Report):
n = 16, median ~= 222857 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 14
<= 10 min: 2
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Major LoadDatasets Times Distribution (since startup):
n = 1637, median ~= 211969 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 1
<= 5 min: 1600
<= 10 min: 35
<= 20 min: 0
<= 1 hr: 1
> 1 hr: 0
Minor LoadDatasets Times Distribution (since last Daily Report):
n = 1, median ~= 150 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 1
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since startup):
n = 33, median ~= 161 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 5
<= 200 ms: 19
<= 500 ms: 0
<= 1 s: 2
<= 2 s: 3
<= 5 s: 1
<= 10 s: 0
<= 20 s: 3
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last major LoadDatasets):
n = 1, median ~= 1 ms
0 ms: 0
1 ms: 1
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last Daily Report):
n = 276, median ~= 56 ms
0 ms: 33
1 ms: 10
2 ms: 0
<= 5 ms: 29
<= 10 ms: 11
<= 20 ms: 5
<= 50 ms: 35
<= 100 ms: 128
<= 200 ms: 7
<= 500 ms: 6
<= 1 s: 11
<= 2 s: 1
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since startup):
n = 41724, median ~= 5 ms
0 ms: 5000
1 ms: 3357
2 ms: 1332
<= 5 ms: 12336
<= 10 ms: 11083
<= 20 ms: 900
<= 50 ms: 3207
<= 100 ms: 1495
<= 200 ms: 1284
<= 500 ms: 751
<= 1 s: 459
<= 2 s: 200
<= 5 s: 127
<= 10 s: 25
<= 20 s: 14
<= 1 min: 85
<= 2 min: 48
<= 5 min: 15
<= 10 min: 2
<= 20 min: 2
<= 1 hr: 1
> 1 hr: 1
Response Succeeded Time Distribution (since last major LoadDatasets):
n = 22, median ~= 17 ms
0 ms: 2
1 ms: 1
2 ms: 1
<= 5 ms: 0
<= 10 ms: 3
<= 20 ms: 6
<= 50 ms: 7
<= 100 ms: 2
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last Daily Report):
n = 3143, median ~= 20 ms
0 ms: 111
1 ms: 52
2 ms: 82
<= 5 ms: 175
<= 10 ms: 235
<= 20 ms: 943
<= 50 ms: 562
<= 100 ms: 154
<= 200 ms: 216
<= 500 ms: 214
<= 1 s: 200
<= 2 s: 105
<= 5 s: 84
<= 10 s: 8
<= 20 s: 2
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since startup):
n = 333461, median ~= 15 ms
0 ms: 16772
1 ms: 17195
2 ms: 33442
<= 5 ms: 53775
<= 10 ms: 21869
<= 20 ms: 49798
<= 50 ms: 48982
<= 100 ms: 17339
<= 200 ms: 20611
<= 500 ms: 22462
<= 1 s: 13750
<= 2 s: 9570
<= 5 s: 5682
<= 10 s: 1148
<= 20 s: 490
<= 1 min: 321
<= 2 min: 132
<= 5 min: 94
<= 10 min: 20
<= 20 min: 7
<= 1 hr: 2
> 1 hr: 0
TaskThread Failed Time Distribution (since last Daily Report):
n = 0
TaskThread Failed Time Distribution (since startup):
n = 0
TaskThread Succeeded Time Distribution (since last Daily Report):
n = 0
TaskThread Succeeded Time Distribution (since startup):
n = 0
SgtMap topography nFromCache=28 nNotFromCache=215
GSHHS: nCached=100 of 100, nCoarse=2532, nSuccesses=1623, nTossed=1155
NationalBoundaries: nCached=100 of 100, nCoarse=288, nSuccesses=280, nTossed=4
StateBoundaries: nCached=100 of 100, nCoarse=281, nSuccesses=280, nTossed=4
Rivers: nCached=100 of 100, nCoarse=282, nSuccesses=280, nTossed=4
bufferedImage isAccelerated=[unknown]
Number of threads: Tomcat-waiting=0, inotify=0, other=66
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)
#1 Thread[AsyncFileHandlerWriter-1867750575,5,main] TIMED_WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:513)
java.base@11.0.7/java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:675)
app//org.apache.juli.AsyncFileHandler$LoggerThread.run(AsyncFileHandler.java:159)
#2 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#3 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#4 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#5 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#6 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#7 Thread[cluster1-nio-worker-4,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#8 Thread[cluster1-nio-worker-5,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#9 Thread[cluster1-nio-worker-6,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#10 Thread[cluster1-nio-worker-7,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#11 Thread[cluster1-reconnection-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#12 Thread[cluster1-reconnection-1,5,main] WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#13 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#14 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#15 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#16 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#17 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#18 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#19 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#20 Thread[cluster2-nio-worker-4,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#21 Thread[cluster2-nio-worker-5,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#22 Thread[cluster2-nio-worker-6,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#23 Thread[cluster2-nio-worker-7,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#24 Thread[cluster2-reconnection-0,5,main] WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#25 Thread[cluster2-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#26 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#27 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#28 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#29 Thread[cluster3-nio-worker-0,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#30 Thread[cluster3-nio-worker-1,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#31 Thread[cluster3-nio-worker-2,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#32 Thread[cluster3-nio-worker-3,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#33 Thread[cluster3-nio-worker-4,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#34 Thread[cluster3-nio-worker-5,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#35 Thread[cluster3-nio-worker-6,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#36 Thread[cluster3-nio-worker-7,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#37 Thread[cluster3-reconnection-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#38 Thread[cluster3-reconnection-1,5,main] WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#39 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#40 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#41 Thread[Common-Cleaner,8,InnocuousThreadGroup] TIMED_WAITING daemon
java.base@11.0.7/java.lang.Object.wait(Native Method)
java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.7/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
java.base@11.0.7/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
#42 Thread[ContainerBackgroundProcessor[StandardEngine[Catalina]],5,main] TIMED_WAITING daemon
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1365)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#43 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#44 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.7/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#45 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.7/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#46 Thread[Finalizer,8,system] WAITING daemon
java.base@11.0.7/java.lang.Object.wait(Native Method)
java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.base@11.0.7/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
#47 Thread[http-nio-8080-Acceptor-0,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
java.base@11.0.7/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
java.base@11.0.7/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:446)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:70)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:95)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#48 Thread[http-nio-8080-AsyncTimeout,5,main] TIMED_WAITING daemon
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
org.apache.coyote.AbstractProtocol$AsyncTimeout.run(AbstractProtocol.java:1113)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#49 Thread[http-nio-8080-ClientPoller-0,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#50 Thread[http-nio-8080-ClientPoller-1,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#51 Thread[http-nio-8080-exec-6078,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#52 Thread[http-nio-8080-exec-6113,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#53 Thread[http-nio-8080-exec-6119,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#54 Thread[http-nio-8080-exec-6120,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#55 Thread[http-nio-8080-exec-6122,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#56 Thread[http-nio-8080-exec-6127,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#57 Thread[http-nio-8080-exec-6135,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#58 Thread[http-nio-8080-exec-6136,5,main] RUNNABLE daemon
java.base@11.0.7/java.lang.Thread.dumpThreads(Native Method)
java.base@11.0.7/java.lang.Thread.getAllStackTraces(Thread.java:1657)
com.cohort.util.MustBe.allStackTraces(MustBe.java:353)
gov.noaa.pfel.erddap.Erddap.doStatus(Erddap.java:3178)
gov.noaa.pfel.erddap.Erddap.doGet(Erddap.java:595)
javax.servlet.http.HttpServlet.service(HttpServlet.java:634)
javax.servlet.http.HttpServlet.service(HttpServlet.java:741)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:668)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:770)
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415)
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#59 Thread[http-nio-8080-exec-6138,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#60 Thread[http-nio-8080-exec-6140,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#61 Thread[Java2D Disposer,10,system] WAITING daemon
java.base@11.0.7/java.lang.Object.wait(Native Method)
java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.desktop@11.0.7/sun.java2d.Disposer.run(Disposer.java:144)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
#62 Thread[main,5,main] RUNNABLE
java.base@11.0.7/java.net.PlainSocketImpl.socketAccept(Native Method)
java.base@11.0.7/java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:458)
java.base@11.0.7/java.net.ServerSocket.implAccept(ServerSocket.java:565)
java.base@11.0.7/java.net.ServerSocket.accept(ServerSocket.java:533)
org.apache.catalina.core.StandardServer.await(StandardServer.java:447)
org.apache.catalina.startup.Catalina.await(Catalina.java:770)
org.apache.catalina.startup.Catalina.start(Catalina.java:716)
java.base@11.0.7/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
java.base@11.0.7/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
java.base@11.0.7/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.base@11.0.7/java.lang.reflect.Method.invoke(Method.java:566)
app//org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:350)
app//org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:492)
#63 Thread[NioBlockingSelector.BlockPoller-1,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(NioBlockingSelector.java:298)
#64 Thread[Reference Handler,10,system] RUNNABLE daemon
java.base@11.0.7/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
java.base@11.0.7/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
java.base@11.0.7/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
#65 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:282)
#66 Thread[Signal Dispatcher,9,system] RUNNABLE daemon