Serving data from the Marine Institute (Ireland)
Brought to you by the Marine Institute(Ireland)
|
Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland) |
Brought to you by the Marine Institute(Ireland) |
Current time is 2020-11-27T10:32:13+00:00
Startup was at 2020-11-12T07:02:00+00:00
Last major LoadDatasets started 6m 21s ago and finished after 230 seconds.
nGridDatasets = 9
nTableDatasets = 43
nTotalDatasets = 52
n Datasets Failed To Load (in the last major LoadDatasets) = 0
ERROR: n Orphan Datasets (datasets in ERDDAP but not in datasets.xml) = 1
nuig_carna_temp(end)
Response Failed Time (since last major LoadDatasets) n = 1, median ~= 0 ms
Response Failed Time (since last Daily Report) n = 296, median ~= 36 ms
Response Failed Time (since startup) n = 16392, median ~= 10 ms
Response Succeeded Time (since last major LoadDatasets) n = 34, median ~= 11 ms
Response Succeeded Time (since last Daily Report) n = 2734, median ~= 14 ms
Response Succeeded Time (since startup) n = 299304, median ~= 5 ms
TaskThread has finished 0 out of 0 tasks. Currently, no task is running.
TaskThread Failed Time (since last Daily Report) n = 0
TaskThread Failed Time (since startup) n = 0
TaskThread Succeeded Time (since last Daily Report) n = 0
TaskThread Succeeded Time (since startup) n = 0
Number of threads: Tomcat-waiting=0, inotify=0, other=67
MemoryInUse= 300 MB (highWaterMark= 1677 MB) (Xmx ~= 5888 MB)
Major LoadDatasets Time Series: MLD Datasets Loaded Requests (medianTime in seconds) Number of Threads Memory (MB)
timestamp time nTry nFail nTotal nSuccess (median) nFailed (median) tomWait inotify other inUse highWater
2020-11-27T10:29:39+00:00 227s 7 0 52 240 ( 0) 35 ( 0) 0 0 68 84 1677
2020-11-27T10:14:45+00:00 234s 6 0 52 219 ( 0) 25 ( 0) 0 0 68 85 1677
2020-11-27T09:59:47+00:00 235s 7 0 52 220 ( 0) 21 ( 0) 0 0 68 176 1677
2020-11-27T09:44:59+00:00 247s 6 0 52 159 ( 0) 13 ( 0) 0 0 69 82 1677
2020-11-27T09:34:11+00:00 499s 27 0 51 267 ( 0) 26 ( 0) 0 0 68 85 1677
2020-11-27T09:14:42+00:00 230s 6 0 52 269 ( 0) 37 ( 0) 0 0 69 86 1677
2020-11-27T08:59:39+00:00 227s 8 0 52 188 ( 0) 19 ( 0) 0 0 68 86 1677
2020-11-27T08:44:58+00:00 247s 8 0 52 208 ( 0) 26 ( 0) 0 0 69 86 1677
2020-11-27T08:29:42+00:00 231s 7 0 52 209 ( 0) 24 ( 0) 0 0 68 86 1677
2020-11-27T08:14:46+00:00 235s 6 0 52 177 ( 0) 23 ( 0) 0 0 69 85 1677
2020-11-27T07:59:43+00:00 232s 6 0 52 195 ( 0) 20 ( 0) 0 0 68 85 1677
2020-11-27T07:45:01+00:00 250s 9 0 52 174 ( 0) 8 ( 0) 0 0 68 86 1677
2020-11-27T07:29:49+00:00 239s 7 0 52 175 ( 0) 18 ( 0) 0 0 68 84 1677
2020-11-27T07:14:51+00:00 241s 7 0 52 176 ( 0) 14 ( 0) 0 0 68 85 1677
2020-11-27T06:59:42+00:00 231s 6 0 52 159 ( 0) 3 ( 0) 0 0 68 86 1677
2020-11-27T06:44:51+00:00 241s 9 0 52 241 ( 0) 18 ( 0) 0 0 68 86 1677
2020-11-27T06:29:37+00:00 226s 7 0 52 184 ( 0) 22 ( 0) 0 0 68 86 1677
2020-11-27T06:14:46+00:00 236s 6 0 52 249 ( 0) 23 ( 0) 0 0 68 86 1677
2020-11-27T05:59:43+00:00 232s 7 0 52 152 ( 0) 2 ( 0) 0 0 68 86 1677
2020-11-27T05:45:00+00:00 250s 7 0 52 200 ( 0) 30 ( 0) 0 0 68 86 1677
2020-11-27T05:29:43+00:00 233s 9 0 52 160 ( 0) 18 ( 0) 0 0 68 86 1677
2020-11-27T05:14:38+00:00 228s 6 0 52 152 ( 0) 8 ( 0) 0 0 68 86 1677
2020-11-27T04:59:35+00:00 225s 6 0 52 149 ( 0) 2 ( 0) 0 0 68 86 1677
2020-11-27T04:45:00+00:00 250s 7 0 52 185 ( 0) 4 ( 0) 0 0 68 87 1677
2020-11-27T04:29:40+00:00 231s 7 0 52 164 ( 0) 6 ( 0) 0 0 68 86 1677
2020-11-27T04:14:40+00:00 231s 8 0 52 182 ( 0) 5 ( 0) 0 0 68 85 1677
2020-11-27T03:59:45+00:00 236s 6 0 52 147 ( 0) 2 ( 0) 0 0 68 226 1677
2020-11-27T03:44:59+00:00 249s 7 0 52 154 ( 0) 25 ( 0) 0 0 68 87 1677
2020-11-27T03:29:51+00:00 241s 7 0 52 172 ( 0) 26 ( 0) 0 0 69 87 1677
2020-11-27T03:15:44+00:00 294s 6 0 52 164 ( 0) 13 ( 0) 0 0 68 86 1677
2020-11-27T02:59:54+00:00 244s 9 0 52 139 ( 0) 3 ( 0) 0 0 68 86 1677
2020-11-27T02:44:56+00:00 247s 8 0 52 161 ( 0) 13 ( 0) 0 0 68 86 1677
2020-11-27T02:29:37+00:00 227s 7 0 52 147 ( 0) 3 ( 0) 0 0 68 86 1677
2020-11-27T02:14:46+00:00 236s 7 0 52 153 ( 0) 3 ( 0) 0 0 68 86 1677
2020-11-27T01:59:46+00:00 237s 8 0 52 147 ( 0) 2 ( 0) 0 0 68 85 1677
2020-11-27T01:44:53+00:00 244s 7 0 52 153 ( 0) 4 ( 0) 0 0 68 87 1677
2020-11-27T01:29:45+00:00 236s 8 0 52 134 ( 0) 6 ( 0) 0 0 68 86 1677
2020-11-27T01:14:36+00:00 227s 7 0 52 154 ( 0) 3 ( 0) 0 0 68 87 1677
2020-11-27T00:59:35+00:00 226s 6 0 52 156 ( 0) 18 ( 0) 0 0 68 87 1677
2020-11-27T00:45:03+00:00 254s 9 0 52 175 ( 0) 7 ( 0) 0 0 68 86 1677
2020-11-27T00:29:37+00:00 228s 7 0 52 163 ( 0) 3 ( 0) 0 0 68 85 1677
2020-11-27T00:14:46+00:00 237s 6 0 52 151 ( 0) 3 ( 0) 0 0 68 85 1677
2020-11-26T23:59:45+00:00 236s 6 0 52 165 ( 0) 12 ( 0) 0 0 68 85 1677
2020-11-26T23:44:58+00:00 249s 7 0 52 175 ( 0) 3 ( 0) 0 0 69 84 1677
2020-11-26T23:29:51+00:00 242s 9 0 52 240 ( 0) 18 ( 0) 0 0 68 85 1677
2020-11-26T23:14:44+00:00 236s 6 0 52 177 ( 0) 7 ( 0) 0 0 68 87 1677
2020-11-26T22:59:49+00:00 241s 7 0 52 156 ( 0) 3 ( 0) 0 0 68 85 1677
2020-11-26T22:44:52+00:00 244s 7 0 52 191 ( 0) 12 ( 0) 0 0 69 85 1677
2020-11-26T22:29:44+00:00 235s 9 0 52 213 ( 0) 14 ( 0) 0 0 72 93 1677
2020-11-26T22:14:42+00:00 233s 6 0 52 205 ( 0) 8 ( 0) 0 0 69 109 1677
2020-11-26T21:59:50+00:00 242s 5 0 52 174 ( 0) 7 ( 0) 0 0 68 100 1677
2020-11-26T21:46:41+00:00 353s 7 0 52 355 ( 0) 14 ( 0) 0 0 73 165 1677
2020-11-26T21:29:43+00:00 235s 9 0 52 177 ( 0) 3 ( 0) 0 0 68 86 1677
2020-11-26T21:14:46+00:00 238s 6 0 52 182 ( 0) 5 ( 0) 0 0 68 86 1677
2020-11-26T20:59:34+00:00 226s 6 0 52 204 ( 0) 4 ( 0) 0 0 68 86 1677
2020-11-26T20:45:00+00:00 252s 7 0 52 168 ( 0) 5 ( 0) 0 0 68 86 1677
2020-11-26T20:29:44+00:00 236s 11 0 52 197 ( 0) 17 ( 0) 0 0 68 86 1677
2020-11-26T20:14:36+00:00 228s 6 0 52 181 ( 0) 6 ( 0) 0 0 68 86 1677
2020-11-26T19:59:56+00:00 248s 7 0 52 209 ( 0) 5 ( 0) 0 0 68 86 1677
2020-11-26T19:44:54+00:00 246s 7 0 52 180 ( 0) 4 ( 0) 0 0 68 86 1677
2020-11-26T19:29:43+00:00 235s 12 0 52 206 ( 0) 6 ( 0) 0 0 70 86 1677
2020-11-26T19:14:45+00:00 237s 6 0 52 211 ( 0) 11 ( 0) 0 0 68 101 1677
2020-11-26T18:59:25+00:00 218s 6 0 52 195 ( 0) 12 ( 0) 0 0 68 86 1677
2020-11-26T18:45:00+00:00 252s 8 0 52 193 ( 0) 6 ( 0) 0 0 68 86 1677
2020-11-26T18:29:43+00:00 236s 7 0 52 198 ( 0) 5 ( 0) 0 0 68 86 1677
2020-11-26T18:14:44+00:00 236s 8 0 52 223 ( 0) 7 ( 0) 0 0 68 87 1677
2020-11-26T17:59:42+00:00 234s 6 0 52 248 ( 0) 10 ( 0) 0 0 68 86 1677
2020-11-26T17:45:01+00:00 254s 7 0 52 238 ( 0) 11 ( 0) 0 0 83 86 1677
2020-11-26T17:29:46+00:00 239s 7 0 52 170 ( 0) 4 ( 0) 0 0 69 86 1677
2020-11-26T17:14:40+00:00 233s 8 0 52 185 ( 0) 8 ( 0) 0 0 68 86 1677
2020-11-26T16:59:43+00:00 236s 6 0 52 149 ( 0) 2 ( 0) 0 0 69 86 1677
2020-11-26T16:45:05+00:00 258s 7 0 52 219 ( 0) 8 ( 0) 0 0 68 86 1677
2020-11-26T16:29:46+00:00 239s 6 0 52 272 ( 0) 7 ( 0) 0 0 69 88 1677
2020-11-26T16:15:12+00:00 265s 9 0 52 189 ( 0) 11 ( 0) 0 0 68 81 1677
2020-11-26T15:59:45+00:00 238s 8 0 52 186 ( 0) 23 ( 0) 0 0 69 86 1677
2020-11-26T15:44:54+00:00 247s 7 0 52 358 ( 0) 29 ( 0) 0 0 68 86 1677
2020-11-26T15:29:40+00:00 233s 6 0 52 289 ( 0) 23 ( 0) 0 0 70 85 1677
2020-11-26T15:14:58+00:00 251s 7 0 52 196 ( 0) 15 ( 0) 0 0 68 85 1677
2020-11-26T14:59:39+00:00 233s 8 0 52 174 ( 0) 2 ( 0) 0 0 69 86 1677
2020-11-26T14:45:00+00:00 253s 10 0 52 271 ( 0) 5 ( 0) 0 0 68 86 1677
2020-11-26T14:29:46+00:00 240s 6 0 52 217 ( 0) 4 ( 0) 0 0 68 86 1677
2020-11-26T14:14:46+00:00 240s 7 0 52 209 ( 0) 5 ( 0) 0 0 68 86 1677
2020-11-26T13:59:40+00:00 234s 6 0 52 169 ( 0) 5 ( 0) 0 0 68 85 1677
2020-11-26T13:45:00+00:00 254s 9 0 52 226 ( 0) 5 ( 0) 0 0 68 78 1677
2020-11-26T13:29:33+00:00 227s 7 0 52 228 ( 0) 24 ( 0) 0 0 68 86 1677
2020-11-26T13:14:43+00:00 237s 7 0 52 126 ( 0) 19 ( 0) 0 0 68 84 1677
2020-11-26T12:59:40+00:00 234s 7 0 52 183 ( 0) 39 ( 0) 0 0 68 86 1677
2020-11-26T12:44:55+00:00 249s 7 0 52 140 ( 0) 34 ( 0) 0 0 68 86 1677
2020-11-26T12:29:45+00:00 240s 9 0 52 138 ( 0) 33 ( 0) 0 0 68 84 1677
2020-11-26T12:14:42+00:00 237s 7 0 52 127 ( 0) 33 ( 0) 0 0 68 84 1677
2020-11-26T11:59:47+00:00 241s 6 0 52 183 ( 0) 43 ( 0) 0 0 74 84 1677
2020-11-26T11:44:54+00:00 249s 7 0 52 181 ( 0) 43 ( 0) 0 0 68 86 1677
2020-11-26T11:29:41+00:00 235s 8 0 52 181 ( 0) 41 ( 0) 0 0 68 84 1677
2020-11-26T11:14:43+00:00 237s 7 0 52 156 ( 0) 34 ( 0) 0 0 71 84 1677
2020-11-26T10:59:51+00:00 246s 6 0 52 250 ( 0) 44 ( 0) 0 0 68 82 1677
2020-11-26T10:44:56+00:00 250s 8 0 52 203 ( 0) 37 ( 0) 0 0 68 86 1677
2020-11-26T10:29:34+00:00 229s 6 0 52 219 ( 0) 24 ( 0) 0 0 68 86 1677
2020-11-26T10:14:47+00:00 242s 9 0 52 200 ( 0) 5 ( 0) 0 0 68 86 1677
2020-11-26T09:59:39+00:00 234s 6 0 52 228 ( 0) 6 ( 0) 0 0 74 85 1677
2020-11-26T09:45:03+00:00 258s 7 0 52 239 ( 0) 9 ( 0) 0 0 68 83 1677
Major LoadDatasets Times Distribution (since last Daily Report):
n = 13, median ~= 217500 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 12
<= 10 min: 1
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Major LoadDatasets Times Distribution (since startup):
n = 1454, median ~= 213610 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 1
<= 5 min: 1396
<= 10 min: 55
<= 20 min: 2
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since last Daily Report):
n = 2, median ~= 75 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 2
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since startup):
n = 59, median ~= 183 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 1
<= 100 ms: 11
<= 200 ms: 21
<= 500 ms: 1
<= 1 s: 13
<= 2 s: 10
<= 5 s: 0
<= 10 s: 0
<= 20 s: 1
<= 1 min: 0
<= 2 min: 1
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last major LoadDatasets):
n = 1, median ~= 0 ms
0 ms: 1
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last Daily Report):
n = 296, median ~= 36 ms
0 ms: 32
1 ms: 15
2 ms: 0
<= 5 ms: 6
<= 10 ms: 2
<= 20 ms: 10
<= 50 ms: 157
<= 100 ms: 49
<= 200 ms: 12
<= 500 ms: 8
<= 1 s: 0
<= 2 s: 2
<= 5 s: 1
<= 10 s: 0
<= 20 s: 1
<= 1 min: 1
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since startup):
n = 16392, median ~= 10 ms
0 ms: 3446
1 ms: 1899
2 ms: 87
<= 5 ms: 1168
<= 10 ms: 1620
<= 20 ms: 437
<= 50 ms: 3908
<= 100 ms: 1699
<= 200 ms: 720
<= 500 ms: 584
<= 1 s: 258
<= 2 s: 194
<= 5 s: 152
<= 10 s: 11
<= 20 s: 16
<= 1 min: 84
<= 2 min: 60
<= 5 min: 42
<= 10 min: 5
<= 20 min: 1
<= 1 hr: 1
> 1 hr: 0
Response Succeeded Time Distribution (since last major LoadDatasets):
n = 34, median ~= 11 ms
0 ms: 2
1 ms: 0
2 ms: 2
<= 5 ms: 10
<= 10 ms: 2
<= 20 ms: 9
<= 50 ms: 4
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 5
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last Daily Report):
n = 2734, median ~= 14 ms
0 ms: 107
1 ms: 78
2 ms: 120
<= 5 ms: 758
<= 10 ms: 102
<= 20 ms: 531
<= 50 ms: 442
<= 100 ms: 227
<= 200 ms: 115
<= 500 ms: 118
<= 1 s: 36
<= 2 s: 21
<= 5 s: 72
<= 10 s: 3
<= 20 s: 4
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since startup):
n = 299304, median ~= 5 ms
0 ms: 19897
1 ms: 11952
2 ms: 16757
<= 5 ms: 106189
<= 10 ms: 13614
<= 20 ms: 40563
<= 50 ms: 32011
<= 100 ms: 20483
<= 200 ms: 13861
<= 500 ms: 10288
<= 1 s: 2852
<= 2 s: 3240
<= 5 s: 6746
<= 10 s: 352
<= 20 s: 289
<= 1 min: 111
<= 2 min: 19
<= 5 min: 57
<= 10 min: 18
<= 20 min: 0
<= 1 hr: 4
> 1 hr: 1
TaskThread Failed Time Distribution (since last Daily Report):
n = 0
TaskThread Failed Time Distribution (since startup):
n = 0
TaskThread Succeeded Time Distribution (since last Daily Report):
n = 0
TaskThread Succeeded Time Distribution (since startup):
n = 0
SgtMap topography nFromCache=23 nNotFromCache=266
GSHHS: nCached=100 of 100, nCoarse=2634, nSuccesses=1683, nTossed=1263
NationalBoundaries: nCached=100 of 100, nCoarse=292, nSuccesses=350, nTossed=63
StateBoundaries: nCached=100 of 100, nCoarse=258, nSuccesses=349, nTossed=58
Rivers: nCached=100 of 100, nCoarse=286, nSuccesses=347, nTossed=67
bufferedImage isAccelerated=[unknown]
Number of threads: Tomcat-waiting=0, inotify=0, other=67
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)
#1 Thread[AsyncFileHandlerWriter-2046562095,5,main] TIMED_WAITING daemon
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9/java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:513)
java.base@11.0.9/java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:675)
app//org.apache.juli.AsyncFileHandler$LoggerThread.run(AsyncFileHandler.java:159)
#2 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#3 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#4 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#5 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#6 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#7 Thread[cluster1-nio-worker-4,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#8 Thread[cluster1-nio-worker-5,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#9 Thread[cluster1-nio-worker-6,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#10 Thread[cluster1-nio-worker-7,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#11 Thread[cluster1-reconnection-0,5,main] TIMED_WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#12 Thread[cluster1-reconnection-1,5,main] WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#13 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#14 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.9/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#15 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#16 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#17 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#18 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#19 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#20 Thread[cluster2-nio-worker-4,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#21 Thread[cluster2-nio-worker-5,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#22 Thread[cluster2-nio-worker-6,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#23 Thread[cluster2-nio-worker-7,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#24 Thread[cluster2-reconnection-0,5,main] WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#25 Thread[cluster2-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#26 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#27 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.9/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#28 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#29 Thread[cluster3-nio-worker-0,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#30 Thread[cluster3-nio-worker-1,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#31 Thread[cluster3-nio-worker-2,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#32 Thread[cluster3-nio-worker-3,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#33 Thread[cluster3-nio-worker-4,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#34 Thread[cluster3-nio-worker-5,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#35 Thread[cluster3-nio-worker-6,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#36 Thread[cluster3-nio-worker-7,5,main] RUNNABLE
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#37 Thread[cluster3-reconnection-0,5,main] TIMED_WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#38 Thread[cluster3-reconnection-1,5,main] WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#39 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#40 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.9/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#41 Thread[Common-Cleaner,8,InnocuousThreadGroup] TIMED_WAITING daemon
java.base@11.0.9/java.lang.Object.wait(Native Method)
java.base@11.0.9/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.9/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
java.base@11.0.9/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
#42 Thread[ContainerBackgroundProcessor[StandardEngine[Catalina]],5,main] TIMED_WAITING daemon
java.base@11.0.9/java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1365)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#43 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#44 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.9/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.9/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#45 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.9/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.9/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#46 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.9/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.9/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#47 Thread[Finalizer,8,system] WAITING daemon
java.base@11.0.9/java.lang.Object.wait(Native Method)
java.base@11.0.9/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.9/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.base@11.0.9/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
#48 Thread[http-nio-8080-Acceptor-0,5,main] RUNNABLE daemon
java.base@11.0.9/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
java.base@11.0.9/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
java.base@11.0.9/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:446)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:70)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:95)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#49 Thread[http-nio-8080-AsyncTimeout,5,main] TIMED_WAITING daemon
java.base@11.0.9/java.lang.Thread.sleep(Native Method)
org.apache.coyote.AbstractProtocol$AsyncTimeout.run(AbstractProtocol.java:1113)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#50 Thread[http-nio-8080-ClientPoller-0,5,main] RUNNABLE daemon
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#51 Thread[http-nio-8080-ClientPoller-1,5,main] RUNNABLE daemon
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#52 Thread[http-nio-8080-exec-7564,5,main] WAITING daemon
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#53 Thread[http-nio-8080-exec-7581,5,main] WAITING daemon
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#54 Thread[http-nio-8080-exec-7587,5,main] WAITING daemon
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#55 Thread[http-nio-8080-exec-7603,5,main] WAITING daemon
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#56 Thread[http-nio-8080-exec-7606,5,main] RUNNABLE daemon
java.base@11.0.9/java.lang.Thread.dumpThreads(Native Method)
java.base@11.0.9/java.lang.Thread.getAllStackTraces(Thread.java:1658)
com.cohort.util.MustBe.allStackTraces(MustBe.java:353)
gov.noaa.pfel.erddap.Erddap.doStatus(Erddap.java:3178)
gov.noaa.pfel.erddap.Erddap.doGet(Erddap.java:595)
javax.servlet.http.HttpServlet.service(HttpServlet.java:634)
javax.servlet.http.HttpServlet.service(HttpServlet.java:741)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:668)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:770)
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415)
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#57 Thread[http-nio-8080-exec-7610,5,main] WAITING daemon
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#58 Thread[http-nio-8080-exec-7611,5,main] WAITING daemon
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#59 Thread[http-nio-8080-exec-7614,5,main] WAITING daemon
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#60 Thread[http-nio-8080-exec-7615,5,main] WAITING daemon
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#61 Thread[http-nio-8080-exec-7616,5,main] WAITING daemon
java.base@11.0.9/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#62 Thread[Java2D Disposer,10,system] WAITING daemon
java.base@11.0.9/java.lang.Object.wait(Native Method)
java.base@11.0.9/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.9/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.desktop@11.0.9/sun.java2d.Disposer.run(Disposer.java:144)
java.base@11.0.9/java.lang.Thread.run(Thread.java:834)
#63 Thread[main,5,main] RUNNABLE
java.base@11.0.9/java.net.PlainSocketImpl.socketAccept(Native Method)
java.base@11.0.9/java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:458)
java.base@11.0.9/java.net.ServerSocket.implAccept(ServerSocket.java:565)
java.base@11.0.9/java.net.ServerSocket.accept(ServerSocket.java:533)
org.apache.catalina.core.StandardServer.await(StandardServer.java:447)
org.apache.catalina.startup.Catalina.await(Catalina.java:770)
org.apache.catalina.startup.Catalina.start(Catalina.java:716)
java.base@11.0.9/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
java.base@11.0.9/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
java.base@11.0.9/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.base@11.0.9/java.lang.reflect.Method.invoke(Method.java:566)
app//org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:350)
app//org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:492)
#64 Thread[NioBlockingSelector.BlockPoller-1,5,main] RUNNABLE daemon
java.base@11.0.9/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(NioBlockingSelector.java:298)
#65 Thread[Reference Handler,10,system] RUNNABLE daemon
java.base@11.0.9/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
java.base@11.0.9/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
java.base@11.0.9/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
#66 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.base@11.0.9/java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:282)
#67 Thread[Signal Dispatcher,9,system] RUNNABLE daemon