Marine Institute Logo Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland)
   
Brought to you by the Marine Institute(Ireland)    

ERDDAP > Status

Current time is 2020-08-08T11:10:27+00:00
Startup was at  2020-07-22T07:01:20+00:00
Last major LoadDatasets started 7m 59s ago and finished after 230 seconds.
nGridDatasets  = 9
nTableDatasets = 40
nTotalDatasets = 49
n Datasets Failed To Load (in the last major LoadDatasets) = 0
Response Failed    Time (since last major LoadDatasets) n =        1,  median ~=        1 ms
Response Failed    Time (since last Daily Report)       n =      276,  median ~=       56 ms
Response Failed    Time (since startup)                 n =    41724,  median ~=        5 ms
Response Succeeded Time (since last major LoadDatasets) n =       22,  median ~=       17 ms
Response Succeeded Time (since last Daily Report)       n =     3143,  median ~=       20 ms
Response Succeeded Time (since startup)                 n =   333461,  median ~=       15 ms
TaskThread has finished 0 out of 0 tasks.  Currently, no task is running.
TaskThread Failed    Time (since last Daily Report)     n =        0
TaskThread Failed    Time (since startup)               n =        0
TaskThread Succeeded Time (since last Daily Report)     n =        0
TaskThread Succeeded Time (since startup)               n =        0
Number of threads: Tomcat-waiting=0, inotify=0, other=66
MemoryInUse=   135 MB (highWaterMark=  1842 MB) (Xmx ~= 5888 MB)

Major LoadDatasets Time Series: MLD    Datasets Loaded    Requests (medianTime in seconds)     Number of Threads      Memory (MB)
  timestamp                    time   nTry nFail nTotal  nSuccess (median) nFailed (median)  tomWait inotify other  inUse highWater
  2020-08-08T11:06:16+00:00    228s      6     0     49       161 (     0)       9 (     0)        0       0    67     89      1842
  2020-08-08T10:52:05+00:00    277s      7     0     49       162 (     0)      41 (     0)        0       0    68     86      1842
  2020-08-08T10:36:22+00:00    235s      6     0     49       163 (     0)      62 (     0)        0       0    67     86      1842
  2020-08-08T10:21:31+00:00    244s      9     0     49       213 (     0)       7 (     0)        0       0    67     86      1842
  2020-08-08T10:06:24+00:00    237s      6     0     49       162 (     0)      13 (     0)        0       0    75     86      1842
  2020-08-08T09:51:56+00:00    269s      6     0     49       274 (     0)      20 (     0)        0       0    67     86      1842
  2020-08-08T09:39:39+00:00    432s     18     0     49       189 (     0)       6 (     0)        0       0    67     86      1842
  2020-08-08T09:21:32+00:00    245s      7     0     49       167 (     0)      28 (     0)        0       0    67     85      1842
  2020-08-08T09:07:35+00:00    308s     16     0     49       215 (     0)       5 (     0)        0       0    67     84      1842
  2020-08-08T08:51:40+00:00    253s      7     0     49       211 (     0)      21 (     0)        0       0    67     86      1842
  2020-08-08T08:36:20+00:00    233s      6     0     49       190 (     0)       8 (     0)        0       0    67     85      1842
  2020-08-08T08:21:38+00:00    252s      7     0     49       215 (     0)      18 (     0)        0       0    67     83      1842
  2020-08-08T08:06:35+00:00    248s      6     0     49       160 (     0)      10 (     0)        0       0    67     87      1842
  2020-08-08T07:52:00+00:00    274s      9     0     49       186 (     0)       5 (     0)        0       0    68     86      1842
  2020-08-08T07:36:20+00:00    233s      6     0     49       216 (     0)      14 (     0)        0       0    67     88      1842
  2020-08-08T07:21:36+00:00    249s      7     0     49       237 (     0)       8 (     0)        0       0    67     84      1842
  2020-08-08T07:06:23+00:00    237s      6     0     49       157 (     0)       5 (     0)        0       0    67     84      1842
  2020-08-08T06:52:03+00:00    276s     10     0     49       194 (     0)      10 (     0)        0       0    68     77      1842
  2020-08-08T06:36:17+00:00    231s      6     0     49       112 (     0)       3 (     0)        0       0    67     87      1842
  2020-08-08T06:21:36+00:00    250s      7     0     49       144 (     0)      24 (     0)        0       0    67     86      1842
  2020-08-08T06:06:39+00:00    253s      6     0     49       153 (     0)      25 (     0)        0       0    67     84      1842
  2020-08-08T05:51:41+00:00    255s      7     0     49       124 (     0)      15 (     0)        0       0    67     94      1842
  2020-08-08T05:36:19+00:00    233s      8     0     49       123 (     0)       4 (     0)        0       0    67     87      1842
  2020-08-08T05:21:20+00:00    234s      8     0     49        93 (     0)       4 (     0)        0       0    67     88      1842
  2020-08-08T05:06:23+00:00    237s      6     0     49       114 (     0)       3 (     0)        0       0    67     74      1842
  2020-08-08T04:51:45+00:00    259s      7     0     49        89 (     0)       4 (     0)        0       0    67     96      1842
  2020-08-08T04:36:19+00:00    233s      7     0     49       126 (     0)      10 (     0)        0       0    67     84      1842
  2020-08-08T04:21:29+00:00    244s      9     0     49       103 (     0)       7 (     0)        0       0    67     79      1842
  2020-08-08T04:06:40+00:00    254s      6     0     49       139 (     0)       3 (     0)        0       0    67    257      1842
  2020-08-08T03:51:44+00:00    259s      7     0     49       127 (     0)      11 (     0)        0       0    67     86      1842
  2020-08-08T03:36:28+00:00    242s      6     0     49       167 (     0)       6 (     0)        0       0    67     85      1842
  2020-08-08T03:21:33+00:00    248s      7     0     49       139 (     0)       7 (     0)        0       0    67     86      1842
  2020-08-08T03:06:42+00:00    256s      8     0     49       141 (     0)       4 (     0)        0       0    67     85      1842
  2020-08-08T02:51:52+00:00    267s      7     0     49       131 (     0)       4 (     0)        0       0    67     87      1842
  2020-08-08T02:36:19+00:00    234s      6     0     49       132 (     0)       7 (     0)        0       0    67     86      1842
  2020-08-08T02:21:47+00:00    262s      7     0     49       135 (     0)       6 (     0)        0       0    67     85      1842
  2020-08-08T02:06:40+00:00    255s      6     0     49       135 (     0)       4 (     0)        0       0    67     86      1842
  2020-08-08T01:51:58+00:00    273s      9     0     49       119 (     0)       5 (     0)        0       0    68     92      1842
  2020-08-08T01:36:27+00:00    242s      9     0     49       123 (     0)       5 (     0)        0       0    67     85      1842
  2020-08-08T01:21:38+00:00    253s      7     0     49       105 (     0)       4 (     0)        0       0    67     86      1842
  2020-08-08T01:06:48+00:00    263s      8     0     49       150 (     0)       5 (     0)        0       0    67     86      1842
  2020-08-08T00:51:37+00:00    253s      7     0     49       127 (     0)       6 (     0)        0       0    67     86      1842
  2020-08-08T00:36:44+00:00    260s      8     0     49       139 (     0)       6 (     0)        0       0    67     85      1842
  2020-08-08T00:21:26+00:00    241s      7     0     49       111 (     0)       4 (     0)        0       0    67     86      1842
  2020-08-08T00:06:50+00:00    266s      6     0     49       149 (     0)       7 (     0)        0       0    67     85      1842
  2020-08-07T23:52:02+00:00    277s      8     0     49       132 (     0)       6 (     0)        0       0    68     88      1842
  2020-08-07T23:36:21+00:00    236s      6     0     49       142 (     0)       4 (     0)        0       0    67     87      1842
  2020-08-07T23:21:42+00:00    257s      9     0     49       137 (     0)       4 (     0)        0       0    67     86      1842
  2020-08-07T23:06:31+00:00    247s      6     0     49       135 (     0)       6 (     0)        0       0    67     87      1842
  2020-08-07T22:51:52+00:00    268s      7     0     49       139 (     0)       5 (     0)        0       0    67     85      1842
  2020-08-07T22:36:42+00:00    258s      6     0     49       177 (     0)      10 (     0)        0       0    67     88      1842
  2020-08-07T22:21:42+00:00    258s      7     0     49       174 (     0)      13 (     0)        0       0    70     74      1842
  2020-08-07T22:06:35+00:00    251s      8     0     49       153 (     0)       5 (     0)        0       0    67     86      1842
  2020-08-07T21:51:46+00:00    262s      7     0     49       183 (     0)      16 (     0)        0       0    67     84      1842
  2020-08-07T21:36:31+00:00    247s      6     0     49       170 (     0)       9 (     0)        0       0    67     86      1842
  2020-08-07T21:21:42+00:00    258s      7     0     49       183 (     0)      12 (     0)        0       0    68     86      1842
  2020-08-07T21:06:54+00:00    271s      6     0     49       289 (     0)       9 (     0)        0       0    68     85      1842
  2020-08-07T20:51:53+00:00    270s     10     0     49       174 (     0)       7 (     0)        0       0    67     86      1842
  2020-08-07T20:36:24+00:00    240s      8     0     49       128 (     0)       7 (     0)        0       0    67     86      1842
  2020-08-07T20:21:31+00:00    247s      7     0     49       161 (     0)      11 (     0)        0       0    67     86      1842
  2020-08-07T20:06:33+00:00    250s      6     0     49       160 (     0)       3 (     0)        0       0    67     87      1842
  2020-08-07T19:51:58+00:00    274s      7     0     49       161 (     0)      13 (     0)        0       0    68     91      1842
  2020-08-07T19:36:14+00:00    231s      8     0     49       124 (     0)       4 (     0)        0       0    67     87      1842
  2020-08-07T19:21:38+00:00    255s      8     0     49       162 (     0)      15 (     0)        0       0    67     86      1842
  2020-08-07T19:06:30+00:00    247s      6     0     49       227 (     0)       6 (     0)        0       0    67     87      1842
  2020-08-07T18:51:40+00:00    258s      8     0     49       153 (     0)       9 (     0)        0       0    67     87      1842
  2020-08-07T18:36:25+00:00    243s      8     0     49       145 (     0)       9 (     0)        0       0    74     86      1842
  2020-08-07T18:21:15+00:00    232s      7     0     49       222 (     0)     150 (     0)        0       0    67     86      1842
  2020-08-07T18:06:49+00:00    267s      6     0     49       200 (     0)     137 (     0)        0       0    67     86      1842
  2020-08-07T17:51:55+00:00    272s      7     0     49       253 (     0)      14 (     0)        0       0    67     86      1842
  2020-08-07T17:36:27+00:00    245s      6     0     49       188 (     0)       3 (     0)        0       0    67     87      1842
  2020-08-07T17:21:39+00:00    256s      9     0     49       181 (     0)      61 (     0)        0       0    67     86      1842
  2020-08-07T17:06:24+00:00    242s      5     0     49       265 (     0)     135 (     0)        0       0    67     90      1842
  2020-08-07T16:53:04+00:00    342s      7     0     49       289 (     0)     105 (     0)        0       0    67     86      1842
  2020-08-07T16:36:25+00:00    243s      8     0     49       134 (     0)       5 (     0)        0       0    67     87      1842
  2020-08-07T16:21:26+00:00    244s      6     0     49       573 (     0)      13 (     0)        0       0    67     85      1842
  2020-08-07T16:08:28+00:00    365s      9     0     49       499 (     0)      11 (     0)        0       0    69     85      1842
  2020-08-07T15:51:38+00:00    256s      7     0     49       127 (     0)       4 (     0)        0       0    67     85      1842
  2020-08-07T15:36:37+00:00    254s      6     0     49       245 (     0)      11 (     0)        0       0    67     85      1842
  2020-08-07T15:21:41+00:00    259s      7     0     49       176 (     0)      10 (     0)        0       0    67     86      1842
  2020-08-07T15:06:28+00:00    246s      6     0     49       203 (     0)       4 (     0)        0       0    67     84      1842
  2020-08-07T14:51:43+00:00    261s      9     0     49       291 (     0)     143 (     0)        0       0    67     86      1842
  2020-08-07T14:36:24+00:00    242s      6     0     49       192 (     0)       5 (     0)        0       0    67     85      1842
  2020-08-07T14:21:35+00:00    253s      7     0     49       205 (     0)      11 (     0)        0       0    67     86      1842
  2020-08-07T14:06:12+00:00    230s      6     0     49       248 (     0)       3 (     0)        0       0    67     85      1842
  2020-08-07T13:52:04+00:00    282s      7     0     49       550 (     0)      12 (     0)        0       0    71     85      1842
  2020-08-07T13:36:26+00:00    245s      8     0     49       652 (     0)       4 (     0)        0       0    68     86      1842
  2020-08-07T13:21:26+00:00    244s      7     0     49       317 (     0)       8 (     0)        0       0    68     87      1842
  2020-08-07T13:06:34+00:00    253s      7     0     49       382 (     0)      16 (     0)        0       0    73     86      1842
  2020-08-07T12:51:52+00:00    270s      7     0     49       355 (     0)      14 (     0)        0       0    67     86      1842
  2020-08-07T12:36:27+00:00    245s      6     0     49       307 (     0)       9 (     0)        0       0    67     83      1842
  2020-08-07T12:21:46+00:00    264s     10     0     49       303 (     0)      13 (     0)        0       0    72     84      1842
  2020-08-07T12:06:19+00:00    238s      6     0     49       175 (     0)       5 (     0)        0       0    67     82      1842
  2020-08-07T11:51:40+00:00    259s      8     0     49       216 (     0)       4 (     0)        0       0    67     85      1842
  2020-08-07T11:36:17+00:00    236s      6     0     49       226 (     0)      10 (     0)        0       0    74     86      1842
  2020-08-07T11:21:29+00:00    248s      9     0     49       162 (     0)      10 (     0)        0       0    67     86      1842
  2020-08-07T11:06:33+00:00    252s      6     0     49       248 (     0)      18 (     0)        0       0    75    530      1842
  2020-08-07T10:51:50+00:00    269s      7     0     49       305 (     0)       5 (     0)        0       0    67     81      1842
  2020-08-07T10:36:23+00:00    243s      6     0     49       350 (     0)       9 (     0)        0       0    68    283      1842
  2020-08-07T10:21:22+00:00    241s      9     0     49       177 (     0)       9 (     0)        0       0    67     87      1842


Major LoadDatasets Times Distribution (since last Daily Report):
    n =       16,  median ~=   222857 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:          14
    <= 10 min:          2
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Major LoadDatasets Times Distribution (since startup):
    n =     1637,  median ~=   211969 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           1
    <= 5 min:        1600
    <= 10 min:         35
    <= 20 min:          0
    <= 1 hr:            1
    >  1 hr:            0


Minor LoadDatasets Times Distribution (since last Daily Report):
    n =        1,  median ~=      150 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          1
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Minor LoadDatasets Times Distribution (since startup):
    n =       33,  median ~=      161 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          5
    <= 200 ms:         19
    <= 500 ms:          0
    <= 1 s:             2
    <= 2 s:             3
    <= 5 s:             1
    <= 10 s:            0
    <= 20 s:            3
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0


Response Failed Time Distribution (since last major LoadDatasets):
    n =        1,  median ~=        1 ms
    0 ms:               0
    1 ms:               1
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Failed Time Distribution (since last Daily Report):
    n =      276,  median ~=       56 ms
    0 ms:              33
    1 ms:              10
    2 ms:               0
    <= 5 ms:           29
    <= 10 ms:          11
    <= 20 ms:           5
    <= 50 ms:          35
    <= 100 ms:        128
    <= 200 ms:          7
    <= 500 ms:          6
    <= 1 s:            11
    <= 2 s:             1
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Failed Time Distribution (since startup):
    n =    41724,  median ~=        5 ms
    0 ms:            5000
    1 ms:            3357
    2 ms:            1332
    <= 5 ms:        12336
    <= 10 ms:       11083
    <= 20 ms:         900
    <= 50 ms:        3207
    <= 100 ms:       1495
    <= 200 ms:       1284
    <= 500 ms:        751
    <= 1 s:           459
    <= 2 s:           200
    <= 5 s:           127
    <= 10 s:           25
    <= 20 s:           14
    <= 1 min:          85
    <= 2 min:          48
    <= 5 min:          15
    <= 10 min:          2
    <= 20 min:          2
    <= 1 hr:            1
    >  1 hr:            1


Response Succeeded Time Distribution (since last major LoadDatasets):
    n =       22,  median ~=       17 ms
    0 ms:               2
    1 ms:               1
    2 ms:               1
    <= 5 ms:            0
    <= 10 ms:           3
    <= 20 ms:           6
    <= 50 ms:           7
    <= 100 ms:          2
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Succeeded Time Distribution (since last Daily Report):
    n =     3143,  median ~=       20 ms
    0 ms:             111
    1 ms:              52
    2 ms:              82
    <= 5 ms:          175
    <= 10 ms:         235
    <= 20 ms:         943
    <= 50 ms:         562
    <= 100 ms:        154
    <= 200 ms:        216
    <= 500 ms:        214
    <= 1 s:           200
    <= 2 s:           105
    <= 5 s:            84
    <= 10 s:            8
    <= 20 s:            2
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Succeeded Time Distribution (since startup):
    n =   333461,  median ~=       15 ms
    0 ms:           16772
    1 ms:           17195
    2 ms:           33442
    <= 5 ms:        53775
    <= 10 ms:       21869
    <= 20 ms:       49798
    <= 50 ms:       48982
    <= 100 ms:      17339
    <= 200 ms:      20611
    <= 500 ms:      22462
    <= 1 s:         13750
    <= 2 s:          9570
    <= 5 s:          5682
    <= 10 s:         1148
    <= 20 s:          490
    <= 1 min:         321
    <= 2 min:         132
    <= 5 min:          94
    <= 10 min:         20
    <= 20 min:          7
    <= 1 hr:            2
    >  1 hr:            0


TaskThread Failed Time Distribution (since last Daily Report):
    n =        0

TaskThread Failed Time Distribution (since startup):
    n =        0

TaskThread Succeeded Time Distribution (since last Daily Report):
    n =        0

TaskThread Succeeded Time Distribution (since startup):
    n =        0


SgtMap topography nFromCache=28 nNotFromCache=215
GSHHS: nCached=100 of 100, nCoarse=2532, nSuccesses=1623, nTossed=1155
NationalBoundaries: nCached=100 of 100,  nCoarse=288, nSuccesses=280, nTossed=4
StateBoundaries: nCached=100 of 100,  nCoarse=281, nSuccesses=280, nTossed=4
Rivers: nCached=100 of 100,  nCoarse=282, nSuccesses=280, nTossed=4
bufferedImage isAccelerated=[unknown]

Number of threads: Tomcat-waiting=0, inotify=0, other=66
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)

#1 Thread[AsyncFileHandlerWriter-1867750575,5,main] TIMED_WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:513)
java.base@11.0.7/java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:675)
app//org.apache.juli.AsyncFileHandler$LoggerThread.run(AsyncFileHandler.java:159)

#2 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#3 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#4 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#5 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#6 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#7 Thread[cluster1-nio-worker-4,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#8 Thread[cluster1-nio-worker-5,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#9 Thread[cluster1-nio-worker-6,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#10 Thread[cluster1-nio-worker-7,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#11 Thread[cluster1-reconnection-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#12 Thread[cluster1-reconnection-1,5,main] WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#13 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#14 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#15 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#16 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#17 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#18 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#19 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#20 Thread[cluster2-nio-worker-4,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#21 Thread[cluster2-nio-worker-5,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#22 Thread[cluster2-nio-worker-6,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#23 Thread[cluster2-nio-worker-7,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#24 Thread[cluster2-reconnection-0,5,main] WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#25 Thread[cluster2-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#26 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#27 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#28 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#29 Thread[cluster3-nio-worker-0,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#30 Thread[cluster3-nio-worker-1,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#31 Thread[cluster3-nio-worker-2,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#32 Thread[cluster3-nio-worker-3,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#33 Thread[cluster3-nio-worker-4,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#34 Thread[cluster3-nio-worker-5,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#35 Thread[cluster3-nio-worker-6,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#36 Thread[cluster3-nio-worker-7,5,main] RUNNABLE
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#37 Thread[cluster3-reconnection-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#38 Thread[cluster3-reconnection-1,5,main] WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#39 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.7/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#40 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#41 Thread[Common-Cleaner,8,InnocuousThreadGroup] TIMED_WAITING daemon
java.base@11.0.7/java.lang.Object.wait(Native Method)
java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.7/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
java.base@11.0.7/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)

#42 Thread[ContainerBackgroundProcessor[StandardEngine[Catalina]],5,main] TIMED_WAITING daemon
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1365)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#43 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#44 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.7/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#45 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.7/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#46 Thread[Finalizer,8,system] WAITING daemon
java.base@11.0.7/java.lang.Object.wait(Native Method)
java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.base@11.0.7/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)

#47 Thread[http-nio-8080-Acceptor-0,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
java.base@11.0.7/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
java.base@11.0.7/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:446)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:70)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:95)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#48 Thread[http-nio-8080-AsyncTimeout,5,main] TIMED_WAITING daemon
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
org.apache.coyote.AbstractProtocol$AsyncTimeout.run(AbstractProtocol.java:1113)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#49 Thread[http-nio-8080-ClientPoller-0,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#50 Thread[http-nio-8080-ClientPoller-1,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#51 Thread[http-nio-8080-exec-6078,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#52 Thread[http-nio-8080-exec-6113,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#53 Thread[http-nio-8080-exec-6119,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#54 Thread[http-nio-8080-exec-6120,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#55 Thread[http-nio-8080-exec-6122,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#56 Thread[http-nio-8080-exec-6127,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#57 Thread[http-nio-8080-exec-6135,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#58 Thread[http-nio-8080-exec-6136,5,main] RUNNABLE daemon
java.base@11.0.7/java.lang.Thread.dumpThreads(Native Method)
java.base@11.0.7/java.lang.Thread.getAllStackTraces(Thread.java:1657)
com.cohort.util.MustBe.allStackTraces(MustBe.java:353)
gov.noaa.pfel.erddap.Erddap.doStatus(Erddap.java:3178)
gov.noaa.pfel.erddap.Erddap.doGet(Erddap.java:595)
javax.servlet.http.HttpServlet.service(HttpServlet.java:634)
javax.servlet.http.HttpServlet.service(HttpServlet.java:741)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:668)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:770)
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415)
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#59 Thread[http-nio-8080-exec-6138,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#60 Thread[http-nio-8080-exec-6140,5,main] WAITING daemon
java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#61 Thread[Java2D Disposer,10,system] WAITING daemon
java.base@11.0.7/java.lang.Object.wait(Native Method)
java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.desktop@11.0.7/sun.java2d.Disposer.run(Disposer.java:144)
java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

#62 Thread[main,5,main] RUNNABLE
java.base@11.0.7/java.net.PlainSocketImpl.socketAccept(Native Method)
java.base@11.0.7/java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:458)
java.base@11.0.7/java.net.ServerSocket.implAccept(ServerSocket.java:565)
java.base@11.0.7/java.net.ServerSocket.accept(ServerSocket.java:533)
org.apache.catalina.core.StandardServer.await(StandardServer.java:447)
org.apache.catalina.startup.Catalina.await(Catalina.java:770)
org.apache.catalina.startup.Catalina.start(Catalina.java:716)
java.base@11.0.7/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
java.base@11.0.7/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
java.base@11.0.7/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.base@11.0.7/java.lang.reflect.Method.invoke(Method.java:566)
app//org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:350)
app//org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:492)

#63 Thread[NioBlockingSelector.BlockPoller-1,5,main] RUNNABLE daemon
java.base@11.0.7/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.7/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.7/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.7/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(NioBlockingSelector.java:298)

#64 Thread[Reference Handler,10,system] RUNNABLE daemon
java.base@11.0.7/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
java.base@11.0.7/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
java.base@11.0.7/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)

#65 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.base@11.0.7/java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:282)

#66 Thread[Signal Dispatcher,9,system] RUNNABLE daemon


 
ERDDAP, Version 1.82
Disclaimers | Privacy Policy | Contact