Marine Institute Logo Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland)
   
Brought to you by the Marine Institute(Ireland)    

ERDDAP > Status

Current time is 2020-09-28T04:51:26+00:00
Startup was at  2020-09-22T07:01:15+00:00
Last major LoadDatasets started 4m 16s ago and finished after 200 seconds.
nGridDatasets  = 9
nTableDatasets = 42
nTotalDatasets = 51
n Datasets Failed To Load (in the last major LoadDatasets) = 0
Response Failed    Time (since last major LoadDatasets) n =        0
Response Failed    Time (since last Daily Report)       n =      668,  median ~=       10 ms
Response Failed    Time (since startup)                 n =     8785,  median ~=        9 ms
Response Succeeded Time (since last major LoadDatasets) n =       12,  median ~=       15 ms
Response Succeeded Time (since last Daily Report)       n =    16533,  median ~=       15 ms
Response Succeeded Time (since startup)                 n =   115385,  median ~=       14 ms
TaskThread has finished 0 out of 0 tasks.  Currently, no task is running.
TaskThread Failed    Time (since last Daily Report)     n =        0
TaskThread Failed    Time (since startup)               n =        0
TaskThread Succeeded Time (since last Daily Report)     n =        0
TaskThread Succeeded Time (since startup)               n =        0
Number of threads: Tomcat-waiting=0, inotify=0, other=69
MemoryInUse=   142 MB (highWaterMark=  3260 MB) (Xmx ~= 5888 MB)

Major LoadDatasets Time Series: MLD    Datasets Loaded    Requests (medianTime in seconds)     Number of Threads      Memory (MB)
  timestamp                    time   nTry nFail nTotal  nSuccess (median) nFailed (median)  tomWait inotify other  inUse highWater
  2020-09-28T04:50:25+00:00    195s      6     0     51       186 (     0)      13 (     0)        0       0    69    102      3260
  2020-09-28T04:35:48+00:00    218s      9     0     51       224 (     0)       4 (     0)        0       0    70     91      3260
  2020-09-28T04:20:42+00:00    212s      6     0     51       223 (     0)       3 (     0)        0       0    69     92      3260
  2020-09-28T04:05:46+00:00    216s      7     0     51       203 (     0)       4 (     0)        0       0    70     95      3260
  2020-09-28T03:50:24+00:00    195s      6     0     51       217 (     0)      13 (     0)        0       0    69    100      3260
  2020-09-28T03:35:28+00:00    199s      7     0     51       150 (     0)       3 (     0)        0       0    69    100      3260
  2020-09-28T03:20:21+00:00    192s      8     0     51       140 (     0)       3 (     0)        0       0    69    100      3260
  2020-09-28T03:06:01+00:00    232s      8     0     51       171 (     0)       5 (     0)        0       0    69    100      3260
  2020-09-28T02:50:27+00:00    198s      6     0     51       152 (     0)       3 (     0)        0       0    69    104      3260
  2020-09-28T02:35:28+00:00    199s      7     0     51       149 (     0)       4 (     0)        0       0    69    100      3260
  2020-09-28T02:20:55+00:00    226s      8     0     51       162 (     0)       5 (     0)        0       0    70    100      3260
  2020-09-28T02:05:38+00:00    209s      8     0     51       181 (     0)       8 (     0)        0       0    69    100      3260
  2020-09-28T01:50:29+00:00    201s      6     0     51       149 (     0)       3 (     0)        0       0    69    100      3260
  2020-09-28T01:35:39+00:00    210s      8     0     51       162 (     0)       5 (     0)        0       0    69    100      3260
  2020-09-28T01:20:13+00:00    184s      6     0     51       142 (     0)       3 (     0)        0       0    69    100      3260
  2020-09-28T01:05:41+00:00    212s      9     0     51       153 (     0)       5 (     0)        0       0    69    105      3260
  2020-09-28T00:50:28+00:00    200s      6     0     51       141 (     0)       3 (     0)        0       0    69    104      3260
  2020-09-28T00:35:37+00:00    209s      7     0     51       153 (     0)       3 (     0)        0       0    69    104      3260
  2020-09-28T00:20:26+00:00    197s      9     0     51       138 (     0)       3 (     0)        0       0    69    108      3260
  2020-09-28T00:05:48+00:00    220s      7     0     51       166 (     0)      10 (     0)        0       0    69     99      3260
  2020-09-27T23:50:32+00:00    204s      8     0     51       154 (     0)       4 (     0)        0       0    69    100      3260
  2020-09-27T23:35:32+00:00    204s      7     0     51       194 (     0)       5 (     0)        0       0    69    100      3260
  2020-09-27T23:20:21+00:00    193s      6     0     51       135 (     0)       3 (     0)        0       0    69    100      3260
  2020-09-27T23:05:58+00:00    230s      7     0     51       163 (     0)       4 (     0)        0       0    69     99      3260
  2020-09-27T22:50:51+00:00    223s      7     0     51       159 (     0)       5 (     0)        0       0    70    100      3260
  2020-09-27T22:35:41+00:00    213s      9     0     51       167 (     0)       3 (     0)        0       0    69    100      3260
  2020-09-27T22:20:33+00:00    205s      6     0     51       156 (     0)       3 (     0)        0       0    69     99      3260
  2020-09-27T22:05:45+00:00    218s      7     0     51       192 (     0)       4 (     0)        0       0    69     99      3260
  2020-09-27T21:50:40+00:00    212s      6     0     51       174 (     0)      10 (     0)        0       0    69    101      3260
  2020-09-27T21:35:35+00:00    207s      9     0     51       187 (     0)       6 (     0)        0       0    69    101      3260
  2020-09-27T21:20:27+00:00    199s      6     0     51       145 (     0)       3 (     0)        0       0    69    103      3260
  2020-09-27T21:05:52+00:00    225s      7     0     51       215 (     0)      17 (     0)        0       0    69     99      3260
  2020-09-27T20:50:23+00:00    196s      7     0     51       293 (     0)       5 (     0)        0       0    69     99      3260
  2020-09-27T20:35:36+00:00    208s     10     0     51       179 (     0)       6 (     0)        0       0    72    101      3260
  2020-09-27T20:20:31+00:00    204s      6     0     51       153 (     0)       3 (     0)        0       0    69     99      3260
  2020-09-27T20:05:41+00:00    214s      7     0     51       168 (     0)       4 (     0)        0       0    69     99      3260
  2020-09-27T19:50:21+00:00    194s      6     0     51       162 (     0)       8 (     0)        0       0    69    100      3260
  2020-09-27T19:35:38+00:00    211s      7     0     51       222 (     0)      11 (     0)        0       0    69    100      3260
  2020-09-27T19:20:15+00:00    188s      8     0     51       144 (     0)       3 (     0)        0       0    69    100      3260
  2020-09-27T19:05:59+00:00    232s      7     0     51       210 (     0)       8 (     0)        0       0    69     99      3260
  2020-09-27T18:50:31+00:00    204s      7     0     51       159 (     0)       5 (     0)        0       0    69     97      3260
  2020-09-27T18:35:34+00:00    207s      8     0     51       192 (     0)       4 (     0)        0       0    69    252      3260
  2020-09-27T18:20:21+00:00    195s      6     0     51       198 (     0)       3 (     0)        0       0    69     98      3260
  2020-09-27T18:06:02+00:00    235s      9     0     51       196 (     0)       6 (     0)        0       0    69     99      3260
  2020-09-27T17:50:26+00:00    199s      6     0     51       168 (     0)       3 (     0)        0       0    69    104      3260
  2020-09-27T17:35:44+00:00    218s      7     0     51       194 (     0)       7 (     0)        0       0    69    100      3260
  2020-09-27T17:20:23+00:00    197s      7     0     51       155 (     0)       3 (     0)        0       0    69    100      3260
  2020-09-27T17:05:43+00:00    217s      9     0     51       210 (     0)      15 (     0)        0       0    69     99      3260
  2020-09-27T16:50:25+00:00    199s      6     0     51       169 (     0)       5 (     0)        0       0    69    100      3260
  2020-09-27T16:35:13+00:00    187s      7     0     51       180 (     0)       4 (     0)        0       0    69    100      3260
  2020-09-27T16:20:27+00:00    201s      6     0     51       182 (     0)       9 (     0)        0       0    69    104      3260
  2020-09-27T16:05:52+00:00    226s      7     0     51       200 (     0)       9 (     0)        0       0    69    100      3260
  2020-09-27T15:50:25+00:00    199s      8     0     51       154 (     0)       8 (     0)        0       0    69     97      3260
  2020-09-27T15:35:37+00:00    211s      7     0     51       210 (     0)       3 (     0)        0       0    69    729      3260
  2020-09-27T15:20:15+00:00    189s      6     0     51       212 (     0)       8 (     0)        0       0    69     99      3260
  2020-09-27T15:05:40+00:00    215s      7     0     51       192 (     0)       5 (     0)        0       0    69     99      3260
  2020-09-27T14:50:24+00:00    198s      6     0     51       166 (     0)       4 (     0)        0       0    69     99      3260
  2020-09-27T14:35:55+00:00    229s     11     0     51       243 (     0)      14 (     0)        0       0    69    106      3260
  2020-09-27T14:20:28+00:00    203s      6     0     51       203 (     0)       5 (     0)        0       0    70     99      3260
  2020-09-27T14:05:40+00:00    214s      7     0     51       216 (     0)      12 (     0)        0       0    69     99      3260
  2020-09-27T13:50:24+00:00    199s      6     0     51       172 (     0)       4 (     0)        0       0    69    100      3260
  2020-09-27T13:35:25+00:00    200s      9     0     51       194 (     0)      12 (     0)        0       0    69     99      3260
  2020-09-27T13:20:04+00:00    179s      6     0     51       201 (     0)      15 (     0)        0       0    69     99      3260
  2020-09-27T13:05:32+00:00    207s      7     0     51       275 (     0)      19 (     0)        0       0    69     98      3260
  2020-09-27T12:50:33+00:00    208s      6     0     51       193 (     0)      11 (     0)        0       0    84     99      3260
  2020-09-27T12:35:30+00:00    205s      9     0     51       219 (     0)       8 (     0)        0       0    70    105      3260
  2020-09-27T12:20:19+00:00    194s      6     0     51       186 (     0)      12 (     0)        0       0    69     99      3260
  2020-09-27T12:05:48+00:00    223s      7     0     51       189 (     0)       4 (     0)        0       0    69     99      3260
  2020-09-27T11:50:23+00:00    198s      6     0     51       168 (     0)       3 (     0)        0       0    69     99      3260
  2020-09-27T11:35:31+00:00    207s      9     0     51       208 (     0)      20 (     0)        0       0    71     98      3260
  2020-09-27T11:20:13+00:00    188s      6     0     51       178 (     0)      16 (     0)        0       0    69     98      3260
  2020-09-27T11:06:05+00:00    241s      7     0     51       215 (     0)      14 (     0)        0       0    69     99      3260
  2020-09-27T10:50:18+00:00    193s      6     0     51       261 (     0)      21 (     0)        0       0    69     99      3260
  2020-09-27T10:35:24+00:00    199s      8     0     51       243 (     0)       3 (     0)        0       0    70     99      3260
  2020-09-27T10:20:29+00:00    205s      8     0     51       203 (     0)       7 (     0)        0       0    69    100      3260
  2020-09-27T10:05:41+00:00    217s      7     0     51       224 (     0)       7 (     0)        0       0    69     99      3260
  2020-09-27T09:50:24+00:00    200s      6     0     51       202 (     0)       6 (     0)        0       0    69     99      3260
  2020-09-27T09:35:33+00:00    209s      7     0     51       312 (     0)      29 (     0)        0       0    69     98      3260
  2020-09-27T09:20:23+00:00    199s      6     0     51       196 (     0)       9 (     0)        0       0    69     99      3260
  2020-09-27T09:05:38+00:00    214s      9     0     51       253 (     0)      15 (     0)        0       0    71     99      3260
  2020-09-27T08:50:17+00:00    193s      6     0     51       186 (     0)       9 (     0)        0       0    69     99      3260
  2020-09-27T08:35:29+00:00    205s      8     0     50       236 (     0)       8 (     0)        0       0    69     99      3260
  2020-09-27T08:20:16+00:00    193s      6     0     51       205 (     0)       7 (     0)        0       0    69     99      3260
  2020-09-27T08:05:47+00:00    223s      9     0     51       256 (     0)      22 (     0)        0       0    69    101      3260
  2020-09-27T07:50:27+00:00    204s      5     0     51       207 (     0)      18 (     0)        0       0    69     99      3260
  2020-09-27T07:38:32+00:00    389s     10     0     51       230 (     0)      12 (     0)        0       0    69     99      3260
  2020-09-27T07:20:11+00:00    188s      5     0     51       176 (     0)       7 (     0)        0       0    70    179      3260
  2020-09-27T07:06:56+00:00    293s     25     0     51       263 (     0)      14 (     0)        0       0    69     78      3260
  2020-09-27T06:50:13+00:00    190s      9     0     51       222 (     0)       8 (     0)        0       0    69     99      3260
  2020-09-27T06:35:24+00:00    201s      8     0     51       195 (     0)       5 (     0)        0       0    69     99      3260
  2020-09-27T06:20:19+00:00    196s      6     0     51       280 (     0)      12 (     0)        0       0    69     98      3260
  2020-09-27T06:05:53+00:00    230s      7     0     51       257 (     0)      20 (     0)        0       0    69     98      3260
  2020-09-27T05:50:31+00:00    208s      8     0     51       160 (     0)       4 (     0)        0       0    69    100      3260
  2020-09-27T05:35:23+00:00    201s      7     0     51       156 (     0)       3 (     0)        0       0    69     99      3260
  2020-09-27T05:20:20+00:00    198s      6     0     51       168 (     0)       8 (     0)        0       0    69     99      3260
  2020-09-27T05:05:32+00:00    210s      7     0     51       182 (     0)       5 (     0)        0       0    69     98      3260
  2020-09-27T04:50:30+00:00    208s      8     0     51       210 (     0)       4 (     0)        0       0    69    271      3260
  2020-09-27T04:35:19+00:00    198s      7     0     51       189 (     0)       3 (     0)        0       0    69     93      3260
  2020-09-27T04:20:22+00:00    200s      6     0     51       230 (     0)       8 (     0)        0       0    69     93      3260
  2020-09-27T04:05:26+00:00    204s      7     0     51       211 (     0)       8 (     0)        0       0    69     98      3260


Major LoadDatasets Times Distribution (since last Daily Report):
    n =       87,  median ~=   211047 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:          86
    <= 10 min:          1
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Major LoadDatasets Times Distribution (since startup):
    n =      568,  median ~=   211449 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:         559
    <= 10 min:          9
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0


Minor LoadDatasets Times Distribution (since last Daily Report):
    n =        4,  median ~=      500 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          1
    <= 200 ms:          0
    <= 500 ms:          1
    <= 1 s:             1
    <= 2 s:             1
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Minor LoadDatasets Times Distribution (since startup):
    n =       20,  median ~=      750 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          3
    <= 200 ms:          1
    <= 500 ms:          2
    <= 1 s:             8
    <= 2 s:             4
    <= 5 s:             0
    <= 10 s:            2
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0


Response Failed Time Distribution (since last major LoadDatasets):
    n =        0

Response Failed Time Distribution (since last Daily Report):
    n =      668,  median ~=       10 ms
    0 ms:             192
    1 ms:              82
    2 ms:               1
    <= 5 ms:           37
    <= 10 ms:          23
    <= 20 ms:          16
    <= 50 ms:          97
    <= 100 ms:         56
    <= 200 ms:         62
    <= 500 ms:         55
    <= 1 s:            17
    <= 2 s:            11
    <= 5 s:            11
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           6
    <= 2 min:           2
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Failed Time Distribution (since startup):
    n =     8785,  median ~=        9 ms
    0 ms:            1252
    1 ms:             689
    2 ms:              50
    <= 5 ms:         1007
    <= 10 ms:        1992
    <= 20 ms:         192
    <= 50 ms:        1570
    <= 100 ms:        438
    <= 200 ms:        670
    <= 500 ms:        470
    <= 1 s:           200
    <= 2 s:           117
    <= 5 s:            57
    <= 10 s:            5
    <= 20 s:            5
    <= 1 min:          37
    <= 2 min:          18
    <= 5 min:          14
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            1
    >  1 hr:            1


Response Succeeded Time Distribution (since last major LoadDatasets):
    n =       12,  median ~=       15 ms
    0 ms:               1
    1 ms:               0
    2 ms:               1
    <= 5 ms:            0
    <= 10 ms:           2
    <= 20 ms:           4
    <= 50 ms:           1
    <= 100 ms:          2
    <= 200 ms:          1
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Succeeded Time Distribution (since last Daily Report):
    n =    16533,  median ~=       15 ms
    0 ms:             584
    1 ms:             295
    2 ms:             414
    <= 5 ms:          700
    <= 10 ms:        3890
    <= 20 ms:        4963
    <= 50 ms:        2536
    <= 100 ms:        730
    <= 200 ms:        903
    <= 500 ms:        792
    <= 1 s:           292
    <= 2 s:           148
    <= 5 s:           240
    <= 10 s:           24
    <= 20 s:           14
    <= 1 min:           7
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            1
    >  1 hr:            0

Response Succeeded Time Distribution (since startup):
    n =   115385,  median ~=       14 ms
    0 ms:            4537
    1 ms:            3925
    2 ms:            5035
    <= 5 ms:        11891
    <= 10 ms:       20653
    <= 20 ms:       27255
    <= 50 ms:       17144
    <= 100 ms:       7186
    <= 200 ms:       7133
    <= 500 ms:       5583
    <= 1 s:          1948
    <= 2 s:          1365
    <= 5 s:          1400
    <= 10 s:          155
    <= 20 s:           86
    <= 1 min:          47
    <= 2 min:           5
    <= 5 min:          15
    <= 10 min:         17
    <= 20 min:          0
    <= 1 hr:            5
    >  1 hr:            0


TaskThread Failed Time Distribution (since last Daily Report):
    n =        0

TaskThread Failed Time Distribution (since startup):
    n =        0

TaskThread Succeeded Time Distribution (since last Daily Report):
    n =        0

TaskThread Succeeded Time Distribution (since startup):
    n =        0


SgtMap topography nFromCache=31 nNotFromCache=140
GSHHS: nCached=100 of 100, nCoarse=1140, nSuccesses=1471, nTossed=232
NationalBoundaries: nCached=100 of 100,  nCoarse=229, nSuccesses=389, nTossed=22
StateBoundaries: nCached=100 of 100,  nCoarse=165, nSuccesses=389, nTossed=1
Rivers: nCached=100 of 100,  nCoarse=219, nSuccesses=389, nTossed=22
bufferedImage isAccelerated=[unknown]

Number of threads: Tomcat-waiting=0, inotify=0, other=69
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)

#1 Thread[AsyncFileHandlerWriter-1867750575,5,main] TIMED_WAITING daemon
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.8/java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:513)
java.base@11.0.8/java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:675)
app//org.apache.juli.AsyncFileHandler$LoggerThread.run(AsyncFileHandler.java:159)

#2 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#3 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#4 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#5 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#6 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#7 Thread[cluster1-nio-worker-4,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#8 Thread[cluster1-nio-worker-5,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#9 Thread[cluster1-nio-worker-6,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#10 Thread[cluster1-nio-worker-7,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#11 Thread[cluster1-reconnection-0,5,main] WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#12 Thread[cluster1-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#13 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#14 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.8/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#15 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#16 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#17 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#18 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#19 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#20 Thread[cluster2-nio-worker-4,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#21 Thread[cluster2-nio-worker-5,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#22 Thread[cluster2-nio-worker-6,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#23 Thread[cluster2-nio-worker-7,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#24 Thread[cluster2-reconnection-0,5,main] WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#25 Thread[cluster2-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#26 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#27 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.8/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#28 Thread[cluster2-worker-864,5,main] TIMED_WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.8/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#29 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#30 Thread[cluster3-nio-worker-0,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#31 Thread[cluster3-nio-worker-1,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#32 Thread[cluster3-nio-worker-2,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#33 Thread[cluster3-nio-worker-3,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#34 Thread[cluster3-nio-worker-4,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#35 Thread[cluster3-nio-worker-5,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#36 Thread[cluster3-nio-worker-6,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#37 Thread[cluster3-nio-worker-7,5,main] RUNNABLE
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#38 Thread[cluster3-reconnection-0,5,main] TIMED_WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#39 Thread[cluster3-reconnection-1,5,main] WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#40 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.8/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#41 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.8/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#42 Thread[Common-Cleaner,8,InnocuousThreadGroup] TIMED_WAITING daemon
java.base@11.0.8/java.lang.Object.wait(Native Method)
java.base@11.0.8/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.8/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)
java.base@11.0.8/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)

#43 Thread[ContainerBackgroundProcessor[StandardEngine[Catalina]],5,main] TIMED_WAITING daemon
java.base@11.0.8/java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1365)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#44 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#45 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.8/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.8/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#46 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.8/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.8/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#47 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.8/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.8/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#48 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.8/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.8/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#49 Thread[Finalizer,8,system] WAITING daemon
java.base@11.0.8/java.lang.Object.wait(Native Method)
java.base@11.0.8/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.8/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.base@11.0.8/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)

#50 Thread[http-nio-8080-Acceptor-0,5,main] RUNNABLE daemon
java.base@11.0.8/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
java.base@11.0.8/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
java.base@11.0.8/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:446)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:70)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:95)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#51 Thread[http-nio-8080-AsyncTimeout,5,main] TIMED_WAITING daemon
java.base@11.0.8/java.lang.Thread.sleep(Native Method)
org.apache.coyote.AbstractProtocol$AsyncTimeout.run(AbstractProtocol.java:1113)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#52 Thread[http-nio-8080-ClientPoller-0,5,main] RUNNABLE daemon
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#53 Thread[http-nio-8080-ClientPoller-1,5,main] RUNNABLE daemon
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#54 Thread[http-nio-8080-exec-2597,5,main] WAITING daemon
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#55 Thread[http-nio-8080-exec-2619,5,main] WAITING daemon
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#56 Thread[http-nio-8080-exec-2623,5,main] WAITING daemon
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#57 Thread[http-nio-8080-exec-2624,5,main] WAITING daemon
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#58 Thread[http-nio-8080-exec-2626,5,main] WAITING daemon
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#59 Thread[http-nio-8080-exec-2628,5,main] RUNNABLE daemon
java.base@11.0.8/java.lang.Thread.dumpThreads(Native Method)
java.base@11.0.8/java.lang.Thread.getAllStackTraces(Thread.java:1658)
com.cohort.util.MustBe.allStackTraces(MustBe.java:353)
gov.noaa.pfel.erddap.Erddap.doStatus(Erddap.java:3178)
gov.noaa.pfel.erddap.Erddap.doGet(Erddap.java:595)
javax.servlet.http.HttpServlet.service(HttpServlet.java:634)
javax.servlet.http.HttpServlet.service(HttpServlet.java:741)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:668)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:770)
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415)
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#60 Thread[http-nio-8080-exec-2630,5,main] WAITING daemon
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#61 Thread[http-nio-8080-exec-2631,5,main] WAITING daemon
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#62 Thread[http-nio-8080-exec-2633,5,main] WAITING daemon
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#63 Thread[http-nio-8080-exec-2640,5,main] WAITING daemon
java.base@11.0.8/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.8/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.8/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.8/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.8/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#64 Thread[Java2D Disposer,10,system] WAITING daemon
java.base@11.0.8/java.lang.Object.wait(Native Method)
java.base@11.0.8/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.8/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.desktop@11.0.8/sun.java2d.Disposer.run(Disposer.java:144)
java.base@11.0.8/java.lang.Thread.run(Thread.java:834)

#65 Thread[main,5,main] RUNNABLE
java.base@11.0.8/java.net.PlainSocketImpl.socketAccept(Native Method)
java.base@11.0.8/java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:458)
java.base@11.0.8/java.net.ServerSocket.implAccept(ServerSocket.java:565)
java.base@11.0.8/java.net.ServerSocket.accept(ServerSocket.java:533)
org.apache.catalina.core.StandardServer.await(StandardServer.java:447)
org.apache.catalina.startup.Catalina.await(Catalina.java:770)
org.apache.catalina.startup.Catalina.start(Catalina.java:716)
java.base@11.0.8/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
java.base@11.0.8/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
java.base@11.0.8/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.base@11.0.8/java.lang.reflect.Method.invoke(Method.java:566)
app//org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:350)
app//org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:492)

#66 Thread[NioBlockingSelector.BlockPoller-1,5,main] RUNNABLE daemon
java.base@11.0.8/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.8/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.8/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.8/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(NioBlockingSelector.java:298)

#67 Thread[Reference Handler,10,system] RUNNABLE daemon
java.base@11.0.8/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
java.base@11.0.8/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
java.base@11.0.8/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)

#68 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.base@11.0.8/java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:282)

#69 Thread[Signal Dispatcher,9,system] RUNNABLE daemon


 
ERDDAP, Version 1.82
Disclaimers | Privacy Policy | Contact