Marine Institute Logo Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland)
   
Brought to you by the Marine Institute(Ireland)    

ERDDAP > Status

Current time is 2021-01-28T01:06:06+00:00
Startup was at  2021-01-15T07:01:28+00:00
Last major LoadDatasets started 9m 1s ago and finished after 360 seconds.
nGridDatasets  = 9
nTableDatasets = 44
nTotalDatasets = 53
n Datasets Failed To Load (in the last major LoadDatasets) = 0
Response Failed    Time (since last major LoadDatasets) n =        5,  median ~=        0 ms
Response Failed    Time (since last Daily Report)       n =     1222,  median ~=       20 ms
Response Failed    Time (since startup)                 n =    37850,  median ~=        0 ms
Response Succeeded Time (since last major LoadDatasets) n =       25,  median ~=        4 ms
Response Succeeded Time (since last Daily Report)       n =    19133,  median ~=       84 ms
Response Succeeded Time (since startup)                 n =   272330,  median ~=       19 ms
TaskThread has finished 0 out of 0 tasks.  Currently, no task is running.
TaskThread Failed    Time (since last Daily Report)     n =        0
TaskThread Failed    Time (since startup)               n =        0
TaskThread Succeeded Time (since last Daily Report)     n =        0
TaskThread Succeeded Time (since startup)               n =        0
Number of threads: Tomcat-waiting=0, inotify=0, other=67
MemoryInUse=   949 MB (highWaterMark=  1981 MB) (Xmx ~= 5888 MB)

Major LoadDatasets Time Series: MLD    Datasets Loaded    Requests (medianTime in seconds)     Number of Threads      Memory (MB)
  timestamp                    time   nTry nFail nTotal  nSuccess (median) nFailed (median)  tomWait inotify other  inUse highWater
  2021-01-28T01:03:02+00:00    357s      7     0     53        66 (     0)       3 (     0)        0       0    68     97      1981
  2021-01-28T00:47:14+00:00    309s      7     0     53        31 (     0)       3 (     0)        0       0    68     98      1981
  2021-01-28T00:34:24+00:00    439s      6     0     53        96 (     0)      16 (     0)        0       0    68     94      1981
  2021-01-28T00:17:32+00:00    328s      7     0     53        62 (     0)       7 (     0)        0       0    68     98      1981
  2021-01-28T00:03:07+00:00    362s      6     0     53       103 (     0)      17 (     0)        0       0    68     96      1981
  2021-01-27T23:49:52+00:00    467s      6     0     53        85 (     0)      13 (     0)        0       0    68    130      1981
  2021-01-27T23:35:26+00:00    502s      8     0     53       344 (     0)      15 (     0)        0       0    68    144      1981
  2021-01-27T23:17:24+00:00    319s      7     0     53        70 (     0)      14 (     0)        0       0    68     99      1981
  2021-01-27T23:02:23+00:00    318s      7     0     53        92 (     0)      16 (     0)        0       0    68     95      1981
  2021-01-27T22:47:29+00:00    325s      6     0     53        68 (     0)       9 (     0)        0       0    68     99      1981
  2021-01-27T22:32:35+00:00    330s      8     0     53       108 (     0)      12 (     0)        0       0    68     97      1981
  2021-01-27T22:17:25+00:00    321s      8     0     53        95 (     0)      17 (     0)        0       0    68     97      1981
  2021-01-27T22:03:08+00:00    364s      7     0     53        62 (     0)       7 (     0)        0       0    68     98      1981
  2021-01-27T21:47:19+00:00    314s      6     0     53       161 (     0)      15 (     0)        0       0    68     97      1981
  2021-01-27T21:32:41+00:00    337s      6     0     53       305 (     0)      71 (     0)        0       0    68     96      1981
  2021-01-27T21:17:32+00:00    327s      8     0     53        71 (     0)       8 (     0)        0       0    68     99      1981
  2021-01-27T21:03:57+00:00    413s      7     0     53        92 (     0)       9 (     0)        0       0    68    102      1981
  2021-01-27T20:47:13+00:00    308s      6     0     53       150 (     0)      23 (     0)        0       0    68     99      1981
  2021-01-27T20:32:42+00:00    338s      7     0     53       115 (     0)      21 (     0)        0       0    68     98      1981
  2021-01-27T20:17:27+00:00    323s      9     0     53        46 (     0)       5 (     0)        0       0    68     99      1981
  2021-01-27T20:02:57+00:00    353s      7     0     53        80 (     0)       5 (     0)        0       0    68     98      1981
  2021-01-27T19:47:31+00:00    327s      6     0     53       132 (     0)      17 (     0)        0       0    68     98      1981
  2021-01-27T19:32:28+00:00    324s      6     0     53       207 (     0)       9 (     0)        0       0    68     98      1981
  2021-01-27T19:17:44+00:00    340s      7     0     53        82 (     0)      19 (     0)        0       0    68     99      1981
  2021-01-27T19:03:14+00:00    371s     12     0     53       144 (     0)      25 (     0)        0       0    68     98      1981
  2021-01-27T18:47:36+00:00    333s      6     0     53        45 (     0)      12 (     0)        0       0    68     99      1981
  2021-01-27T18:32:36+00:00    332s      6     0     53       119 (     0)       6 (     0)        0       0    68     97      1981
  2021-01-27T18:17:30+00:00    326s      7     0     53       138 (     0)      13 (     0)        0       0    68     96      1981
  2021-01-27T18:03:10+00:00    367s     10     0     53       205 (     0)      22 (     0)        0       0    68     95      1981
  2021-01-27T17:47:46+00:00    342s      6     0     53       148 (     0)      31 (     0)        0       0    69     98      1981
  2021-01-27T17:32:23+00:00    320s      6     0     53        50 (     0)       5 (     0)        0       0    68     98      1981
  2021-01-27T17:17:43+00:00    339s      7     0     53        76 (     0)       6 (     0)        0       0    69     99      1981
  2021-01-27T17:02:57+00:00    353s      9     0     53       123 (     0)       7 (     0)        0       0    68     98      1981
  2021-01-27T16:47:14+00:00    311s      6     0     53       106 (     0)       5 (     0)        0       0    69     96      1981
  2021-01-27T16:32:04+00:00    301s      6     0     53       180 (     0)      18 (     0)        0       0    68     87      1981
  2021-01-27T16:17:53+00:00    350s      7     0     53       228 (     0)      27 (     0)        0       0    68    141      1981
  2021-01-27T16:02:46+00:00    343s     10     0     53       170 (     0)      19 (     0)        0       0    68    102      1981
  2021-01-27T15:47:38+00:00    335s      6     0     53       147 (     0)      15 (     0)        0       0    68     98      1981
  2021-01-27T15:32:37+00:00    334s      6     0     53       170 (     0)      17 (     0)        0       0    68     96      1981
  2021-01-27T15:18:31+00:00    388s      8     0     53       109 (     0)      17 (     0)        0       0    68    130      1981
  2021-01-27T15:02:28+00:00    326s      7     0     53        76 (     0)      12 (     0)        0       0    68     97      1981
  2021-01-27T14:47:38+00:00    335s      8     0     53       145 (     0)      17 (     0)        0       0    68     96      1981
  2021-01-27T14:32:22+00:00    319s      7     0     53       138 (     0)      23 (     0)        0       0    68     97      1981
  2021-01-27T14:17:41+00:00    338s      7     0     53        99 (     0)      24 (     0)        0       0    68     99      1981
  2021-01-27T14:03:02+00:00    360s      9     0     53        58 (     0)      10 (     0)        0       0    69     98      1981
  2021-01-27T13:47:38+00:00    336s      6     0     53       179 (     0)      29 (     0)        0       0    68     98      1981
  2021-01-27T13:32:32+00:00    330s      8     0     53       112 (     0)      20 (     0)        0       0    68     97      1981
  2021-01-27T13:17:28+00:00    326s      6     0     53        99 (     0)      18 (     0)        0       0    68     98      1981
  2021-01-27T13:02:48+00:00    346s      8     0     53       178 (     0)      33 (     0)        0       0    75     97      1981
  2021-01-27T12:47:46+00:00    344s      6     0     53       188 (     0)      17 (     0)        0       0    69     99      1981
  2021-01-27T12:32:09+00:00    307s      8     0     53       134 (     0)      27 (     0)        0       0    68    192      1981
  2021-01-27T12:17:14+00:00    312s      6     0     53        76 (     0)      13 (     0)        0       0    68     98      1981
  2021-01-27T12:03:54+00:00    412s      7     0     53       264 (     0)      28 (     0)        0       0    68     97      1981
  2021-01-27T11:47:30+00:00    328s      7     0     53       171 (     0)      19 (     0)        0       0    85     98      1981
  2021-01-27T11:32:29+00:00    327s      6     0     53       531 (     0)      16 (     0)        0       0    71     96      1981
  2021-01-27T11:17:28+00:00    326s      8     0     53       331 (     0)      16 (     0)        0       0    82     96      1981
  2021-01-27T11:02:49+00:00    347s      7     0     53       358 (     0)      12 (     0)        0       0    83     95      1981
  2021-01-27T10:47:22+00:00    320s      7     0     53       498 (     0)      15 (     0)        0       0    75     93      1981
  2021-01-27T10:32:22+00:00    320s      6     0     53       202 (     0)      23 (     0)        0       0    70     82      1981
  2021-01-27T10:17:28+00:00    326s      6     0     53       104 (     0)      13 (     0)        0       0    68     86      1981
  2021-01-27T10:03:06+00:00    365s     10     0     53       171 (     0)      18 (     0)        0       0    68     84      1981
  2021-01-27T09:47:05+00:00    304s      7     0     53       926 (     0)      39 (     0)        0       0    68     82      1981
  2021-01-27T09:32:40+00:00    339s      6     0     53      5289 (     0)      23 (     0)        0       0    85     82      1981
  2021-01-27T09:17:37+00:00    336s      6     0     53      2931 (     0)      11 (     0)        0       0    69    732      1981
  2021-01-27T09:03:20+00:00    379s      7     0     53       144 (     0)      26 (     0)        0       0    68     84      1981
  2021-01-27T08:47:20+00:00    318s      8     0     53        68 (     0)       6 (     0)        0       0    68     86      1981
  2021-01-27T08:37:15+00:00    614s     26     0     53       176 (     0)      23 (     0)        0       0    68     86      1981
  2021-01-27T08:17:51+00:00    349s      7     0     53       121 (     0)      32 (     0)        0       0    68     86      1981
  2021-01-27T08:02:58+00:00    357s      7     0     53       122 (     0)      14 (     0)        0       0    68     85      1981
  2021-01-27T07:46:48+00:00    288s      6     0     53        95 (     0)      17 (     0)        0       0    68     84      1981
  2021-01-27T07:33:20+00:00    380s      8     0     53       156 (     0)      17 (     0)        0       0    68    136      1981
  2021-01-27T07:17:21+00:00    320s      6     0     53        87 (     0)      12 (     0)        0       0    68     85      1981
  2021-01-27T07:02:32+00:00    333s      7     0     53        99 (     0)      35 (     0)        0       0    68     85      1981
  2021-01-27T06:47:07+00:00    308s      9     0     53        80 (     0)       6 (     0)        0       0    68     86      1981
  2021-01-27T06:32:33+00:00    334s      8     0     53        93 (     0)      15 (     0)        0       0    68     84      1981
  2021-01-27T06:17:55+00:00    356s      6     0     53       125 (     0)      12 (     0)        0       0    68     80      1981
  2021-01-27T06:02:59+00:00    361s      7     0     53       219 (     0)      23 (     0)        0       0    71     80      1981
  2021-01-27T05:47:24+00:00    325s      8     0     53        92 (     0)       4 (     0)        0       0    70    164      1981
  2021-01-27T05:32:26+00:00    327s      8     0     53        93 (     0)       9 (     0)        0       0    68     80      1981
  2021-01-27T05:17:04+00:00    305s      5     0     53       170 (     0)      11 (     0)        0       0    68     81      1981
  2021-01-27T05:03:05+00:00    367s      7     0     53        83 (     0)      20 (     0)        0       0    69     84      1981
  2021-01-27T04:47:20+00:00    322s      6     0     53        68 (     0)      15 (     0)        0       0    68     86      1981
  2021-01-27T04:32:33+00:00    334s      7     0     53        70 (     0)      12 (     0)        0       0    68     83      1981
  2021-01-27T04:17:25+00:00    327s      8     0     53        46 (     0)      11 (     0)        0       0    68     86      1981
  2021-01-27T04:02:40+00:00    342s      8     0     53        57 (     0)       6 (     0)        0       0    68     85      1981
  2021-01-27T03:47:16+00:00    318s      6     0     53        53 (     0)       4 (     0)        0       0    68     86      1981
  2021-01-27T03:32:20+00:00    322s      7     0     53        42 (     0)       4 (     0)        0       0    68     82      1981
  2021-01-27T03:17:23+00:00    325s      6     0     53        51 (     0)       5 (     0)        0       0    68     86      1981
  2021-01-27T03:03:13+00:00    375s     10     0     53        68 (     0)       6 (     0)        0       0    69     85      1981
  2021-01-27T02:47:09+00:00    311s      6     0     53        59 (     0)       7 (     0)        0       0    68     84      1981
  2021-01-27T02:32:19+00:00    321s      7     0     53        48 (     0)       8 (     0)        0       0    68    163      1981
  2021-01-27T02:17:05+00:00    307s      7     0     53        69 (     0)      10 (     0)        0       0    76     85      1981
  2021-01-27T02:02:54+00:00    357s      8     0     53        94 (     0)      11 (     0)        0       0    69     86      1981
  2021-01-27T01:47:13+00:00    316s      9     0     53        52 (     0)       3 (     0)        0       0    68     86      1981
  2021-01-27T01:32:12+00:00    314s     10     0     53        61 (     0)       4 (     0)        0       0    68     75      1981
  2021-01-27T01:17:21+00:00    323s      6     0     53        45 (     0)       4 (     0)        0       0    68     86      1981
  2021-01-27T01:02:25+00:00    328s      7     0     53        77 (     0)      51 (     0)        0       0    69     84      1981
  2021-01-27T00:47:04+00:00    307s      6     0     53        41 (     0)       6 (     0)        0       0    68     86      1981
  2021-01-27T00:32:25+00:00    328s      9     0     53        66 (     0)      47 (     0)        0       0    69     85      1981
  2021-01-27T00:17:22+00:00    325s      6     0     53        87 (     0)      53 (     0)        0       0    68     86      1981


Major LoadDatasets Times Distribution (since last Daily Report):
    n =       72,  median ~=   450000 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           1
    <= 10 min:         70
    <= 20 min:          1
    <= 1 hr:            0
    >  1 hr:            0

Major LoadDatasets Times Distribution (since startup):
    n =     1224,  median ~=   286405 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:         662
    <= 10 min:        559
    <= 20 min:          3
    <= 1 hr:            0
    >  1 hr:            0


Minor LoadDatasets Times Distribution (since last Daily Report):
    n =        2,  median ~=      350 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          2
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Minor LoadDatasets Times Distribution (since startup):
    n =       34,  median ~=      243 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          5
    <= 200 ms:         11
    <= 500 ms:          7
    <= 1 s:             3
    <= 2 s:             6
    <= 5 s:             2
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0


Response Failed Time Distribution (since last major LoadDatasets):
    n =        5,  median ~=        0 ms
    0 ms:               5
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Failed Time Distribution (since last Daily Report):
    n =     1222,  median ~=       20 ms
    0 ms:             356
    1 ms:             152
    2 ms:               4
    <= 5 ms:           55
    <= 10 ms:          24
    <= 20 ms:          18
    <= 50 ms:         276
    <= 100 ms:        142
    <= 200 ms:         76
    <= 500 ms:         62
    <= 1 s:            21
    <= 2 s:            15
    <= 5 s:            13
    <= 10 s:            1
    <= 20 s:            1
    <= 1 min:           2
    <= 2 min:           3
    <= 5 min:           1
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Failed Time Distribution (since startup):
    n =    37850,  median ~=        0 ms
    0 ms:           17348
    1 ms:           11315
    2 ms:             332
    <= 5 ms:          655
    <= 10 ms:         385
    <= 20 ms:         311
    <= 50 ms:        2931
    <= 100 ms:       2057
    <= 200 ms:        859
    <= 500 ms:        577
    <= 1 s:           273
    <= 2 s:           358
    <= 5 s:           237
    <= 10 s:           17
    <= 20 s:           30
    <= 1 min:          80
    <= 2 min:          55
    <= 5 min:          26
    <= 10 min:          3
    <= 20 min:          0
    <= 1 hr:            1
    >  1 hr:            0


Response Succeeded Time Distribution (since last major LoadDatasets):
    n =       25,  median ~=        4 ms
    0 ms:               4
    1 ms:               2
    2 ms:               2
    <= 5 ms:            7
    <= 10 ms:           1
    <= 20 ms:           0
    <= 50 ms:           3
    <= 100 ms:          2
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             2
    <= 5 s:             1
    <= 10 s:            1
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Succeeded Time Distribution (since last Daily Report):
    n =    19133,  median ~=       84 ms
    0 ms:            1659
    1 ms:             441
    2 ms:             401
    <= 5 ms:          643
    <= 10 ms:         423
    <= 20 ms:         986
    <= 50 ms:        2269
    <= 100 ms:       4056
    <= 200 ms:       3787
    <= 500 ms:       3191
    <= 1 s:           308
    <= 2 s:           259
    <= 5 s:           598
    <= 10 s:           37
    <= 20 s:           41
    <= 1 min:          26
    <= 2 min:           0
    <= 5 min:           3
    <= 10 min:          5
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Succeeded Time Distribution (since startup):
    n =   272330,  median ~=       19 ms
    0 ms:           12993
    1 ms:           10147
    2 ms:           19085
    <= 5 ms:        42090
    <= 10 ms:        8408
    <= 20 ms:       49638
    <= 50 ms:       28356
    <= 100 ms:      35664
    <= 200 ms:      24529
    <= 500 ms:      24169
    <= 1 s:          3959
    <= 2 s:          3544
    <= 5 s:          8051
    <= 10 s:          653
    <= 20 s:          581
    <= 1 min:         407
    <= 2 min:          24
    <= 5 min:          18
    <= 10 min:         14
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0


TaskThread Failed Time Distribution (since last Daily Report):
    n =        0

TaskThread Failed Time Distribution (since startup):
    n =        0

TaskThread Succeeded Time Distribution (since last Daily Report):
    n =        0

TaskThread Succeeded Time Distribution (since startup):
    n =        0


SgtMap topography nFromCache=23 nNotFromCache=332
GSHHS: nCached=100 of 100, nCoarse=1668, nSuccesses=1556, nTossed=856
NationalBoundaries: nCached=100 of 100,  nCoarse=250, nSuccesses=388, nTossed=87
StateBoundaries: nCached=100 of 100,  nCoarse=201, nSuccesses=388, nTossed=77
Rivers: nCached=100 of 100,  nCoarse=249, nSuccesses=387, nTossed=88
bufferedImage isAccelerated=[unknown]

Number of threads: Tomcat-waiting=0, inotify=0, other=67
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)

#1 Thread[AsyncFileHandlerWriter-2046562095,5,main] TIMED_WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:513)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:675)
app//org.apache.juli.AsyncFileHandler$LoggerThread.run(AsyncFileHandler.java:159)

#2 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#3 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#4 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#5 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#6 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#7 Thread[cluster1-nio-worker-4,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#8 Thread[cluster1-nio-worker-5,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#9 Thread[cluster1-nio-worker-6,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#10 Thread[cluster1-nio-worker-7,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#11 Thread[cluster1-reconnection-0,5,main] WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#12 Thread[cluster1-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#13 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#14 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#15 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#16 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#17 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#18 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#19 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#20 Thread[cluster2-nio-worker-4,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#21 Thread[cluster2-nio-worker-5,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#22 Thread[cluster2-nio-worker-6,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#23 Thread[cluster2-nio-worker-7,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#24 Thread[cluster2-reconnection-0,5,main] WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#25 Thread[cluster2-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#26 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#27 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#28 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#29 Thread[cluster3-nio-worker-0,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#30 Thread[cluster3-nio-worker-1,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#31 Thread[cluster3-nio-worker-2,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#32 Thread[cluster3-nio-worker-3,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#33 Thread[cluster3-nio-worker-4,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#34 Thread[cluster3-nio-worker-5,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#35 Thread[cluster3-nio-worker-6,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#36 Thread[cluster3-nio-worker-7,5,main] RUNNABLE
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#37 Thread[cluster3-reconnection-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#38 Thread[cluster3-reconnection-1,5,main] WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#39 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.9.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#40 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#41 Thread[Common-Cleaner,8,InnocuousThreadGroup] TIMED_WAITING daemon
java.base@11.0.9.1/java.lang.Object.wait(Native Method)
java.base@11.0.9.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.9.1/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)
java.base@11.0.9.1/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)

#42 Thread[ContainerBackgroundProcessor[StandardEngine[Catalina]],5,main] TIMED_WAITING daemon
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1365)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#43 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#44 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#45 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#46 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.9.1/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#47 Thread[Finalizer,8,system] WAITING daemon
java.base@11.0.9.1/java.lang.Object.wait(Native Method)
java.base@11.0.9.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.9.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.base@11.0.9.1/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)

#48 Thread[http-nio-8080-Acceptor-0,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
java.base@11.0.9.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
java.base@11.0.9.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:446)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:70)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:95)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#49 Thread[http-nio-8080-AsyncTimeout,5,main] TIMED_WAITING daemon
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
org.apache.coyote.AbstractProtocol$AsyncTimeout.run(AbstractProtocol.java:1113)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#50 Thread[http-nio-8080-ClientPoller-0,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#51 Thread[http-nio-8080-ClientPoller-1,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#52 Thread[http-nio-8080-exec-10593,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#53 Thread[http-nio-8080-exec-10643,5,main] RUNNABLE daemon
java.base@11.0.9.1/java.lang.Thread.dumpThreads(Native Method)
java.base@11.0.9.1/java.lang.Thread.getAllStackTraces(Thread.java:1658)
com.cohort.util.MustBe.allStackTraces(MustBe.java:353)
gov.noaa.pfel.erddap.Erddap.doStatus(Erddap.java:3178)
gov.noaa.pfel.erddap.Erddap.doGet(Erddap.java:595)
javax.servlet.http.HttpServlet.service(HttpServlet.java:634)
javax.servlet.http.HttpServlet.service(HttpServlet.java:741)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:668)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:770)
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415)
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#54 Thread[http-nio-8080-exec-10650,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#55 Thread[http-nio-8080-exec-10651,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#56 Thread[http-nio-8080-exec-10664,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#57 Thread[http-nio-8080-exec-10666,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#58 Thread[http-nio-8080-exec-10667,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#59 Thread[http-nio-8080-exec-10668,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#60 Thread[http-nio-8080-exec-10673,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#61 Thread[http-nio-8080-exec-10674,5,main] WAITING daemon
java.base@11.0.9.1/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.9.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.9.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.9.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.9.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#62 Thread[Java2D Disposer,10,system] WAITING daemon
java.base@11.0.9.1/java.lang.Object.wait(Native Method)
java.base@11.0.9.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.9.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.desktop@11.0.9.1/sun.java2d.Disposer.run(Disposer.java:144)
java.base@11.0.9.1/java.lang.Thread.run(Thread.java:834)

#63 Thread[main,5,main] RUNNABLE
java.base@11.0.9.1/java.net.PlainSocketImpl.socketAccept(Native Method)
java.base@11.0.9.1/java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:458)
java.base@11.0.9.1/java.net.ServerSocket.implAccept(ServerSocket.java:565)
java.base@11.0.9.1/java.net.ServerSocket.accept(ServerSocket.java:533)
org.apache.catalina.core.StandardServer.await(StandardServer.java:447)
org.apache.catalina.startup.Catalina.await(Catalina.java:770)
org.apache.catalina.startup.Catalina.start(Catalina.java:716)
java.base@11.0.9.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
java.base@11.0.9.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
java.base@11.0.9.1/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.base@11.0.9.1/java.lang.reflect.Method.invoke(Method.java:566)
app//org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:350)
app//org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:492)

#64 Thread[NioBlockingSelector.BlockPoller-1,5,main] RUNNABLE daemon
java.base@11.0.9.1/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.9.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.9.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(NioBlockingSelector.java:298)

#65 Thread[Reference Handler,10,system] RUNNABLE daemon
java.base@11.0.9.1/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
java.base@11.0.9.1/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
java.base@11.0.9.1/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)

#66 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.base@11.0.9.1/java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:282)

#67 Thread[Signal Dispatcher,9,system] RUNNABLE daemon


 
ERDDAP, Version 1.82
Disclaimers | Privacy Policy | Contact