Marine Institute Logo Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland)
   
Brought to you by the Marine Institute(Ireland)    

ERDDAP > Status

Current time is 2024-02-25T04:09:33+00:00
Startup was at  2024-02-22T11:07:11+00:00
Last major LoadDatasets started 3m 44s ago and finished after 155 seconds.
nGridDatasets  = 10
nTableDatasets = 62
nTotalDatasets = 72
n Datasets Failed To Load (in the last major LoadDatasets) = 3
    ireland_marine_research_database_charts, imifeeaghco2, spiddal_obs_adcp, (end)
Unique users (since startup)                            n = 1297
Response Failed    Time (since last major LoadDatasets) n =        0
Response Failed    Time (since last Daily Report)       n =     1903,  median ~=     2348 ms
Response Failed    Time (since startup)                 n =     7055,  median ~=     2235 ms
Response Succeeded Time (since last major LoadDatasets) n =       17,  median ~=     2450 ms
Response Succeeded Time (since last Daily Report)       n =    15410,  median ~=       46 ms
Response Succeeded Time (since startup)                 n =    46888,  median ~=       49 ms
TaskThread has finished 0 out of 0 tasks.  Currently, no task is running.
TaskThread Failed    Time (since last Daily Report)     n =        0
TaskThread Failed    Time (since startup)               n =        0
TaskThread Succeeded Time (since last Daily Report)     n =        0
TaskThread Succeeded Time (since startup)               n =        0
Number of threads: Tomcat-waiting=19, inotify=4, other=48
MemoryInUse=   783 MB (highWaterMark=  2060 MB) (Xmx ~= 5888 MB)

Major LoadDatasets Time Series: MLD    Datasets Loaded            Requests (median times in ms)              Number of Threads      MB    Open
  timestamp                    time   nTry nFail nTotal  nSuccess (median) nFail (median) memFail tooMany  tomWait inotify other  inUse  Files
----------------------------  -----   -----------------  ------------------------------------------------  ---------------------  -----  -----
  2024-02-25T04:08:20+00:00    151s     10     3     72       158 (    41)     3 (    28)       0       0       20       4    49    101     0%
  2024-02-25T03:53:16+00:00    147s      9     3     72       137 (    57)     4 (    35)       0       0       20       4    49    103     0%
  2024-02-25T03:38:17+00:00    148s     10     3     72       215 (    39)     5 (    35)       0       0       20       4    49    100     0%
  2024-02-25T03:23:32+00:00    163s     11     3     72       127 (    45)     5 (    31)       0       0       20       4    50    104     0%
  2024-02-25T03:08:19+00:00    150s     10     3     72       143 (    57)     4 (    30)       0       0       20       4    49    100     0%
  2024-02-25T02:53:21+00:00    152s      9     3     72       135 (    48)    42 (   200)       0       0       20       4    49    103     0%
  2024-02-25T02:38:20+00:00    152s     10     3     72       293 (    41)    16 (   800)       0       0       20       4    49    102     0%
  2024-02-25T02:23:29+00:00    160s     13     3     72       142 (    44)     5 (    31)       0       0       20       4    50    103     0%
  2024-02-25T02:08:18+00:00    149s     11     3     72       149 (    41)     5 (    25)       0       0       20       4    50    103     0%
  2024-02-25T01:53:19+00:00    151s     11     4     71       144 (    66)    14 (    44)       0       0       20       4    49    106     0%
  2024-02-25T01:38:22+00:00    153s     12     4     71       200 (    39)     7 (    41)       0       0       20       4    49    103     0%
  2024-02-25T01:23:23+00:00    155s     11     4     71       187 (   145)    68 (   659)       2       0       20       4    49    106     0%
  2024-02-25T01:08:30+00:00    162s     13     4     71       128 (    61)    19 (  2964)       0       0       20       4    50    110     0%
  2024-02-25T00:53:18+00:00    150s     10     4     71       157 (    78)    54 (     1)       0       0       14       4    55    193     0%
  2024-02-25T00:38:21+00:00    153s     11     4     71       229 (    40)    23 (  7500)       0       0       43       4    51    108     0%
  2024-02-25T00:23:17+00:00    149s     11     4     71       113 (    47)     9 (    33)       0       0       20       4    49    110     0%
  2024-02-25T00:08:20+00:00    152s     11     4     71       289 (   470)    77 (  3403)       0       0       19       4    50    364     0%
  2024-02-24T23:53:30+00:00    163s     12     4     71       135 (    70)    11 (   350)       0       0       27       4    50    111     0%
  2024-02-24T23:38:15+00:00    147s     10     4     71       205 (    39)     7 (    41)       0       0       20       4    49    111     0%
  2024-02-24T23:23:18+00:00    150s     12     4     71       149 (    64)    20 (  4000)       0       0       22       4    49    110     0%
  2024-02-24T23:08:22+00:00    155s     11     4     71       117 (    58)     3 (    35)       0       0       20       4    49    108     0%
  2024-02-24T22:53:29+00:00    162s     12     4     71       166 (    76)    25 (  4700)       0       0       20       4    50    109     0%
  2024-02-24T22:38:19+00:00    152s     10     4     71       213 (    40)     5 (    39)       0       0       20       4    49    108     0%
  2024-02-24T22:23:13+00:00    146s     10     4     71       118 (    57)    41 (194571)       0       9       20       4    49    110     0%
  2024-02-24T22:08:20+00:00    153s     12     4     71       206 (   100)    61 (  3212)       0     273       96       4   103    117     0%
  2024-02-24T21:53:27+00:00    161s     12     4     71       128 (    57)     4 (    35)       0       0       20       4    50    106     0%
  2024-02-24T21:38:14+00:00    147s     10     4     71       259 (    33)     4 (    35)       0       0       20       4    49    103     0%
  2024-02-24T21:23:19+00:00    152s     10     4     71       182 (    79)     5 (    31)       0       0       26       4    49    103     0%
  2024-02-24T21:08:18+00:00    151s     14     4     71       119 (    58)     4 (    40)       0       0       20       4    49    103     0%
  2024-02-24T20:53:17+00:00    151s     10     4     71       296 (    95)    69 (  3430)       0       0       20       4    49    103     0%
  2024-02-24T20:38:26+00:00    160s     11     3     72       254 (    38)    48 (   406)       0       0       15       4    55    102     0%
  2024-02-24T20:23:13+00:00    147s     10     3     72       174 (    82)    38 ( 35652)       0      62       25       4    49    103     0%
  2024-02-24T20:08:19+00:00    153s     11     3     72       135 (    49)     4 (    40)       0       0       20       4    49     97     0%
  2024-02-24T19:53:18+00:00    152s      9     3     72       150 (    56)    21 (  2577)       0       0       20       4    49     96     0%
  2024-02-24T19:38:25+00:00    159s     11     3     72       236 (    45)    37 (  3500)       0       0       20       4    50    101     0%
  2024-02-24T19:23:15+00:00    149s      9     3     72       180 (    45)     6 (    28)       0       0       20       4    49     98     0%
  2024-02-24T19:08:20+00:00    155s     11     3     72       228 (    43)     2 (    35)       0       0       20       4    49     97     0%
  2024-02-24T18:53:13+00:00    148s      9     3     72       130 (    55)     4 (    50)       0       0       20       4    49    101     0%
  2024-02-24T18:38:24+00:00    158s     11     3     72       223 (    41)     5 (    35)       0       0       20       4    50    100     0%
  2024-02-24T18:23:18+00:00    152s      9     3     72       122 (    48)     5 (    35)       0       0       20       4    49     98     0%
  2024-02-24T18:08:20+00:00    154s     11     3     72       204 (    56)     7 (    45)       0       0       24       4    49     97     0%
  2024-02-24T17:53:12+00:00    147s     10     3     72       280 (   342)    54 (  3200)       0       0       20       4    49    103     0%
  2024-02-24T17:38:15+00:00    150s      9     3     72       232 (    41)    43 (  2611)       0       0       20       4    49     97     0%
  2024-02-24T17:23:30+00:00    165s     11     3     72       328 (   456)     6 (    35)       0       0       20       4    50    101     0%
  2024-02-24T17:08:19+00:00    154s     11     3     72       135 (    48)    12 (  3000)       0       0       20       4    49     97     0%
  2024-02-24T16:53:15+00:00    151s      9     3     72       158 (    44)    22 (  2643)       0       0       20       4    49    100     0%
  2024-02-24T16:38:14+00:00    149s      9     3     72       221 (    38)     7 (    29)       0       0       19       4    50     98     0%
  2024-02-24T16:23:28+00:00    164s     12     3     72       154 (    45)    15 (  2500)       0       0       20       4    50    101     0%
  2024-02-24T16:08:19+00:00    154s     11     3     72       128 (    49)     4 (    30)       0       0       20       4    49     97     0%
  2024-02-24T15:53:14+00:00    149s      9     3     72       165 (    55)    40 (  2273)       0       0       20       4    49    101     0%
  2024-02-24T15:38:13+00:00    148s      9     3     72       219 (    40)     6 (    38)       0       0       20       4    49    101     0%
  2024-02-24T15:23:28+00:00    163s     12     3     72       143 (    42)     5 (    31)       0       0       20       4    50     97     0%
  2024-02-24T15:08:15+00:00    151s     10     3     72       162 (    56)    37 (  2944)       0       0       20       4    49     97     0%
  2024-02-24T14:53:14+00:00    150s     13     3     72       155 (    63)    22 (  2462)       0       0       20       4    49     99     0%
  2024-02-24T14:38:13+00:00    149s      9     3     72       241 (    39)    27 (  2618)       0       0       20       4    49    192     0%
  2024-02-24T14:23:22+00:00    158s     14     3     72       162 (    50)    37 (  3357)       0       0       20       4    50     97     0%
  2024-02-24T14:08:14+00:00    150s     10     3     72       132 (    52)    22 (  2643)       0       0       20       4    49     97     0%
  2024-02-24T13:53:16+00:00    152s     10     3     72       167 (    57)    25 (  4250)       0       0       25       4    49     97     0%
  2024-02-24T13:38:15+00:00    151s      9     3     72       324 (    37)    24 (  2429)       0       0       22       4    49    100     0%
  2024-02-24T13:23:15+00:00    152s     10     3     72       137 (    48)    26 (   500)       0       0       22       4    49     97     0%
  2024-02-24T13:08:28+00:00    164s     11     3     72       166 (    73)    54 (  3031)       0       0       24       4    50     98     0%
  2024-02-24T12:53:15+00:00    152s     11     3     72       159 (    50)    22 (  2462)       0       0       20       4    49     97     0%
  2024-02-24T12:38:48+00:00    185s     11     3     72       253 (    39)    40 (  2840)       0       0       20       4    49    103     0%
  2024-02-24T12:23:12+00:00    149s     11     3     72       146 (    55)    20 (  5000)       0       0       21       4    49    100     0%
  2024-02-24T12:08:12+00:00    149s     10     4     71       159 (    53)    37 (  2944)       0       0       20       4    49     96     0%
  2024-02-24T11:53:28+00:00    165s     13     4     71       152 (    46)     7 (    45)       0       0       20       4    50     99     0%
  2024-02-24T11:38:59+00:00    196s     35     3     72       249 (    39)    35 (  3147)       0       0       26       4    49     95     0%
  2024-02-24T11:23:24+00:00    161s     16     4     71       145 (    50)    35 (  2975)       0       0       19       4    58     97     0%
  2024-02-24T11:08:15+00:00    152s     10     4     71       166 (    46)    20 (  3000)       0       0       25       4    49     94     0%
  2024-02-24T10:53:24+00:00    162s     13     4     71       188 (    74)    56 (  2938)       0       0       27       4    50     97     0%
  2024-02-24T10:38:10+00:00    147s     10     4     71       236 (    36)    45 (  2589)       0       0       20       4    49    100     0%
  2024-02-24T10:23:13+00:00    151s     11     4     71       147 (    49)    26 (  2706)       0       0       20       4    49     99     0%
  2024-02-24T10:08:11+00:00    149s     10     4     71       149 (    48)    15 (    35)       0       0       25       4    49    100     0%
  2024-02-24T09:53:12+00:00    150s     11     4     71       169 (    45)    31 (  2675)       0       0       20       4    49     99     0%
  2024-02-24T09:38:24+00:00    162s     12     4     71       248 (    39)     4 (    35)       0       0       20       4    50     97     0%
  2024-02-24T09:23:13+00:00    151s     11     4     71       154 (    39)     4 (    35)       0       0       19       4    50     98     0%
  2024-02-24T09:08:16+00:00    154s     10     4     71       170 (    41)    11 (   425)       0       0       20       4    49     96     0%
  2024-02-24T08:53:11+00:00    149s     11     4     71       199 (    63)    24 (  2300)       0       0       27       4    49     98     0%
  2024-02-24T08:38:20+00:00    159s     12     4     71       312 (    44)    64 (  3219)       0       0       34       4    50     98     0%
  2024-02-24T08:23:13+00:00    151s     13     4     71       160 (    44)    24 (  3000)       0       0       21       4    49     99     0%
  2024-02-24T08:08:11+00:00    150s     12     4     71       162 (    42)    13 (   425)       0       0       19       4    57    193     0%
  2024-02-24T07:53:11+00:00    150s     11     4     71       180 (    49)    20 (  5000)       0       0       19       4    50    105     0%
  2024-02-24T07:38:19+00:00    158s     12     4     71       248 (    45)    39 (  2833)       0       0       20       4    50     99     0%
  2024-02-24T07:23:13+00:00    152s     11     4     71       158 (    49)    27 (  2618)       0       0       20       4    49     96     0%
  2024-02-24T07:08:18+00:00    157s     10     4     71       144 (    61)    54 (  3071)       0       0       20       4    49     97     0%
  2024-02-24T06:53:10+00:00    149s     11     4     71       168 (    76)    19 (  2750)       0       0       23       4    49     95     0%
  2024-02-24T06:38:08+00:00    148s     11     4     71       206 (    39)    23 (  2536)       0       0       20       4    50     99     0%
  2024-02-24T06:23:23+00:00    162s     12     4     71       166 (    62)    58 (  3000)       0       0       26       4    49     99     0%
  2024-02-24T06:08:08+00:00    148s     10     4     71       135 (    72)    39 (  2911)       0       0       20       4    49     96     0%
  2024-02-24T05:53:15+00:00    154s     12     4     71       117 (    64)     6 (    38)       0       0       20       4    49     97     0%
  2024-02-24T05:38:25+00:00    165s     11     4     71       224 (    41)    20 (  2692)       0       0       16       4    53     95     0%
  2024-02-24T05:23:24+00:00    164s     13     4     71       109 (    45)     6 (    43)       0       0       20       4    50     99     0%
  2024-02-24T05:08:14+00:00    154s     10     4     71       171 (    99)    48 (  3059)       0       0       23       4    49     95     0%


Major LoadDatasets Times Distribution (since last Daily Report):
    n =       84,  median ~=   210000 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:          84
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Major LoadDatasets Times Distribution (since startup):
    n =      256,  median ~=   210356 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             1
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:         253
    <= 10 min:          0
    <= 20 min:          1
    <= 1 hr:            1
    >  1 hr:            0


Minor LoadDatasets Times Distribution (since last Daily Report):
    n =        5,  median ~=      150 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          2
    <= 200 ms:          1
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             2
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Minor LoadDatasets Times Distribution (since startup):
    n =       12,  median ~=      150 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          5
    <= 200 ms:          2
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             5
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0


Response Failed Time Distribution (since last major LoadDatasets):
    n =        0

Response Failed Time Distribution (since last Daily Report):
    n =     1903,  median ~=     2348 ms
    0 ms:              35
    1 ms:              42
    2 ms:               0
    <= 5 ms:            5
    <= 10 ms:           6
    <= 20 ms:          19
    <= 50 ms:         424
    <= 100 ms:         42
    <= 200 ms:         37
    <= 500 ms:        155
    <= 1 s:            46
    <= 2 s:            53
    <= 5 s:           755
    <= 10 s:          151
    <= 20 s:           65
    <= 1 min:          24
    <= 2 min:           7
    <= 5 min:          37
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Failed Time Distribution (since startup):
    n =     7055,  median ~=     2235 ms
    0 ms:             116
    1 ms:             122
    2 ms:              11
    <= 5 ms:           73
    <= 10 ms:          32
    <= 20 ms:          56
    <= 50 ms:        1411
    <= 100 ms:        150
    <= 200 ms:         82
    <= 500 ms:        520
    <= 1 s:           372
    <= 2 s:           354
    <= 5 s:          2913
    <= 10 s:          466
    <= 20 s:          223
    <= 1 min:          32
    <= 2 min:          46
    <= 5 min:          76
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0


Response Succeeded Time Distribution (since last major LoadDatasets):
    n =       17,  median ~=     2450 ms
    0 ms:               1
    1 ms:               1
    2 ms:               0
    <= 5 ms:            1
    <= 10 ms:           0
    <= 20 ms:           1
    <= 50 ms:           0
    <= 100 ms:          1
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             2
    <= 5 s:            10
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Succeeded Time Distribution (since last Daily Report):
    n =    15410,  median ~=       46 ms
    0 ms:            1125
    1 ms:            1339
    2 ms:             263
    <= 5 ms:          616
    <= 10 ms:         117
    <= 20 ms:         414
    <= 50 ms:        4370
    <= 100 ms:       2404
    <= 200 ms:        853
    <= 500 ms:        525
    <= 1 s:           688
    <= 2 s:           890
    <= 5 s:          1385
    <= 10 s:          330
    <= 20 s:           48
    <= 1 min:          33
    <= 2 min:           8
    <= 5 min:           2
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Succeeded Time Distribution (since startup):
    n =    46888,  median ~=       49 ms
    0 ms:            3250
    1 ms:            4005
    2 ms:             981
    <= 5 ms:         1878
    <= 10 ms:         446
    <= 20 ms:        1095
    <= 50 ms:       12408
    <= 100 ms:       7085
    <= 200 ms:       2493
    <= 500 ms:       1772
    <= 1 s:          2272
    <= 2 s:          2769
    <= 5 s:          4726
    <= 10 s:         1333
    <= 20 s:          245
    <= 1 min:          36
    <= 2 min:          92
    <= 5 min:           2
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0


TaskThread Failed Time Distribution (since last Daily Report):
    n =        0

TaskThread Failed Time Distribution (since startup):
    n =        0

TaskThread Succeeded Time Distribution (since last Daily Report):
    n =        0

TaskThread Succeeded Time Distribution (since startup):
    n =        0


SgtMap topography nFromCache=0 nNotFromCache=5
GSHHS: nCached=100 of 100, nCoarse=588, nSuccesses=138, nTossed=139
NationalBoundaries: nCached=4 of 100,  nCoarse=62, nSuccesses=4, nTossed=0
StateBoundaries: nCached=4 of 100,  nCoarse=59, nSuccesses=4, nTossed=0
Rivers: nCached=4 of 100,  nCoarse=59, nSuccesses=4, nTossed=0
bufferedImage isAccelerated=[unknown]
canonical map sizes: 45 + 690 + 248 + 1543 + 985 + 1443 = 4954
canonicalStringHolder map sizes: 406 + 688 + 833 + 456 + 210 + 333 = 2926

Number of threads: Tomcat-waiting=19, inotify=4, other=48
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)

#1 Thread[AsyncFileHandlerWriter-1,5,main] WAITING daemon
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.LinkedBlockingDeque.takeFirst(LinkedBlockingDeque.java:492)
java.util.concurrent.LinkedBlockingDeque.take(LinkedBlockingDeque.java:680)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:750)

#2 Thread[Catalina-utility-1,1,main] WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.lang.Thread.run(Thread.java:750)

#3 Thread[Catalina-utility-2,1,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.lang.Thread.run(Thread.java:750)

#4 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#5 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#6 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#7 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#8 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#9 Thread[cluster1-nio-worker-4,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#10 Thread[cluster1-nio-worker-5,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#11 Thread[cluster1-nio-worker-6,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#12 Thread[cluster1-nio-worker-7,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#13 Thread[cluster1-reconnection-0,5,main] WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#14 Thread[cluster1-reconnection-1,5,main] WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#15 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#16 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#17 Thread[cluster11-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#18 Thread[cluster11-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#19 Thread[cluster11-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#20 Thread[cluster11-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#21 Thread[cluster11-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#22 Thread[cluster11-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#23 Thread[cluster11-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#24 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#25 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#26 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#27 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#28 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#29 Thread[cluster2-nio-worker-4,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#30 Thread[cluster2-nio-worker-5,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#31 Thread[cluster2-nio-worker-6,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#32 Thread[cluster2-nio-worker-7,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#33 Thread[cluster2-reconnection-0,5,main] WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#34 Thread[cluster2-reconnection-1,5,main] WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#35 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#36 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)

#37 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:750)

#38 Thread[Finalizer,8,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:188)

#39 Thread[GC Daemon,2,system] TIMED_WAITING daemon
java.lang.Object.wait(Native Method)
sun.misc.GC$Daemon.run(GC.java:117)

#40 Thread[http-nio-8080-Acceptor,5,main] RUNNABLE daemon
sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:548)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:79)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129)
java.lang.Thread.run(Thread.java:750)

#41 Thread[http-nio-8080-Poller,5,main] RUNNABLE daemon
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:812)
java.lang.Thread.run(Thread.java:750)

#42 Thread[https-jsse-nio-8443-Acceptor,5,main] RUNNABLE daemon
sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:548)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:79)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129)
java.lang.Thread.run(Thread.java:750)

#43 Thread[https-jsse-nio-8443-Poller,5,main] RUNNABLE daemon
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:812)
java.lang.Thread.run(Thread.java:750)

#44 Thread[Java2D Disposer,10,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
sun.java2d.Disposer.run(Disposer.java:148)
java.lang.Thread.run(Thread.java:750)

#45 Thread[main,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.StandardServer.await(StandardServer.java:568)
org.apache.catalina.startup.Catalina.await(Catalina.java:864)
org.apache.catalina.startup.Catalina.start(Catalina.java:810)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:347)
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:478)

#46 Thread[Reference Handler,10,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.Object.wait(Object.java:502)
java.lang.ref.Reference.tryHandlePending(Reference.java:191)
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

#47 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:288)

#48 Thread[Signal Dispatcher,9,system] RUNNABLE daemon


 
ERDDAP, Version 2.14
Disclaimers | Privacy Policy | Contact