Serving data from the Marine Institute (Ireland)
Brought to you by the Marine Institute(Ireland)
|
Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland) |
Brought to you by the Marine Institute(Ireland) |
Current time is 2024-10-22T01:54:50+00:00
Startup was at 2024-10-19T07:50:35+00:00
Last major LoadDatasets started 3m 40s ago and finished after 175 seconds.
nGridDatasets = 11
nTableDatasets = 62
nTotalDatasets = 73
n Datasets Failed To Load (in the last major LoadDatasets) = 6
ireland_marine_research_database_charts, imiglenamongarms, imifeeaghco2, imiroughriverarms,
spiddal_obs_adcp, IMI_EATL_WAVE, (end)
Unique users (since startup) n = 3057
Response Failed Time (since last major LoadDatasets) n = 3, median ~= 28 ms
Response Failed Time (since last Daily Report) n = 5369, median ~= 4731 ms
Response Failed Time (since startup) n = 19194, median ~= 4313 ms
Response Succeeded Time (since last major LoadDatasets) n = 23, median ~= 70 ms
Response Succeeded Time (since last Daily Report) n = 21827, median ~= 530 ms
Response Succeeded Time (since startup) n = 77937, median ~= 467 ms
TaskThread has finished 0 out of 0 tasks. Currently, no task is running.
TaskThread Failed Time (since last Daily Report) n = 0
TaskThread Failed Time (since startup) n = 0
TaskThread Succeeded Time (since last Daily Report) n = 0
TaskThread Succeeded Time (since startup) n = 0
Number of threads: Tomcat-waiting=23, inotify=4, other=42
MemoryInUse= 1273 MB (highWaterMark= 3377 MB) (Xmx ~= 5888 MB)
Major LoadDatasets Time Series: MLD Datasets Loaded Requests (median times in ms) Number of Threads MB Open
timestamp time nTry nFail nTotal nSuccess (median) nFail (median) memFail tooMany tomWait inotify other inUse Files
---------------------------- ----- ----------------- ------------------------------------------------ --------------------- ----- -----
2024-10-22T01:54:01+00:00 172s 14 6 73 138 ( 80) 10 ( 3500) 0 0 25 4 43 101 0%
2024-10-22T01:39:11+00:00 182s 15 6 73 193 ( 42) 17 ( 2750) 0 0 20 4 43 137 0%
2024-10-22T01:23:55+00:00 166s 13 6 73 131 ( 67) 9 ( 1500) 0 0 20 4 43 133 0%
2024-10-22T01:08:58+00:00 169s 13 6 73 140 ( 47) 5 ( 31) 0 0 20 4 43 123 0%
2024-10-22T00:53:56+00:00 167s 13 6 73 152 ( 218) 49 ( 5313) 0 0 24 4 43 123 0%
2024-10-22T00:38:59+00:00 170s 13 6 73 187 ( 38) 7 ( 39) 0 0 20 4 44 161 0%
2024-10-22T00:24:15+00:00 186s 16 6 73 139 ( 67) 42 ( 49) 0 0 20 4 42 151 0%
2024-10-22T00:08:57+00:00 168s 13 6 73 148 ( 106) 18 ( 1400) 0 0 19 4 45 102 0%
2024-10-21T23:53:58+00:00 170s 15 6 73 171 ( 361) 12 ( 2000) 0 0 20 4 43 103 0%
2024-10-21T23:38:53+00:00 165s 12 6 73 148 ( 44) 7 ( 41) 0 0 20 4 43 127 0%
2024-10-21T23:24:10+00:00 182s 15 6 73 114 ( 58) 15 ( 88) 0 0 19 4 44 101 0%
2024-10-21T23:08:58+00:00 170s 13 6 73 162 ( 83) 14 ( 2500) 0 0 20 4 44 119 0%
2024-10-21T22:53:58+00:00 170s 13 6 73 174 ( 59) 5 ( 45) 0 0 20 4 42 101 0%
2024-10-21T22:38:54+00:00 166s 12 6 73 207 ( 70) 17 ( 2300) 0 0 19 4 44 102 0%
2024-10-21T22:23:58+00:00 170s 12 6 73 161 ( 163) 13 ( 1500) 0 0 25 4 44 122 0%
2024-10-21T22:09:16+00:00 188s 16 6 73 144 ( 90) 9 ( 1500) 0 0 20 4 44 104 0%
2024-10-21T21:53:57+00:00 169s 14 6 73 249 ( 763) 32 ( 3714) 0 0 28 4 43 104 0%
2024-10-21T21:39:00+00:00 172s 13 6 73 248 ( 410) 19 ( 275) 0 0 28 4 43 128 0%
2024-10-21T21:23:54+00:00 166s 13 6 73 169 ( 73) 14 ( 50) 0 0 20 4 42 103 0%
2024-10-21T21:08:57+00:00 169s 13 6 73 205 ( 410) 23 ( 2150) 0 0 27 4 43 104 0%
2024-10-21T20:54:07+00:00 179s 16 6 73 189 ( 271) 69 ( 4906) 0 0 25 4 42 130 0%
2024-10-21T20:38:57+00:00 169s 12 6 73 219 ( 44) 12 ( 67) 0 0 20 4 43 106 0%
2024-10-21T20:24:02+00:00 174s 12 6 73 147 ( 104) 9 ( 43) 0 0 20 4 43 138 0%
2024-10-21T20:08:58+00:00 171s 13 6 73 302 ( 1243) 67 ( 3500) 0 0 20 4 44 130 0%
2024-10-21T19:53:58+00:00 171s 13 6 73 162 ( 189) 14 ( 200) 0 0 28 4 42 136 0%
2024-10-21T19:39:06+00:00 179s 15 6 73 215 ( 89) 24 ( 2500) 0 0 28 4 44 136 0%
2024-10-21T19:23:59+00:00 172s 12 6 73 209 ( 813) 21 ( 463) 0 0 29 4 43 108 0%
2024-10-21T19:08:56+00:00 169s 13 6 73 231 ( 672) 23 ( 583) 0 0 27 4 43 102 0%
2024-10-21T18:53:58+00:00 171s 13 6 73 359 ( 578) 16 ( 500) 0 0 28 4 43 105 0%
2024-10-21T18:39:10+00:00 183s 15 6 73 302 ( 468) 65 ( 4719) 0 35 28 4 43 105 0%
2024-10-21T18:23:56+00:00 170s 12 6 73 241 ( 521) 27 ( 750) 0 0 36 4 42 121 0%
2024-10-21T18:08:56+00:00 169s 13 6 73 150 ( 115) 9 ( 425) 0 0 20 4 43 128 0%
2024-10-21T17:53:58+00:00 171s 13 6 73 315 ( 2109) 104 ( 4778) 0 0 28 4 43 141 0%
2024-10-21T17:39:05+00:00 178s 17 6 73 222 ( 89) 40 ( 6429) 0 0 20 4 43 107 0%
2024-10-21T17:23:56+00:00 170s 14 6 73 217 ( 407) 50 ( 4571) 0 0 12 4 52 127 0%
2024-10-21T17:08:59+00:00 172s 13 6 73 249 ( 392) 8 ( 10) 0 0 20 4 43 125 0%
2024-10-21T16:54:00+00:00 175s 14 6 73 200 ( 268) 14 ( 2600) 0 0 20 4 43 135 0%
2024-10-21T16:38:54+00:00 168s 12 6 73 307 ( 47) 46 ( 5435) 0 0 26 4 43 107 0%
2024-10-21T16:24:09+00:00 183s 15 6 73 164 ( 92) 102 ( 3708) 0 0 23 4 43 109 0%
2024-10-21T16:08:50+00:00 165s 13 6 73 199 ( 186) 29 ( 2750) 0 0 34 4 43 123 0%
2024-10-21T15:53:53+00:00 168s 13 6 73 244 ( 729) 49 ( 5300) 0 0 20 4 42 106 0%
2024-10-21T15:38:52+00:00 167s 12 6 73 280 ( 164) 80 ( 5957) 0 0 28 4 43 106 0%
2024-10-21T15:24:04+00:00 179s 15 6 73 196 ( 350) 15 ( 1500) 0 0 19 4 43 311 0%
2024-10-21T15:08:55+00:00 170s 13 6 73 249 ( 382) 54 ( 3000) 0 0 27 4 44 127 0%
2024-10-21T14:54:00+00:00 175s 13 6 73 286 ( 600) 27 ( 2955) 0 0 43 4 43 105 0%
2024-10-21T14:39:07+00:00 183s 12 6 73 226 ( 67) 37 ( 4625) 0 0 20 4 43 115 0%
2024-10-21T14:23:55+00:00 171s 12 6 73 189 ( 239) 18 ( 2429) 0 0 20 4 43 115 0%
2024-10-21T14:09:13+00:00 189s 16 6 73 283 ( 470) 38 ( 2563) 0 0 28 4 43 119 0%
2024-10-21T13:53:54+00:00 170s 13 6 73 237 ( 114) 28 ( 700) 0 0 15 4 55 412 0%
2024-10-21T13:38:53+00:00 169s 12 6 73 374 ( 400) 82 ( 2840) 0 0 26 4 44 406 0%
2024-10-21T13:23:55+00:00 171s 15 6 73 2577 ( 6874) 1451 ( 6568) 0 405 98 4 42 109 0%
2024-10-21T13:09:14+00:00 191s 16 6 73 1933 ( 6929) 987 ( 6263) 0 55 10 4 243 1806 0%
2024-10-21T12:53:53+00:00 170s 13 6 73 387 ( 148) 60 ( 4625) 0 0 37 4 45 1213 0%
2024-10-21T12:38:54+00:00 171s 12 6 73 299 ( 180) 104 ( 7326) 0 19 25 4 44 103 0%
2024-10-21T12:23:51+00:00 168s 13 6 73 269 ( 550) 78 ( 3174) 0 0 45 4 42 122 0%
2024-10-21T12:09:06+00:00 183s 16 6 73 196 ( 83) 31 ( 6477) 0 0 19 4 50 162 0%
2024-10-21T11:53:55+00:00 172s 15 6 73 300 ( 571) 32 ( 3667) 0 0 27 4 43 100 0%
2024-10-21T11:38:44+00:00 161s 12 6 73 208 ( 65) 151 ( 6868) 0 0 14 4 58 170 0%
2024-10-21T11:23:48+00:00 165s 12 6 73 201 ( 421) 19 ( 1500) 0 0 28 4 43 99 0%
2024-10-21T11:08:53+00:00 170s 13 6 73 300 ( 317) 53 ( 2900) 0 0 23 4 43 127 0%
2024-10-21T10:54:05+00:00 182s 18 6 73 322 ( 279) 106 ( 5763) 0 0 33 4 42 122 0%
2024-10-21T10:38:52+00:00 169s 12 6 73 250 ( 96) 31 ( 2281) 0 0 20 4 42 115 0%
2024-10-21T10:23:51+00:00 169s 12 6 73 353 ( 1194) 56 ( 4600) 0 83 20 4 43 103 0%
2024-10-21T10:08:56+00:00 174s 13 6 73 247 ( 271) 61 ( 4156) 0 0 25 4 43 97 0%
2024-10-21T09:53:53+00:00 170s 13 6 73 253 ( 698) 50 ( 4000) 0 0 24 4 42 98 0%
2024-10-21T09:39:05+00:00 183s 15 6 73 382 ( 225) 35 ( 1500) 0 0 23 4 45 1032 0%
2024-10-21T09:23:50+00:00 168s 12 6 73 351 ( 1279) 58 ( 2923) 0 0 33 4 61 801 0%
2024-10-21T09:09:53+00:00 231s 14 6 73 346 ( 889) 92 ( 4375) 0 0 31 4 47 251 0%
2024-10-21T08:53:53+00:00 171s 12 6 73 282 ( 86) 32 ( 2545) 0 0 19 4 43 140 0%
2024-10-21T08:38:54+00:00 172s 13 6 73 344 ( 150) 93 ( 5585) 0 0 26 4 45 401 0%
2024-10-21T08:24:23+00:00 201s 18 6 73 321 ( 625) 30 ( 2000) 0 0 27 4 43 91 0%
2024-10-21T08:09:20+00:00 198s 24 6 73 342 ( 946) 61 ( 4250) 0 0 29 4 43 121 0%
2024-10-21T07:54:48+00:00 227s 34 6 73 310 ( 185) 76 ( 5270) 0 0 27 4 42 100 0%
2024-10-21T07:39:00+00:00 179s 13 6 73 261 ( 162) 29 ( 2346) 0 0 28 4 43 89 0%
2024-10-21T07:24:08+00:00 186s 15 6 73 225 ( 191) 74 ( 6023) 0 0 25 4 45 94 0%
2024-10-21T07:08:58+00:00 177s 14 6 73 298 ( 392) 327 ( 1213) 0 0 30 4 44 95 0%
2024-10-21T06:54:00+00:00 179s 12 6 73 313 ( 178) 309 ( 1061) 1 0 34 4 44 205 0%
2024-10-21T06:38:52+00:00 171s 13 6 73 183 ( 48) 46 ( 5000) 0 0 27 4 42 100 0%
2024-10-21T06:23:58+00:00 177s 12 6 73 222 ( 373) 12 ( 500) 0 0 16 4 53 95 0%
2024-10-21T06:09:15+00:00 194s 16 6 73 210 ( 243) 48 ( 5000) 0 0 26 4 44 100 0%
2024-10-21T05:53:56+00:00 175s 12 6 73 121 ( 155) 9 ( 47) 0 0 20 4 43 100 0%
2024-10-21T05:38:57+00:00 176s 13 6 73 219 ( 86) 26 ( 1000) 0 0 20 4 44 100 0%
2024-10-21T05:23:53+00:00 173s 12 6 73 121 ( 145) 38 ( 5909) 0 0 26 4 43 341 0%
2024-10-21T05:08:57+00:00 176s 14 6 73 127 ( 73) 6 ( 40) 0 0 20 4 44 100 0%
2024-10-21T04:54:08+00:00 187s 15 6 73 134 ( 200) 16 ( 2500) 0 0 20 4 42 98 0%
2024-10-21T04:38:54+00:00 174s 12 6 73 207 ( 42) 10 ( 26) 0 0 20 4 44 100 0%
2024-10-21T04:24:01+00:00 180s 14 6 73 102 ( 81) 4 ( 50) 0 0 20 4 43 98 0%
2024-10-21T04:09:02+00:00 181s 13 6 73 107 ( 62) 5 ( 25) 0 0 20 4 43 98 0%
2024-10-21T03:53:51+00:00 170s 12 6 73 106 ( 110) 7 ( 39) 0 0 20 4 43 100 0%
2024-10-21T03:39:08+00:00 188s 15 6 73 159 ( 45) 7 ( 45) 0 0 20 4 44 98 0%
2024-10-21T03:23:54+00:00 174s 13 6 73 88 ( 64) 3 ( 43) 0 0 20 4 43 100 0%
2024-10-21T03:08:58+00:00 178s 13 6 73 155 ( 93) 8 ( 50) 0 0 20 4 44 101 0%
2024-10-21T02:53:58+00:00 178s 12 6 73 172 ( 70) 6 ( 100) 0 0 27 4 43 99 0%
Major LoadDatasets Times Distribution (since last Daily Report):
n = 75, median ~= 210000 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 75
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Major LoadDatasets Times Distribution (since startup):
n = 265, median ~= 210341 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 264
<= 10 min: 1
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since last Daily Report):
n = 2, median ~= 5000 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 1
<= 10 s: 1
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since startup):
n = 9, median ~= 2900 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 2
<= 500 ms: 1
<= 1 s: 0
<= 2 s: 0
<= 5 s: 5
<= 10 s: 1
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last major LoadDatasets):
n = 3, median ~= 28 ms
0 ms: 0
1 ms: 1
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 2
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last Daily Report):
n = 5369, median ~= 4731 ms
0 ms: 38
1 ms: 48
2 ms: 11
<= 5 ms: 15
<= 10 ms: 42
<= 20 ms: 48
<= 50 ms: 551
<= 100 ms: 60
<= 200 ms: 18
<= 500 ms: 280
<= 1 s: 153
<= 2 s: 177
<= 5 s: 1366
<= 10 s: 1606
<= 20 s: 727
<= 1 min: 157
<= 2 min: 35
<= 5 min: 37
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since startup):
n = 19194, median ~= 4313 ms
0 ms: 137
1 ms: 162
2 ms: 68
<= 5 ms: 47
<= 10 ms: 173
<= 20 ms: 183
<= 50 ms: 1856
<= 100 ms: 195
<= 200 ms: 111
<= 500 ms: 1010
<= 1 s: 704
<= 2 s: 801
<= 5 s: 5382
<= 10 s: 5887
<= 20 s: 1512
<= 1 min: 629
<= 2 min: 109
<= 5 min: 223
<= 10 min: 5
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last major LoadDatasets):
n = 23, median ~= 70 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 2
<= 10 ms: 0
<= 20 ms: 1
<= 50 ms: 3
<= 100 ms: 14
<= 200 ms: 3
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last Daily Report):
n = 21827, median ~= 530 ms
0 ms: 532
1 ms: 732
2 ms: 323
<= 5 ms: 572
<= 10 ms: 146
<= 20 ms: 390
<= 50 ms: 3242
<= 100 ms: 1946
<= 200 ms: 1431
<= 500 ms: 1522
<= 1 s: 1272
<= 2 s: 1789
<= 5 s: 3547
<= 10 s: 2399
<= 20 s: 1701
<= 1 min: 194
<= 2 min: 84
<= 5 min: 5
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since startup):
n = 77937, median ~= 467 ms
0 ms: 1651
1 ms: 2284
2 ms: 1139
<= 5 ms: 2207
<= 10 ms: 455
<= 20 ms: 1243
<= 50 ms: 11780
<= 100 ms: 7119
<= 200 ms: 5679
<= 500 ms: 6086
<= 1 s: 5323
<= 2 s: 7152
<= 5 s: 13382
<= 10 s: 8375
<= 20 s: 3438
<= 1 min: 501
<= 2 min: 103
<= 5 min: 20
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
TaskThread Failed Time Distribution (since last Daily Report):
n = 0
TaskThread Failed Time Distribution (since startup):
n = 0
TaskThread Succeeded Time Distribution (since last Daily Report):
n = 0
TaskThread Succeeded Time Distribution (since startup):
n = 0
SgtMap topography nFromCache=9 nNotFromCache=18
GSHHS: nCached=100 of 100, nCoarse=961, nSuccesses=413, nTossed=225
NationalBoundaries: nCached=37 of 100, nCoarse=93, nSuccesses=52, nTossed=0
StateBoundaries: nCached=20 of 100, nCoarse=88, nSuccesses=35, nTossed=0
Rivers: nCached=37 of 100, nCoarse=98, nSuccesses=52, nTossed=0
bufferedImage isAccelerated=[unknown]
canonical map sizes: 173 + 713 + 258 + 1544 + 992 + 1449 = 5129
canonicalStringHolder map sizes: 524 + 746 + 912 + 459 + 209 + 377 = 3227
Number of threads: Tomcat-waiting=23, inotify=4, other=42
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)
#1 Thread[AsyncFileHandlerWriter-1,5,main] WAITING daemon
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.LinkedBlockingDeque.takeFirst(LinkedBlockingDeque.java:492)
java.util.concurrent.LinkedBlockingDeque.take(LinkedBlockingDeque.java:680)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:750)
#2 Thread[Catalina-utility-1,1,main] WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
java.lang.Thread.run(Thread.java:750)
#3 Thread[Catalina-utility-2,1,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
java.lang.Thread.run(Thread.java:750)
#4 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#5 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#6 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#7 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#8 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#9 Thread[cluster1-nio-worker-4,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#10 Thread[cluster1-nio-worker-5,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#11 Thread[cluster1-nio-worker-6,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#12 Thread[cluster1-nio-worker-7,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#13 Thread[cluster1-reconnection-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#14 Thread[cluster1-reconnection-1,5,main] WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#15 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#16 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#17 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#18 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#19 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#20 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#21 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#22 Thread[cluster2-nio-worker-4,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#23 Thread[cluster2-nio-worker-5,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#24 Thread[cluster2-nio-worker-6,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#25 Thread[cluster2-nio-worker-7,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#26 Thread[cluster2-reconnection-0,5,main] WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#27 Thread[cluster2-reconnection-1,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#28 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#29 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#30 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:750)
#31 Thread[Finalizer,8,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:188)
#32 Thread[GC Daemon,2,system] TIMED_WAITING daemon
java.lang.Object.wait(Native Method)
sun.misc.GC$Daemon.run(GC.java:117)
#33 Thread[http-nio-8080-Acceptor,5,main] RUNNABLE daemon
sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:548)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:79)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129)
java.lang.Thread.run(Thread.java:750)
#34 Thread[http-nio-8080-Poller,5,main] RUNNABLE daemon
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:812)
java.lang.Thread.run(Thread.java:750)
#35 Thread[https-jsse-nio-8443-Acceptor,5,main] RUNNABLE daemon
sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:548)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:79)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129)
java.lang.Thread.run(Thread.java:750)
#36 Thread[https-jsse-nio-8443-exec-6365,5,main] TIMED_WAITING daemon
java.lang.Thread.sleep(Native Method)
com.cohort.util.Math2.sleep(Math2.java:309)
gov.noaa.pfel.erddap.util.EDStatic.lowSendError(EDStatic.java:5563)
gov.noaa.pfel.erddap.util.EDStatic.sendError(EDStatic.java:5534)
gov.noaa.pfel.erddap.Erddap.doGet(Erddap.java:704)
javax.servlet.http.HttpServlet.service(HttpServlet.java:529)
javax.servlet.http.HttpServlet.service(HttpServlet.java:623)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:51)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)
org.apache.catalina.filters.CorsFilter.handleNonCORS(CorsFilter.java:331)
org.apache.catalina.filters.CorsFilter.doFilter(CorsFilter.java:158)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)
org.apache.catalina.filters.HttpHeaderSecurityFilter.doFilter(HttpHeaderSecurityFilter.java:129)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:168)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90)
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:481)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93)
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:670)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:346)
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:390)
org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:928)
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1794)
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)
org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
java.lang.Thread.run(Thread.java:750)
#37 Thread[https-jsse-nio-8443-Poller,5,main] RUNNABLE daemon
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:812)
java.lang.Thread.run(Thread.java:750)
#38 Thread[Java2D Disposer,10,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
sun.java2d.Disposer.run(Disposer.java:148)
java.lang.Thread.run(Thread.java:750)
#39 Thread[main,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.StandardServer.await(StandardServer.java:568)
org.apache.catalina.startup.Catalina.await(Catalina.java:825)
org.apache.catalina.startup.Catalina.start(Catalina.java:773)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476)
#40 Thread[Reference Handler,10,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.Object.wait(Object.java:502)
java.lang.ref.Reference.tryHandlePending(Reference.java:191)
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
#41 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:288)
#42 Thread[Signal Dispatcher,9,system] RUNNABLE daemon