Serving data from the Marine Institute (Ireland)
Brought to you by the Marine Institute(Ireland)
|
Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland) |
Brought to you by the Marine Institute(Ireland) |
Current time is 2025-11-29T08:07:33+00:00
Startup was at 2025-11-25T23:43:20+00:00
Last major LoadDatasets started 8m 23s ago and finished after 90 seconds.
nGridDatasets = 9
nTableDatasets = 77
nTotalDatasets = 86
n Datasets Failed To Load (in the last major LoadDatasets) = 5
ireland_marine_research_database_charts, imifeeaghco2, compass_neatl_hindcast_grid,
IMI_Model_Stats, IMI_EATL_WAVE, (end)
Unique users (since startup) n = 13325
Response Failed Time (since last major LoadDatasets) n = 85, median ~= 685 ms
Response Failed Time (since last Daily Report) n = 416, median ~= 491 ms
Response Failed Time (since startup) n = 23503, median ~= 407 ms
Response Succeeded Time (since last major LoadDatasets) n = 92, median ~= 179 ms
Response Succeeded Time (since last Daily Report) n = 799, median ~= 142 ms
Response Succeeded Time (since startup) n = 55023, median ~= 99 ms
TaskThread has finished 0 out of 0 tasks. Currently, no task is running.
TaskThread Failed Time (since last Daily Report) n = 0
TaskThread Failed Time (since startup) n = 0
TaskThread Succeeded Time (since last Daily Report) n = 0
TaskThread Succeeded Time (since startup) n = 0
Number of threads: Tomcat-waiting=23, inotify=4, other=36
MemoryInUse= 659 MB (highWaterMark= 1749 MB) (Xmx ~= 5888 MB)
Major LoadDatasets Time Series: MLD Datasets Loaded Requests (median times in ms) Number of Threads MB Open
timestamp time nTry nFail nTotal nSuccess (median) nFail (median) memFail tooMany tomWait inotify other inUse Files
---------------------------- ----- ----------------- ------------------------------------------------ --------------------- ----- -----
2025-11-29T08:00:34+00:00 85s 12 5 86 182 ( 179) 73 ( 925) 0 0 26 4 37 115 0%
2025-11-29T07:45:51+00:00 102s 14 6 85 169 ( 75) 142 ( 477) 0 0 20 4 37 101 0%
2025-11-29T07:30:34+00:00 85s 11 6 85 141 ( 150) 34 ( 376) 0 0 19 4 38 105 0%
2025-11-29T07:15:40+00:00 91s 12 6 85 215 ( 141) 82 ( 385) 0 0 22 4 37 104 0%
2025-11-29T07:00:35+00:00 86s 11 5 86 139 ( 268) 33 ( 450) 0 0 22 4 37 99 0%
2025-11-29T06:45:49+00:00 101s 13 5 86 156 ( 114) 96 ( 363) 0 0 19 4 38 105 0%
2025-11-29T06:30:31+00:00 82s 10 5 86 148 ( 175) 40 ( 330) 0 0 19 4 38 290 0%
2025-11-29T06:15:35+00:00 87s 11 5 86 138 ( 138) 33 ( 390) 0 0 19 4 38 105 0%
2025-11-29T06:00:36+00:00 88s 11 5 86 106 ( 178) 32 ( 340) 0 0 19 4 38 259 0%
2025-11-29T05:45:46+00:00 98s 12 5 86 151 ( 104) 61 ( 350) 0 0 20 4 37 106 0%
2025-11-29T05:30:33+00:00 84s 11 5 86 114 ( 145) 56 ( 341) 0 0 18 4 39 107 0%
2025-11-29T05:15:38+00:00 90s 11 5 86 150 ( 97) 51 ( 525) 0 0 20 4 37 106 0%
2025-11-29T05:00:32+00:00 84s 13 5 86 107 ( 137) 29 ( 434) 1 0 20 4 37 105 0%
2025-11-29T04:45:35+00:00 86s 10 5 86 142 ( 95) 65 ( 379) 0 0 20 4 37 102 0%
2025-11-29T04:30:49+00:00 101s 13 5 86 128 ( 270) 67 ( 406) 0 0 47 4 38 104 0%
2025-11-29T04:15:35+00:00 87s 11 5 86 140 ( 78) 34 ( 388) 0 0 20 4 37 108 0%
2025-11-29T04:00:31+00:00 83s 11 5 86 142 ( 132) 27 ( 390) 0 0 20 4 37 109 0%
2025-11-29T03:45:33+00:00 85s 10 5 86 153 ( 80) 81 ( 355) 0 0 20 4 37 106 0%
2025-11-29T03:30:48+00:00 100s 13 5 86 94 ( 176) 26 ( 380) 0 0 20 4 37 309 0%
2025-11-29T03:15:32+00:00 84s 11 5 86 142 ( 91) 34 ( 388) 0 0 20 4 37 105 0%
2025-11-29T03:00:29+00:00 82s 11 5 86 110 ( 239) 26 ( 400) 0 0 20 4 37 104 0%
2025-11-29T02:45:31+00:00 84s 10 5 86 123 ( 85) 60 ( 353) 0 0 20 4 37 104 0%
2025-11-29T02:30:35+00:00 88s 10 5 86 118 ( 161) 50 ( 354) 0 0 18 4 39 103 0%
2025-11-29T02:15:55+00:00 108s 14 5 86 212 ( 56) 44 ( 480) 0 0 20 4 37 105 0%
2025-11-29T02:00:29+00:00 82s 11 5 86 117 ( 213) 26 ( 406) 0 0 20 4 37 107 0%
2025-11-29T01:45:39+00:00 92s 11 5 86 156 ( 95) 61 ( 353) 0 0 20 4 37 102 0%
2025-11-29T01:30:31+00:00 84s 10 5 86 99 ( 186) 51 ( 372) 0 0 18 4 39 144 0%
2025-11-29T01:15:45+00:00 98s 14 5 86 183 ( 91) 34 ( 380) 0 0 20 4 37 108 0%
2025-11-29T01:00:27+00:00 81s 12 5 86 132 ( 181) 32 ( 406) 0 0 20 4 37 104 0%
2025-11-29T00:45:32+00:00 86s 11 5 86 173 ( 209) 62 ( 357) 0 0 37 4 37 91 0%
2025-11-29T00:30:31+00:00 84s 10 5 86 109 ( 78) 47 ( 363) 0 0 18 4 39 145 0%
2025-11-29T00:15:28+00:00 82s 10 5 86 136 ( 84) 37 ( 468) 0 0 19 4 38 107 0%
2025-11-29T00:02:10+00:00 184s 36 5 86 123 ( 134) 35 ( 392) 0 0 20 4 37 104 0%
2025-11-28T23:45:54+00:00 108s 29 5 86 125 ( 97) 73 ( 379) 0 0 29 4 37 104 0%
2025-11-28T23:30:29+00:00 83s 10 5 86 123 ( 164) 51 ( 395) 0 0 19 4 38 154 0%
2025-11-28T23:15:33+00:00 88s 11 5 86 186 ( 65) 41 ( 434) 0 0 20 4 37 104 0%
2025-11-28T23:00:43+00:00 98s 14 5 86 160 ( 246) 28 ( 360) 0 0 20 4 37 107 0%
2025-11-28T22:45:28+00:00 83s 10 5 86 210 ( 221) 81 ( 373) 0 0 27 4 37 102 0%
2025-11-28T22:30:30+00:00 85s 10 5 86 138 ( 133) 39 ( 436) 0 0 22 4 38 146 0%
2025-11-28T22:15:29+00:00 84s 11 5 86 163 ( 90) 34 ( 406) 0 0 24 4 38 157 0%
2025-11-28T22:00:42+00:00 97s 17 5 86 204 ( 133) 30 ( 380) 0 0 29 4 37 105 0%
2025-11-28T21:45:27+00:00 82s 10 5 86 256 ( 58) 87 ( 352) 0 0 23 4 37 107 0%
2025-11-28T21:30:28+00:00 83s 13 5 86 174 ( 172) 29 ( 410) 0 0 25 4 37 103 0%
2025-11-28T21:15:30+00:00 86s 12 5 86 203 ( 127) 72 ( 360) 0 0 26 4 37 106 0%
2025-11-28T21:00:43+00:00 98s 15 5 86 148 ( 167) 84 ( 313) 0 0 28 4 37 103 0%
2025-11-28T20:45:33+00:00 88s 10 5 86 180 ( 144) 109 ( 305) 0 0 23 4 40 98 0%
2025-11-28T20:30:29+00:00 84s 10 5 86 129 ( 188) 269 ( 481) 0 0 31 4 38 104 0%
2025-11-28T20:15:32+00:00 87s 12 5 86 184 ( 107) 72 ( 380) 0 0 29 4 40 103 0%
2025-11-28T20:00:41+00:00 96s 15 6 85 193 ( 45) 37 ( 434) 0 0 26 4 37 102 0%
2025-11-28T19:45:31+00:00 87s 13 6 85 197 ( 104) 102 ( 371) 0 0 20 4 37 102 0%
2025-11-28T19:30:29+00:00 85s 11 6 85 173 ( 108) 36 ( 369) 0 0 29 4 37 109 0%
2025-11-28T19:15:29+00:00 85s 12 6 85 234 ( 96) 54 ( 654) 0 0 26 4 37 108 0%
2025-11-28T19:00:40+00:00 96s 15 6 85 166 ( 88) 39 ( 322) 0 0 29 4 37 104 0%
2025-11-28T18:45:27+00:00 83s 11 6 85 191 ( 77) 107 ( 320) 0 0 24 4 38 397 0%
2025-11-28T18:30:27+00:00 83s 11 6 85 192 ( 189) 35 ( 359) 0 0 27 4 37 98 0%
2025-11-28T18:15:31+00:00 88s 12 6 85 185 ( 69) 48 ( 260) 0 0 23 4 37 102 0%
2025-11-28T18:00:28+00:00 84s 12 6 85 217 ( 185) 37 ( 430) 0 0 25 4 37 101 0%
2025-11-28T17:45:41+00:00 97s 14 6 85 186 ( 73) 80 ( 348) 0 0 21 4 37 101 0%
2025-11-28T17:30:26+00:00 83s 11 6 85 192 ( 145) 49 ( 625) 0 0 27 4 37 101 0%
2025-11-28T17:15:27+00:00 84s 12 6 85 232 ( 108) 38 ( 440) 0 0 20 4 37 102 0%
2025-11-28T17:00:25+00:00 82s 14 6 85 129 ( 115) 25 ( 390) 0 0 20 4 37 427 0%
2025-11-28T16:45:40+00:00 97s 17 6 85 167 ( 62) 64 ( 350) 0 0 20 4 37 83 0%
2025-11-28T16:30:27+00:00 84s 12 6 85 148 ( 104) 48 ( 345) 0 0 24 4 37 101 0%
2025-11-28T16:15:29+00:00 86s 14 7 84 185 ( 110) 44 ( 440) 0 0 28 4 37 105 0%
2025-11-28T16:00:28+00:00 85s 13 7 84 200 ( 185) 47 ( 397) 0 0 27 4 37 105 0%
2025-11-28T15:45:31+00:00 88s 13 7 84 220 ( 69) 58 ( 350) 0 0 26 4 38 114 0%
2025-11-28T15:30:42+00:00 99s 16 8 83 233 ( 131) 64 ( 408) 0 0 26 4 38 106 0%
2025-11-28T15:15:28+00:00 85s 13 7 84 210 ( 100) 34 ( 400) 0 0 23 4 37 110 0%
2025-11-28T15:00:27+00:00 85s 13 7 84 223 ( 134) 46 ( 643) 0 0 47 4 37 101 0%
2025-11-28T14:45:25+00:00 83s 12 7 84 329 ( 196) 65 ( 365) 0 0 33 4 37 105 0%
2025-11-28T14:30:43+00:00 101s 15 7 84 247 ( 264) 93 ( 536) 0 0 26 4 38 104 0%
2025-11-28T14:15:28+00:00 85s 13 7 84 241 ( 123) 38 ( 420) 0 0 32 4 37 106 0%
2025-11-28T14:00:26+00:00 84s 13 7 84 211 ( 188) 28 ( 400) 0 0 22 4 38 102 0%
2025-11-28T13:45:26+00:00 85s 14 7 84 251 ( 190) 71 ( 382) 0 0 28 4 38 323 0%
2025-11-28T13:30:38+00:00 97s 16 8 83 198 ( 158) 54 ( 350) 0 0 25 4 38 106 0%
2025-11-28T13:15:23+00:00 82s 14 8 83 291 ( 171) 66 ( 722) 0 0 38 4 37 103 0%
2025-11-28T13:00:27+00:00 86s 15 8 83 313 ( 307) 55 ( 679) 0 0 26 4 38 101 0%
2025-11-28T12:45:26+00:00 85s 14 8 83 276 ( 186) 102 ( 381) 0 0 33 4 37 83 0%
2025-11-28T12:30:23+00:00 82s 13 8 83 386 ( 1) 31 ( 430) 0 0 34 4 37 106 0%
2025-11-28T12:15:39+00:00 99s 17 8 83 321 ( 21) 43 ( 410) 0 0 33 4 38 106 0%
2025-11-28T12:00:26+00:00 85s 14 8 83 282 ( 170) 50 ( 667) 0 0 40 4 37 182 0%
2025-11-28T11:45:24+00:00 84s 13 8 83 379 ( 128) 108 ( 458) 0 0 46 4 37 102 0%
2025-11-28T11:30:23+00:00 82s 13 8 83 409 ( 18) 47 ( 379) 0 4 52 4 38 105 0%
2025-11-28T11:15:39+00:00 99s 17 8 83 391 ( 18) 45 ( 453) 0 0 30 4 37 106 0%
2025-11-28T11:00:22+00:00 82s 14 8 83 295 ( 175) 47 ( 452) 0 0 29 4 38 102 0%
2025-11-28T10:45:29+00:00 89s 13 8 83 430 ( 80) 334 ( 761) 0 0 34 4 38 97 0%
2025-11-28T10:30:22+00:00 83s 13 8 83 274 ( 228) 110 ( 750) 0 0 29 4 38 128 0%
2025-11-28T10:15:27+00:00 87s 14 8 83 188 ( 124) 46 ( 400) 0 0 20 4 37 109 0%
2025-11-28T10:00:48+00:00 109s 17 8 83 239 ( 257) 50 ( 625) 0 0 27 4 37 106 0%
2025-11-28T09:45:22+00:00 83s 13 8 83 245 ( 174) 162 ( 485) 0 0 29 4 37 99 0%
2025-11-28T09:30:22+00:00 83s 12 7 84 365 ( 564) 384 ( 823) 2 0 32 4 38 107 0%
2025-11-28T09:15:24+00:00 84s 14 6 85 236 ( 110) 64 ( 643) 0 0 20 4 37 101 0%
2025-11-28T09:00:34+00:00 95s 16 6 85 259 ( 324) 66 ( 2000) 0 3 34 4 37 103 0%
Major LoadDatasets Times Distribution (since last Daily Report):
n = 4, median ~= 90000 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 4
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Major LoadDatasets Times Distribution (since startup):
n = 322, median ~= 90473 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 317
<= 5 min: 5
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since last Daily Report):
n = 0
Minor LoadDatasets Times Distribution (since startup):
n = 9, median ~= 3750 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 1
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 6
<= 10 s: 2
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last major LoadDatasets):
n = 85, median ~= 685 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 1
<= 100 ms: 1
<= 200 ms: 4
<= 500 ms: 28
<= 1 s: 23
<= 2 s: 18
<= 5 s: 8
<= 10 s: 2
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last Daily Report):
n = 416, median ~= 491 ms
0 ms: 8
1 ms: 3
2 ms: 0
<= 5 ms: 3
<= 10 ms: 2
<= 20 ms: 2
<= 50 ms: 17
<= 100 ms: 8
<= 200 ms: 12
<= 500 ms: 158
<= 1 s: 61
<= 2 s: 61
<= 5 s: 42
<= 10 s: 29
<= 20 s: 9
<= 1 min: 1
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since startup):
n = 23503, median ~= 407 ms
0 ms: 1780
1 ms: 942
2 ms: 32
<= 5 ms: 150
<= 10 ms: 85
<= 20 ms: 109
<= 50 ms: 662
<= 100 ms: 1074
<= 200 ms: 506
<= 500 ms: 9276
<= 1 s: 3855
<= 2 s: 1510
<= 5 s: 2322
<= 10 s: 852
<= 20 s: 269
<= 1 min: 25
<= 2 min: 26
<= 5 min: 22
<= 10 min: 3
<= 20 min: 3
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last major LoadDatasets):
n = 92, median ~= 179 ms
0 ms: 0
1 ms: 6
2 ms: 4
<= 5 ms: 3
<= 10 ms: 0
<= 20 ms: 3
<= 50 ms: 14
<= 100 ms: 5
<= 200 ms: 14
<= 500 ms: 19
<= 1 s: 12
<= 2 s: 10
<= 5 s: 2
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last Daily Report):
n = 799, median ~= 142 ms
0 ms: 15
1 ms: 38
2 ms: 16
<= 5 ms: 32
<= 10 ms: 12
<= 20 ms: 31
<= 50 ms: 122
<= 100 ms: 74
<= 200 ms: 141
<= 500 ms: 126
<= 1 s: 40
<= 2 s: 62
<= 5 s: 51
<= 10 s: 32
<= 20 s: 7
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since startup):
n = 55023, median ~= 99 ms
0 ms: 5725
1 ms: 3131
2 ms: 1480
<= 5 ms: 3226
<= 10 ms: 1154
<= 20 ms: 2427
<= 50 ms: 4306
<= 100 ms: 6193
<= 200 ms: 7166
<= 500 ms: 7687
<= 1 s: 3062
<= 2 s: 3698
<= 5 s: 3046
<= 10 s: 1998
<= 20 s: 562
<= 1 min: 89
<= 2 min: 68
<= 5 min: 3
<= 10 min: 0
<= 20 min: 2
<= 1 hr: 0
> 1 hr: 0
TaskThread Failed Time Distribution (since last Daily Report):
n = 0
TaskThread Failed Time Distribution (since startup):
n = 0
TaskThread Succeeded Time Distribution (since last Daily Report):
n = 0
TaskThread Succeeded Time Distribution (since startup):
n = 0
SgtMap topography nFromCache=2 nNotFromCache=19
GSHHS: nCached=100 of 100, nCoarse=692, nSuccesses=381, nTossed=82
NationalBoundaries: nCached=13 of 100, nCoarse=73, nSuccesses=18, nTossed=0
StateBoundaries: nCached=13 of 100, nCoarse=65, nSuccesses=18, nTossed=0
Rivers: nCached=13 of 100, nCoarse=72, nSuccesses=18, nTossed=0
bufferedImage isAccelerated=[unknown]
canonical map sizes: 40819 + 758 + 276 + 1574 + 1017 + 1472 = 45916
canonicalStringHolder map sizes: 63753 + 6050 + 4709 + 532 + 234 + 376 = 75654
Number of threads: Tomcat-waiting=23, inotify=4, other=36
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)
#1 Thread[AsyncFileHandlerWriter-1,5,main] WAITING daemon
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.LinkedBlockingDeque.takeFirst(LinkedBlockingDeque.java:492)
java.util.concurrent.LinkedBlockingDeque.take(LinkedBlockingDeque.java:680)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:750)
#2 Thread[Catalina-utility-1,1,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
java.lang.Thread.run(Thread.java:750)
#3 Thread[Catalina-utility-2,1,main] WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
java.lang.Thread.run(Thread.java:750)
#4 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#5 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#6 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:286)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#7 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:286)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#8 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait0(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:176)
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:286)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#9 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#10 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#11 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#12 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#13 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#14 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#15 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#16 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#17 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#18 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#19 Thread[cluster3-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#20 Thread[cluster3-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#21 Thread[cluster3-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#22 Thread[cluster3-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#23 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#24 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#25 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:750)
#26 Thread[Finalizer,8,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:188)
#27 Thread[GC Daemon,2,system] TIMED_WAITING daemon
java.lang.Object.wait(Native Method)
sun.misc.GC$Daemon.run(GC.java:117)
#28 Thread[http-nio-8080-Acceptor,5,main] RUNNABLE daemon
sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:545)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:71)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129)
java.lang.Thread.run(Thread.java:750)
#29 Thread[http-nio-8080-Poller,5,main] RUNNABLE daemon
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:811)
java.lang.Thread.run(Thread.java:750)
#30 Thread[https-jsse-nio-8443-Acceptor,5,main] RUNNABLE daemon
sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:545)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:71)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129)
java.lang.Thread.run(Thread.java:750)
#31 Thread[https-jsse-nio-8443-Poller,5,main] RUNNABLE daemon
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:811)
java.lang.Thread.run(Thread.java:750)
#32 Thread[Java2D Disposer,10,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
sun.java2d.Disposer.run(Disposer.java:148)
java.lang.Thread.run(Thread.java:750)
#33 Thread[main,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.StandardServer.await(StandardServer.java:524)
org.apache.catalina.startup.Catalina.await(Catalina.java:829)
org.apache.catalina.startup.Catalina.start(Catalina.java:777)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476)
#34 Thread[Reference Handler,10,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.Object.wait(Object.java:502)
java.lang.ref.Reference.tryHandlePending(Reference.java:191)
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
#35 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:288)
#36 Thread[Signal Dispatcher,9,system] RUNNABLE daemon