![]() |
Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland) |
Brought to you by the Marine Institute(Ireland) |
Current time is 2026-03-14T12:26:18+00:00
Startup was at 2026-02-24T15:19:09+00:00
Last major LoadDatasets started 2m 51s ago and finished after 85 seconds.
nGridDatasets = 9
nTableDatasets = 77
nTotalDatasets = 86
n Datasets Failed To Load (in the last major LoadDatasets) = 5
ireland_marine_research_database_charts, imifeeaghco2, compass_neatl_hindcast_grid,
IMI_Model_Stats, IMI_EATL_WAVE, (end)
Unique users (since startup) n = 34796
Response Failed Time (since last major LoadDatasets) n = 3, median ~= 1 ms
Response Failed Time (since last Daily Report) n = 1350, median ~= 780 ms
Response Failed Time (since startup) n = 59218, median ~= 375 ms
Response Succeeded Time (since last major LoadDatasets) n = 28, median ~= 44 ms
Response Succeeded Time (since last Daily Report) n = 5485, median ~= 51 ms
Response Succeeded Time (since startup) n = 851465, median ~= 2 ms
TaskThread has finished 0 out of 0 tasks. Currently, no task is running.
TaskThread Failed Time (since last Daily Report) n = 0
TaskThread Failed Time (since startup) n = 0
TaskThread Succeeded Time (since last Daily Report) n = 0
TaskThread Succeeded Time (since startup) n = 0
Number of threads: Tomcat-waiting=19, inotify=4, other=36
MemoryInUse= 1117 MB (highWaterMark= 2467 MB) (Xmx ~= 5888 MB)
Major LoadDatasets Time Series: MLD Datasets Loaded Requests (median times in ms) Number of Threads MB Open
timestamp time nTry nFail nTotal nSuccess (median) nFail (median) memFail tooMany tomWait inotify other inUse Files
---------------------------- ----- ----------------- ------------------------------------------------ --------------------- ----- -----
2026-03-14T12:24:48+00:00 80s 10 5 86 157 ( 18) 7 ( 0) 0 0 20 4 37 128 0%
2026-03-14T12:10:06+00:00 98s 11 5 86 279 ( 73) 25 ( 150) 0 0 19 4 38 125 0%
2026-03-14T11:54:48+00:00 81s 11 5 86 191 ( 27) 15 ( 150) 0 0 20 4 37 127 0%
2026-03-14T11:40:06+00:00 99s 13 5 86 342 ( 112) 29 ( 150) 0 0 31 4 37 123 0%
2026-03-14T11:24:47+00:00 80s 10 5 86 242 ( 200) 24 ( 1250) 0 0 25 4 38 125 0%
2026-03-14T11:09:53+00:00 86s 13 5 86 208 ( 42) 11 ( 1) 0 0 23 4 37 123 0%
2026-03-14T10:54:51+00:00 84s 12 5 86 179 ( 36) 13 ( 43) 0 0 24 4 38 122 0%
2026-03-14T10:40:05+00:00 99s 14 5 86 289 ( 53) 17 ( 35) 0 0 23 4 37 123 0%
2026-03-14T10:24:46+00:00 79s 10 5 86 226 ( 46) 29 ( 12) 0 0 26 4 37 175 0%
2026-03-14T10:09:54+00:00 88s 12 5 86 300 ( 123) 267 ( 812) 0 0 30 4 39 124 0%
2026-03-14T09:54:47+00:00 81s 11 5 86 242 ( 59) 64 ( 588) 0 0 31 4 37 126 0%
2026-03-14T09:39:47+00:00 81s 10 5 86 290 ( 54) 29 ( 525) 0 0 20 4 37 128 0%
2026-03-14T09:25:03+00:00 96s 14 5 86 204 ( 37) 67 ( 789) 0 0 21 4 38 126 0%
2026-03-14T09:09:56+00:00 90s 11 5 86 335 ( 56) 177 ( 809) 2 0 33 4 38 125 0%
2026-03-14T08:54:51+00:00 85s 11 5 86 334 ( 200) 226 ( 857) 0 0 31 4 38 162 0%
2026-03-14T08:39:46+00:00 80s 10 5 86 266 ( 45) 22 ( 0) 0 0 30 4 37 127 0%
2026-03-14T08:25:00+00:00 95s 16 5 86 279 ( 62) 27 ( 875) 0 0 28 4 37 130 0%
2026-03-14T08:09:51+00:00 86s 12 5 86 384 ( 147) 117 ( 1203) 0 0 30 4 37 127 0%
2026-03-14T07:54:50+00:00 84s 13 6 85 256 ( 94) 96 ( 742) 2 0 24 4 40 351 0%
2026-03-14T07:39:49+00:00 84s 12 7 84 260 ( 44) 74 ( 1625) 0 0 26 4 38 385 0%
2026-03-14T07:25:00+00:00 95s 16 7 84 195 ( 32) 11 ( 25) 0 0 23 4 37 128 0%
2026-03-14T07:09:53+00:00 88s 13 7 84 243 ( 39) 31 ( 88) 0 0 25 4 38 130 0%
2026-03-14T06:54:46+00:00 81s 13 7 84 274 ( 79) 14 ( 5) 0 0 33 4 37 127 0%
2026-03-14T06:39:45+00:00 81s 12 7 84 245 ( 41) 37 ( 413) 0 0 26 4 37 130 0%
2026-03-14T06:24:47+00:00 83s 12 7 84 301 ( 183) 20 ( 80) 0 0 42 4 37 133 0%
2026-03-14T06:10:11+00:00 106s 16 7 84 207 ( 46) 31 ( 0) 0 0 21 4 37 145 0%
2026-03-14T05:54:44+00:00 79s 13 7 84 158 ( 30) 10 ( 1) 0 0 22 4 37 131 0%
2026-03-14T05:39:48+00:00 83s 12 7 84 220 ( 42) 20 ( 50) 0 0 21 4 38 128 0%
2026-03-14T05:24:44+00:00 80s 13 7 84 165 ( 26) 25 ( 1250) 0 0 22 4 37 131 0%
2026-03-14T05:10:06+00:00 102s 16 7 84 201 ( 37) 31 ( 938) 0 0 21 4 38 134 0%
2026-03-14T04:54:45+00:00 81s 13 7 84 146 ( 29) 7 ( 4) 0 0 19 4 38 131 0%
2026-03-14T04:39:46+00:00 82s 12 7 84 206 ( 39) 22 ( 225) 0 0 20 4 37 130 0%
2026-03-14T04:24:45+00:00 81s 12 7 84 169 ( 33) 8 ( 1) 0 0 20 4 37 132 0%
2026-03-14T04:09:56+00:00 93s 13 7 84 207 ( 37) 10 ( 1) 0 0 19 4 38 134 0%
2026-03-14T03:55:01+00:00 98s 16 7 84 159 ( 34) 10 ( 1) 0 0 20 4 37 133 0%
2026-03-14T03:39:45+00:00 82s 12 7 84 209 ( 38) 24 ( 200) 0 0 20 4 37 132 0%
2026-03-14T03:24:46+00:00 82s 12 7 84 186 ( 24) 9 ( 75) 0 0 20 4 37 132 0%
2026-03-14T03:09:56+00:00 92s 13 7 84 187 ( 38) 12 ( 1) 0 0 20 4 37 129 0%
2026-03-14T02:55:01+00:00 98s 16 7 84 175 ( 27) 10 ( 1) 0 0 20 4 37 129 0%
2026-03-14T02:39:45+00:00 82s 12 7 84 202 ( 41) 26 ( 221) 0 0 20 4 37 134 0%
2026-03-14T02:24:45+00:00 83s 14 7 84 166 ( 32) 9 ( 1) 0 0 20 4 37 135 0%
2026-03-14T02:09:58+00:00 96s 14 7 84 260 ( 42) 12 ( 1) 0 0 20 4 37 175 0%
2026-03-14T01:54:58+00:00 96s 17 8 83 187 ( 31) 8 ( 20) 0 0 20 4 37 132 0%
2026-03-14T01:39:45+00:00 83s 12 7 84 206 ( 44) 29 ( 262) 0 0 20 4 37 135 0%
2026-03-14T01:24:42+00:00 82s 12 6 85 157 ( 27) 9 ( 0) 0 0 20 4 37 133 0%
2026-03-14T01:09:46+00:00 87s 12 6 85 199 ( 45) 10 ( 0) 0 0 20 4 37 133 0%
2026-03-14T00:55:02+00:00 102s 15 6 85 187 ( 34) 10 ( 10) 0 0 20 4 37 130 0%
2026-03-14T00:39:41+00:00 82s 11 6 85 267 ( 20) 53 ( 1) 0 0 20 4 37 133 0%
2026-03-14T00:24:44+00:00 84s 11 6 85 307 ( 278) 10 ( 1) 0 0 22 4 37 131 0%
2026-03-14T00:09:47+00:00 87s 12 6 85 216 ( 41) 7 ( 35) 0 0 20 4 37 133 0%
2026-03-13T23:54:53+00:00 94s 15 6 85 180 ( 39) 17 ( 28) 0 0 20 4 37 133 0%
2026-03-13T23:39:39+00:00 80s 11 6 85 221 ( 38) 33 ( 253) 0 0 20 4 37 137 0%
2026-03-13T23:24:40+00:00 81s 11 6 85 179 ( 35) 13 ( 43) 0 0 25 4 37 134 0%
2026-03-13T23:09:45+00:00 86s 12 6 85 208 ( 37) 16 ( 63) 0 0 23 4 37 137 0%
2026-03-13T22:54:39+00:00 80s 12 6 85 207 ( 33) 24 ( 200) 0 0 25 4 37 141 0%
2026-03-13T22:39:55+00:00 96s 14 6 85 313 ( 39) 39 ( 261) 0 0 28 4 37 130 0%
2026-03-13T22:24:41+00:00 82s 12 6 85 347 ( 24) 11 ( 15) 0 0 29 4 37 136 0%
2026-03-13T22:09:46+00:00 88s 13 7 84 278 ( 18) 15 ( 0) 0 0 27 4 37 137 0%
2026-03-13T21:54:41+00:00 82s 17 7 84 256 ( 37) 28 ( 1) 0 0 29 4 37 140 0%
2026-03-13T21:39:42+00:00 84s 12 7 84 334 ( 26) 40 ( 284) 0 0 27 4 37 137 0%
2026-03-13T21:24:58+00:00 99s 16 7 84 276 ( 12) 14 ( 1) 0 0 27 4 37 136 0%
2026-03-13T21:09:48+00:00 90s 13 7 84 281 ( 29) 24 ( 1000) 0 0 20 4 37 137 0%
2026-03-13T20:54:41+00:00 83s 13 7 84 197 ( 27) 185 ( 917) 0 0 24 4 37 137 0%
2026-03-13T20:39:38+00:00 80s 12 7 84 231 ( 38) 44 ( 304) 0 0 20 4 37 139 0%
2026-03-13T20:24:55+00:00 97s 15 6 85 204 ( 17) 14 ( 0) 0 0 20 4 37 136 0%
2026-03-13T20:09:41+00:00 83s 11 5 86 269 ( 35) 23 ( 43) 0 0 21 4 37 123 0%
2026-03-13T19:54:38+00:00 81s 11 5 86 225 ( 21) 9 ( 25) 0 0 29 4 37 138 0%
2026-03-13T19:39:39+00:00 81s 10 5 86 267 ( 28) 46 ( 318) 0 0 27 4 37 138 0%
2026-03-13T19:24:39+00:00 81s 10 5 86 213 ( 14) 7 ( 0) 0 0 23 4 37 137 0%
2026-03-13T19:10:01+00:00 103s 15 5 86 246 ( 27) 17 ( 41) 0 0 24 4 38 140 0%
2026-03-13T18:54:41+00:00 84s 11 5 86 323 ( 115) 39 ( 375) 0 0 25 4 37 138 0%
2026-03-13T18:39:38+00:00 81s 10 5 86 492 ( 833) 54 ( 327) 0 0 28 4 37 130 0%
2026-03-13T18:24:43+00:00 86s 10 5 86 434 ( 700) 15 ( 75) 0 0 41 4 38 137 0%
2026-03-13T18:09:58+00:00 101s 14 5 86 269 ( 31) 12 ( 1) 0 0 23 4 38 143 0%
2026-03-13T17:54:38+00:00 81s 11 5 86 220 ( 29) 12 ( 50) 0 0 20 4 37 137 0%
2026-03-13T17:39:38+00:00 82s 12 5 86 306 ( 45) 64 ( 388) 0 0 32 4 37 135 0%
2026-03-13T17:24:41+00:00 85s 12 5 86 253 ( 42) 11 ( 4) 0 0 27 4 37 135 0%
2026-03-13T17:10:00+00:00 104s 14 5 86 369 ( 51) 25 ( 44) 0 0 31 4 39 151 0%
2026-03-13T16:54:37+00:00 80s 11 5 86 278 ( 34) 16 ( 300) 0 0 23 4 37 135 0%
2026-03-13T16:39:40+00:00 84s 11 5 86 299 ( 31) 48 ( 282) 0 0 20 4 37 134 0%
2026-03-13T16:24:40+00:00 84s 10 5 86 212 ( 30) 10 ( 1) 0 0 15 4 42 438 0%
2026-03-13T16:09:46+00:00 90s 11 5 86 270 ( 38) 12 ( 150) 0 0 30 4 37 137 0%
2026-03-13T15:55:35+00:00 139s 28 5 86 253 ( 42) 26 ( 10) 0 0 24 4 38 137 0%
2026-03-13T15:39:33+00:00 78s 9 5 86 196 ( 41) 42 ( 332) 0 0 20 4 37 138 0%
2026-03-13T15:25:41+00:00 146s 37 5 86 233 ( 24) 16 ( 1) 0 0 21 4 37 135 0%
2026-03-13T15:09:48+00:00 92s 11 5 86 230 ( 40) 22 ( 100) 0 0 26 4 37 138 0%
2026-03-13T14:54:45+00:00 90s 12 5 86 187 ( 39) 18 ( 250) 0 0 20 4 37 139 0%
2026-03-13T14:39:54+00:00 99s 14 5 86 302 ( 47) 64 ( 305) 0 0 31 4 38 181 0%
2026-03-13T14:24:35+00:00 80s 11 6 85 213 ( 38) 21 ( 150) 0 0 20 4 37 132 0%
2026-03-13T14:09:45+00:00 90s 13 6 85 415 ( 73) 27 ( 1300) 0 0 32 4 37 137 0%
2026-03-13T13:54:37+00:00 83s 12 5 86 346 ( 69) 17 ( 13) 0 0 21 4 37 139 0%
2026-03-13T13:39:51+00:00 97s 13 5 86 341 ( 80) 49 ( 323) 0 0 23 4 38 148 0%
2026-03-13T13:24:34+00:00 80s 11 5 86 239 ( 45) 20 ( 1) 0 0 20 4 37 139 0%
Major LoadDatasets Times Distribution (since last Daily Report):
n = 21, median ~= 90000 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 21
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Major LoadDatasets Times Distribution (since startup):
n = 1717, median ~= 91180 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 1652
<= 5 min: 60
<= 10 min: 5
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since last Daily Report):
n = 0
Minor LoadDatasets Times Distribution (since startup):
n = 60, median ~= 3556 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 1
<= 200 ms: 2
<= 500 ms: 4
<= 1 s: 5
<= 2 s: 4
<= 5 s: 27
<= 10 s: 13
<= 20 s: 0
<= 1 min: 3
<= 2 min: 1
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last major LoadDatasets):
n = 3, median ~= 1 ms
0 ms: 0
1 ms: 2
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 1
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last Daily Report):
n = 1350, median ~= 780 ms
0 ms: 103
1 ms: 49
2 ms: 3
<= 5 ms: 4
<= 10 ms: 1
<= 20 ms: 12
<= 50 ms: 63
<= 100 ms: 28
<= 200 ms: 33
<= 500 ms: 100
<= 1 s: 498
<= 2 s: 276
<= 5 s: 128
<= 10 s: 46
<= 20 s: 6
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since startup):
n = 59218, median ~= 375 ms
0 ms: 8059
1 ms: 4703
2 ms: 309
<= 5 ms: 1205
<= 10 ms: 593
<= 20 ms: 590
<= 50 ms: 3770
<= 100 ms: 2827
<= 200 ms: 2318
<= 500 ms: 8994
<= 1 s: 10868
<= 2 s: 5674
<= 5 s: 5270
<= 10 s: 3001
<= 20 s: 588
<= 1 min: 114
<= 2 min: 29
<= 5 min: 301
<= 10 min: 3
<= 20 min: 2
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last major LoadDatasets):
n = 28, median ~= 44 ms
0 ms: 2
1 ms: 2
2 ms: 0
<= 5 ms: 1
<= 10 ms: 2
<= 20 ms: 3
<= 50 ms: 5
<= 100 ms: 3
<= 200 ms: 4
<= 500 ms: 2
<= 1 s: 2
<= 2 s: 1
<= 5 s: 1
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last Daily Report):
n = 5485, median ~= 51 ms
0 ms: 649
1 ms: 236
2 ms: 93
<= 5 ms: 227
<= 10 ms: 80
<= 20 ms: 339
<= 50 ms: 1108
<= 100 ms: 373
<= 200 ms: 418
<= 500 ms: 496
<= 1 s: 513
<= 2 s: 370
<= 5 s: 415
<= 10 s: 158
<= 20 s: 7
<= 1 min: 2
<= 2 min: 0
<= 5 min: 1
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since startup):
n = 851465, median ~= 2 ms
0 ms: 323589
1 ms: 74355
2 ms: 23822
<= 5 ms: 38678
<= 10 ms: 18796
<= 20 ms: 40776
<= 50 ms: 79190
<= 100 ms: 28619
<= 200 ms: 34909
<= 500 ms: 74043
<= 1 s: 42379
<= 2 s: 33959
<= 5 s: 25813
<= 10 s: 10884
<= 20 s: 1173
<= 1 min: 340
<= 2 min: 99
<= 5 min: 34
<= 10 min: 3
<= 20 min: 3
<= 1 hr: 1
> 1 hr: 0
TaskThread Failed Time Distribution (since last Daily Report):
n = 0
TaskThread Failed Time Distribution (since startup):
n = 0
TaskThread Succeeded Time Distribution (since last Daily Report):
n = 0
TaskThread Succeeded Time Distribution (since startup):
n = 0
SgtMap topography nFromCache=59 nNotFromCache=296
GSHHS: nCached=100 of 100, nCoarse=3087, nSuccesses=1816, nTossed=1425
NationalBoundaries: nCached=100 of 100, nCoarse=394, nSuccesses=288, nTossed=171
StateBoundaries: nCached=100 of 100, nCoarse=323, nSuccesses=288, nTossed=171
Rivers: nCached=100 of 100, nCoarse=369, nSuccesses=288, nTossed=171
bufferedImage isAccelerated=[unknown]
canonical map sizes: 997 + 1006 + 497 + 1573 + 1017 + 1472 = 6562
canonicalStringHolder map sizes: 1919 + 1407 + 1608 + 812 + 404 + 711 = 6861
Number of threads: Tomcat-waiting=19, inotify=4, other=36
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)
#1 Thread[AsyncFileHandlerWriter-1,5,main] WAITING daemon
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.LinkedBlockingDeque.takeFirst(LinkedBlockingDeque.java:492)
java.util.concurrent.LinkedBlockingDeque.take(LinkedBlockingDeque.java:680)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:750)
#2 Thread[Catalina-utility-1,1,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
java.lang.Thread.run(Thread.java:750)
#3 Thread[Catalina-utility-2,1,main] WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
java.lang.Thread.run(Thread.java:750)
#4 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#5 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#6 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#7 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#8 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#9 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#10 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#11 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#12 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#13 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#14 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#15 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#16 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#17 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#18 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#19 Thread[cluster3-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#20 Thread[cluster3-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#21 Thread[cluster3-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#22 Thread[cluster3-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#23 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#24 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#25 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:750)
#26 Thread[Finalizer,8,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:188)
#27 Thread[GC Daemon,2,system] TIMED_WAITING daemon
java.lang.Object.wait(Native Method)
sun.misc.GC$Daemon.run(GC.java:117)
#28 Thread[http-nio-8080-Acceptor,5,main] RUNNABLE daemon
sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:566)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:69)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:128)
java.lang.Thread.run(Thread.java:750)
#29 Thread[http-nio-8080-Poller,5,main] RUNNABLE daemon
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:831)
java.lang.Thread.run(Thread.java:750)
#30 Thread[https-jsse-nio-8443-Acceptor,5,main] RUNNABLE daemon
sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:566)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:69)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:128)
java.lang.Thread.run(Thread.java:750)
#31 Thread[https-jsse-nio-8443-Poller,5,main] RUNNABLE daemon
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:831)
java.lang.Thread.run(Thread.java:750)
#32 Thread[Java2D Disposer,10,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
sun.java2d.Disposer.run(Disposer.java:148)
java.lang.Thread.run(Thread.java:750)
#33 Thread[main,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.StandardServer.await(StandardServer.java:522)
org.apache.catalina.startup.Catalina.await(Catalina.java:826)
org.apache.catalina.startup.Catalina.start(Catalina.java:774)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:342)
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:473)
#34 Thread[Reference Handler,10,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.Object.wait(Object.java:502)
java.lang.ref.Reference.tryHandlePending(Reference.java:191)
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
#35 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:288)
#36 Thread[Signal Dispatcher,9,system] RUNNABLE daemon