Serving data from the Marine Institute (Ireland)
Brought to you by the Marine Institute(Ireland)
|
Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland) |
Brought to you by the Marine Institute(Ireland) |
Current time is 2025-05-17T08:49:46+00:00
Startup was at 2025-05-16T07:16:34+00:00
Last major LoadDatasets started 2m 57s ago and finished after 80 seconds.
nGridDatasets = 9
nTableDatasets = 69
nTotalDatasets = 78
n Datasets Failed To Load (in the last major LoadDatasets) = 8
ireland_marine_research_database_charts, imiglenamongarms, imifeeaghco2, imiroughriverarms,
compass_neatl_hindcast_grid, IMI_Model_Stats, spiddal_obs_adcp, IMI_EATL_WAVE, (end)
Unique users (since startup) n = 1546
Response Failed Time (since last major LoadDatasets) n = 13, median ~= 825 ms
Response Failed Time (since last Daily Report) n = 508, median ~= 846 ms
Response Failed Time (since startup) n = 3140, median ~= 678 ms
Response Succeeded Time (since last major LoadDatasets) n = 39, median ~= 750 ms
Response Succeeded Time (since last Daily Report) n = 1536, median ~= 390 ms
Response Succeeded Time (since startup) n = 16190, median ~= 181 ms
TaskThread has finished 0 out of 0 tasks. Currently, no task is running.
TaskThread Failed Time (since last Daily Report) n = 0
TaskThread Failed Time (since startup) n = 0
TaskThread Succeeded Time (since last Daily Report) n = 0
TaskThread Succeeded Time (since startup) n = 0
Number of threads: Tomcat-waiting=19, inotify=4, other=36
MemoryInUse= 346 MB (highWaterMark= 494 MB) (Xmx ~= 5888 MB)
Major LoadDatasets Time Series: MLD Datasets Loaded Requests (median times in ms) Number of Threads MB Open
timestamp time nTry nFail nTotal nSuccess (median) nFail (median) memFail tooMany tomWait inotify other inUse Files
---------------------------- ----- ----------------- ------------------------------------------------ --------------------- ----- -----
2025-05-17T08:48:07+00:00 78s 16 8 78 203 ( 425) 81 ( 881) 0 0 20 4 37 88 0%
2025-05-17T08:33:03+00:00 75s 14 8 78 221 ( 356) 101 ( 466) 2 0 30 4 37 86 0%
2025-05-17T08:18:06+00:00 78s 14 8 78 273 ( 535) 164 ( 831) 2 0 30 4 37 87 0%
2025-05-17T08:03:15+00:00 87s 14 8 78 284 ( 1140) 81 ( 1219) 0 0 30 4 37 87 0%
2025-05-17T07:48:03+00:00 75s 14 8 78 203 ( 218) 45 ( 5938) 0 0 19 4 38 373 0%
2025-05-17T07:33:34+00:00 106s 29 8 78 171 ( 310) 14 ( 100) 0 0 21 4 37 85 0%
2025-05-17T07:19:00+00:00 132s 36 7 79 142 ( 50) 9 ( 33) 0 0 20 4 37 88 0%
2025-05-17T07:03:15+00:00 87s 13 7 79 89 ( 75) 33 ( 768) 0 0 20 4 37 88 0%
2025-05-17T06:48:08+00:00 81s 13 7 79 160 ( 83) 36 ( 2300) 0 0 19 4 38 89 0%
2025-05-17T06:33:01+00:00 73s 15 7 79 214 ( 262) 23 ( 44) 0 0 29 4 37 86 0%
2025-05-17T06:18:06+00:00 78s 12 7 79 173 ( 257) 9 ( 41) 0 0 20 4 37 84 0%
2025-05-17T06:03:12+00:00 85s 14 7 79 157 ( 215) 25 ( 4250) 0 0 20 4 37 86 0%
2025-05-17T05:48:03+00:00 76s 13 7 79 148 ( 186) 55 ( 1417) 0 13 25 4 38 96 0%
2025-05-17T05:33:02+00:00 75s 18 7 79 246 ( 18) 12 ( 50) 0 0 20 4 37 144 0%
2025-05-17T05:17:59+00:00 72s 12 7 79 163 ( 206) 25 ( 607) 0 0 20 4 37 88 0%
2025-05-17T05:03:03+00:00 76s 12 7 79 89 ( 96) 17 ( 275) 0 0 18 4 39 405 0%
2025-05-17T04:48:17+00:00 90s 14 7 79 107 ( 44) 8 ( 37) 0 0 20 4 37 87 0%
2025-05-17T04:32:58+00:00 72s 13 7 79 135 ( 251) 12 ( 50) 0 0 20 4 37 85 0%
2025-05-17T04:18:00+00:00 74s 14 7 79 156 ( 188) 25 ( 7500) 0 0 20 4 37 86 0%
2025-05-17T04:03:00+00:00 74s 12 7 79 87 ( 45) 9 ( 47) 0 0 20 4 37 84 0%
2025-05-17T03:48:14+00:00 88s 14 7 79 167 ( 86) 12 ( 50) 0 0 35 4 38 86 0%
2025-05-17T03:33:01+00:00 75s 15 7 79 122 ( 281) 12 ( 45) 0 0 20 4 37 86 0%
2025-05-17T03:17:59+00:00 74s 14 7 79 113 ( 44) 9 ( 38) 0 0 20 4 37 86 0%
2025-05-17T03:03:03+00:00 77s 12 7 79 89 ( 75) 9 ( 43) 0 0 20 4 37 177 0%
2025-05-17T02:48:05+00:00 79s 12 7 79 113 ( 45) 7 ( 38) 0 0 20 4 37 82 0%
2025-05-17T02:33:19+00:00 93s 15 7 79 141 ( 270) 13 ( 75) 0 0 20 4 37 86 0%
2025-05-17T02:17:59+00:00 74s 14 7 79 165 ( 42) 8 ( 35) 0 0 20 4 37 89 0%
2025-05-17T02:03:00+00:00 75s 12 7 79 94 ( 78) 9 ( 47) 0 0 20 4 37 96 0%
2025-05-17T01:47:58+00:00 73s 12 7 79 104 ( 43) 8 ( 44) 0 0 20 4 37 84 0%
2025-05-17T01:33:14+00:00 90s 15 7 79 150 ( 237) 12 ( 50) 0 0 20 4 37 87 0%
2025-05-17T01:18:00+00:00 76s 13 7 79 150 ( 155) 14 ( 200) 0 0 20 4 37 86 0%
2025-05-17T01:03:00+00:00 76s 14 7 79 102 ( 69) 9 ( 47) 0 0 20 4 37 89 0%
2025-05-17T00:48:04+00:00 81s 12 7 79 117 ( 50) 8 ( 44) 0 0 20 4 37 83 0%
2025-05-17T00:32:58+00:00 75s 14 7 79 133 ( 257) 13 ( 43) 0 0 20 4 37 84 0%
2025-05-17T00:18:14+00:00 90s 15 7 79 118 ( 61) 9 ( 35) 0 0 20 4 37 86 0%
2025-05-17T00:03:03+00:00 80s 14 7 79 117 ( 193) 9 ( 47) 0 0 20 4 37 85 0%
2025-05-16T23:47:59+00:00 76s 12 7 79 101 ( 41) 7 ( 41) 0 0 20 4 37 82 0%
2025-05-16T23:33:02+00:00 79s 15 7 79 143 ( 237) 19 ( 175) 0 0 20 4 37 178 0%
2025-05-16T23:18:10+00:00 86s 13 7 79 121 ( 48) 13 ( 125) 0 0 20 4 37 85 0%
2025-05-16T23:02:57+00:00 74s 12 7 79 101 ( 73) 10 ( 44) 0 0 20 4 37 83 0%
2025-05-16T22:48:01+00:00 78s 15 7 79 127 ( 56) 26 ( 5000) 0 0 20 4 37 85 0%
2025-05-16T22:32:57+00:00 74s 14 7 79 139 ( 241) 12 ( 45) 0 0 20 4 37 86 0%
2025-05-16T22:18:09+00:00 86s 13 7 79 155 ( 98) 11 ( 47) 0 0 20 4 37 85 0%
2025-05-16T22:02:58+00:00 75s 12 7 79 96 ( 183) 10 ( 50) 0 0 20 4 37 85 0%
2025-05-16T21:47:57+00:00 74s 12 7 79 101 ( 47) 10 ( 35) 0 0 20 4 37 83 0%
2025-05-16T21:33:02+00:00 79s 16 7 79 140 ( 260) 16 ( 50) 0 0 20 4 37 83 0%
2025-05-16T21:18:08+00:00 86s 13 7 79 153 ( 35) 8 ( 43) 0 0 20 4 37 85 0%
2025-05-16T21:02:58+00:00 76s 12 7 79 122 ( 288) 26 ( 5000) 0 0 20 4 37 85 0%
2025-05-16T20:48:02+00:00 80s 12 7 79 134 ( 82) 25 ( 5833) 0 0 20 4 37 88 0%
2025-05-16T20:32:59+00:00 77s 14 7 79 164 ( 188) 65 ( 2733) 0 0 20 4 37 85 0%
2025-05-16T20:17:58+00:00 76s 14 7 79 127 ( 49) 10 ( 35) 0 0 20 4 37 84 0%
2025-05-16T20:03:15+00:00 93s 13 7 79 101 ( 97) 23 ( 1500) 0 0 20 4 37 85 0%
2025-05-16T19:47:55+00:00 73s 12 7 79 193 ( 350) 17 ( 48) 0 0 50 4 37 83 0%
2025-05-16T19:32:57+00:00 75s 15 7 79 146 ( 225) 14 ( 100) 0 0 20 4 37 85 0%
2025-05-16T19:17:54+00:00 72s 14 7 79 134 ( 65) 7 ( 46) 0 0 20 4 37 85 0%
2025-05-16T19:02:55+00:00 73s 12 7 79 94 ( 69) 9 ( 47) 0 0 20 4 37 85 0%
2025-05-16T18:48:15+00:00 93s 13 7 79 118 ( 45) 8 ( 44) 0 0 20 4 37 83 0%
2025-05-16T18:32:57+00:00 75s 14 7 79 185 ( 119) 12 ( 45) 0 0 20 4 37 85 0%
2025-05-16T18:17:54+00:00 72s 13 7 79 169 ( 218) 13 ( 44) 0 0 20 4 37 85 0%
2025-05-16T18:02:59+00:00 77s 14 7 79 177 ( 302) 13 ( 75) 0 0 24 4 37 82 0%
2025-05-16T17:47:53+00:00 72s 12 7 79 155 ( 217) 12 ( 41) 0 0 20 4 37 84 0%
2025-05-16T17:33:14+00:00 93s 15 7 79 286 ( 430) 24 ( 380) 0 0 34 4 37 83 0%
2025-05-16T17:17:54+00:00 73s 12 7 79 142 ( 42) 9 ( 43) 0 0 20 4 37 85 0%
2025-05-16T17:02:56+00:00 75s 12 7 79 178 ( 79) 17 ( 46) 0 0 20 4 37 83 0%
2025-05-16T16:48:02+00:00 81s 14 7 79 125 ( 70) 9 ( 46) 0 0 20 4 37 84 0%
2025-05-16T16:33:10+00:00 89s 15 7 79 307 ( 339) 18 ( 150) 0 0 26 4 37 84 0%
2025-05-16T16:17:55+00:00 74s 12 7 79 147 ( 83) 13 ( 28) 0 0 20 4 37 85 0%
2025-05-16T16:02:55+00:00 74s 13 7 79 128 ( 80) 8 ( 40) 0 0 21 4 37 85 0%
2025-05-16T15:47:59+00:00 78s 14 7 79 139 ( 48) 10 ( 41) 0 0 29 4 37 85 0%
2025-05-16T15:32:57+00:00 76s 21 7 79 153 ( 213) 13 ( 88) 0 0 20 4 37 100 0%
2025-05-16T15:18:09+00:00 88s 13 7 79 205 ( 90) 13 ( 88) 0 0 25 4 37 85 0%
2025-05-16T15:02:57+00:00 77s 13 7 79 136 ( 129) 26 ( 4000) 0 0 25 4 37 88 0%
2025-05-16T14:48:01+00:00 81s 14 7 79 125 ( 44) 10 ( 40) 0 0 20 4 37 84 0%
2025-05-16T14:32:56+00:00 75s 14 7 79 215 ( 289) 34 ( 326) 0 0 20 4 37 83 0%
2025-05-16T14:17:55+00:00 75s 12 7 79 213 ( 340) 15 ( 425) 0 0 20 4 37 85 0%
2025-05-16T14:03:12+00:00 92s 13 7 79 139 ( 146) 23 ( 2500) 0 0 19 4 38 293 0%
2025-05-16T13:47:55+00:00 76s 12 7 79 141 ( 47) 11 ( 43) 0 0 20 4 37 91 0%
2025-05-16T13:33:02+00:00 82s 16 7 79 205 ( 303) 17 ( 92) 0 0 20 4 37 82 0%
2025-05-16T13:17:54+00:00 74s 13 7 79 146 ( 43) 8 ( 38) 0 0 20 4 37 82 0%
2025-05-16T13:02:55+00:00 76s 14 8 78 165 ( 141) 26 ( 5000) 0 0 21 4 37 82 0%
2025-05-16T12:48:08+00:00 89s 14 8 78 179 ( 79) 14 ( 46) 0 0 29 4 37 78 0%
2025-05-16T12:32:56+00:00 77s 18 8 78 174 ( 88) 20 ( 25) 0 0 20 4 37 82 0%
2025-05-16T12:17:57+00:00 78s 13 8 78 188 ( 49) 27 ( 4500) 0 0 20 4 37 86 0%
2025-05-16T12:02:55+00:00 76s 16 8 78 223 ( 519) 34 ( 100) 0 0 28 4 37 81 0%
2025-05-16T11:48:06+00:00 88s 14 8 78 218 ( 122) 273 ( 956) 0 0 25 4 37 83 0%
2025-05-16T11:32:57+00:00 78s 18 8 78 175 ( 293) 39 ( 964) 0 0 19 4 38 225 0%
2025-05-16T11:17:53+00:00 74s 13 8 78 183 ( 38) 11 ( 33) 0 0 20 4 37 88 0%
2025-05-16T11:02:54+00:00 75s 13 8 78 171 ( 268) 13 ( 75) 0 0 20 4 37 84 0%
2025-05-16T10:48:04+00:00 86s 14 8 78 180 ( 178) 89 ( 901) 0 0 19 4 38 79 0%
2025-05-16T10:32:54+00:00 76s 15 8 78 189 ( 295) 83 ( 625) 2 0 20 4 37 83 0%
2025-05-16T10:17:59+00:00 81s 15 8 78 182 ( 212) 244 ( 931) 0 0 20 4 37 81 0%
2025-05-16T10:02:53+00:00 75s 13 8 78 202 ( 286) 128 ( 883) 0 0 19 4 38 144 0%
2025-05-16T09:48:04+00:00 86s 14 8 78 126 ( 43) 10 ( 40) 0 0 20 4 37 79 0%
Major LoadDatasets Times Distribution (since last Daily Report):
n = 7, median ~= 95000 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 6
<= 5 min: 1
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Major LoadDatasets Times Distribution (since startup):
n = 103, median ~= 90594 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 101
<= 5 min: 2
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Minor LoadDatasets Times Distribution (since last Daily Report):
n = 0
Minor LoadDatasets Times Distribution (since startup):
n = 2, median ~= 3500 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 0
<= 2 s: 0
<= 5 s: 2
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last major LoadDatasets):
n = 13, median ~= 825 ms
0 ms: 0
1 ms: 0
2 ms: 0
<= 5 ms: 0
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 0
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 0
<= 1 s: 10
<= 2 s: 2
<= 5 s: 1
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since last Daily Report):
n = 508, median ~= 846 ms
0 ms: 0
1 ms: 2
2 ms: 0
<= 5 ms: 0
<= 10 ms: 1
<= 20 ms: 11
<= 50 ms: 63
<= 100 ms: 5
<= 200 ms: 5
<= 500 ms: 59
<= 1 s: 156
<= 2 s: 114
<= 5 s: 52
<= 10 s: 22
<= 20 s: 15
<= 1 min: 3
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Failed Time Distribution (since startup):
n = 3140, median ~= 678 ms
0 ms: 39
1 ms: 32
2 ms: 2
<= 5 ms: 6
<= 10 ms: 11
<= 20 ms: 67
<= 50 ms: 610
<= 100 ms: 96
<= 200 ms: 54
<= 500 ms: 427
<= 1 s: 634
<= 2 s: 583
<= 5 s: 304
<= 10 s: 113
<= 20 s: 110
<= 1 min: 51
<= 2 min: 0
<= 5 min: 1
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last major LoadDatasets):
n = 39, median ~= 750 ms
0 ms: 1
1 ms: 0
2 ms: 0
<= 5 ms: 1
<= 10 ms: 0
<= 20 ms: 0
<= 50 ms: 4
<= 100 ms: 0
<= 200 ms: 0
<= 500 ms: 1
<= 1 s: 25
<= 2 s: 7
<= 5 s: 0
<= 10 s: 0
<= 20 s: 0
<= 1 min: 0
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since last Daily Report):
n = 1536, median ~= 390 ms
0 ms: 30
1 ms: 56
2 ms: 25
<= 5 ms: 55
<= 10 ms: 10
<= 20 ms: 43
<= 50 ms: 240
<= 100 ms: 62
<= 200 ms: 73
<= 500 ms: 275
<= 1 s: 209
<= 2 s: 163
<= 5 s: 180
<= 10 s: 92
<= 20 s: 18
<= 1 min: 5
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
Response Succeeded Time Distribution (since startup):
n = 16190, median ~= 181 ms
0 ms: 446
1 ms: 774
2 ms: 473
<= 5 ms: 903
<= 10 ms: 174
<= 20 ms: 656
<= 50 ms: 3060
<= 100 ms: 873
<= 200 ms: 909
<= 500 ms: 3471
<= 1 s: 1553
<= 2 s: 1365
<= 5 s: 929
<= 10 s: 477
<= 20 s: 92
<= 1 min: 35
<= 2 min: 0
<= 5 min: 0
<= 10 min: 0
<= 20 min: 0
<= 1 hr: 0
> 1 hr: 0
TaskThread Failed Time Distribution (since last Daily Report):
n = 0
TaskThread Failed Time Distribution (since startup):
n = 0
TaskThread Succeeded Time Distribution (since last Daily Report):
n = 0
TaskThread Succeeded Time Distribution (since startup):
n = 0
SgtMap topography nFromCache=2 nNotFromCache=6
GSHHS: nCached=100 of 100, nCoarse=249, nSuccesses=264, nTossed=1
NationalBoundaries: nCached=2 of 100, nCoarse=20, nSuccesses=4, nTossed=0
StateBoundaries: nCached=2 of 100, nCoarse=19, nSuccesses=4, nTossed=0
Rivers: nCached=2 of 100, nCoarse=19, nSuccesses=4, nTossed=0
bufferedImage isAccelerated=[unknown]
canonical map sizes: 138 + 723 + 262 + 1556 + 994 + 1436 = 5109
canonicalStringHolder map sizes: 520 + 756 + 940 + 476 + 199 + 334 = 3225
Number of threads: Tomcat-waiting=19, inotify=4, other=36
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)
#1 Thread[AsyncFileHandlerWriter-1,5,main] WAITING daemon
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.LinkedBlockingDeque.takeFirst(LinkedBlockingDeque.java:492)
java.util.concurrent.LinkedBlockingDeque.take(LinkedBlockingDeque.java:680)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:750)
#2 Thread[Catalina-utility-1,1,main] WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
java.lang.Thread.run(Thread.java:750)
#3 Thread[Catalina-utility-2,1,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
java.lang.Thread.run(Thread.java:750)
#4 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#5 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#6 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#7 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#8 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#9 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#10 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#11 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#12 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#13 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#14 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#15 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#16 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#17 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#18 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#19 Thread[cluster3-nio-worker-0,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#20 Thread[cluster3-nio-worker-1,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#21 Thread[cluster3-nio-worker-2,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#22 Thread[cluster3-nio-worker-3,5,main] RUNNABLE
io.netty.channel.epoll.Native.epollWait(Native Method)
io.netty.channel.epoll.Native.epollWait(Native.java:192)
io.netty.channel.epoll.Native.epollWait(Native.java:185)
io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#23 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#24 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.lang.Thread.run(Thread.java:750)
#25 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:750)
#26 Thread[Finalizer,8,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:188)
#27 Thread[GC Daemon,2,system] TIMED_WAITING daemon
java.lang.Object.wait(Native Method)
sun.misc.GC$Daemon.run(GC.java:117)
#28 Thread[http-nio-8080-Acceptor,5,main] RUNNABLE daemon
sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:545)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:71)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129)
java.lang.Thread.run(Thread.java:750)
#29 Thread[http-nio-8080-Poller,5,main] RUNNABLE daemon
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:811)
java.lang.Thread.run(Thread.java:750)
#30 Thread[https-jsse-nio-8443-Acceptor,5,main] RUNNABLE daemon
sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421)
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:545)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:71)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129)
java.lang.Thread.run(Thread.java:750)
#31 Thread[https-jsse-nio-8443-Poller,5,main] RUNNABLE daemon
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:811)
java.lang.Thread.run(Thread.java:750)
#32 Thread[Java2D Disposer,10,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
sun.java2d.Disposer.run(Disposer.java:148)
java.lang.Thread.run(Thread.java:750)
#33 Thread[main,5,main] TIMED_WAITING
java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.StandardServer.await(StandardServer.java:524)
org.apache.catalina.startup.Catalina.await(Catalina.java:829)
org.apache.catalina.startup.Catalina.start(Catalina.java:777)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476)
#34 Thread[Reference Handler,10,system] WAITING daemon
java.lang.Object.wait(Native Method)
java.lang.Object.wait(Object.java:502)
java.lang.ref.Reference.tryHandlePending(Reference.java:191)
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
#35 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:288)
#36 Thread[Signal Dispatcher,9,system] RUNNABLE daemon