![]() |
Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland) |
Brought to you by the Marine Institute(Ireland) |
Current time is 2025-07-14T20:00:38+00:00 Startup was at 2025-05-29T07:16:55+00:00 Last major LoadDatasets started 4m 53s ago and finished after 80 seconds. nGridDatasets = 9 nTableDatasets = 72 nTotalDatasets = 81 n Datasets Failed To Load (in the last major LoadDatasets) = 6 ireland_marine_research_database_charts, imifeeaghco2, imiroughriverarms, compass_neatl_hindcast_grid, IMI_Model_Stats, IMI_EATL_WAVE, (end) Unique users (since startup) n = 135980 Response Failed Time (since last major LoadDatasets) n = 8, median ~= 28 ms Response Failed Time (since last Daily Report) n = 12347, median ~= 446 ms Response Failed Time (since startup) n = 182759, median ~= 551 ms Response Succeeded Time (since last major LoadDatasets) n = 52, median ~= 90 ms Response Succeeded Time (since last Daily Report) n = 14233, median ~= 238 ms Response Succeeded Time (since startup) n = 873783, median ~= 195 ms TaskThread has finished 0 out of 0 tasks. Currently, no task is running. TaskThread Failed Time (since last Daily Report) n = 0 TaskThread Failed Time (since startup) n = 0 TaskThread Succeeded Time (since last Daily Report) n = 0 TaskThread Succeeded Time (since startup) n = 0 Number of threads: Tomcat-waiting=22, inotify=4, other=36 MemoryInUse= 2010 MB (highWaterMark= 3426 MB) (Xmx ~= 5888 MB) Major LoadDatasets Time Series: MLD Datasets Loaded Requests (median times in ms) Number of Threads MB Open timestamp time nTry nFail nTotal nSuccess (median) nFail (median) memFail tooMany tomWait inotify other inUse Files ---------------------------- ----- ----------------- ------------------------------------------------ --------------------- ----- ----- 2025-07-14T19:57:02+00:00 77s 11 6 81 201 ( 267) 27 ( 45) 0 0 28 4 37 234 0% 2025-07-14T19:42:03+00:00 78s 12 6 81 287 ( 238) 24 ( 40) 0 0 21 4 37 234 0% 2025-07-14T19:27:20+00:00 95s 14 6 81 167 ( 135) 28 ( 44) 0 0 21 4 37 237 0% 2025-07-14T19:12:02+00:00 78s 11 6 81 206 ( 70) 21 ( 37) 0 0 21 4 37 248 0% 2025-07-14T18:57:03+00:00 78s 13 6 81 188 ( 257) 18 ( 37) 0 0 21 4 37 230 0% 2025-07-14T18:42:00+00:00 76s 12 6 81 299 ( 223) 41 ( 369) 0 0 23 4 37 238 0% 2025-07-14T18:27:06+00:00 81s 11 6 81 224 ( 378) 27 ( 1500) 0 0 47 4 37 236 0% 2025-07-14T18:12:24+00:00 100s 14 6 81 254 ( 111) 32 ( 32) 0 0 28 4 40 570 0% 2025-07-14T17:57:06+00:00 82s 12 6 81 183 ( 279) 14 ( 31) 0 0 23 4 37 239 0% 2025-07-14T17:42:02+00:00 78s 13 6 81 313 ( 238) 29 ( 69) 0 0 20 4 37 485 0% 2025-07-14T17:27:08+00:00 84s 11 6 81 166 ( 220) 16 ( 37) 0 0 22 4 37 240 0% 2025-07-14T17:12:17+00:00 94s 20 6 81 215 ( 52) 18 ( 30) 0 0 20 4 37 234 0% 2025-07-14T16:57:04+00:00 80s 12 6 81 181 ( 196) 27 ( 75) 0 0 20 4 37 235 0% 2025-07-14T16:42:01+00:00 77s 12 6 81 313 ( 157) 27 ( 40) 0 0 24 4 37 236 0% 2025-07-14T16:27:06+00:00 83s 12 6 81 284 ( 99) 28 ( 200) 0 0 30 4 37 240 0% 2025-07-14T16:12:15+00:00 91s 14 6 81 275 ( 104) 29 ( 44) 0 0 27 4 37 236 0% 2025-07-14T15:57:05+00:00 81s 12 6 81 228 ( 244) 31 ( 294) 0 0 28 4 37 238 0% 2025-07-14T15:41:59+00:00 76s 12 6 81 332 ( 294) 30 ( 50) 0 0 19 4 38 233 0% 2025-07-14T15:27:06+00:00 83s 11 5 82 240 ( 332) 28 ( 200) 0 0 27 4 37 236 0% 2025-07-14T15:12:00+00:00 77s 10 5 82 256 ( 252) 23 ( 35) 0 0 32 4 37 236 0% 2025-07-14T14:57:16+00:00 93s 14 5 82 178 ( 200) 23 ( 58) 0 0 27 4 37 233 0% 2025-07-14T14:41:59+00:00 76s 11 5 82 329 ( 273) 39 ( 335) 0 0 21 4 38 231 0% 2025-07-14T14:27:08+00:00 85s 10 5 82 291 ( 234) 35 ( 48) 0 0 27 4 37 233 0% 2025-07-14T14:12:00+00:00 77s 11 5 82 514 ( 274) 41 ( 21) 0 0 37 4 37 235 0% 2025-07-14T13:57:18+00:00 95s 14 5 82 280 ( 150) 28 ( 1) 0 0 27 4 37 243 0% 2025-07-14T13:42:02+00:00 79s 15 5 82 359 ( 229) 27 ( 49) 0 0 27 4 37 233 0% 2025-07-14T13:27:11+00:00 88s 10 5 82 294 ( 215) 28 ( 100) 0 0 29 4 37 252 0% 2025-07-14T13:11:59+00:00 77s 11 5 82 298 ( 220) 34 ( 41) 0 0 24 4 37 230 0% 2025-07-14T12:57:15+00:00 93s 13 5 82 257 ( 92) 15 ( 32) 0 0 24 4 37 232 0% 2025-07-14T12:41:59+00:00 77s 12 5 82 422 ( 248) 41 ( 221) 0 0 31 4 37 238 0% 2025-07-14T12:27:05+00:00 83s 11 5 82 425 ( 350) 70 ( 5000) 0 0 37 4 37 233 0% 2025-07-14T12:11:59+00:00 77s 10 5 82 339 ( 232) 30 ( 31) 0 0 32 4 37 235 0% 2025-07-14T11:57:14+00:00 93s 14 5 82 239 ( 245) 20 ( 30) 0 0 25 4 37 478 0% 2025-07-14T11:41:58+00:00 77s 12 5 82 381 ( 300) 61 ( 286) 0 0 30 4 37 231 0% 2025-07-14T11:27:04+00:00 83s 10 5 82 326 ( 342) 59 ( 463) 0 0 38 4 37 237 0% 2025-07-14T11:11:58+00:00 78s 10 5 82 254 ( 142) 27 ( 42) 0 0 27 4 37 242 0% 2025-07-14T10:57:13+00:00 92s 13 5 82 460 ( 446) 40 ( 750) 0 0 28 4 37 235 0% 2025-07-14T10:42:01+00:00 81s 11 5 82 339 ( 246) 68 ( 318) 0 0 30 4 37 264 0% 2025-07-14T10:27:01+00:00 81s 11 5 82 391 ( 406) 362 ( 786) 0 0 28 4 37 238 0% 2025-07-14T10:11:58+00:00 77s 10 5 82 323 ( 43) 1080 ( 481) 0 0 44 4 39 239 0% 2025-07-14T09:57:13+00:00 93s 13 5 82 207 ( 194) 988 ( 488) 0 0 43 4 40 237 0% 2025-07-14T09:42:18+00:00 98s 16 5 82 312 ( 286) 932 ( 403) 0 0 43 4 40 238 0% 2025-07-14T09:27:01+00:00 80s 11 5 82 190 ( 49) 863 ( 410) 0 0 34 4 39 237 0% 2025-07-14T09:11:56+00:00 76s 10 5 82 241 ( 168) 897 ( 484) 0 0 34 4 39 233 0% 2025-07-14T08:56:58+00:00 78s 11 5 82 232 ( 180) 967 ( 480) 0 0 33 4 40 235 0% 2025-07-14T08:42:16+00:00 96s 13 5 82 317 ( 299) 901 ( 444) 2 0 32 4 41 402 0% 2025-07-14T08:27:00+00:00 80s 13 5 82 151 ( 92) 272 ( 422) 0 0 25 4 38 236 0% 2025-07-14T08:11:59+00:00 80s 11 5 82 253 ( 166) 1168 ( 530) 0 0 46 4 41 239 0% 2025-07-14T07:57:06+00:00 87s 13 5 82 259 ( 454) 908 ( 442) 0 0 48 4 39 244 0% 2025-07-14T07:42:12+00:00 93s 13 5 82 191 ( 94) 819 ( 401) 0 0 48 4 39 240 0% 2025-07-14T07:28:06+00:00 147s 38 5 82 317 ( 370) 978 ( 533) 0 0 48 4 39 244 0% 2025-07-14T07:11:58+00:00 79s 11 5 82 362 ( 648) 924 ( 390) 0 0 47 4 40 282 0% 2025-07-14T06:56:59+00:00 80s 11 5 82 286 ( 476) 1236 ( 662) 2 0 49 4 38 505 0% 2025-07-14T06:42:11+00:00 93s 12 5 82 391 ( 296) 1252 ( 535) 1 0 27 4 43 507 0% 2025-07-14T06:26:59+00:00 80s 10 5 82 207 ( 339) 790 ( 437) 0 0 27 4 39 231 0% 2025-07-14T06:12:00+00:00 81s 12 5 82 207 ( 69) 707 ( 405) 0 0 23 4 40 235 0% 2025-07-14T05:56:58+00:00 80s 11 5 82 177 ( 253) 36 ( 10) 0 0 26 4 37 235 0% 2025-07-14T05:41:55+00:00 77s 11 5 82 240 ( 247) 27 ( 41) 0 0 20 4 37 237 0% 2025-07-14T05:27:13+00:00 95s 11 5 82 167 ( 263) 40 ( 371) 0 0 20 4 37 236 0% 2025-07-14T05:11:55+00:00 77s 10 5 82 167 ( 84) 19 ( 37) 0 0 17 4 40 791 0% 2025-07-14T04:57:00+00:00 82s 13 5 82 180 ( 160) 17 ( 37) 0 0 29 4 37 235 0% 2025-07-14T04:41:55+00:00 77s 11 5 82 247 ( 231) 24 ( 41) 0 0 20 4 37 242 0% 2025-07-14T04:26:57+00:00 79s 11 5 82 123 ( 246) 14 ( 35) 0 0 20 4 37 241 0% 2025-07-14T04:12:10+00:00 93s 11 5 82 211 ( 108) 22 ( 33) 0 0 29 4 37 236 0% 2025-07-14T03:56:58+00:00 81s 13 5 82 157 ( 232) 15 ( 37) 0 0 21 4 37 238 0% 2025-07-14T03:42:03+00:00 86s 12 5 82 241 ( 255) 28 ( 63) 0 0 23 4 37 240 0% 2025-07-14T03:26:59+00:00 81s 11 5 82 136 ( 234) 15 ( 37) 0 0 20 4 37 240 0% 2025-07-14T03:12:08+00:00 91s 12 5 82 167 ( 84) 18 ( 35) 0 0 20 4 37 237 0% 2025-07-14T02:56:56+00:00 79s 14 5 82 141 ( 231) 17 ( 38) 0 0 20 4 37 232 0% 2025-07-14T02:41:56+00:00 79s 12 6 81 242 ( 259) 25 ( 46) 0 0 18 4 39 699 0% 2025-07-14T02:26:58+00:00 81s 11 6 81 114 ( 223) 14 ( 35) 0 0 20 4 37 236 0% 2025-07-14T02:12:08+00:00 92s 12 6 81 325 ( 89) 24 ( 38) 0 0 33 4 38 216 0% 2025-07-14T01:56:58+00:00 81s 15 6 81 156 ( 217) 15 ( 37) 0 0 20 4 37 238 0% 2025-07-14T01:41:55+00:00 78s 14 7 80 227 ( 242) 24 ( 41) 0 0 20 4 37 236 0% 2025-07-14T01:26:57+00:00 81s 13 7 80 120 ( 237) 14 ( 40) 0 0 20 4 37 236 0% 2025-07-14T01:11:55+00:00 79s 12 7 80 172 ( 88) 19 ( 34) 0 0 19 4 38 235 0% 2025-07-14T00:57:10+00:00 94s 15 7 80 153 ( 224) 14 ( 35) 0 0 20 4 37 237 0% 2025-07-14T00:41:52+00:00 76s 11 5 82 238 ( 258) 25 ( 40) 0 0 20 4 37 233 0% 2025-07-14T00:26:59+00:00 83s 12 5 82 131 ( 255) 15 ( 38) 0 0 20 4 37 237 0% 2025-07-14T00:11:55+00:00 79s 11 5 82 205 ( 93) 21 ( 31) 0 0 20 4 37 239 0% 2025-07-13T23:57:14+00:00 98s 13 5 82 145 ( 178) 16 ( 39) 0 0 20 4 37 236 0% 2025-07-13T23:41:54+00:00 79s 18 5 82 241 ( 250) 22 ( 42) 0 0 20 4 37 237 0% 2025-07-13T23:26:59+00:00 83s 11 6 81 137 ( 177) 14 ( 35) 0 0 20 4 37 238 0% 2025-07-13T23:11:57+00:00 82s 12 6 81 165 ( 49) 23 ( 41) 0 0 20 4 37 239 0% 2025-07-13T22:57:05+00:00 90s 14 6 81 134 ( 221) 15 ( 35) 0 0 20 4 37 243 0% 2025-07-13T22:41:53+00:00 78s 12 6 81 238 ( 258) 22 ( 42) 0 0 20 4 37 236 0% 2025-07-13T22:26:56+00:00 81s 11 6 81 130 ( 200) 15 ( 35) 0 0 20 4 37 235 0% 2025-07-13T22:11:53+00:00 78s 12 6 81 201 ( 99) 26 ( 43) 0 0 20 4 37 236 0% 2025-07-13T21:57:07+00:00 92s 14 6 81 143 ( 258) 14 ( 35) 0 0 20 4 37 240 0% 2025-07-13T21:41:53+00:00 78s 12 6 81 258 ( 252) 32 ( 63) 0 0 20 4 37 236 0% 2025-07-13T21:27:00+00:00 85s 11 6 81 147 ( 253) 14 ( 37) 0 0 20 4 37 237 0% 2025-07-13T21:11:52+00:00 77s 11 6 81 188 ( 106) 408 ( 571) 0 0 27 4 37 235 0% 2025-07-13T20:56:53+00:00 79s 13 6 81 183 ( 346) 22 ( 46) 0 0 22 4 37 238 0% Major LoadDatasets Times Distribution (since last Daily Report): n = 51, median ~= 90600 ms 0 ms: 0 1 ms: 0 2 ms: 0 <= 5 ms: 0 <= 10 ms: 0 <= 20 ms: 0 <= 50 ms: 0 <= 100 ms: 0 <= 200 ms: 0 <= 500 ms: 0 <= 1 s: 0 <= 2 s: 0 <= 5 s: 0 <= 10 s: 0 <= 20 s: 0 <= 1 min: 0 <= 2 min: 50 <= 5 min: 1 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Major LoadDatasets Times Distribution (since startup): n = 4467, median ~= 90758 ms 0 ms: 0 1 ms: 0 2 ms: 0 <= 5 ms: 0 <= 10 ms: 0 <= 20 ms: 0 <= 50 ms: 0 <= 100 ms: 0 <= 200 ms: 0 <= 500 ms: 0 <= 1 s: 0 <= 2 s: 0 <= 5 s: 1 <= 10 s: 0 <= 20 s: 0 <= 1 min: 1 <= 2 min: 4353 <= 5 min: 95 <= 10 min: 15 <= 20 min: 2 <= 1 hr: 0 > 1 hr: 0 Minor LoadDatasets Times Distribution (since last Daily Report): n = 1, median ~= 7500 ms 0 ms: 0 1 ms: 0 2 ms: 0 <= 5 ms: 0 <= 10 ms: 0 <= 20 ms: 0 <= 50 ms: 0 <= 100 ms: 0 <= 200 ms: 0 <= 500 ms: 0 <= 1 s: 0 <= 2 s: 0 <= 5 s: 0 <= 10 s: 1 <= 20 s: 0 <= 1 min: 0 <= 2 min: 0 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Minor LoadDatasets Times Distribution (since startup): n = 155, median ~= 2750 ms 0 ms: 0 1 ms: 0 2 ms: 0 <= 5 ms: 0 <= 10 ms: 0 <= 20 ms: 0 <= 50 ms: 0 <= 100 ms: 1 <= 200 ms: 13 <= 500 ms: 39 <= 1 s: 6 <= 2 s: 0 <= 5 s: 74 <= 10 s: 20 <= 20 s: 2 <= 1 min: 0 <= 2 min: 0 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Response Failed Time Distribution (since last major LoadDatasets): n = 8, median ~= 28 ms 0 ms: 2 1 ms: 0 2 ms: 0 <= 5 ms: 0 <= 10 ms: 0 <= 20 ms: 1 <= 50 ms: 4 <= 100 ms: 1 <= 200 ms: 0 <= 500 ms: 0 <= 1 s: 0 <= 2 s: 0 <= 5 s: 0 <= 10 s: 0 <= 20 s: 0 <= 1 min: 0 <= 2 min: 0 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Response Failed Time Distribution (since last Daily Report): n = 12347, median ~= 446 ms 0 ms: 1031 1 ms: 649 2 ms: 5 <= 5 ms: 24 <= 10 ms: 19 <= 20 ms: 42 <= 50 ms: 526 <= 100 ms: 79 <= 200 ms: 791 <= 500 ms: 3673 <= 1 s: 3346 <= 2 s: 1257 <= 5 s: 669 <= 10 s: 175 <= 20 s: 57 <= 1 min: 4 <= 2 min: 0 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Response Failed Time Distribution (since startup): n = 182759, median ~= 551 ms 0 ms: 12335 1 ms: 5613 2 ms: 151 <= 5 ms: 1421 <= 10 ms: 732 <= 20 ms: 2975 <= 50 ms: 27346 <= 100 ms: 6793 <= 200 ms: 5908 <= 500 ms: 25323 <= 1 s: 27512 <= 2 s: 31162 <= 5 s: 22841 <= 10 s: 7032 <= 20 s: 3546 <= 1 min: 939 <= 2 min: 226 <= 5 min: 891 <= 10 min: 9 <= 20 min: 3 <= 1 hr: 1 > 1 hr: 0 Response Succeeded Time Distribution (since last major LoadDatasets): n = 52, median ~= 90 ms 0 ms: 2 1 ms: 1 2 ms: 1 <= 5 ms: 1 <= 10 ms: 1 <= 20 ms: 1 <= 50 ms: 15 <= 100 ms: 5 <= 200 ms: 10 <= 500 ms: 11 <= 1 s: 3 <= 2 s: 0 <= 5 s: 0 <= 10 s: 0 <= 20 s: 1 <= 1 min: 0 <= 2 min: 0 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Response Succeeded Time Distribution (since last Daily Report): n = 14233, median ~= 238 ms 0 ms: 246 1 ms: 446 2 ms: 225 <= 5 ms: 509 <= 10 ms: 145 <= 20 ms: 599 <= 50 ms: 2508 <= 100 ms: 998 <= 200 ms: 917 <= 500 ms: 4141 <= 1 s: 1067 <= 2 s: 615 <= 5 s: 1327 <= 10 s: 398 <= 20 s: 78 <= 1 min: 11 <= 2 min: 0 <= 5 min: 3 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Response Succeeded Time Distribution (since startup): n = 873783, median ~= 195 ms 0 ms: 25827 1 ms: 36757 2 ms: 18186 <= 5 ms: 37681 <= 10 ms: 10031 <= 20 ms: 40238 <= 50 ms: 156112 <= 100 ms: 48713 <= 200 ms: 66510 <= 500 ms: 216307 <= 1 s: 72424 <= 2 s: 65480 <= 5 s: 51501 <= 10 s: 18407 <= 20 s: 4468 <= 1 min: 4469 <= 2 min: 487 <= 5 min: 108 <= 10 min: 57 <= 20 min: 11 <= 1 hr: 9 > 1 hr: 0 TaskThread Failed Time Distribution (since last Daily Report): n = 0 TaskThread Failed Time Distribution (since startup): n = 0 TaskThread Succeeded Time Distribution (since last Daily Report): n = 0 TaskThread Succeeded Time Distribution (since startup): n = 0 SgtMap topography nFromCache=77 nNotFromCache=609 GSHHS: nCached=100 of 100, nCoarse=7662, nSuccesses=2505, nTossed=1896 NationalBoundaries: nCached=100 of 100, nCoarse=989, nSuccesses=367, nTossed=120 StateBoundaries: nCached=100 of 100, nCoarse=804, nSuccesses=362, nTossed=100 Rivers: nCached=100 of 100, nCoarse=892, nSuccesses=367, nTossed=120 bufferedImage isAccelerated=[unknown] canonical map sizes: 40787 + 736 + 267 + 1564 + 1012 + 1466 = 45832 canonicalStringHolder map sizes: 63600 + 6132 + 4459 + 479 + 215 + 339 = 75224 Number of threads: Tomcat-waiting=22, inotify=4, other=36 (format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus) #1 Thread[AsyncFileHandlerWriter-1,5,main] WAITING daemon sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingDeque.takeFirst(LinkedBlockingDeque.java:492) java.util.concurrent.LinkedBlockingDeque.take(LinkedBlockingDeque.java:680) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) #2 Thread[Catalina-utility-1,1,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63) java.lang.Thread.run(Thread.java:750) #3 Thread[Catalina-utility-2,1,main] WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63) java.lang.Thread.run(Thread.java:750) #4 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #5 Thread[cluster1-nio-worker-0,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #6 Thread[cluster1-nio-worker-1,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #7 Thread[cluster1-nio-worker-2,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #8 Thread[cluster1-nio-worker-3,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #9 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #10 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING java.lang.Thread.sleep(Native Method) io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569) io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #11 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #12 Thread[cluster2-nio-worker-0,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #13 Thread[cluster2-nio-worker-1,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #14 Thread[cluster2-nio-worker-2,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #15 Thread[cluster2-nio-worker-3,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #16 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #17 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING java.lang.Thread.sleep(Native Method) io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569) io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #18 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #19 Thread[cluster3-nio-worker-0,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #20 Thread[cluster3-nio-worker-1,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #21 Thread[cluster3-nio-worker-2,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #22 Thread[cluster3-nio-worker-3,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #23 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #24 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING java.lang.Thread.sleep(Native Method) io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569) io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #25 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) #26 Thread[Finalizer,8,system] WAITING daemon java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:188) #27 Thread[GC Daemon,2,system] TIMED_WAITING daemon java.lang.Object.wait(Native Method) sun.misc.GC$Daemon.run(GC.java:117) #28 Thread[http-nio-8080-Acceptor,5,main] RUNNABLE daemon sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:545) org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:71) org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129) java.lang.Thread.run(Thread.java:750) #29 Thread[http-nio-8080-Poller,5,main] RUNNABLE daemon sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:811) java.lang.Thread.run(Thread.java:750) #30 Thread[https-jsse-nio-8443-Acceptor,5,main] RUNNABLE daemon sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:545) org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:71) org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129) java.lang.Thread.run(Thread.java:750) #31 Thread[https-jsse-nio-8443-Poller,5,main] RUNNABLE daemon sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:811) java.lang.Thread.run(Thread.java:750) #32 Thread[Java2D Disposer,10,system] WAITING daemon java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) sun.java2d.Disposer.run(Disposer.java:148) java.lang.Thread.run(Thread.java:750) #33 Thread[main,5,main] TIMED_WAITING java.lang.Thread.sleep(Native Method) org.apache.catalina.core.StandardServer.await(StandardServer.java:524) org.apache.catalina.startup.Catalina.await(Catalina.java:829) org.apache.catalina.startup.Catalina.start(Catalina.java:777) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345) org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476) #34 Thread[Reference Handler,10,system] WAITING daemon java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) java.lang.ref.Reference.tryHandlePending(Reference.java:191) java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153) #35 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon java.lang.Thread.sleep(Native Method) gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:288) #36 Thread[Signal Dispatcher,9,system] RUNNABLE daemon