![]() |
Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland) |
Brought to you by the Marine Institute(Ireland) |
Current time is 2025-10-20T10:44:22+00:00 Startup was at 2025-10-19T16:18:00+00:00 Last major LoadDatasets started 11m 7s ago and finished after 95 seconds. nGridDatasets = 9 nTableDatasets = 77 nTotalDatasets = 86 n Datasets Failed To Load (in the last major LoadDatasets) = 5 ireland_marine_research_database_charts, imifeeaghco2, compass_neatl_hindcast_grid, IMI_Model_Stats, IMI_EATL_WAVE, (end) Unique users (since startup) n = 1348 Response Failed Time (since last major LoadDatasets) n = 13, median ~= 150 ms Response Failed Time (since last Daily Report) n = 1399, median ~= 1367 ms Response Failed Time (since startup) n = 3157, median ~= 1299 ms Response Succeeded Time (since last major LoadDatasets) n = 114, median ~= 69 ms Response Succeeded Time (since last Daily Report) n = 3275, median ~= 281 ms Response Succeeded Time (since startup) n = 12004, median ~= 249 ms TaskThread has finished 0 out of 0 tasks. Currently, no task is running. TaskThread Failed Time (since last Daily Report) n = 0 TaskThread Failed Time (since startup) n = 0 TaskThread Succeeded Time (since last Daily Report) n = 0 TaskThread Succeeded Time (since startup) n = 0 Number of threads: Tomcat-waiting=19, inotify=4, other=36 MemoryInUse= 432 MB (highWaterMark= 589 MB) (Xmx ~= 5888 MB) Major LoadDatasets Time Series: MLD Datasets Loaded Requests (median times in ms) Number of Threads MB Open timestamp time nTry nFail nTotal nSuccess (median) nFail (median) memFail tooMany tomWait inotify other inUse Files ---------------------------- ----- ----------------- ------------------------------------------------ --------------------- ----- ----- 2025-10-20T10:34:44+00:00 89s 11 5 86 236 ( 306) 39 ( 58) 0 0 20 4 37 104 0% 2025-10-20T10:19:47+00:00 92s 11 5 86 336 ( 500) 276 ( 1512) 0 0 28 4 38 188 0% 2025-10-20T10:05:02+00:00 107s 11 5 86 237 ( 235) 70 ( 1414) 0 0 17 4 48 101 0% 2025-10-20T09:49:54+00:00 100s 10 5 86 253 ( 51) 21 ( 69) 0 0 25 4 37 103 0% 2025-10-20T09:34:46+00:00 92s 13 5 86 215 ( 308) 40 ( 1182) 0 0 25 4 37 106 0% 2025-10-20T09:19:44+00:00 90s 12 5 86 246 ( 350) 82 ( 1483) 0 0 20 4 37 104 0% 2025-10-20T09:05:00+00:00 106s 11 5 86 265 ( 464) 144 ( 816) 2 0 32 4 40 347 0% 2025-10-20T08:49:52+00:00 98s 10 5 86 211 ( 450) 319 ( 1432) 0 0 30 4 37 101 0% 2025-10-20T08:34:44+00:00 90s 13 5 86 189 ( 280) 13 ( 125) 0 0 20 4 37 104 0% 2025-10-20T08:19:59+00:00 105s 13 5 86 146 ( 75) 19 ( 150) 0 0 19 4 38 102 0% 2025-10-20T08:04:44+00:00 90s 10 5 86 249 ( 240) 30 ( 1250) 0 0 36 4 37 106 0% 2025-10-20T07:49:51+00:00 97s 10 5 86 201 ( 255) 156 ( 1230) 2 0 20 4 37 105 0% 2025-10-20T07:34:44+00:00 91s 15 5 86 229 ( 354) 107 ( 1485) 0 0 25 4 37 103 0% 2025-10-20T07:20:00+00:00 107s 13 5 86 149 ( 45) 70 ( 3500) 0 0 27 4 37 99 0% 2025-10-20T07:04:42+00:00 89s 11 5 86 196 ( 100) 195 ( 1821) 0 0 20 4 37 100 0% 2025-10-20T06:49:50+00:00 98s 10 5 86 250 ( 539) 338 ( 2313) 1 0 36 4 38 100 0% 2025-10-20T06:34:47+00:00 94s 12 5 86 198 ( 261) 113 ( 1031) 0 0 27 4 39 589 0% 2025-10-20T06:19:40+00:00 88s 10 5 86 222 ( 398) 19 ( 41) 0 0 30 4 37 110 0% 2025-10-20T06:04:57+00:00 105s 13 5 86 120 ( 361) 30 ( 3000) 0 0 20 4 37 111 0% 2025-10-20T05:49:51+00:00 99s 10 5 86 98 ( 96) 7 ( 69) 0 0 18 4 39 111 0% 2025-10-20T05:34:44+00:00 91s 12 5 86 139 ( 275) 17 ( 75) 0 0 18 4 39 115 0% 2025-10-20T05:19:50+00:00 98s 10 5 86 103 ( 92) 7 ( 117) 0 0 20 4 37 111 0% 2025-10-20T05:05:01+00:00 109s 13 5 86 88 ( 167) 11 ( 89) 0 0 18 4 39 510 0% 2025-10-20T04:49:46+00:00 94s 10 5 86 126 ( 82) 8 ( 67) 0 0 20 4 37 118 0% 2025-10-20T04:34:43+00:00 92s 13 5 86 131 ( 285) 14 ( 75) 0 0 20 4 37 114 0% 2025-10-20T04:19:43+00:00 91s 10 5 86 105 ( 98) 7 ( 75) 0 0 20 4 37 111 0% 2025-10-20T04:04:45+00:00 93s 8 5 86 76 ( 153) 7 ( 75) 0 0 25 4 37 113 0% 2025-10-20T03:58:38+00:00 627s 13 5 86 147 ( 76) 20 (136364) 0 0 20 4 37 113 0% 2025-10-20T03:34:40+00:00 89s 12 5 86 119 ( 285) 16 ( 43) 0 0 20 4 37 113 0% 2025-10-20T03:19:41+00:00 90s 11 5 86 116 ( 114) 7 ( 58) 0 0 20 4 37 116 0% 2025-10-20T03:04:42+00:00 91s 11 6 85 86 ( 150) 8 ( 67) 0 0 20 4 37 114 0% 2025-10-20T02:49:56+00:00 105s 14 6 85 102 ( 100) 7 ( 75) 0 0 20 4 37 113 0% 2025-10-20T02:34:44+00:00 93s 13 6 85 129 ( 299) 12 ( 100) 0 0 20 4 37 113 0% 2025-10-20T02:19:41+00:00 90s 11 6 85 146 ( 69) 7 ( 81) 0 0 20 4 37 116 0% 2025-10-20T02:04:39+00:00 88s 11 6 85 109 ( 44) 8 ( 67) 0 0 20 4 37 113 0% 2025-10-20T01:49:56+00:00 105s 14 6 85 103 ( 84) 7 ( 58) 0 0 20 4 37 116 0% 2025-10-20T01:34:39+00:00 89s 13 6 85 123 ( 294) 12 ( 75) 0 0 20 4 37 113 0% 2025-10-20T01:19:39+00:00 89s 11 6 85 105 ( 94) 11 ( 35) 0 0 20 4 37 114 0% 2025-10-20T01:04:47+00:00 97s 12 6 85 78 ( 182) 8 ( 75) 0 0 20 4 37 114 0% 2025-10-20T00:49:48+00:00 97s 12 6 85 128 ( 213) 7 ( 85) 0 0 20 4 37 116 0% 2025-10-20T00:34:56+00:00 105s 17 6 85 131 ( 285) 12 ( 88) 0 0 20 4 37 116 0% 2025-10-20T00:19:38+00:00 88s 11 6 85 115 ( 94) 11 ( 31) 0 0 20 4 37 113 0% 2025-10-20T00:04:40+00:00 90s 11 6 85 118 ( 98) 9 ( 63) 0 0 20 4 37 112 0% 2025-10-19T23:49:45+00:00 95s 11 6 85 110 ( 56) 8 ( 43) 0 0 20 4 37 113 0% 2025-10-19T23:34:39+00:00 89s 13 6 85 155 ( 254) 13 ( 94) 0 0 20 4 37 114 0% 2025-10-19T23:19:57+00:00 107s 16 6 85 132 ( 96) 7 ( 69) 0 0 20 4 37 111 0% 2025-10-19T23:04:40+00:00 91s 12 7 84 69 ( 150) 8 ( 90) 0 0 19 4 38 172 0% 2025-10-19T22:49:41+00:00 91s 12 7 84 114 ( 85) 10 ( 35) 0 0 20 4 37 110 0% 2025-10-19T22:34:42+00:00 93s 14 7 84 129 ( 295) 12 ( 75) 0 0 20 4 37 116 0% 2025-10-19T22:19:40+00:00 91s 13 7 84 152 ( 158) 12 ( 58) 0 0 23 4 37 113 0% 2025-10-19T22:04:55+00:00 105s 14 7 84 99 ( 278) 10 ( 83) 0 0 19 4 38 150 0% 2025-10-19T21:49:46+00:00 96s 12 7 84 120 ( 133) 7 ( 75) 0 0 20 4 37 115 0% 2025-10-19T21:34:42+00:00 93s 14 7 84 137 ( 320) 12 ( 83) 0 0 20 4 37 116 0% 2025-10-19T21:19:38+00:00 89s 13 7 84 127 ( 158) 13 ( 28) 0 0 20 4 37 113 0% 2025-10-19T21:04:40+00:00 91s 12 7 84 144 ( 390) 197 ( 479) 0 0 20 4 37 174 0% 2025-10-19T20:49:54+00:00 105s 14 7 84 190 ( 418) 9 ( 75) 0 0 20 4 37 113 0% 2025-10-19T20:34:38+00:00 89s 15 7 84 145 ( 299) 36 ( 1333) 0 0 20 4 37 116 0% 2025-10-19T20:19:35+00:00 87s 13 7 84 115 ( 150) 7 ( 81) 0 0 20 4 37 113 0% 2025-10-19T20:04:38+00:00 89s 12 7 84 120 ( 115) 8 ( 75) 0 0 20 4 37 113 0% 2025-10-19T19:49:42+00:00 94s 13 7 84 122 ( 232) 8 ( 70) 0 0 20 4 37 116 0% 2025-10-19T19:34:52+00:00 104s 17 8 83 136 ( 284) 12 ( 83) 0 0 20 4 37 112 0% 2025-10-19T19:19:36+00:00 88s 13 8 83 130 ( 100) 9 ( 46) 0 0 20 4 37 113 0% 2025-10-19T19:04:39+00:00 91s 14 8 83 115 ( 268) 22 ( 1667) 0 0 20 4 37 113 0% 2025-10-19T18:49:43+00:00 95s 14 8 83 112 ( 92) 8 ( 63) 0 0 20 4 37 117 0% 2025-10-19T18:34:51+00:00 103s 23 8 83 143 ( 292) 25 ( 425) 0 0 20 4 37 116 0% 2025-10-19T18:19:37+00:00 89s 13 8 83 150 ( 241) 44 ( 4667) 0 0 20 4 37 114 0% 2025-10-19T18:04:38+00:00 90s 14 8 83 125 ( 259) 23 ( 2500) 0 0 20 4 37 120 0% 2025-10-19T17:49:45+00:00 98s 14 8 83 252 ( 1154) 74 ( 11000) 0 0 20 4 37 115 0% 2025-10-19T17:34:50+00:00 102s 18 9 82 410 ( 1489) 93 ( 7794) 0 0 25 4 37 118 0% 2025-10-19T17:19:35+00:00 87s 14 9 82 246 ( 10) 23 ( 150) 0 0 20 4 37 115 0% 2025-10-19T17:04:38+00:00 91s 15 9 82 674 ( 181) 86 ( 20000) 0 206 29 4 37 114 0% 2025-10-19T16:49:46+00:00 99s 14 9 82 159 ( 97) 9 ( 75) 0 0 20 4 37 81 0% 2025-10-19T16:34:35+00:00 88s 17 9 82 157 ( 277) 17 ( 125) 0 0 24 4 38 80 0% 2025-10-19T16:23:00+00:00 292s 90 8 83 33 ( 750) 1 ( 8) 0 0 20 4 38 73 0% Major LoadDatasets Times Distribution (since last Daily Report): n = 14, median ~= 90000 ms 0 ms: 0 1 ms: 0 2 ms: 0 <= 5 ms: 0 <= 10 ms: 0 <= 20 ms: 0 <= 50 ms: 0 <= 100 ms: 0 <= 200 ms: 0 <= 500 ms: 0 <= 1 s: 0 <= 2 s: 0 <= 5 s: 0 <= 10 s: 0 <= 20 s: 0 <= 1 min: 0 <= 2 min: 14 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Major LoadDatasets Times Distribution (since startup): n = 74, median ~= 90833 ms 0 ms: 0 1 ms: 0 2 ms: 0 <= 5 ms: 0 <= 10 ms: 0 <= 20 ms: 0 <= 50 ms: 0 <= 100 ms: 0 <= 200 ms: 0 <= 500 ms: 0 <= 1 s: 0 <= 2 s: 0 <= 5 s: 0 <= 10 s: 0 <= 20 s: 0 <= 1 min: 0 <= 2 min: 72 <= 5 min: 1 <= 10 min: 0 <= 20 min: 1 <= 1 hr: 0 > 1 hr: 0 Minor LoadDatasets Times Distribution (since last Daily Report): n = 1, median ~= 750 ms 0 ms: 0 1 ms: 0 2 ms: 0 <= 5 ms: 0 <= 10 ms: 0 <= 20 ms: 0 <= 50 ms: 0 <= 100 ms: 0 <= 200 ms: 0 <= 500 ms: 0 <= 1 s: 1 <= 2 s: 0 <= 5 s: 0 <= 10 s: 0 <= 20 s: 0 <= 1 min: 0 <= 2 min: 0 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Minor LoadDatasets Times Distribution (since startup): n = 2, median ~= 1000 ms 0 ms: 0 1 ms: 0 2 ms: 0 <= 5 ms: 0 <= 10 ms: 0 <= 20 ms: 0 <= 50 ms: 0 <= 100 ms: 0 <= 200 ms: 0 <= 500 ms: 0 <= 1 s: 1 <= 2 s: 0 <= 5 s: 1 <= 10 s: 0 <= 20 s: 0 <= 1 min: 0 <= 2 min: 0 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Response Failed Time Distribution (since last major LoadDatasets): n = 13, median ~= 150 ms 0 ms: 1 1 ms: 0 2 ms: 0 <= 5 ms: 0 <= 10 ms: 0 <= 20 ms: 0 <= 50 ms: 1 <= 100 ms: 4 <= 200 ms: 1 <= 500 ms: 0 <= 1 s: 1 <= 2 s: 0 <= 5 s: 2 <= 10 s: 3 <= 20 s: 0 <= 1 min: 0 <= 2 min: 0 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Response Failed Time Distribution (since last Daily Report): n = 1399, median ~= 1367 ms 0 ms: 42 1 ms: 27 2 ms: 2 <= 5 ms: 1 <= 10 ms: 2 <= 20 ms: 12 <= 50 ms: 66 <= 100 ms: 56 <= 200 ms: 27 <= 500 ms: 112 <= 1 s: 97 <= 2 s: 697 <= 5 s: 134 <= 10 s: 99 <= 20 s: 21 <= 1 min: 3 <= 2 min: 1 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Response Failed Time Distribution (since startup): n = 3157, median ~= 1299 ms 0 ms: 100 1 ms: 86 2 ms: 7 <= 5 ms: 2 <= 10 ms: 9 <= 20 ms: 29 <= 50 ms: 229 <= 100 ms: 289 <= 200 ms: 123 <= 500 ms: 276 <= 1 s: 170 <= 2 s: 865 <= 5 s: 544 <= 10 s: 205 <= 20 s: 136 <= 1 min: 31 <= 2 min: 14 <= 5 min: 40 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 2 > 1 hr: 0 Response Succeeded Time Distribution (since last major LoadDatasets): n = 114, median ~= 69 ms 0 ms: 6 1 ms: 7 2 ms: 1 <= 5 ms: 9 <= 10 ms: 0 <= 20 ms: 6 <= 50 ms: 23 <= 100 ms: 13 <= 200 ms: 4 <= 500 ms: 12 <= 1 s: 8 <= 2 s: 5 <= 5 s: 14 <= 10 s: 6 <= 20 s: 0 <= 1 min: 0 <= 2 min: 0 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Response Succeeded Time Distribution (since last Daily Report): n = 3275, median ~= 281 ms 0 ms: 88 1 ms: 103 2 ms: 67 <= 5 ms: 149 <= 10 ms: 37 <= 20 ms: 142 <= 50 ms: 481 <= 100 ms: 235 <= 200 ms: 150 <= 500 ms: 687 <= 1 s: 373 <= 2 s: 368 <= 5 s: 223 <= 10 s: 151 <= 20 s: 16 <= 1 min: 5 <= 2 min: 0 <= 5 min: 0 <= 10 min: 0 <= 20 min: 0 <= 1 hr: 0 > 1 hr: 0 Response Succeeded Time Distribution (since startup): n = 12004, median ~= 249 ms 0 ms: 374 1 ms: 481 2 ms: 325 <= 5 ms: 753 <= 10 ms: 191 <= 20 ms: 384 <= 50 ms: 1367 <= 100 ms: 956 <= 200 ms: 668 <= 500 ms: 3104 <= 1 s: 1183 <= 2 s: 969 <= 5 s: 744 <= 10 s: 349 <= 20 s: 92 <= 1 min: 21 <= 2 min: 39 <= 5 min: 1 <= 10 min: 1 <= 20 min: 2 <= 1 hr: 0 > 1 hr: 0 TaskThread Failed Time Distribution (since last Daily Report): n = 0 TaskThread Failed Time Distribution (since startup): n = 0 TaskThread Succeeded Time Distribution (since last Daily Report): n = 0 TaskThread Succeeded Time Distribution (since startup): n = 0 SgtMap topography nFromCache=0 nNotFromCache=2 GSHHS: nCached=4 of 100, nCoarse=110, nSuccesses=8, nTossed=0 NationalBoundaries: nCached=2 of 100, nCoarse=5, nSuccesses=2, nTossed=0 StateBoundaries: nCached=2 of 100, nCoarse=5, nSuccesses=2, nTossed=0 Rivers: nCached=2 of 100, nCoarse=5, nSuccesses=2, nTossed=0 bufferedImage isAccelerated=[unknown] canonical map sizes: 675 + 652 + 275 + 1572 + 1017 + 1471 = 5662 canonicalStringHolder map sizes: 30732 + 99366 + 2500 + 537 + 237 + 361 = 133733 Number of threads: Tomcat-waiting=19, inotify=4, other=36 (format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus) #1 Thread[AsyncFileHandlerWriter-1,5,main] WAITING daemon sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingDeque.takeFirst(LinkedBlockingDeque.java:492) java.util.concurrent.LinkedBlockingDeque.take(LinkedBlockingDeque.java:680) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) #2 Thread[Catalina-utility-1,1,main] WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63) java.lang.Thread.run(Thread.java:750) #3 Thread[Catalina-utility-2,1,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63) java.lang.Thread.run(Thread.java:750) #4 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #5 Thread[cluster1-nio-worker-0,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #6 Thread[cluster1-nio-worker-1,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #7 Thread[cluster1-nio-worker-2,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #8 Thread[cluster1-nio-worker-3,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #9 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #10 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING java.lang.Thread.sleep(Native Method) io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569) io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #11 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #12 Thread[cluster2-nio-worker-0,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #13 Thread[cluster2-nio-worker-1,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #14 Thread[cluster2-nio-worker-2,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #15 Thread[cluster2-nio-worker-3,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #16 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #17 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING java.lang.Thread.sleep(Native Method) io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569) io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #18 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #19 Thread[cluster3-nio-worker-0,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #20 Thread[cluster3-nio-worker-1,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #21 Thread[cluster3-nio-worker-2,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #22 Thread[cluster3-nio-worker-3,5,main] RUNNABLE io.netty.channel.epoll.Native.epollWait(Native Method) io.netty.channel.epoll.Native.epollWait(Native.java:192) io.netty.channel.epoll.Native.epollWait(Native.java:185) io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290) io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #23 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #24 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING java.lang.Thread.sleep(Native Method) io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:569) io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:465) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) #25 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) #26 Thread[Finalizer,8,system] WAITING daemon java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:188) #27 Thread[GC Daemon,2,system] TIMED_WAITING daemon java.lang.Object.wait(Native Method) sun.misc.GC$Daemon.run(GC.java:117) #28 Thread[http-nio-8080-Acceptor,5,main] RUNNABLE daemon sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:545) org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:71) org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129) java.lang.Thread.run(Thread.java:750) #29 Thread[http-nio-8080-Poller,5,main] RUNNABLE daemon sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:811) java.lang.Thread.run(Thread.java:750) #30 Thread[https-jsse-nio-8443-Acceptor,5,main] RUNNABLE daemon sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:545) org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:71) org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:129) java.lang.Thread.run(Thread.java:750) #31 Thread[https-jsse-nio-8443-Poller,5,main] RUNNABLE daemon sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:811) java.lang.Thread.run(Thread.java:750) #32 Thread[Java2D Disposer,10,system] WAITING daemon java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) sun.java2d.Disposer.run(Disposer.java:148) java.lang.Thread.run(Thread.java:750) #33 Thread[main,5,main] TIMED_WAITING java.lang.Thread.sleep(Native Method) org.apache.catalina.core.StandardServer.await(StandardServer.java:524) org.apache.catalina.startup.Catalina.await(Catalina.java:829) org.apache.catalina.startup.Catalina.start(Catalina.java:777) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345) org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476) #34 Thread[Reference Handler,10,system] WAITING daemon java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) java.lang.ref.Reference.tryHandlePending(Reference.java:191) java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153) #35 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon java.lang.Thread.sleep(Native Method) gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:288) #36 Thread[Signal Dispatcher,9,system] RUNNABLE daemon