Marine Institute Logo Marine Institute ERDDAP Server
Serving data from the Marine Institute (Ireland)
   
Brought to you by the Marine Institute(Ireland)    

ERDDAP > Status

Current time is 2019-12-05T19:19:52+00:00
Startup was at  2019-12-05T07:02:08+00:00
Last major LoadDatasets started 2m 37s ago and is still running.
nGridDatasets  = 8
nTableDatasets = 35
nTotalDatasets = 43
n Datasets Failed To Load (in the last major LoadDatasets) = 0
Response Failed    Time (since last major LoadDatasets) n =        4,  median ~=        0 ms
Response Failed    Time (since last Daily Report)       n =     5066,  median ~=       34 ms
Response Failed    Time (since startup)                 n =     5066,  median ~=       34 ms
Response Succeeded Time (since last major LoadDatasets) n =      105,  median ~=        6 ms
Response Succeeded Time (since last Daily Report)       n =    18174,  median ~=       34 ms
Response Succeeded Time (since startup)                 n =    18219,  median ~=       34 ms
TaskThread has finished 0 out of 0 tasks.  Currently, no task is running.
TaskThread Failed    Time (since last Daily Report)     n =        0
TaskThread Failed    Time (since startup)               n =        0
TaskThread Succeeded Time (since last Daily Report)     n =        0
TaskThread Succeeded Time (since startup)               n =        0
Number of threads: Tomcat-waiting=0, inotify=0, other=85
MemoryInUse=  1448 MB (highWaterMark=  1448 MB) (Xmx ~= 5888 MB)

Major LoadDatasets Time Series: MLD    Datasets Loaded    Requests (medianTime in seconds)     Number of Threads      Memory (MB)
  timestamp                    time   nTry nFail nTotal  nSuccess (median) nFailed (median)  tomWait inotify other  inUse highWater
  2019-12-05T19:06:06+00:00    231s      6     0     43        87 (     0)      13 (     0)        0       0    81     75       404
  2019-12-05T18:51:02+00:00    227s      6     0     43        69 (     0)       5 (     0)        0       0    81     76       404
  2019-12-05T18:36:10+00:00    236s      8     0     43        61 (     0)       5 (     0)        0       0    81     75       404
  2019-12-05T18:21:17+00:00    242s      7     0     43       100 (     0)       6 (     0)        0       0    81     76       404
  2019-12-05T18:06:06+00:00    232s      7     0     43       107 (     0)       4 (     0)        0       0    81     76       404
  2019-12-05T17:51:04+00:00    230s      6     0     43        96 (     0)       5 (     0)        0       0    81     77       404
  2019-12-05T17:36:18+00:00    243s      7     0     43       127 (     0)       9 (     0)        0       0    81     77       404
  2019-12-05T17:21:24+00:00    250s      8     0     43       149 (     0)      13 (     0)        0       0    81     77       404
  2019-12-05T17:06:04+00:00    229s      6     0     43       155 (     0)      21 (     0)        0       0    81     75       404
  2019-12-05T16:51:07+00:00    233s      7     0     43       125 (     0)       5 (     0)        0       0    81     76       404
  2019-12-05T16:36:08+00:00    234s      9     0     43       101 (     0)       4 (     0)        0       0    81     76       404
  2019-12-05T16:21:09+00:00    236s      8     0     43        98 (     0)       5 (     0)        0       0    81     77       404
  2019-12-05T16:06:52+00:00    278s      7     0     43       518 (     0)     138 (     0)        0       0    81    193       404
  2019-12-05T15:50:52+00:00    218s      7     0     43       442 (     0)     178 (     0)        0       0    95     73       404
  2019-12-05T15:36:03+00:00    229s      7     0     43       498 (     0)     161 (     0)        0       0    95    361       404
  2019-12-05T15:21:19+00:00    245s      8     0     43       476 (     0)     130 (     0)        0       0    95     76       404
  2019-12-05T15:06:40+00:00    266s      7     0     43       556 (     0)     184 (     0)        0       0    95     73       404
  2019-12-05T14:50:59+00:00    225s      6     0     43       501 (     0)     188 (     0)        0       0    95     75       404
  2019-12-05T14:36:09+00:00    235s      9     0     43       473 (     0)     161 (     0)        0       0    95     71       404
  2019-12-05T14:21:13+00:00    239s      7     0     43       525 (     0)     131 (     0)        0       0    96     64       404
  2019-12-05T14:06:13+00:00    239s      7     0     43       623 (     0)     163 (     0)        0       0    96    404       404
  2019-12-05T13:50:46+00:00    213s      6     0     43       505 (     0)     186 (     0)        0       0    94     77       252
  2019-12-05T13:36:03+00:00    230s      8     0     43       599 (     0)     159 (     0)        0       0    94     76       252
  2019-12-05T13:21:15+00:00    242s      7     0     43       595 (     0)     150 (     0)        0       0    91     76       252
  2019-12-05T13:06:11+00:00    238s      6     0     43       544 (     0)     133 (     0)        0       0    91     76       252
  2019-12-05T12:51:14+00:00    241s      7     0     43       479 (     0)     177 (     0)        0       0    91     75       252
  2019-12-05T12:36:07+00:00    235s      7     0     43       488 (     0)     152 (     0)        0       0    91     77       252
  2019-12-05T12:21:23+00:00    251s      8     0     43       633 (     0)     142 (     0)        0       0    91     76       252
  2019-12-05T12:06:03+00:00    230s      6     0     43       504 (     0)     135 (     0)        0       0    91     74       252
  2019-12-05T11:51:06+00:00    233s      6     0     43       542 (     0)     176 (     0)        0       0    92     70       252
  2019-12-05T11:36:13+00:00    241s      8     0     43       519 (     0)     170 (     0)        0       0    92     76       252
  2019-12-05T11:21:08+00:00    236s      8     0     43       522 (     0)     135 (     0)        0       0    92     76       252
  2019-12-05T11:06:08+00:00    235s      7     0     43       618 (     0)     131 (     0)        0       0    92     75       252
  2019-12-05T10:51:03+00:00    231s      6     0     43       527 (     0)     194 (     0)        0       0    92     76       252
  2019-12-05T10:36:01+00:00    229s      7     0     43       455 (     0)     158 (     0)        0       0    92     76       252
  2019-12-05T10:21:02+00:00    230s      9     0     43       516 (     0)     132 (     0)        0       0    93     77       252
  2019-12-05T10:06:08+00:00    236s      7     0     43       547 (     0)     133 (     0)        0       0    93     77       252
  2019-12-05T09:50:45+00:00    213s      6     0     43       437 (     0)     169 (     0)        0       0    94     75       252
  2019-12-05T09:36:12+00:00    240s      6     0     43       538 (     0)     175 (     0)        0       0    94     76       252
  2019-12-05T09:21:27+00:00    255s     11     0     43       502 (     0)     136 (     0)        0       0    94     76       252
  2019-12-05T09:05:48+00:00    216s      6     0     43       467 (     0)     129 (     0)        0       0    95     75       252
  2019-12-05T08:50:57+00:00    225s      7     0     43       446 (     0)     173 (     0)        0       0    87     75       252
  2019-12-05T08:36:08+00:00    236s      6     0     43       468 (     0)     152 (     0)        0       0    87     77       252
  2019-12-05T08:21:13+00:00    241s      9     0     43       324 (     0)      90 (     0)        0       0    82     76       252
  2019-12-05T08:06:00+00:00    228s      7     0     43        77 (     0)       4 (     0)        0       0    81     76       252
  2019-12-05T07:50:45+00:00    213s      7     0     43        81 (     0)       4 (     0)        0       0    81     75       252
  2019-12-05T07:35:59+00:00    227s      6     0     43       176 (     0)      22 (     0)        0       0    81     75       252
  2019-12-05T07:21:11+00:00    239s      7     0     43        71 (     0)      17 (     0)        0       0    81     73       252
  2019-12-05T07:07:29+00:00    318s     42     0     43        45 (     0)       1 (     0)        0       0    82     61       252


Major LoadDatasets Times Distribution (since last Daily Report):
    n =       48,  median ~=   210000 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:          48
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Major LoadDatasets Times Distribution (since startup):
    n =       49,  median ~=   211875 ms
    0 ms:               0
    1 ms:               0
    2 ms:               0
    <= 5 ms:            0
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:          48
    <= 10 min:          1
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0


Minor LoadDatasets Times Distribution (since last Daily Report):
    n =        0

Minor LoadDatasets Times Distribution (since startup):
    n =        0


Response Failed Time Distribution (since last major LoadDatasets):
    n =        4,  median ~=        0 ms
    0 ms:               2
    1 ms:               1
    2 ms:               0
    <= 5 ms:            1
    <= 10 ms:           0
    <= 20 ms:           0
    <= 50 ms:           0
    <= 100 ms:          0
    <= 200 ms:          0
    <= 500 ms:          0
    <= 1 s:             0
    <= 2 s:             0
    <= 5 s:             0
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           0
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Failed Time Distribution (since last Daily Report):
    n =     5066,  median ~=       34 ms
    0 ms:             642
    1 ms:             475
    2 ms:              12
    <= 5 ms:           36
    <= 10 ms:          20
    <= 20 ms:         118
    <= 50 ms:        2582
    <= 100 ms:        896
    <= 200 ms:        129
    <= 500 ms:         79
    <= 1 s:            36
    <= 2 s:            24
    <= 5 s:             3
    <= 10 s:            0
    <= 20 s:            3
    <= 1 min:           9
    <= 2 min:           2
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Failed Time Distribution (since startup):
    n =     5066,  median ~=       34 ms
    0 ms:             642
    1 ms:             474
    2 ms:              12
    <= 5 ms:           36
    <= 10 ms:          21
    <= 20 ms:         118
    <= 50 ms:        2582
    <= 100 ms:        896
    <= 200 ms:        129
    <= 500 ms:         79
    <= 1 s:            36
    <= 2 s:            24
    <= 5 s:             3
    <= 10 s:            0
    <= 20 s:            3
    <= 1 min:           9
    <= 2 min:           2
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0


Response Succeeded Time Distribution (since last major LoadDatasets):
    n =      105,  median ~=        6 ms
    0 ms:              22
    1 ms:               1
    2 ms:               6
    <= 5 ms:           21
    <= 10 ms:          11
    <= 20 ms:           5
    <= 50 ms:          16
    <= 100 ms:          2
    <= 200 ms:          2
    <= 500 ms:          0
    <= 1 s:             7
    <= 2 s:             9
    <= 5 s:             2
    <= 10 s:            0
    <= 20 s:            0
    <= 1 min:           1
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Succeeded Time Distribution (since last Daily Report):
    n =    18174,  median ~=       34 ms
    0 ms:             754
    1 ms:            1140
    2 ms:             688
    <= 5 ms:          948
    <= 10 ms:         742
    <= 20 ms:        1858
    <= 50 ms:        6369
    <= 100 ms:       3125
    <= 200 ms:        984
    <= 500 ms:        638
    <= 1 s:           395
    <= 2 s:           269
    <= 5 s:           191
    <= 10 s:           63
    <= 20 s:            7
    <= 1 min:           3
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0

Response Succeeded Time Distribution (since startup):
    n =    18219,  median ~=       34 ms
    0 ms:             757
    1 ms:            1151
    2 ms:             688
    <= 5 ms:          951
    <= 10 ms:         745
    <= 20 ms:        1858
    <= 50 ms:        6372
    <= 100 ms:       3126
    <= 200 ms:        987
    <= 500 ms:        640
    <= 1 s:           401
    <= 2 s:           272
    <= 5 s:           198
    <= 10 s:           63
    <= 20 s:            7
    <= 1 min:           3
    <= 2 min:           0
    <= 5 min:           0
    <= 10 min:          0
    <= 20 min:          0
    <= 1 hr:            0
    >  1 hr:            0


TaskThread Failed Time Distribution (since last Daily Report):
    n =        0

TaskThread Failed Time Distribution (since startup):
    n =        0

TaskThread Succeeded Time Distribution (since last Daily Report):
    n =        0

TaskThread Succeeded Time Distribution (since startup):
    n =        0


SgtMap topography nFromCache=1 nNotFromCache=17
GSHHS: nCached=34 of 100, nCoarse=79, nSuccesses=80, nTossed=0
NationalBoundaries: nCached=17 of 100,  nCoarse=10, nSuccesses=20, nTossed=0
StateBoundaries: nCached=17 of 100,  nCoarse=10, nSuccesses=20, nTossed=0
Rivers: nCached=17 of 100,  nCoarse=10, nSuccesses=20, nTossed=0
bufferedImage isAccelerated=[unknown]

Number of threads: Tomcat-waiting=0, inotify=0, other=85
(format: #threadNumber Thread[threadName,threadPriority,threadGroup] threadStatus)

#1 Thread[ajp-nio-8009-Acceptor-0,5,main] RUNNABLE daemon
java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:446)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:70)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:95)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#2 Thread[ajp-nio-8009-AsyncTimeout,5,main] TIMED_WAITING daemon
java.base@11.0.4/java.lang.Thread.sleep(Native Method)
org.apache.coyote.AbstractProtocol$AsyncTimeout.run(AbstractProtocol.java:1113)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#3 Thread[ajp-nio-8009-ClientPoller-0,5,main] RUNNABLE daemon
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#4 Thread[ajp-nio-8009-ClientPoller-1,5,main] RUNNABLE daemon
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#5 Thread[ajp-nio-8009-exec-1,5,main] WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#6 Thread[ajp-nio-8009-exec-10,5,main] WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#7 Thread[ajp-nio-8009-exec-2,5,main] WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#8 Thread[ajp-nio-8009-exec-3,5,main] WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#9 Thread[ajp-nio-8009-exec-4,5,main] WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#10 Thread[ajp-nio-8009-exec-5,5,main] WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#11 Thread[ajp-nio-8009-exec-6,5,main] WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#12 Thread[ajp-nio-8009-exec-7,5,main] WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#13 Thread[ajp-nio-8009-exec-8,5,main] WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#14 Thread[ajp-nio-8009-exec-9,5,main] WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:103)
org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#15 Thread[AsyncFileHandlerWriter-2046562095,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:513)
java.base@11.0.4/java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:675)
app//org.apache.juli.AsyncFileHandler$LoggerThread.run(AsyncFileHandler.java:159)

#16 Thread[cluster1-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#17 Thread[cluster1-nio-worker-0,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#18 Thread[cluster1-nio-worker-1,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#19 Thread[cluster1-nio-worker-2,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#20 Thread[cluster1-nio-worker-3,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#21 Thread[cluster1-nio-worker-4,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#22 Thread[cluster1-nio-worker-5,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#23 Thread[cluster1-nio-worker-6,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#24 Thread[cluster1-nio-worker-7,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#25 Thread[cluster1-reconnection-0,5,main] WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#26 Thread[cluster1-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#27 Thread[cluster1-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#28 Thread[cluster1-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.4/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#29 Thread[cluster2-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#30 Thread[cluster2-nio-worker-0,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#31 Thread[cluster2-nio-worker-1,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#32 Thread[cluster2-nio-worker-2,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#33 Thread[cluster2-nio-worker-3,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#34 Thread[cluster2-nio-worker-4,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#35 Thread[cluster2-nio-worker-5,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#36 Thread[cluster2-nio-worker-6,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#37 Thread[cluster2-nio-worker-7,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#38 Thread[cluster2-reconnection-0,5,main] WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#39 Thread[cluster2-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#40 Thread[cluster2-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#41 Thread[cluster2-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.4/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#42 Thread[cluster3-connection-reaper-0,5,main] TIMED_WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#43 Thread[cluster3-nio-worker-0,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#44 Thread[cluster3-nio-worker-1,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#45 Thread[cluster3-nio-worker-2,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#46 Thread[cluster3-nio-worker-3,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#47 Thread[cluster3-nio-worker-4,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#48 Thread[cluster3-nio-worker-5,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#49 Thread[cluster3-nio-worker-6,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#50 Thread[cluster3-nio-worker-7,5,main] RUNNABLE
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:753)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:409)
io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#51 Thread[cluster3-reconnection-0,5,main] WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#52 Thread[cluster3-reconnection-1,5,main] TIMED_WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#53 Thread[cluster3-scheduled-task-worker-0,5,main] TIMED_WAITING
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#54 Thread[cluster3-timeouter-0,5,main] TIMED_WAITING
java.base@11.0.4/java.lang.Thread.sleep(Native Method)
io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:560)
io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:459)
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#55 Thread[Common-Cleaner,8,InnocuousThreadGroup] TIMED_WAITING daemon
java.base@11.0.4/java.lang.Object.wait(Native Method)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.4/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
java.base@11.0.4/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)

#56 Thread[ContainerBackgroundProcessor[StandardEngine[Catalina]],5,main] TIMED_WAITING daemon
java.base@11.0.4/java.lang.Thread.sleep(Native Method)
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1365)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#57 Thread[FileHandlerLogFilesCleaner-1,5,main] WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#58 Thread[FileSystemWatchService,5,main] RUNNABLE daemon
java.base@11.0.4/sun.nio.fs.LinuxWatchService.poll(Native Method)
java.base@11.0.4/sun.nio.fs.LinuxWatchService$Poller.run(LinuxWatchService.java:316)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#59 Thread[Finalizer,8,system] WAITING daemon
java.base@11.0.4/java.lang.Object.wait(Native Method)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.base@11.0.4/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)

#60 Thread[http-nio-8080-Acceptor-0,5,main] RUNNABLE daemon
java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:446)
org.apache.tomcat.util.net.NioEndpoint.serverSocketAccept(NioEndpoint.java:70)
org.apache.tomcat.util.net.Acceptor.run(Acceptor.java:95)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#61 Thread[http-nio-8080-AsyncTimeout,5,main] TIMED_WAITING daemon
java.base@11.0.4/java.lang.Thread.sleep(Native Method)
org.apache.coyote.AbstractProtocol$AsyncTimeout.run(AbstractProtocol.java:1113)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#62 Thread[http-nio-8080-ClientPoller-0,5,main] RUNNABLE daemon
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#63 Thread[http-nio-8080-ClientPoller-1,5,main] RUNNABLE daemon
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioEndpoint$Poller.run(NioEndpoint.java:742)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#64 Thread[http-nio-8080-exec-103,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#65 Thread[http-nio-8080-exec-109,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#66 Thread[http-nio-8080-exec-111,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#67 Thread[http-nio-8080-exec-112,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#68 Thread[http-nio-8080-exec-114,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#69 Thread[http-nio-8080-exec-115,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#70 Thread[http-nio-8080-exec-116,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#71 Thread[http-nio-8080-exec-117,5,main] RUNNABLE daemon
java.base@11.0.4/java.lang.Thread.dumpThreads(Native Method)
java.base@11.0.4/java.lang.Thread.getAllStackTraces(Thread.java:1657)
com.cohort.util.MustBe.allStackTraces(MustBe.java:353)
gov.noaa.pfel.erddap.Erddap.doStatus(Erddap.java:3178)
gov.noaa.pfel.erddap.Erddap.doGet(Erddap.java:595)
javax.servlet.http.HttpServlet.service(HttpServlet.java:634)
javax.servlet.http.HttpServlet.service(HttpServlet.java:741)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:668)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:770)
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415)
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#72 Thread[http-nio-8080-exec-119,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#73 Thread[http-nio-8080-exec-120,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#74 Thread[http-nio-8080-exec-121,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#75 Thread[http-nio-8080-exec-122,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#76 Thread[http-nio-8080-exec-123,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#77 Thread[http-nio-8080-exec-93,5,main] TIMED_WAITING daemon
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:85)
org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:31)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#78 Thread[Java2D Disposer,10,system] WAITING daemon
java.base@11.0.4/java.lang.Object.wait(Native Method)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
java.desktop@11.0.4/sun.java2d.Disposer.run(Disposer.java:144)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

#79 Thread[LoadDatasets,5,main] RUNNABLE daemon
java.base@11.0.4/java.net.SocketInputStream.socketRead0(Native Method)
java.base@11.0.4/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
java.base@11.0.4/java.net.SocketInputStream.read(SocketInputStream.java:168)
java.base@11.0.4/java.net.SocketInputStream.read(SocketInputStream.java:140)
com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:1971)
com.microsoft.sqlserver.jdbc.TDSReader.readPacket(IOBuffer.java:6369)
com.microsoft.sqlserver.jdbc.TDSReader.nextPacket(IOBuffer.java:6323)
com.microsoft.sqlserver.jdbc.TDSReader.ensurePayload(IOBuffer.java:6301)
com.microsoft.sqlserver.jdbc.TDSReader.readBytes(IOBuffer.java:6600)
com.microsoft.sqlserver.jdbc.SimpleInputStream.read(SimpleInputStream.java:305)
com.microsoft.sqlserver.jdbc.SimpleInputStream.read(SimpleInputStream.java:267)
com.microsoft.sqlserver.jdbc.SimpleInputStream.getBytes(SimpleInputStream.java:352)
com.microsoft.sqlserver.jdbc.DDC.convertStreamToObject(DDC.java:637)
com.microsoft.sqlserver.jdbc.ServerDTVImpl.getValue(dtv.java:3762)
com.microsoft.sqlserver.jdbc.DTV.getValue(dtv.java:246)
com.microsoft.sqlserver.jdbc.Column.getValue(Column.java:190)
com.microsoft.sqlserver.jdbc.SQLServerResultSet.getValue(SQLServerResultSet.java:2037)
com.microsoft.sqlserver.jdbc.SQLServerResultSet.getValue(SQLServerResultSet.java:2023)
com.microsoft.sqlserver.jdbc.SQLServerResultSet.getString(SQLServerResultSet.java:2454)
gov.noaa.pfel.erddap.dataset.EDDTableFromDatabase.getDataForDapQuery(EDDTableFromDatabase.java:892)
gov.noaa.pfel.erddap.dataset.EDDTable.subsetVariablesDataTable(EDDTable.java:11509)
gov.noaa.pfel.erddap.dataset.EDDTable.distinctSubsetVariablesDataTable(EDDTable.java:11575)
gov.noaa.pfel.erddap.dataset.EDDTable.ensureValid(EDDTable.java:654)
gov.noaa.pfel.erddap.dataset.EDDTableFromDatabase.<init>(EDDTableFromDatabase.java:577)
gov.noaa.pfel.erddap.dataset.EDDTableFromDatabase.lowFromXml(EDDTableFromDatabase.java:232)
gov.noaa.pfel.erddap.dataset.EDDTableFromDatabase.fromXml(EDDTableFromDatabase.java:93)
gov.noaa.pfel.erddap.dataset.EDD.fromXml(EDD.java:403)
gov.noaa.pfel.erddap.LoadDatasets.run(LoadDatasets.java:336)

#80 Thread[main,5,main] RUNNABLE
java.base@11.0.4/java.net.PlainSocketImpl.socketAccept(Native Method)
java.base@11.0.4/java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:458)
java.base@11.0.4/java.net.ServerSocket.implAccept(ServerSocket.java:551)
java.base@11.0.4/java.net.ServerSocket.accept(ServerSocket.java:519)
org.apache.catalina.core.StandardServer.await(StandardServer.java:447)
org.apache.catalina.startup.Catalina.await(Catalina.java:770)
org.apache.catalina.startup.Catalina.start(Catalina.java:716)
java.base@11.0.4/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
java.base@11.0.4/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
java.base@11.0.4/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.base@11.0.4/java.lang.reflect.Method.invoke(Method.java:566)
app//org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:350)
app//org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:492)

#81 Thread[NioBlockingSelector.BlockPoller-1,5,main] RUNNABLE daemon
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(NioBlockingSelector.java:298)

#82 Thread[NioBlockingSelector.BlockPoller-2,5,main] RUNNABLE daemon
java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(NioBlockingSelector.java:298)

#83 Thread[Reference Handler,10,system] RUNNABLE daemon
java.base@11.0.4/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
java.base@11.0.4/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
java.base@11.0.4/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)

#84 Thread[RunLoadDatasets,5,main] TIMED_WAITING daemon
java.base@11.0.4/java.lang.Thread.sleep(Native Method)
gov.noaa.pfel.erddap.RunLoadDatasets.run(RunLoadDatasets.java:282)

#85 Thread[Signal Dispatcher,9,system] RUNNABLE daemon


 
ERDDAP, Version 1.82
Disclaimers | Privacy Policy | Contact