发生full gc后，出现很多unload class后，所有线程都block了，持续两分钟，包括gc的thread都block了，求大神们指点一二...为什么出现这种情况

需要更多信息。您说的所有线程都block了很可能不准确…
如果您能重现这个问题，请在您觉得所有线程都block的时候用jstack -m来抓一下当时所有线程的栈。

我在mac上jstack -m只能打印出no deadlock，没有堆栈信息。只有jstack -F 能打印出堆栈，请问这是为什么？

jstack -F 的堆栈信息：

Deadlock Detection:

No deadlocks found.

Thread 125203: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)
 - sun.net.www.http.KeepAliveCache.run() @bci=3, line=172 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 84283: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
 - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)


Thread 97147: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=24, line=1079 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 128003: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)


Thread 127495: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 125963: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)
 - java.lang.Thread.sleep(long, int) @bci=57, line=340 (Interpreted frame)
 - java.util.concurrent.TimeUnit.sleep(long) @bci=23, line=360 (Interpreted frame)



Thread 125443: (state = IN_NATIVE)
 - sun.nio.ch.KQueueArrayWrapper.kevent0(int, long, int, long) @bci=0 (Compiled frame; information may be imprecise)
 - sun.nio.ch.KQueueArrayWrapper.poll(long) @bci=17, line=200 (Compiled frame)
 - sun.nio.ch.KQueueSelectorImpl.doSelect(long) @bci=30, line=103 (Compiled frame)
 - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Compiled frame)
 - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Compiled frame)
 - org.jboss.netty.channel.socket.nio.NioWorker.run() @bci=60, line=160 (Compiled frame)
 - org.jboss.netty.util.ThreadRenamingRunnable.run() @bci=55, line=108 (Interpreted frame)
 - org.jboss.netty.util.internal.IoWorkerRunnable.run() @bci=13, line=46 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=95, line=1145 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 88087: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=122, line=1090 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 124419: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)


Thread 123907: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 123395: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)


Thread 122883: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 122371: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.LinkedBlockingQueue.poll(long, java.util.concurrent.TimeUnit) @bci=62, line=467 (Interpreted frame)
 - io.netty.util.concurrent.SingleThreadEventExecutor.takeTask() @bci=111, line=235 (Interpreted frame)
 - io.netty.util.concurrent.DefaultEventExecutor.run() @bci=1, line=34 (Interpreted frame)
 - io.netty.util.concurrent.SingleThreadEventExecutor$2.run() @bci=13, line=116 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 121859: (state = IN_NATIVE)
 - sun.nio.ch.KQueueArrayWrapper.kevent0(int, long, int, long) @bci=0 (Compiled frame; information may be imprecise)
 - sun.nio.ch.KQueueArrayWrapper.poll(long) @bci=17, line=200 (Compiled frame)
 - sun.nio.ch.KQueueSelectorImpl.doSelect(long) @bci=30, line=103 (Compiled frame)
 - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Compiled frame)
 - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Compiled frame)
 - sun.net.httpserver.ServerImpl$Dispatcher.run() @bci=72, line=341 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 121347: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
 - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)


Thread 120835: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)


Thread 120323: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 119811: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)


Thread 119559: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 118787: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)
 - java.lang.Thread.sleep(long, int) @bci=57, line=340 (Interpreted frame)
 - java.util.concurrent.TimeUnit.sleep(long) @bci=23, line=360 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 118275: (state = IN_NATIVE)
 - sun.nio.ch.KQueueArrayWrapper.kevent0(int, long, int, long) @bci=0 (Compiled frame; information may be imprecise)
 - sun.nio.ch.KQueueArrayWrapper.poll(long) @bci=17, line=200 (Compiled frame)
 - sun.nio.ch.KQueueSelectorImpl.doSelect(long) @bci=30, line=103 (Compiled frame)
 - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Compiled frame)
 - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Compiled frame)
 - org.apache.mina.transport.socket.nio.SocketIoProcessor$Worker.run() @bci=12, line=483 (Interpreted frame)
 - org.apache.mina.util.NamePreservingRunnable.run() @bci=29, line=51 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=95, line=1145 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 118023: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 117251: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)


Thread 116739: (state = IN_NATIVE)
 - sun.nio.ch.KQueueArrayWrapper.kevent0(int, long, int, long) @bci=0 (Compiled frame; information may be imprecise)
 - sun.nio.ch.KQueueArrayWrapper.poll(long) @bci=17, line=200 (Compiled frame)
 - sun.nio.ch.KQueueSelectorImpl.doSelect(long) @bci=30, line=103 (Compiled frame)
 - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Compiled frame)
 - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Compiled frame)
 - org.apache.mina.transport.socket.nio.SocketIoProcessor$Worker.run() @bci=12, line=483 (Interpreted frame)
 - org.apache.mina.util.NamePreservingRunnable.run() @bci=29, line=51 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=95, line=1145 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 116227: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 115743: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)
 - com.taobao.tair.impl.ConfigServerUpdater.run() @bci=40, line=40 (Interpreted frame)

Thread 115467: (state = IN_NATIVE)
 - sun.nio.ch.KQueueArrayWrapper.kevent0(int, long, int, long) @bci=0 (Compiled frame; information may be imprecise)
 - sun.nio.ch.KQueueArrayWrapper.poll(long) @bci=17, line=200 (Compiled frame)
 - sun.nio.ch.KQueueSelectorImpl.doSelect(long) @bci=30, line=103 (Compiled frame)
 - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Compiled frame)
 - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Compiled frame)
 - org.apache.mina.transport.socket.nio.SocketIoProcessor$Worker.run() @bci=12, line=483 (Interpreted frame)
 - org.apache.mina.util.NamePreservingRunnable.run() @bci=29, line=51 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=95, line=1145 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 113939: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 109319: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)


Thread 101411: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)
 - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Interpreted frame)


Thread 1299: (state = IN_NATIVE)


Thread 77315: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.LinkedBlockingQueue.poll(long, java.util.concurrent.TimeUnit) @bci=62, line=467 (Interpreted frame)
 - io.netty.util.concurrent.SingleThreadEventExecutor.takeTask() @bci=111, line=235 (Interpreted frame)
 - io.netty.util.concurrent.DefaultEventExecutor.run() @bci=1, line=34 (Interpreted frame)
 - io.netty.util.concurrent.SingleThreadEventExecutor$2.run() @bci=13, line=116 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 76807: (state = IN_NATIVE)
 - sun.nio.ch.KQueueArrayWrapper.kevent0(int, long, int, long) @bci=0 (Compiled frame; information may be imprecise)
 - sun.nio.ch.KQueueArrayWrapper.poll(long) @bci=17, line=200 (Compiled frame)
 - sun.nio.ch.KQueueSelectorImpl.doSelect(long) @bci=30, line=103 (Compiled frame)
 - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Compiled frame)
 - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Compiled frame)
 - io.netty.channel.nio.NioEventLoop.select() @bci=58, line=622 (Interpreted frame)
 - io.netty.channel.nio.NioEventLoop.run() @bci=27, line=310 (Interpreted frame)
 - io.netty.util.concurrent.SingleThreadEventExecutor$2.run() @bci=13, line=116 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 76291: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=122, line=1090 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 75779: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
 - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)


Thread 75267: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(long, java.util.concurrent.TimeUnit) @bci=106, line=2176 (Interpreted frame)
 - com.taobao.monitor.log.MonitorLogContainers$2.run() @bci=15, line=252 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 74755: (state = IN_NATIVE)
 - sun.nio.ch.KQueueArrayWrapper.kevent0(int, long, int, long) @bci=0 (Compiled frame; information may be imprecise)
 - sun.nio.ch.KQueueArrayWrapper.poll(long) @bci=17, line=200 (Compiled frame)
 - sun.nio.ch.KQueueSelectorImpl.doSelect(long) @bci=30, line=103 (Compiled frame)
 - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Compiled frame)
 - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Compiled frame)
 - org.apache.mina.transport.socket.nio.SocketIoProcessor$Worker.run() @bci=12, line=483 (Interpreted frame)
 - org.apache.mina.util.NamePreservingRunnable.run() @bci=29, line=51 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=95, line=1145 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 73223: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)


Thread 72711: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 36871: (state = IN_NATIVE)
 - sun.nio.ch.KQueueArrayWrapper.kevent0(int, long, int, long) @bci=0 (Compiled frame; information may be imprecise)
 - sun.nio.ch.KQueueArrayWrapper.poll(long) @bci=17, line=200 (Compiled frame)
 - sun.nio.ch.KQueueSelectorImpl.doSelect(long) @bci=30, line=103 (Compiled frame)
 - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Compiled frame)
 - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Compiled frame)
 - org.apache.mina.transport.socket.nio.SocketIoProcessor$Worker.run() @bci=12, line=483 (Interpreted frame)
 - org.apache.mina.util.NamePreservingRunnable.run() @bci=29, line=51 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=95, line=1145 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 37383: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(java.util.concurrent.SynchronousQueue$TransferStack$SNode, boolean, long) @bci=174, line=460 (Interpreted frame)
 - java.util.concurrent.SynchronousQueue$TransferStack.transfer(java.lang.Object, boolean, long) @bci=102, line=359 (Interpreted frame)
 - java.util.concurrent.SynchronousQueue.poll(long, java.util.concurrent.TimeUnit) @bci=11, line=942 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=141, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 38159: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 36623: (state = IN_NATIVE)
 - java.net.PlainSocketImpl.socketConnect(java.net.InetAddress, int, int) @bci=0 (Interpreted frame)
 - java.net.AbstractPlainSocketImpl.doConnect(java.net.InetAddress, int, int) @bci=64, line=339 (Interpreted frame)
 - java.net.AbstractPlainSocketImpl.connectToAddress(java.net.InetAddress, int, int) @bci=23, line=200 (Interpreted frame)
 - java.net.AbstractPlainSocketImpl.connect(java.net.SocketAddress, int) @bci=78, line=182 (Interpreted frame)
 - java.net.SocksSocketImpl.connect(java.net.SocketAddress, int) @bci=378, line=392 (Interpreted frame)
 - java.net.Socket.connect(java.net.SocketAddress, int) @bci=179, line=579 (Interpreted frame)
 - java.net.Socket.connect(java.net.SocketAddress) @bci=3, line=528 (Interpreted frame)
 - com.taobao.tair.impl.mc.stat.notify.ClientStatNotify.reportStat() @bci=106, line=127 (Interpreted frame)
 - com.taobao.tair.impl.mc.stat.notify.ClientStatNotify.run() @bci=37, line=86 (Interpreted frame)
 - com.taobao.tair.impl.mc.stat.notify.ClientStatNotify.access$000(com.taobao.tair.impl.mc.stat.notify.ClientStatNotify) @bci=1, line=27 (Interpreted frame)
 - com.taobao.tair.impl.mc.stat.notify.ClientStatNotify$1.run() @bci=4, line=47 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 74243: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 73731: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 70151: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 69639: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 72195: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 71683: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 64779: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 65035: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 71171: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 70659: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 59151: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 58895: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 69123: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 68611: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 68099: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 67587: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 67075: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 66563: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 66051: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 65539: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 64003: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 63491: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 51211: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 51723: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 62979: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 62467: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 61955: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 61443: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 60931: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 60419: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 48399: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 48143: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 59907: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 59395: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 57859: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 57347: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 56835: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 56323: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 55811: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 55299: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 54787: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 54275: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 41995: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 38411: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 53763: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 53251: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 52739: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 52227: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 50691: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 50179: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 49667: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 49155: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 41479: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 39943: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 47619: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 47107: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 46595: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 46083: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 40455: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 40967: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 39431: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 38919: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 45571: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 45059: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 44547: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 44035: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 43523: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 43011: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)


Thread 42499: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.lang.ref.ReferenceQueue.remove(long) @bci=44, line=135 (Compiled frame)
 - com.mysql.jdbc.AbandonedConnectionCleanupThread.run() @bci=16, line=40 (Interpreted frame)


Thread 35843: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
 - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)


Thread 35331: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)
 - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Interpreted frame)


Thread 34819: (state = IN_NATIVE)
 - sun.nio.ch.KQueueArrayWrapper.kevent0(int, long, int, long) @bci=0 (Compiled frame; information may be imprecise)
 - sun.nio.ch.KQueueArrayWrapper.poll(long) @bci=17, line=200 (Compiled frame)
 - sun.nio.ch.KQueueSelectorImpl.doSelect(long) @bci=30, line=103 (Compiled frame)
 - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Compiled frame)
 - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Compiled frame)
 - org.apache.mina.transport.socket.nio.SocketIoProcessor$Worker.run() @bci=12, line=483 (Interpreted frame)
 - org.apache.mina.util.NamePreservingRunnable.run() @bci=29, line=51 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=95, line=1145 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 34307: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(java.util.concurrent.SynchronousQueue$TransferStack$SNode, boolean, long) @bci=174, line=460 (Interpreted frame)
 - java.util.concurrent.SynchronousQueue$TransferStack.transfer(java.lang.Object, boolean, long) @bci=102, line=359 (Interpreted frame)
 - java.util.concurrent.SynchronousQueue.poll(long, java.util.concurrent.TimeUnit) @bci=11, line=942 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=141, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 33795: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)
 - org.apache.mina.common.PooledByteBufferAllocator$Expirer.run() @bci=10, line=249 (Interpreted frame)


Thread 33283: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=122, line=1090 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 32771: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=122, line=1090 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 32259: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ArrayBlockingQueue.poll(long, java.util.concurrent.TimeUnit) @bci=49, line=389 (Interpreted frame)


Thread 31747: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=122, line=1090 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 31235: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=122, line=1090 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 30723: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)
 - java.util.concurrent.ArrayBlockingQueue.take() @bci=20, line=374 (Interpreted frame)


Thread 30211: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 29699: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(long, java.util.concurrent.TimeUnit) @bci=106, line=2176 (Interpreted frame)


Thread 29187: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(long, java.util.concurrent.TimeUnit) @bci=106, line=2176 (Interpreted frame)


Thread 28675: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)
 - io.netty.util.HashedWheelTimer$Worker.waitForNextTick() @bci=81, line=441 (Interpreted frame)
 - io.netty.util.HashedWheelTimer$Worker.run() @bci=43, line=360 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 27651: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ArrayBlockingQueue.poll(long, java.util.concurrent.TimeUnit) @bci=49, line=389 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=95, line=1145 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 27139: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ArrayBlockingQueue.poll(long, java.util.concurrent.TimeUnit) @bci=49, line=389 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=95, line=1145 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 12299: (state = IN_NATIVE)
 - java.net.SocketInputStream.socketRead0(java.io.FileDescriptor, byte[], int, int, int) @bci=0 (Interpreted frame)
 - java.net.SocketInputStream.read(byte[], int, int, int) @bci=87, line=152 (Interpreted frame)
 - java.net.SocketInputStream.read(byte[], int, int) @bci=11, line=122 (Interpreted frame)
 


Thread 13063: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=122, line=1090 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 12039: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ArrayBlockingQueue.poll(long, java.util.concurrent.TimeUnit) @bci=49, line=389 (Interpreted frame)
 

Thread 25859: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
 - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)


Thread 25347: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - org.mortbay.thread.QueuedThreadPool$PoolThread.run() @bci=275, line=625 (Interpreted frame)


Thread 24835: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - org.mortbay.thread.QueuedThreadPool$PoolThread.run() @bci=275, line=625 (Interpreted frame)


Thread 24323: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)
 

Thread 23811: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)


Thread 23299: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=122, line=1090 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 22787: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=122, line=1090 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 22275: (state = BLOCKED)
 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
 - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
 - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=122, line=1090 (Interpreted frame)
 - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1068 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=26, line=1130 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 22023: (state = IN_NATIVE)
 - sun.nio.ch.KQueueArrayWrapper.kevent0(int, long, int, long) @bci=0 (Compiled frame; information may be imprecise)
 - sun.nio.ch.KQueueArrayWrapper.poll(long) @bci=17, line=200 (Compiled frame)
 - sun.nio.ch.KQueueSelectorImpl.doSelect(long) @bci=30, line=103 (Compiled frame)
 - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Compiled frame)
 - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Compiled frame)
 - org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink$Boss.run() @bci=23, line=240 (Interpreted frame)
 - org.jboss.netty.util.ThreadRenamingRunnable.run() @bci=55, line=108 (Interpreted frame)
 - org.jboss.netty.util.internal.DeadLockProofWorker$1.run() @bci=14, line=44 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=95, line=1145 (Interpreted frame)
 - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=615 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 20227: (state = BLOCKED)
 - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)
 - com.taobao.pandora.framework.core.EventDispatcher$1.run() @bci=60, line=74 (Interpreted frame)
 - java.lang.Thread.run() @bci=11, line=744 (Interpreted frame)


Thread 13335: (state = BLOCKED)


Thread 11523: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.lang.ref.ReferenceQueue.remove(long) @bci=44, line=135 (Compiled frame)
 - java.lang.ref.ReferenceQueue.remove() @bci=2, line=151 (Compiled frame)
 - java.lang.ref.Finalizer$FinalizerThread.run() @bci=16, line=189 (Compiled frame)


Thread 11011: (state = BLOCKED)
 - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
 - java.lang.Object.wait() @bci=2, line=503 (Compiled frame)
 - java.lang.ref.Reference$ReferenceHandler.run() @bci=46, line=133 (Compiled frame)


Thread 4867: (state = BLOCKED)
 - org.apache.velocity.runtime.parser.Parser.jj_scan_token(int) @bci=170, line=3340 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.jj_3R_56() @bci=3, line=2768 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.jj_3R_29() @bci=1, line=3000 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.jj_3_8() @bci=1, line=2834 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.jj_3_7() @bci=17, line=2878 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.jj_2_7(int) @bci=19, line=2560 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.Reference() @bci=77, line=1317 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.PrimaryExpression() @bci=128, line=2468 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.UnaryExpression() @bci=309, line=2443 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.MultiplicativeExpression() @bci=1, line=2292 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.AdditiveExpression() @bci=1, line=2216 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.RelationalExpression() @bci=1, line=2084 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.EqualityExpression() @bci=1, line=2008 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.ConditionalAndExpression() @bci=1, line=1968 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.ConditionalOrExpression() @bci=1, line=1928 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.Expression() @bci=22, line=1875 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.SetDirective() @bci=157, line=1807 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.Statement() @bci=356, line=363 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.process() @bci=301, line=311 (Interpreted frame)
 - org.apache.velocity.runtime.parser.Parser.parse(java.io.Reader, java.lang.String) @bci=33, line=105 (Interpreted frame)
 - org.apache.velocity.runtime.RuntimeInstance.parse(java.io.Reader, java.lang.String, boolean) @bci=65, line=1131 (Interpreted frame)
 - org.apache.velocity.runtime.RuntimeInstance.parse(java.io.Reader, java.lang.String) @bci=4, line=1086 (Interpreted frame)
 - org.apache.velocity.Template.process() @bci=69, line=124 (Interpreted frame)
 - org.apache.velocity.runtime.resource.ResourceManagerImpl.loadResource(java.lang.String, int, java.lang.String) @bci=74, line=446 (Interpreted frame)
 - org.apache.velocity.runtime.resource.ResourceManagerImpl.getResource(java.lang.String, int, java.lang.String) @bci=132, line=354 (Interpreted frame)
 - org.apache.velocity.runtime.RuntimeInstance.getTemplate(java.lang.String, java.lang.String) @bci=11, line=1400 (Interpreted frame)
 - org.apache.velocity.app.VelocityEngine.getTemplate(java.lang.String, java.lang.String) @bci=6, line=422 (Interpreted frame)
 - com.alibaba.bcp.task.runner.java.VelocityTemplateManager.getCode(org.apache.velocity.VelocityContext, java.lang.String) @bci=67, line=55 (Interpreted frame)
 - com.alibaba.bcp.task.runner.java.JavaSourceObject.<init>(java.lang.String, java.lang.String, java.lang.String) @bci=152, line=52 (Interpreted frame)
 - com.alibaba.bcp.task.runner.java.JavaRunner.compile(java.lang.String, java.lang.String, java.lang.String, long) @bci=88, line=78 (Interpreted frame)
 - com.alibaba.bcp.task.runner.RuleRunnerFactory.safeCompile(java.lang.String, java.lang.String, java.lang.String, java.lang.String, long) @bci=30, line=30 (Interpreted frame)
 - com.alibaba.bcp.task.core.RuleFactory.load() @bci=471, line=214 (Interpreted frame)
 - com.alibaba.bcp.task.core.RuleFactory.start() @bci=0, line=100 (Interpreted frame)
 - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Interpreted frame)
 - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Interpreted frame)
 - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Interpreted frame)
 - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=606 (Interpreted frame)
 - org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeCustomInitMethod(java.lang.String, java.lang.Object, org.springframework.beans.factory.support.RootBeanDefinition) @bci=281, line=1544 (Interpreted frame)
 - org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(java.lang.String, java.lang.Object, org.springframework.beans.factory.support.RootBeanDefinition) @bci=156, line=1485 (Interpreted frame)
 - org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(java.lang.String, java.lang.Object, org.springframework.beans.factory.support.RootBeanDefinition) @bci=61, line=1417 (Interpreted frame)
 - org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(java.lang.String, org.springframework.beans.factory.support.RootBeanDefinition, java.lang.Object[]) @bci=230, line=519 (Interpreted frame)
 - org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(java.lang.String, org.springframework.beans.factory.support.RootBeanDefinition, java.lang.Object[]) @bci=122, line=456 (Interpreted frame)
 - org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject() @bci=16, line=293 (Interpreted frame)
 - org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(java.lang.String, org.springframework.beans.factory.ObjectFactory) @bci=126, line=222 (Interpreted frame)
 - org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(java.lang.String, java.lang.Class, java.lang.Object[], boolean) @bci=307, line=290 (Interpreted frame)
 - org.springframework.beans.factory.support.AbstractBeanFactory.getBean(java.lang.String) @bci=5, line=192 (Interpreted frame)
 - org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons() @bci=230, line=585 (Interpreted frame)
 - org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(org.springframework.beans.factory.config.ConfigurableListableBeanFactory) @bci=62, line=895 (Interpreted frame)
 - org.springframework.context.support.AbstractApplicationContext.refresh() @bci=54, line=425 (Interpreted frame)
 - org.springframework.web.context.ContextLoader.createWebApplicationContext(javax.servlet.ServletContext, org.springframework.context.ApplicationContext) @bci=229, line=282 (Interpreted frame)
 - org.springframework.web.context.ContextLoader.initWebApplicationContext(javax.servlet.ServletContext) @bci=69, line=204 (Interpreted frame)
 - com.alibaba.citrus.webx.context.WebxComponentsLoader.initWebApplicationContext(javax.servlet.ServletContext) @bci=11, line=127 (Interpreted frame)
 - org.springframework.web.context.ContextLoaderListener.contextInitialized(javax.servlet.ServletContextEvent) @bci=28, line=47 (Interpreted frame)
 - org.mortbay.jetty.handler.ContextHandler.startContext() @bci=62, line=548 (Interpreted frame)
 - org.mortbay.jetty.servlet.Context.startContext() @bci=1, line=136 (Interpreted frame)
 - org.mortbay.jetty.webapp.WebAppContext.startContext() @bci=123, line=1250 (Interpreted frame)
 - org.mortbay.jetty.handler.ContextHandler.doStart() @bci=140, line=517 (Interpreted frame)
 - org.mortbay.jetty.webapp.WebAppContext.doStart() @bci=217, line=467 (Interpreted frame)
 - org.mortbay.component.AbstractLifeCycle.start() @bci=31, line=50 (Interpreted frame)
 - org.mortbay.jetty.handler.HandlerWrapper.doStart() @bci=11, line=130 (Interpreted frame)
 - org.mortbay.jetty.Server.doStart() @bci=201, line=224 (Interpreted frame)
 - org.mortbay.component.AbstractLifeCycle.start() @bci=31, line=50 (Interpreted frame)
 - runjettyrun.Bootstrap.main(java.lang.String[]) @bci=1322, line=275 (Interpreted frame)

这样…但其实并不是所有线程都block了啊。至少main线程的：

Thread 4867: (state = BLOCKED) 
- org.apache.velocity.runtime.parser.Parser.jj_scan_token(int) @bci=170, line=3340 (Interpreted frame)

看起来不像真的block了。

这样得出别的招了：
1、下次在遇到这种看起来像是都block的时候用pstack来看看VM线程们都在干嘛
2、用 -XX:+PrintSafepointStatistics -XX:PrintSafepointStatisticsCount=1 来打印safepoint信息，看看那些看起来都block的时候是不是在safepoint里。如果是的话是什么safepoint，是不是GC。如果是GC的话，暂停个2分钟也不算什么稀奇的事，可以慢慢排查…

暂停的时候的safepoint是这样的

vmop                    [threads: total initially_running wait_to_block]    [time: spin block sync cleanup vmop] page_trap_count
129.536: RevokeBias                       [     152          0              1    ]      [     0     4     4     0     0    ]  0   
         vmop                    [threads: total initially_running wait_to_block]    [time: spin block sync cleanup vmop] page_trap_count
130.529: RevokeBias                       [     152          0              1    ]      [     0     0     0     0     0    ]  0   
         vmop                    [threads: total initially_running wait_to_block]    [time: spin block sync cleanup vmop] page_trap_count
138.690: BulkRevokeBias                   [     151          0              1    ]      [     0     0     0     0     0    ]  0   
         vmop                    [threads: total initially_running wait_to_block]    [time: spin block sync cleanup vmop] page_trap_count
140.137: RevokeBias                       [     151          0              1    ]      [     0     0     0     0     0    ]  0   
         vmop                    [threads: total initially_running wait_to_block]    [time: spin block sync cleanup vmop] page_trap_count
159.536: RevokeBias                       [     150          0              1    ]      [     0     0     0     0     0    ]  0   
         vmop                    [threads: total initially_running wait_to_block]    [time: spin block sync cleanup vmop] page_trap_count
160.530: RevokeBias                       [     151          0              1    ]      [     0     0     0     0     0    ]  0   
         vmop                    [threads: total initially_running wait_to_block]    [time: spin block sync cleanup vmop] page_trap_count
169.666: RevokeBias                       [     151          0              1    ]      [     0     5     6     0     0    ]  0   
         vmop                    [threads: total initially_running wait_to_block]    [time: spin block sync cleanup vmop] page_trap_count
189.536: RevokeBias                       [     151          0              1    ]      [     0     0     0     0     0    ]  0   

gc的日志打印是这样的：

2014-11-21T13:44:50.211-0800: 118.459: [GC [PSYoungGen: 104485K->32425K(121856K)] 373400K->305256K(471040K), 0.0322630 secs] [Times: user=0.09 sys=0.01, real=0.03 secs]
2014-11-21T13:44:50.243-0800: 118.491: [Full GC [PSYoungGen: 32425K->0K(121856K)] [ParOldGen: 272831K->222742K(349184K)] 305256K->222742K(471040K) [PSPermGen: 131071K->81752K(131072K)], 1.1081060 secs] [Times: user=1.13 sys=0.02, real=1.11 secs]
2014-11-21T13:44:51.352-0800: 119.599: Total time for which application threads were stopped: 1.1409680 seconds
2014-11-21T13:44:51.352-0800: 119.600: Application time: 0.0002480 seconds
2014-11-21T13:44:51.352-0800: 119.600: Total time for which application threads were stopped: 0.0005250 seconds
2014-11-21T13:44:51.353-0800: 119.601: Application time: 0.0003860 seconds
2014-11-21T13:44:51.353-0800: 119.601: Total time for which application threads were stopped: 0.0001650 seconds
2014-11-21T13:44:51.353-0800: 119.601: Application time: 0.0000710 seconds
2014-11-21T13:44:51.361-0800: 119.609: Total time for which application threads were stopped: 0.0078230 seconds
2014-11-21T13:44:51.361-0800: 119.609: Application time: 0.0006750 seconds
2014-11-21T13:44:51.362-0800: 119.609: Total time for which application threads were stopped: 0.0001900 seconds
2014-11-21T13:44:51.362-0800: 119.610: Application time: 0.0000920 seconds
2014-11-21T13:44:51.362-0800: 119.610: Total time for which application threads were stopped: 0.0001380 seconds
2014-11-21T13:44:51.362-0800: 119.610: Application time: 0.0000680 seconds
2014-11-21T13:44:51.362-0800: 119.610: Total time for which application threads were stopped: 0.0001580 seconds
2014-11-21T13:44:51.362-0800: 119.610: Application time: 0.0000860 seconds
2014-11-21T13:44:51.362-0800: 119.610: Total time for which application threads were stopped: 0.0001280 seconds
2014-11-21T13:44:51.362-0800: 119.610: Application time: 0.0000560 seconds
2014-11-21T13:44:51.363-0800: 119.610: Total time for which application threads were stopped: 0.0001470 seconds
2014-11-21T13:44:51.363-0800: 119.610: Application time: 0.0000470 seconds
2014-11-21T13:44:51.363-0800: 119.611: Total time for which application threads were stopped: 0.0001180 seconds
2014-11-21T13:44:51.363-0800: 119.611: Application time: 0.0000670 seconds
2014-11-21T13:44:51.363-0800: 119.611: Total time for which application threads were stopped: 0.0001230 seconds
2014-11-21T13:44:51.363-0800: 119.611: Application time: 0.0000610 seconds
2014-11-21T13:44:51.363-0800: 119.611: Total time for which application threads were stopped: 0.0001440 seconds
2014-11-21T13:44:51.363-0800: 119.611: Application time: 0.0002280 seconds
2014-11-21T13:44:51.364-0800: 119.612: Total time for which application threads were stopped: 0.0004260 seconds
2014-11-21T13:45:01.289-0800: 129.537: Application time: 9.9249200 seconds
2014-11-21T13:45:01.293-0800: 129.541: Total time for which application threads were stopped: 0.0046690 seconds
2014-11-21T13:45:02.281-0800: 130.529: Application time: 0.9873240 seconds
2014-11-21T13:45:02.281-0800: 130.529: Total time for which application threads were stopped: 0.0003560 seconds
2014-11-21T13:45:10.442-0800: 138.690: Application time: 8.1611220 seconds
2014-11-21T13:45:10.443-0800: 138.691: Total time for which application threads were stopped: 0.0006980 seconds
2014-11-21T13:45:11.889-0800: 140.137: Application time: 1.4458440 seconds
2014-11-21T13:45:11.889-0800: 140.137: Total time for which application threads were stopped: 0.0003410 seconds
2014-11-21T13:45:31.288-0800: 159.536: Application time: 19.3992940 seconds
2014-11-21T13:45:31.289-0800: 159.537: Total time for which application threads were stopped: 0.0003140 seconds
2014-11-21T13:45:32.282-0800: 160.530: Application time: 0.9930880 seconds
2014-11-21T13:45:32.282-0800: 160.530: Total time for which application threads were stopped: 0.0003540 seconds
2014-11-21T13:45:41.419-0800: 169.666: Application time: 9.1365470 seconds
2014-11-21T13:45:41.425-0800: 169.673: Total time for which application threads were stopped: 0.0063770 seconds
2014-11-21T13:46:01.288-0800: 189.536: Application time: 19.8629780 seconds
2014-11-21T13:46:01.288-0800: 189.536: Total time for which application threads were stopped: 0.0003740 seconds
2014-11-21T13:46:02.283-0800: 190.530: Application time: 0.9942190 seconds
2014-11-21T13:46:02.283-0800: 190.531: Total time for which application threads were stopped: 0.0003450 seconds
2014-11-21T13:46:10.956-0800: 199.203: Application time: 8.6726140 seconds
2014-11-21T13:46:10.956-0800: 199.204: Total time for which application threads were stopped: 0.0006100 seconds
2014-11-21T13:46:31.288-0800: 219.536: Application time: 20.3318180 seconds
2014-11-21T13:46:31.288-0800: 219.536: Total time for which application threads were stopped: 0.0003610 seconds
2014-11-21T13:46:32.283-0800: 220.531: Application time: 0.9950400 seconds
2014-11-21T13:46:32.284-0800: 220.532: Total time for which application threads were stopped: 0.0003690 seconds
2014-11-21T13:46:40.484-0800: 228.732: Application time: 8.2001120 seconds
2014-11-21T13:46:40.484-0800: 228.732: Total time for which application threads were stopped: 0.0003110 seconds
2014-11-21T13:47:01.288-0800: 249.536: Application time: 20.8036310 seconds
2014-11-21T13:47:01.295-0800: 249.543: Total time for which application threads were stopped: 0.0071560 seconds
2014-11-21T13:47:02.283-0800: 250.530: Application time: 0.9874540 seconds
2014-11-21T13:47:02.283-0800: 250.531: Total time for which application threads were stopped: 0.0003290 seconds
2014-11-21T13:47:10.023-0800: 258.270: Application time: 7.7397590 seconds
2014-11-21T13:47:10.023-0800: 258.271: Total time for which application threads were stopped: 0.0004680 seconds
2014-11-21T13:47:10.878-0800: 259.125: Application time: 0.8545540 seconds
2014-11-21T13:47:10.879-0800: 259.127: Total time for which application threads were stopped: 0.0010800 seconds
2014-11-21T13:47:31.288-0800: 279.536: Application time: 20.4093660 seconds
2014-11-21T13:47:31.288-0800: 279.536: Total time for which application threads were stopped: 0.0003220 seconds
2014-11-21T13:47:32.282-0800: 280.530: Application time: 0.9934680 seconds
2014-11-21T13:47:32.286-0800: 280.534: Total time for which application threads were stopped: 0.0045890 seconds
2014-11-21T13:47:35.294-0800: 283.542: Application time: 3.0077790 seconds
2014-11-21T13:47:35.295-0800: 283.543: Total time for which application threads were stopped: 0.0004200 seconds
2014-11-21T13:47:37.299-0800: 285.547: Application time: 2.0042510 seconds
2014-11-21T13:47:37.299-0800: 285.547: Total time for which application threads were stopped: 0.0002940 seconds
2014-11-21T13:47:38.673-0800: 286.920: Application time: 1.3733600 seconds
2014-11-21T13:47:38.673-0800: 286.921: [GC [PSYoungGen: 89088K->3033K(124416K)] 311830K->225775K(473600K), 0.0079420 secs] [Times: user=0.02 sys=0.00, real=0.01 secs]
2014-11-21T13:47:38.681-0800: 286.929: Total time for which application threads were stopped: 0.0085540 seconds
2014-11-21T13:47:39.324-0800: 287.572: Application time: 0.6431620 seconds

应该是Biased锁的问题，我再研究一下。

去掉了Biased锁，还是会暂停，换了linux打印jstack了：

0x00007f8255b68414	__pthread_cond_wait + 0xc4
0x00007f82552d1b57	_ZN7Monitor5IWaitEP6Threadl + 0xc7
0x00007f82552d276f	_ZN7Monitor4waitEblb + 0x22f
0x00007f825543c852	_ZN10JavaThread17java_suspend_selfEv + 0x102
0x00007f82551f23c3	_ZN15JvmtiRawMonitor8raw_waitElbP6Thread + 0x153
0x00007f82551d5b79	_ZN8JvmtiEnv14RawMonitorWaitEP15JvmtiRawMonitorl + 0x59
0x00007f824f9ab2b9		????????
0x00007f824f99d72e		????????
0x00007f824f99e783		????????
0x00007f824f999339		????????
0x00007f824f9996e8		????????
0x00007f824f99c11c		????????
0x00007f82551e4b98	_ZN11JvmtiExport20post_exception_throwEP10JavaThreadP13methodOopDescPhP7oopDesc + 0x5e8
0x00007f825511fa0c	_ZN18InterpreterRuntime31exception_handler_for_exceptionEP10JavaThreadP7oopDesc + 0x27c
0x00007f824b66db8d	* com.sun.source.util.TreePath$1PathFinder.scan(com.sun.source.tree.Tree, com.sun.source.tree.Tree) bci:24 line:65 (Interpreted frame)
0x00007f824b6602b3	* com.sun.source.util.TreePath$1PathFinder.scan(com.sun.source.tree.Tree, java.lang.Object) bci:6 line:62 (Interpreted frame)
0x00007f824b6602b3	* com.sun.source.util.TreeScanner.scan(java.lang.Iterable, java.lang.Object) bci:48 line:90 (Interpreted frame)
0x00007f824b6602b3	* com.sun.source.util.TreeScanner.scanAndReduce(java.lang.Iterable, java.lang.Object, java.lang.Object) bci:4 line:98 (Interpreted frame)
0x00007f824b6602b3	* com.sun.source.util.TreeScanner.visitCompilationUnit(com.sun.source.tree.CompilationUnitTree, java.lang.Object) bci:47 line:119 (Interpreted frame)
0x00007f824b660961	* com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(com.sun.source.tree.TreeVisitor, java.lang.Object) bci:3 line:492 (Interpreted frame)
0x00007f824b660961	* com.sun.source.util.TreePathScanner.scan(com.sun.source.util.TreePath, java.lang.Object) bci:11 line:49 (Interpreted frame)
0x00007f824b6602b3	* com.sun.source.util.TreePath.getPath(com.sun.source.util.TreePath, com.sun.source.tree.Tree) bci:19 line:71 (Interpreted frame)
0x00007f824b6602b3	* com.sun.source.util.TreePath.getPath(com.sun.source.tree.CompilationUnitTree, com.sun.source.tree.Tree) bci:9 line:44 (Interpreted frame)
0x00007f824b6602b3	* com.sun.tools.javac.api.JavacTrees.getPath(javax.lang.model.element.Element, javax.lang.model.element.AnnotationMirror, javax.lang.model.element.AnnotationValue) bci:35 line:200 (Interpreted frame)
0x00007f824b6602b3	* com.sun.tools.javac.api.JavacTrees.getPath(javax.lang.model.element.Element) bci:4 line:189 (Interpreted frame)
0x00007f824b6602b3	* lombok.javac.apt.Processor.toUnit(javax.lang.model.element.Element) bci:16 line:303 (Interpreted frame)
0x00007f824b6602b3	* lombok.javac.apt.Processor.process(java.util.Set, javax.annotation.processing.RoundEnvironment) bci:55 line:234 (Interpreted frame)
0x00007f824b660a7e	* lombok.core.AnnotationProcessor$JavacDescriptor.process(java.util.Set, javax.annotation.processing.RoundEnvironment) bci:6 line:115 (Interpreted frame)
0x00007f824b6603d0	* lombok.core.AnnotationProcessor.process(java.util.Set, javax.annotation.processing.RoundEnvironment) bci:144 line:165 (Interpreted frame)
0x00007f824b660a7e	* com.sun.tools.javac.processing.JavacProcessingEnvironment.callProcessor(javax.annotation.processing.Processor, java.util.Set, javax.annotation.processing.RoundEnvironment) bci:3 line:793 (Interpreted frame)
0x00007f824b6603d0	* com.sun.tools.javac.processing.JavacProcessingEnvironment.discoverAndRunProcs(com.sun.tools.javac.util.Context, java.util.Set, com.sun.tools.javac.util.List, com.sun.tools.javac.util.List) bci:316 line:722 (Interpreted frame)
0x00007f824b6600d8	* com.sun.tools.javac.processing.JavacProcessingEnvironment.access$1700(com.sun.tools.javac.processing.JavacProcessingEnvironment, com.sun.tools.javac.util.Context, java.util.Set, com.sun.tools.javac.util.List, com.sun.tools.javac.util.List) bci:6 line:97 (Interpreted frame)
0x00007f824b6600d8	* com.sun.tools.javac.processing.JavacProcessingEnvironment$Round.run(boolean, boolean) bci:114 line:1029 (Interpreted frame)
0x00007f824b6600d8	* com.sun.tools.javac.processing.JavacProcessingEnvironment.doProcessing(com.sun.tools.javac.util.Context, com.sun.tools.javac.util.List, com.sun.tools.javac.util.List, java.lang.Iterable) bci:99 line:1163 (Interpreted frame)
0x00007f824b6602b3	* com.sun.tools.javac.main.JavaCompiler.processAnnotations(com.sun.tools.javac.util.List, com.sun.tools.javac.util.List) bci:415 line:1108 (Interpreted frame)
0x00007f824b6602b3	* com.sun.tools.javac.main.JavaCompiler.compile(com.sun.tools.javac.util.List, com.sun.tools.javac.util.List, java.lang.Iterable) bci:149 line:824 (Interpreted frame)
0x00007f824b6600d8	* com.sun.tools.javac.main.Main.compile(java.lang.String[], java.lang.String[], com.sun.tools.javac.util.Context, com.sun.tools.javac.util.List, java.lang.Iterable) bci:761 line:439 (Interpreted frame)
0x00007f824b660254	* com.sun.tools.javac.api.JavacTaskImpl.call() bci:59 line:132 (Interpreted frame)

求解啊   

您的程序插了什么JVMTI agent?

以可以远程debug的方式启动的：-agentlib:jdwp=transport=dt_socket,suspend=y,address=localhost:49947

请问那个agent去掉的话还是会有一样的行为不？
Stack trace里涉及JVMTI的那部分看起来挺奇怪的