New topics: Your Pet, IOU, Baby IQ, The Poisons, Birther II, Games, Future Power

Trying out the documentation theme?

Skip to end of metadata
Go to start of metadata
In this set of pages on Investigating A Slow Confluence Installation - Version 3.3.1, I document the steps I took to try and identify slow running operations on my copy of Confluence 3.3.1. I recently added about 10K pages and labels for an EGW topical index, roughly doubling the number of pages (not not total size of content). This should account for the recent slowdowns and non-responsive Confluence that I have seen.

In this set of topics I discuss how I examined the database, stack dumps, dealt with Confluence hangs, logged bugs with the vendor, examined robot activity, and took other defensive measures to keep my copy of Confluence running.

Please let me know if these topics helped you run your copy of Conflunece. You can use the "Add comment" on any of these pages to let me know. Please include your email addres in your comment, I will keep a copy of your email so we can correspond about Confluence, but quickly remove it from the comment you place here.

Here is an analysis.

Pulled these dumps, requested by the Confluence watchdog for linux from the catalina.out, then uploaded them into the wiki with these commands:

bobsgear-cli.sh --action storepage --space "Bobsgear"  --title "Heavy CPU Load - 2010-09-12-08-00-thread-dump" --parent "Thread Dumps 2010-09-12" --file "2010-09-12-08-00-thread-dump"

bobsgear-cli.sh --action storepage --space "Bobsgear"  --title "Low CPU Load - 2010-09-12-09-30-thread-dump" --parent "Thread Dumps 2010-09-12" --file "2010-09-12-09-30-thread-dump"

Report logged with the Atlassian: https://support.atlassian.com/browse/CSP-51459 - response by a technician claiming out of memory issues were the cause of my problems

57K - Slower operation, Confluence using around 150% CPU
Heavy CPU Load - 2010-09-12-08-00-thread-dump

2010-09-12 08:00:17
Full thread dump Java HotSpot(TM) Server VM (16.0-b13 mixed mode):

"http-8080-25" daemon prio=10 tid=0x0965dc00 nid=0x1113 in Object.wait() [0x60bd9000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x85db7af8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
    at java.lang.Object.wait(Object.java:485)
    at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
  • locked <0x85db7af8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
    at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
    at java.lang.Thread.run(Thread.java:619)

"http-8080-24" daemon prio=10 tid=0x0965d000 nid=0x1112 in Object.wait() [0x610b3000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-23" daemon prio=10 tid=0x09c33400 nid=0x1111 in Object.wait() [0x62161000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-22" daemon prio=10 tid=0x09c33000 nid=0x1110 in Object.wait() [0x61155000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-21" daemon prio=10 tid=0x09500000 nid=0x4516 in Object.wait() [0x61104000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-20" daemon prio=10 tid=0x0972c800 nid=0x44cc in Object.wait() [0x60d1d000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-19" daemon prio=10 tid=0x0972b800 nid=0x44cb in Object.wait() [0x611f7000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-18" daemon prio=10 tid=0x09682c00 nid=0x44ca in Object.wait() [0x61248000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-17" daemon prio=10 tid=0x098a9800 nid=0x44c9 in Object.wait() [0x60c7b000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-16" daemon prio=10 tid=0x0973c000 nid=0x44c8 in Object.wait() [0x60fc0000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-15" daemon prio=10 tid=0x096ef000 nid=0x44c7 runnable [0x60f00000]
java.lang.Thread.State: RUNNABLE
at java.util.HashMap.size(HashMap.java:268)
at org.apache.commons.collections.SequencedHashMap.size(SequencedHashMap.java:237)
at net.sf.hibernate.util.IdentityMap.entryList(IdentityMap.java:170)
at net.sf.hibernate.util.IdentityMap.entries(IdentityMap.java:58)
at net.sf.hibernate.impl.SessionImpl.flushCollections(SessionImpl.java:2822)
at net.sf.hibernate.impl.SessionImpl.flushEverything(SessionImpl.java:2280)
at net.sf.hibernate.impl.SessionImpl.autoFlushIfRequired(SessionImpl.java:1813)
at net.sf.hibernate.impl.SessionImpl.getQueries(SessionImpl.java:1576)
at net.sf.hibernate.impl.SessionImpl.find(SessionImpl.java:1541)
at net.sf.hibernate.impl.QueryImpl.list(QueryImpl.java:49)
at com.atlassian.confluence.security.persistence.dao.hibernate.HibernateContentPermissionSetDao$1.
doInHibernate(HibernateContentPermissionSetDao.java:44)
at org.springframework.orm.hibernate.HibernateTemplate.execute(HibernateTemplate.java:370)
at org.springframework.orm.hibernate.HibernateTemplate.executeFind(HibernateTemplate.java:341)
at com.atlassian.confluence.security.persistence.dao.hibernate.HibernateContentPermissionSetDao.
getInheritedContentPermissionSets(HibernateContentPermissionSetDao.java:28)
at com.atlassian.confluence.core.DefaultInheritedContentPermissionManager.
getInheritedContentPermissionSets(DefaultInheritedContentPermissionManager.java:18)
at com.atlassian.confluence.core.CachingInheritedContentPermissionManager.
getInheritedContentPermissionSets(CachingInheritedContentPermissionManager.java:46)
at com.atlassian.confluence.core.DefaultContentPermissionManager.
getInheritedContentPermissionSets(DefaultContentPermissionManager.java:114)
at com.atlassian.confluence.core.DefaultContentPermissionManager.
hasContentLevelPermission(DefaultContentPermissionManager.java:153)
at sun.reflect.GeneratedMethodAccessor220.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy13.hasContentLevelPermission(Unknown Source)
at com.atlassian.confluence.security.delegate.PagePermissionsDelegate.
hasContentLevelViewPermission(PagePermissionsDelegate.java:50)
at com.atlassian.confluence.security.delegate.PagePermissionsDelegate.canView(PagePermissionsDelegate.java:17)
at com.atlassian.confluence.security.Permission$1.checkAgainst(Permission.java:18)
at com.atlassian.confluence.security.DefaultPermissionManager.hasPermission(DefaultPermissionManager.java:35)
at com.atlassian.confluence.security.DefaultPermissionManager.getPermittedEntities(DefaultPermissionManager.java:72)
at sun.reflect.GeneratedMethodAccessor530.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
at com.atlassian.spring.interceptors.SpringProfilingInterceptor.invoke(SpringProfilingInterceptor.java:16)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy22.getPermittedEntities(Unknown Source)
at com.atlassian.confluence.core.ConfluenceActionSupport.getPermittedEntitiesOf(ConfluenceActionSupport.java:362)
at com.atlassian.confluence.pages.actions.ChildrenAction.getPermittedChildren(ChildrenAction.java:35)
at com.adaptavist.confluence.naturalchildren.NaturalChildrenAction.
getPermittedChildrenFromSuperClass(NaturalChildrenAction.java:151)
at com.adaptavist.confluence.naturalchildren.NaturalChildrenAction.getPermittedChildren(NaturalChildrenAction.java:142)
at com.adaptavist.confluence.naturalchildren.NaturalChildrenAction.hasPermittedChildren(NaturalChildrenAction.java:156)
at sun.reflect.GeneratedMethodAccessor532.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.doInvoke(UberspectImpl.java:389)
at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.invoke(UberspectImpl.java:378)
at com.atlassian.confluence.velocity.introspection.UnboxingMethod.invoke(UnboxingMethod.java:31)
at org.apache.velocity.runtime.parser.node.ASTMethod.execute(ASTMethod.java:270)
at org.apache.velocity.runtime.parser.node.ASTReference.execute(ASTReference.java:252)
at org.apache.velocity.runtime.parser.node.ASTReference.evaluate(ASTReference.java:460)
at org.apache.velocity.runtime.parser.node.ASTExpression.evaluate(ASTExpression.java:62)
at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:85)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:212)
at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:247)
at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:175)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.directive.Foreach.render(Foreach.java:364)
at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:175)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:87)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:87)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:87)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:212)
at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:247)
at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:175)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.directive.Foreach.render(Foreach.java:364)
at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:175)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:87)
at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:336)
at org.apache.velocity.Template.merge(Template.java:328)
at org.apache.velocity.Template.merge(Template.java:235)
at com.opensymphony.webwork.dispatcher.VelocityResult.doExecute(VelocityResult.java:91)
at com.atlassian.xwork.results.ProfiledVelocityResult.doExecute(ProfiledVelocityResult.java:21)
at com.opensymphony.webwork.dispatcher.WebWorkResultSupport.execute(WebWorkResultSupport.java:116)
at com.opensymphony.xwork.DefaultActionInvocation.executeResult(DefaultActionInvocation.java:263)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:187)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.util.LoggingContextInterceptor.intercept(LoggingContextInterceptor.java:49)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.core.CancellingInterceptor.intercept(CancellingInterceptor.java:23)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.security.websudo.WebSudoInterceptor.intercept(WebSudoInterceptor.java:69)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.security.actions.PermissionCheckInterceptor.intercept(PermissionCheckInterceptor.java:57)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.setup.webwork.BootstrapAwareInterceptor.intercept(BootstrapAwareInterceptor.java:26)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.user.actions.UserAwareInterceptor.intercept(UserAwareInterceptor.java:58)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.pages.actions.CommentAwareInterceptor.intercept(CommentAwareInterceptor.java:44)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.pages.actions.PageAwareInterceptor.intercept(PageAwareInterceptor.java:109)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.spaces.actions.SpaceAwareInterceptor.intercept(SpaceAwareInterceptor.java:68)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.core.actions.LastModifiedInterceptor.intercept(LastModifiedInterceptor.java:38)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.core.ConfluenceAutowireInterceptor.intercept(ConfluenceAutowireInterceptor.java:38)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.xwork.interceptors.TransactionalInvocation.invokeAndHandleExceptions(TransactionalInvocation.java:72)
at com.atlassian.xwork.interceptors.TransactionalInvocation.invokeInTransaction(TransactionalInvocation.java:59)
at com.atlassian.xwork.interceptors.XWorkTransactionInterceptor.intercept(XWorkTransactionInterceptor.java:56)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.xwork.SetupIncompleteInterceptor.intercept(SetupIncompleteInterceptor.java:40)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.DefaultActionProxy.execute(DefaultActionProxy.java:115)
at com.atlassian.confluence.servlet.ConfluenceServletDispatcher.serviceAction(ConfluenceServletDispatcher.java:53)
at com.opensymphony.webwork.dispatcher.ServletDispatcher.service(ServletDispatcher.java:199)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter$1.doFilter(DelegatingPluginFilter.java:66)
at com.niclabs.confluence.mobile.webclient.MobileAgentStringFilter.doFilterInternal(MobileAgentStringFilter.java:25)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:75)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter.doFilter(DelegatingPluginFilter.java:74)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:42)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.
doFilter(ServletFilterModuleContainerFilter.java:77)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.
doFilter(ServletFilterModuleContainerFilter.java:63)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.opensymphony.module.sitemesh.filter.PageFilter.parsePage(PageFilter.java:118)
at com.atlassian.confluence.util.profiling.ProfilingPageFilter.parsePage(ProfilingPageFilter.java:84)
at com.opensymphony.module.sitemesh.filter.PageFilter.doFilter(PageFilter.java:54)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.
doFilter(ServletFilterModuleContainerFilter.java:77)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.
doFilter(ServletFilterModuleContainerFilter.java:63)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.jmx.JmxFilter.doFilter(JmxFilter.java:106)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.core.filters.ServletContextThreadLocalFilter.doFilter(ServletContextThreadLocalFilter.java:19)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.util.LoggingContextFilter.doFilter(LoggingContextFilter.java:47)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.web.filter.ThreadLocalCacheFilter.doFilter(ThreadLocalCacheFilter.java:22)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.util.UserThreadLocalFilter.doFilter(UserThreadLocalFilter.java:44)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.seraph.filter.SecurityFilter.doFilter(SecurityFilter.java:219)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.security.auth.trustedapps.filter.TrustedApplicationsFilter.doFilter(TrustedApplicationsFilter.java:98)
at com.atlassian.confluence.util.AbstractBootstrapHotSwappingFilter.doFilter(AbstractBootstrapHotSwappingFilter.java:30)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.seraph.filter.BaseLoginFilter.doFilter(BaseLoginFilter.java:140)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter$1.doFilter(DelegatingPluginFilter.java:66)
at com.atlassian.oauth.serviceprovider.internal.servlet.OAuthFilter.doFilter(OAuthFilter.java:69)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter.doFilter(DelegatingPluginFilter.java:74)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:42)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:77)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:63)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.util.ClusterHeaderFilter.doFilter(ClusterHeaderFilter.java:34)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.johnson.filters.AbstractJohnsonFilter.doFilter(AbstractJohnsonFilter.java:72)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.springframework.orm.hibernate.support.OpenSessionInViewFilter.doFilterInternal(OpenSessionInViewFilter.java:170)
at com.atlassian.spring.filter.FlushingSpringSessionInViewFilter.doFilterInternal(FlushingSpringSessionInViewFilter.java:29)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:75)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.util.ConfluenceErrorFilter.doFilter(ConfluenceErrorFilter.java:22)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.util.profiling.filters.ProfilingFilter.doFilter(ProfilingFilter.java:99)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.core.datetime.RequestTimeThreadLocalFilter.doFilter(RequestTimeThreadLocalFilter.java:35)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.util.RequestCacheThreadLocalFilter.doFilter(RequestCacheThreadLocalFilter.java:25)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.gzipfilter.GzipFilter.doFilterInternal(GzipFilter.java:81)
at com.atlassian.gzipfilter.GzipFilter.doFilter(GzipFilter.java:51)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.core.filters.cache.AbstractCachingFilter.doFilter(AbstractCachingFilter.java:33)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter$1.doFilter(DelegatingPluginFilter.java:66)
at com.atlassian.confluence.extra.webdav.servlet.filter.ReverseProxyFilter.doFilter(ReverseProxyFilter.java:427)
at com.atlassian.confluence.extra.webdav.servlet.filter.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:34)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter.doFilter(DelegatingPluginFilter.java:74)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:42)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:77)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:63)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.core.filters.encoding.AbstractEncodingFilter.doFilter(AbstractEncodingFilter.java:41)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.core.filters.HeaderSanitisingFilter.doFilter(HeaderSanitisingFilter.java:44)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.servlet.FourOhFourErrorLoggingFilter.doFilter(FourOhFourErrorLoggingFilter.java:65)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:852)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:619)

"http-8080-14" daemon prio=10 tid=0x096ed800 nid=0x44c6 in Object.wait() [0x60eb2000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-13" daemon prio=10 tid=0x09661c00 nid=0x44c5 in Object.wait() [0x60ccc000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-12" daemon prio=10 tid=0x09661800 nid=0x44c4 in Object.wait() [0x60b88000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-11" daemon prio=10 tid=0x0929fc00 nid=0x44c3 in Object.wait() [0x60f57000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-10" daemon prio=10 tid=0x094be800 nid=0x44c2 in Object.wait() [0x612ea000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-9" daemon prio=10 tid=0x0a08bc00 nid=0x44bf in Object.wait() [0x609fc000]
java.lang.Thread.State: WAITING (on object monitor)

"pool-8-thread-1" prio=10 tid=0x6087e000 nid=0x44b8 waiting on condition [0x5fbf4000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

  • parking to wait for <0x7ab208f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
    at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at java.lang.Thread.run(Thread.java:619)

"http-8080-8" daemon prio=10 tid=0x097fc400 nid=0x44b7 in Object.wait() [0x64169000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-7" daemon prio=10 tid=0x0952c800 nid=0x44b6 in Object.wait() [0x641ba000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-6" daemon prio=10 tid=0x0962d000 nid=0x44b5 in Object.wait() [0x6420b000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-5" daemon prio=10 tid=0x0a057800 nid=0x44b4 in Object.wait() [0x6425c000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-4" daemon prio=10 tid=0x09b95800 nid=0x44b3 in Object.wait() [0x642ad000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-3" daemon prio=10 tid=0x09563800 nid=0x44b2 runnable [0x642fe000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:809)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:619)

"http-8080-2" daemon prio=10 tid=0x09d09000 nid=0x44b1 in Object.wait() [0x6445c000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-1" daemon prio=10 tid=0x092e4c00 nid=0x44b0 in Object.wait() [0x644ad000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-Acceptor-0" daemon prio=10 tid=0x604d7400 nid=0x44af runnable [0x644fe000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

  • locked <0x7809c9f0> (a java.net.SocksSocketImpl)
    at java.net.ServerSocket.implAccept(ServerSocket.java:453)
    at java.net.ServerSocket.accept(ServerSocket.java:421)
    at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:61)
    at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:352)
    at java.lang.Thread.run(Thread.java:619)

"ContainerBackgroundProcessor[StandardEngine[Standalone]]" daemon prio=10 tid=0x6047d400 nid=0x44ae waiting on condition [0x64897000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1579)
at java.lang.Thread.run(Thread.java:619)

"pool-5-thread-1" prio=10 tid=0x60829400 nid=0x44ab waiting on condition [0x62243000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

  • parking to wait for <0x780f5718> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
    at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at java.lang.Thread.run(Thread.java:619)

"com.google.common.base.internal.Finalizer" daemon prio=10 tid=0x60478800 nid=0x44aa in Object.wait() [0x622cb000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x7b571c40> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
  • locked <0x7b571c40> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at com.google.common.base.internal.Finalizer.run(Finalizer.java:127)

"Timer-4" daemon prio=10 tid=0x61b2e000 nid=0x448c in Object.wait() [0x61f76000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x733a91b0> (a java.util.TaskQueue)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
  • locked <0x733a91b0> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)

"Timer-3" daemon prio=10 tid=0x0a0d7400 nid=0x448b in Object.wait() [0x61fc7000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78279788> (a java.util.TaskQueue)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
  • locked <0x78279788> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)

"FelixPackageAdmin" daemon prio=10 tid=0x0955e800 nid=0x448a in Object.wait() [0x62067000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78117628> (a org.apache.felix.framework.PackageAdminImpl)
    at java.lang.Object.wait(Object.java:485)
    at org.apache.felix.framework.PackageAdminImpl.run(PackageAdminImpl.java:316)
  • locked <0x78117628> (a org.apache.felix.framework.PackageAdminImpl)
    at java.lang.Thread.run(Thread.java:619)

"FelixStartLevel" daemon prio=10 tid=0x092b2000 nid=0x4489 in Object.wait() [0x620b8000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x72679d10> (a java.util.ArrayList)
    at java.lang.Object.wait(Object.java:485)
    at org.apache.felix.framework.StartLevelImpl.run(StartLevelImpl.java:242)
  • locked <0x72679d10> (a java.util.ArrayList)
    at java.lang.Thread.run(Thread.java:619)

"FelixDispatchQueue" daemon prio=10 tid=0x092b5000 nid=0x4488 in Object.wait() [0x62110000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x72fc2860> (a java.util.ArrayList)
    at java.lang.Object.wait(Object.java:485)
    at org.apache.felix.framework.util.EventDispatcher.run(EventDispatcher.java:917)
  • locked <0x72fc2860> (a java.util.ArrayList)
    at org.apache.felix.framework.util.EventDispatcher.access$000(EventDispatcher.java:54)
    at org.apache.felix.framework.util.EventDispatcher$1.run(EventDispatcher.java:106)
    at java.lang.Thread.run(Thread.java:619)

"Timer-2" daemon prio=10 tid=0x62814c00 nid=0x4486 in Object.wait() [0x62418000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x79a4f730> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:509)
  • locked <0x79a4f730> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)

"DefaultQuartzScheduler_QuartzSchedulerThread" prio=10 tid=0x63afe400 nid=0x4485 in Object.wait() [0x62469000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x79a4f0f8> (a java.lang.Object)
    at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:298)
  • locked <0x79a4f0f8> (a java.lang.Object)

"DefaultQuartzScheduler_Worker-10" prio=10 tid=0x63f06000 nid=0x4484 in Object.wait() [0x624ba000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78111e60> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78111e60> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-9" prio=10 tid=0x6289e400 nid=0x4483 in Object.wait() [0x6250b000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78111ca8> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78111ca8> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-8" prio=10 tid=0x63612400 nid=0x4482 in Object.wait() [0x6255c000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78111af0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78111af0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-7" prio=10 tid=0x63555000 nid=0x4481 in Object.wait() [0x625ad000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78111938> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78111938> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-6" prio=10 tid=0x62898c00 nid=0x4480 in Object.wait() [0x625fe000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78111780> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78111780> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-5" prio=10 tid=0x63628400 nid=0x447f in Object.wait() [0x62976000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x781115c8> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x781115c8> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-4" prio=10 tid=0x635f0000 nid=0x447e in Object.wait() [0x629c7000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78111410> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78111410> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-3" prio=10 tid=0x6351bc00 nid=0x447d in Object.wait() [0x62a18000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78111258> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78111258> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-2" prio=10 tid=0x62890400 nid=0x447c in Object.wait() [0x62a69000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x781110a0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x781110a0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-1" prio=10 tid=0x63fc9000 nid=0x447b in Object.wait() [0x62aba000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78110ee8> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78110ee8> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon prio=10
tid=0x63aa6800 nid=0x447a in Object.wait() [0x62b0b000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797e4c40> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797e4c40> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon prio=10
tid=0x63fe1400 nid=0x4479 in Object.wait() [0x62b5c000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797e4c40> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797e4c40> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon prio=10
tid=0x63bbb000 nid=0x4478 in Object.wait() [0x62bad000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797e4c40> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797e4c40> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"Timer-1" daemon prio=10 tid=0x62892000 nid=0x4477 in Object.wait() [0x62c70000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797e5588> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:509)
  • locked <0x797e5588> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)

"Java2D Disposer" daemon prio=10 tid=0x63677c00 nid=0x4476 in Object.wait() [0x62cc1000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x72d7bee8> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
  • locked <0x72d7bee8> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at sun.java2d.Disposer.run(Disposer.java:125)
    at java.lang.Thread.run(Thread.java:619)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon prio=10
tid=0x63a33400 nid=0x4474 in Object.wait() [0x62bfe000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797da5c8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797da5c8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon prio=10
tid=0x63b2bc00 nid=0x4473 in Object.wait() [0x6335c000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797da5c8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797da5c8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon prio=10
tid=0x643fe800 nid=0x4472 in Object.wait() [0x633ad000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797da5c8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797da5c8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"Timer-0" daemon prio=10 tid=0x63557c00 nid=0x4471 in Object.wait() [0x633fe000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797db0a8> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:509)
  • locked <0x797db0a8> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)

"Low Memory Detector" daemon prio=10 tid=0x09218400 nid=0x446f runnable [0x00000000]
java.lang.Thread.State: RUNNABLE

"CompilerThread1" daemon prio=10 tid=0x09216c00 nid=0x446e waiting on condition [0x00000000]
java.lang.Thread.State: RUNNABLE

"CompilerThread0" daemon prio=10 tid=0x09213800 nid=0x446d waiting on condition [0x00000000]
java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" daemon prio=10 tid=0x09212000 nid=0x446c waiting on condition [0x00000000]
java.lang.Thread.State: RUNNABLE

"Finalizer" daemon prio=10 tid=0x091fe800 nid=0x446b in Object.wait() [0x64b2c000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x79faf520> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
  • locked <0x79faf520> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

"Reference Handler" daemon prio=10 tid=0x091fd000 nid=0x446a in Object.wait() [0x64b7d000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x79faf4f8> (a java.lang.ref.Reference$Lock)
    at java.lang.Object.wait(Object.java:485)
    at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
  • locked <0x79faf4f8> (a java.lang.ref.Reference$Lock)

"main" prio=10 tid=0x0911f000 nid=0x4466 runnable [0xb7240000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

  • locked <0x73876848> (a java.net.SocksSocketImpl)
    at java.net.ServerSocket.implAccept(ServerSocket.java:453)
    at java.net.ServerSocket.accept(ServerSocket.java:421)
    at org.apache.catalina.core.StandardServer.await(StandardServer.java:389)
    at org.apache.catalina.startup.Catalina.await(Catalina.java:662)
    at org.apache.catalina.startup.Catalina.start(Catalina.java:614)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
    at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)

"VM Thread" prio=10 tid=0x091fa400 nid=0x4469 runnable

"GC task thread#0 (ParallelGC)" prio=10 tid=0x09126400 nid=0x4467 runnable

"GC task thread#1 (ParallelGC)" prio=10 tid=0x09127800 nid=0x4468 runnable

"VM Periodic Task Thread" prio=10 tid=0x0921a400 nid=0x4470 waiting on condition

JNI global references: 1254

Heap
PSYoungGen total 757888K, used 561440K [0x79eb0000, 0xb40b0000, 0xb40b0000)
eden space 638848K, 87% used [0x79eb0000,0x9c2f83c0,0xa0e90000)
from space 119040K, 0% used [0xacc70000,0xacc70000,0xb40b0000)
to space 156736K, 0% used [0xa0e90000,0xa0e90000,0xaa7a0000)
ParOldGen total 129024K, used 129022K [0x720b0000, 0x79eb0000, 0x79eb0000)
object space 129024K, 99% used [0x720b0000,0x79eaf828,0x79eb0000)
PSPermGen total 81024K, used 80810K [0x684b0000, 0x6d3d0000, 0x720b0000)
object space 81024K, 99% used [0x684b0000,0x6d39a898,0x6d3d0000)

33K - No slowness, Confluence dropped to almost no CPU, without restart
Low CPU Load - 2010-09-12-09-30-thread-dump

2010-09-12 09:30:14
Full thread dump Java HotSpot(TM) Server VM (16.0-b13 mixed mode):

"http-8080-25" daemon prio=10 tid=0x0965dc00 nid=0x1113 in Object.wait() [0x60bd9000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x808130a8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
    at java.lang.Object.wait(Object.java:485)
    at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
  • locked <0x808130a8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
    at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
    at java.lang.Thread.run(Thread.java:619)

"http-8080-24" daemon prio=10 tid=0x0965d000 nid=0x1112 runnable [0x610b3000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:809)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:619)

"http-8080-23" daemon prio=10 tid=0x09c33400 nid=0x1111 in Object.wait() [0x62161000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-22" daemon prio=10 tid=0x09c33000 nid=0x1110 in Object.wait() [0x61155000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-21" daemon prio=10 tid=0x09500000 nid=0x4516 in Object.wait() [0x61104000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-20" daemon prio=10 tid=0x0972c800 nid=0x44cc in Object.wait() [0x60d1d000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-19" daemon prio=10 tid=0x0972b800 nid=0x44cb in Object.wait() [0x611f7000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-18" daemon prio=10 tid=0x09682c00 nid=0x44ca runnable [0x61248000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:809)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:619)

"http-8080-17" daemon prio=10 tid=0x098a9800 nid=0x44c9 in Object.wait() [0x60c7b000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-16" daemon prio=10 tid=0x0973c000 nid=0x44c8 in Object.wait() [0x60fc0000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-15" daemon prio=10 tid=0x096ef000 nid=0x44c7 in Object.wait() [0x60f03000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-14" daemon prio=10 tid=0x096ed800 nid=0x44c6 in Object.wait() [0x60eb2000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-13" daemon prio=10 tid=0x09661c00 nid=0x44c5 runnable [0x60ccc000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:809)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:619)

"http-8080-12" daemon prio=10 tid=0x09661800 nid=0x44c4 in Object.wait() [0x60b88000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-11" daemon prio=10 tid=0x0929fc00 nid=0x44c3 in Object.wait() [0x60f57000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-10" daemon prio=10 tid=0x094be800 nid=0x44c2 in Object.wait() [0x612ea000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-9" daemon prio=10 tid=0x0a08bc00 nid=0x44bf in Object.wait() [0x609fc000]
java.lang.Thread.State: WAITING (on object monitor)

"pool-8-thread-1" prio=10 tid=0x6087e000 nid=0x44b8 waiting on condition [0x5fbf4000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

  • parking to wait for <0x7ab1cb08> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
    at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at java.lang.Thread.run(Thread.java:619)

"http-8080-8" daemon prio=10 tid=0x097fc400 nid=0x44b7 in Object.wait() [0x64169000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-7" daemon prio=10 tid=0x0952c800 nid=0x44b6 in Object.wait() [0x641ba000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-6" daemon prio=10 tid=0x0962d000 nid=0x44b5 in Object.wait() [0x6420b000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-5" daemon prio=10 tid=0x0a057800 nid=0x44b4 in Object.wait() [0x6425c000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-4" daemon prio=10 tid=0x09b95800 nid=0x44b3 in Object.wait() [0x642ad000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-3" daemon prio=10 tid=0x09563800 nid=0x44b2 in Object.wait() [0x642fe000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-2" daemon prio=10 tid=0x09d09000 nid=0x44b1 in Object.wait() [0x6445c000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

"http-8080-1" daemon prio=10 tid=0x092e4c00 nid=0x44b0 in Object.wait() [0x644ad000]
java.lang.Thread.State: WAITING (on object monitor)

"http-8080-Acceptor-0" daemon prio=10 tid=0x604d7400 nid=0x44af runnable [0x644fe000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

  • locked <0x7809bea8> (a java.net.SocksSocketImpl)
    at java.net.ServerSocket.implAccept(ServerSocket.java:453)
    at java.net.ServerSocket.accept(ServerSocket.java:421)
    at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:61)
    at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:352)
    at java.lang.Thread.run(Thread.java:619)

"ContainerBackgroundProcessor[StandardEngine[Standalone]]" daemon prio=10
tid=0x6047d400 nid=0x44ae waiting on condition [0x64897000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1579)
at java.lang.Thread.run(Thread.java:619)

"pool-5-thread-1" prio=10 tid=0x60829400 nid=0x44ab waiting on condition [0x62243000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

  • parking to wait for <0x780f4ba0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
    at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at java.lang.Thread.run(Thread.java:619)

"com.google.common.base.internal.Finalizer" daemon prio=10 tid=0x60478800 nid=0x44aa in Object.wait() [0x622cb000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x7b56db20> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
  • locked <0x7b56db20> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at com.google.common.base.internal.Finalizer.run(Finalizer.java:127)

"Timer-4" daemon prio=10 tid=0x61b2e000 nid=0x448c in Object.wait() [0x61f76000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x733a90d8> (a java.util.TaskQueue)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
  • locked <0x733a90d8> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)

"Timer-3" daemon prio=10 tid=0x0a0d7400 nid=0x448b in Object.wait() [0x61fc7000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78278c00> (a java.util.TaskQueue)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
  • locked <0x78278c00> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)

"FelixPackageAdmin" daemon prio=10 tid=0x0955e800 nid=0x448a in Object.wait() [0x62067000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78116aa0> (a org.apache.felix.framework.PackageAdminImpl)
    at java.lang.Object.wait(Object.java:485)
    at org.apache.felix.framework.PackageAdminImpl.run(PackageAdminImpl.java:316)
  • locked <0x78116aa0> (a org.apache.felix.framework.PackageAdminImpl)
    at java.lang.Thread.run(Thread.java:619)

"FelixStartLevel" daemon prio=10 tid=0x092b2000 nid=0x4489 in Object.wait() [0x620b8000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x72679cb8> (a java.util.ArrayList)
    at java.lang.Object.wait(Object.java:485)
    at org.apache.felix.framework.StartLevelImpl.run(StartLevelImpl.java:242)
  • locked <0x72679cb8> (a java.util.ArrayList)
    at java.lang.Thread.run(Thread.java:619)

"FelixDispatchQueue" daemon prio=10 tid=0x092b5000 nid=0x4488 in Object.wait() [0x62110000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x72fc2788> (a java.util.ArrayList)
    at java.lang.Object.wait(Object.java:485)
    at org.apache.felix.framework.util.EventDispatcher.run(EventDispatcher.java:917)
  • locked <0x72fc2788> (a java.util.ArrayList)
    at org.apache.felix.framework.util.EventDispatcher.access$000(EventDispatcher.java:54)
    at org.apache.felix.framework.util.EventDispatcher$1.run(EventDispatcher.java:106)
    at java.lang.Thread.run(Thread.java:619)

"Timer-2" daemon prio=10 tid=0x62814c00 nid=0x4486 in Object.wait() [0x62418000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x79a4df00> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:509)
  • locked <0x79a4df00> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)

"DefaultQuartzScheduler_QuartzSchedulerThread" prio=10 tid=0x63afe400 nid=0x4485 in Object.wait() [0x62469000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x79a4d8c8> (a java.lang.Object)
    at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:298)
  • locked <0x79a4d8c8> (a java.lang.Object)

"DefaultQuartzScheduler_Worker-10" prio=10 tid=0x63f06000 nid=0x4484 in Object.wait() [0x624ba000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x781112e8> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x781112e8> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-9" prio=10 tid=0x6289e400 nid=0x4483 in Object.wait() [0x6250b000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78111130> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78111130> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-8" prio=10 tid=0x63612400 nid=0x4482 in Object.wait() [0x6255c000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78110f78> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78110f78> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-7" prio=10 tid=0x63555000 nid=0x4481 in Object.wait() [0x625ad000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78110dc0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78110dc0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-6" prio=10 tid=0x62898c00 nid=0x4480 in Object.wait() [0x625fe000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78110c08> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78110c08> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-5" prio=10 tid=0x63628400 nid=0x447f in Object.wait() [0x62976000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78110a50> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78110a50> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-4" prio=10 tid=0x635f0000 nid=0x447e in Object.wait() [0x629c7000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78110898> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78110898> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-3" prio=10 tid=0x6351bc00 nid=0x447d in Object.wait() [0x62a18000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x781106e0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x781106e0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-2" prio=10 tid=0x62890400 nid=0x447c in Object.wait() [0x62a69000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78110528> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78110528> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultQuartzScheduler_Worker-1" prio=10 tid=0x63fc9000 nid=0x447b in Object.wait() [0x62aba000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x78110370> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)
  • locked <0x78110370> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon prio=10
tid=0x63aa6800 nid=0x447a in Object.wait() [0x62b0b000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797e3430> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797e3430> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon prio=10
tid=0x63fe1400 nid=0x4479 in Object.wait() [0x62b5c000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797e3430> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797e3430> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon prio=10
tid=0x63bbb000 nid=0x4478 in Object.wait() [0x62bad000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797e3430> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797e3430> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"Timer-1" daemon prio=10 tid=0x62892000 nid=0x4477 in Object.wait() [0x62c70000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797e3d78> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:509)
  • locked <0x797e3d78> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)

"Java2D Disposer" daemon prio=10 tid=0x63677c00 nid=0x4476 in Object.wait() [0x62cc1000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x72d7be10> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
  • locked <0x72d7be10> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at sun.java2d.Disposer.run(Disposer.java:125)
    at java.lang.Thread.run(Thread.java:619)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon prio=10
tid=0x63a33400 nid=0x4474 in Object.wait() [0x62bfe000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797d8db8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797d8db8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon prio=10
tid=0x63b2bc00 nid=0x4473 in Object.wait() [0x6335c000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797d8db8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797d8db8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon prio=10
tid=0x643fe800 nid=0x4472 in Object.wait() [0x633ad000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797d8db8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
    at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
  • locked <0x797d8db8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)

"Timer-0" daemon prio=10 tid=0x63557c00 nid=0x4471 in Object.wait() [0x633fe000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x797d9898> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:509)
  • locked <0x797d9898> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)

"Low Memory Detector" daemon prio=10 tid=0x09218400 nid=0x446f runnable [0x00000000]
java.lang.Thread.State: RUNNABLE

"CompilerThread1" daemon prio=10 tid=0x09216c00 nid=0x446e waiting on condition [0x00000000]
java.lang.Thread.State: RUNNABLE

"CompilerThread0" daemon prio=10 tid=0x09213800 nid=0x446d waiting on condition [0x00000000]
java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" daemon prio=10 tid=0x09212000 nid=0x446c waiting on condition [0x00000000]
java.lang.Thread.State: RUNNABLE

"Finalizer" daemon prio=10 tid=0x091fe800 nid=0x446b in Object.wait() [0x64b2c000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x79fadcb8> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
  • locked <0x79fadcb8> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

"Reference Handler" daemon prio=10 tid=0x091fd000 nid=0x446a in Object.wait() [0x64b7d000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

  • waiting on <0x79fadc90> (a java.lang.ref.Reference$Lock)
    at java.lang.Object.wait(Object.java:485)
    at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
  • locked <0x79fadc90> (a java.lang.ref.Reference$Lock)

"main" prio=10 tid=0x0911f000 nid=0x4466 runnable [0xb7240000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)

  • locked <0x73876770> (a java.net.SocksSocketImpl)
    at java.net.ServerSocket.implAccept(ServerSocket.java:453)
    at java.net.ServerSocket.accept(ServerSocket.java:421)
    at org.apache.catalina.core.StandardServer.await(StandardServer.java:389)
    at org.apache.catalina.startup.Catalina.await(Catalina.java:662)
    at org.apache.catalina.startup.Catalina.start(Catalina.java:614)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
    at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)

"VM Thread" prio=10 tid=0x091fa400 nid=0x4469 runnable

"GC task thread#0 (ParallelGC)" prio=10 tid=0x09126400 nid=0x4467 runnable

"GC task thread#1 (ParallelGC)" prio=10 tid=0x09127800 nid=0x4468 runnable

"VM Periodic Task Thread" prio=10 tid=0x0921a400 nid=0x4470 waiting on condition

JNI global references: 1539

Heap
PSYoungGen total 757888K, used 587430K [0x79eb0000, 0xb40b0000, 0xb40b0000)
eden space 638848K, 91% used [0x79eb0000,0x9dc59ab0,0xa0e90000)
from space 119040K, 0% used [0xacc70000,0xacc70000,0xb40b0000)
to space 156736K, 0% used [0xa0e90000,0xa0e90000,0xaa7a0000)
ParOldGen total 129024K, used 129022K [0x720b0000, 0x79eb0000, 0x79eb0000)
object space 129024K, 99% used [0x720b0000,0x79eaf860,0x79eb0000)
PSPermGen total 81536K, used 81176K [0x684b0000, 0x6d450000, 0x720b0000)
object space 81536K, 99% used [0x684b0000,0x6d3f61f8,0x6d450000)


"http-8080-15" appears to have been busy on the same task all the way back to 5:40am. Here is what it was doing then:

"http-8080-15" daemon prio=10 tid=0x096ef000 nid=0x44c7 runnable [0x60f00000]
java.lang.Thread.State: RUNNABLE
at com.atlassian.confluence.core.SpaceContentEntityObject.getSpace(SpaceContentEntityObject.java:20)
at sun.reflect.GeneratedMethodAccessor140.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at net.sf.hibernate.property.BasicPropertyAccessor$BasicGetter.get(BasicPropertyAccessor.java:96)
at net.sf.hibernate.persister.AbstractEntityPersister.getPropertyValues(AbstractEntityPersister.java:253)
at net.sf.hibernate.impl.SessionImpl.flushEntity(SessionImpl.java:2500)
at net.sf.hibernate.impl.SessionImpl.flushEntities(SessionImpl.java:2484)
at net.sf.hibernate.impl.SessionImpl.flushEverything(SessionImpl.java:2279)
at net.sf.hibernate.impl.SessionImpl.autoFlushIfRequired(SessionImpl.java:1813)
at net.sf.hibernate.impl.SessionImpl.getQueries(SessionImpl.java:1576)
at net.sf.hibernate.impl.SessionImpl.find(SessionImpl.java:1541)
at net.sf.hibernate.impl.QueryImpl.list(QueryImpl.java:49)
at com.atlassian.confluence.security.persistence.dao.hibernate.HibernateContentPermissionSetDao$1.doInHibernate(HibernateContentPermissionSetDao.java:44)
at org.springframework.orm.hibernate.HibernateTemplate.execute(HibernateTemplate.java:370)
at org.springframework.orm.hibernate.HibernateTemplate.executeFind(HibernateTemplate.java:341)
at com.atlassian.confluence.security.persistence.dao.hibernate.HibernateContentPermissionSetDao.getInheritedContentPermissionSets(HibernateContentPermissionSetDao.java:28)
at com.atlassian.confluence.core.DefaultInheritedContentPermissionManager.getInheritedContentPermissionSets(DefaultInheritedContentPermissionManager.java:18)
at com.atlassian.confluence.core.CachingInheritedContentPermissionManager.getInheritedContentPermissionSets(CachingInheritedContentPermissionManager.java:46)
at com.atlassian.confluence.core.DefaultContentPermissionManager.getInheritedContentPermissionSets(DefaultContentPermissionManager.java:114)
at com.atlassian.confluence.core.DefaultContentPermissionManager.hasContentLevelPermission(DefaultContentPermissionManager.java:153)
at sun.reflect.GeneratedMethodAccessor220.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy13.hasContentLevelPermission(Unknown Source)
at com.atlassian.confluence.security.delegate.PagePermissionsDelegate.hasContentLevelViewPermission(PagePermissionsDelegate.java:50)
at com.atlassian.confluence.security.delegate.PagePermissionsDelegate.canView(PagePermissionsDelegate.java:17)
at com.atlassian.confluence.security.Permission$1.checkAgainst(Permission.java:18)
at com.atlassian.confluence.security.DefaultPermissionManager.hasPermission(DefaultPermissionManager.java:35)
at com.atlassian.confluence.security.DefaultPermissionManager.getPermittedEntities(DefaultPermissionManager.java:72)
at sun.reflect.GeneratedMethodAccessor530.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
at com.atlassian.spring.interceptors.SpringProfilingInterceptor.invoke(SpringProfilingInterceptor.java:16)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy22.getPermittedEntities(Unknown Source)
at com.atlassian.confluence.core.ConfluenceActionSupport.getPermittedEntitiesOf(ConfluenceActionSupport.java:362)
at com.atlassian.confluence.pages.actions.ChildrenAction.getPermittedChildren(ChildrenAction.java:35)
at com.adaptavist.confluence.naturalchildren.NaturalChildrenAction.getPermittedChildrenFromSuperClass(NaturalChildrenAction.java:151)
at com.adaptavist.confluence.naturalchildren.NaturalChildrenAction.getPermittedChildren(NaturalChildrenAction.java:142)
at com.adaptavist.confluence.naturalchildren.NaturalChildrenAction.hasPermittedChildren(NaturalChildrenAction.java:156)
at sun.reflect.GeneratedMethodAccessor532.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.doInvoke(UberspectImpl.java:389)
at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.invoke(UberspectImpl.java:378)
at com.atlassian.confluence.velocity.introspection.UnboxingMethod.invoke(UnboxingMethod.java:31)
at org.apache.velocity.runtime.parser.node.ASTMethod.execute(ASTMethod.java:270)
at org.apache.velocity.runtime.parser.node.ASTReference.execute(ASTReference.java:252)
at org.apache.velocity.runtime.parser.node.ASTReference.value(ASTReference.java:487)
at org.apache.velocity.runtime.parser.node.ASTExpression.value(ASTExpression.java:71)
at org.apache.velocity.runtime.parser.node.ASTSetDirective.render(ASTSetDirective.java:142)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:212)
at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:247)
at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:175)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.directive.Foreach.render(Foreach.java:364)
at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:175)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:87)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:87)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:87)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:212)
at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:247)
at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:175)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.directive.Foreach.render(Foreach.java:364)
at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:175)
at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72)
at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:87)
at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:336)
at org.apache.velocity.Template.merge(Template.java:328)
at org.apache.velocity.Template.merge(Template.java:235)
at com.opensymphony.webwork.dispatcher.VelocityResult.doExecute(VelocityResult.java:91)
at com.atlassian.xwork.results.ProfiledVelocityResult.doExecute(ProfiledVelocityResult.java:21)
at com.opensymphony.webwork.dispatcher.WebWorkResultSupport.execute(WebWorkResultSupport.java:116)
at com.opensymphony.xwork.DefaultActionInvocation.executeResult(DefaultActionInvocation.java:263)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:187)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.util.LoggingContextInterceptor.intercept(LoggingContextInterceptor.java:49)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.core.CancellingInterceptor.intercept(CancellingInterceptor.java:23)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.security.websudo.WebSudoInterceptor.intercept(WebSudoInterceptor.java:69)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.security.actions.PermissionCheckInterceptor.intercept(PermissionCheckInterceptor.java:57)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.setup.webwork.BootstrapAwareInterceptor.intercept(BootstrapAwareInterceptor.java:26)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.user.actions.UserAwareInterceptor.intercept(UserAwareInterceptor.java:58)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.pages.actions.CommentAwareInterceptor.intercept(CommentAwareInterceptor.java:44)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.pages.actions.PageAwareInterceptor.intercept(PageAwareInterceptor.java:109)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.spaces.actions.SpaceAwareInterceptor.intercept(SpaceAwareInterceptor.java:68)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.core.actions.LastModifiedInterceptor.intercept(LastModifiedInterceptor.java:38)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.core.ConfluenceAutowireInterceptor.intercept(ConfluenceAutowireInterceptor.java:38)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.xwork.interceptors.TransactionalInvocation.invokeAndHandleExceptions(TransactionalInvocation.java:72)
at com.atlassian.xwork.interceptors.TransactionalInvocation.invokeInTransaction(TransactionalInvocation.java:59)
at com.atlassian.xwork.interceptors.XWorkTransactionInterceptor.intercept(XWorkTransactionInterceptor.java:56)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.atlassian.confluence.xwork.SetupIncompleteInterceptor.intercept(SetupIncompleteInterceptor.java:40)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:35)
at com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:165)
at com.opensymphony.xwork.DefaultActionProxy.execute(DefaultActionProxy.java:115)
at com.atlassian.confluence.servlet.ConfluenceServletDispatcher.serviceAction(ConfluenceServletDispatcher.java:53)
at com.opensymphony.webwork.dispatcher.ServletDispatcher.service(ServletDispatcher.java:199)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter$1.doFilter(DelegatingPluginFilter.java:66)
at com.niclabs.confluence.mobile.webclient.MobileAgentStringFilter.doFilterInternal(MobileAgentStringFilter.java:25)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:75)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter.doFilter(DelegatingPluginFilter.java:74)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:42)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:77)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:63)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.opensymphony.module.sitemesh.filter.PageFilter.parsePage(PageFilter.java:118)
at com.atlassian.confluence.util.profiling.ProfilingPageFilter.parsePage(ProfilingPageFilter.java:84)
at com.opensymphony.module.sitemesh.filter.PageFilter.doFilter(PageFilter.java:54)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:77)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:63)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.jmx.JmxFilter.doFilter(JmxFilter.java:106)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.core.filters.ServletContextThreadLocalFilter.doFilter(ServletContextThreadLocalFilter.java:19)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.util.LoggingContextFilter.doFilter(LoggingContextFilter.java:47)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.web.filter.ThreadLocalCacheFilter.doFilter(ThreadLocalCacheFilter.java:22)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.util.UserThreadLocalFilter.doFilter(UserThreadLocalFilter.java:44)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.seraph.filter.SecurityFilter.doFilter(SecurityFilter.java:219)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.security.auth.trustedapps.filter.TrustedApplicationsFilter.doFilter(TrustedApplicationsFilter.java:98)
at com.atlassian.confluence.util.AbstractBootstrapHotSwappingFilter.doFilter(AbstractBootstrapHotSwappingFilter.java:30)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.seraph.filter.BaseLoginFilter.doFilter(BaseLoginFilter.java:140)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter$1.doFilter(DelegatingPluginFilter.java:66)
at com.atlassian.oauth.serviceprovider.internal.servlet.OAuthFilter.doFilter(OAuthFilter.java:69)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter.doFilter(DelegatingPluginFilter.java:74)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:42)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:77)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:63)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.util.ClusterHeaderFilter.doFilter(ClusterHeaderFilter.java:34)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.johnson.filters.AbstractJohnsonFilter.doFilter(AbstractJohnsonFilter.java:72)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.springframework.orm.hibernate.support.OpenSessionInViewFilter.doFilterInternal(OpenSessionInViewFilter.java:170)
at com.atlassian.spring.filter.FlushingSpringSessionInViewFilter.doFilterInternal(FlushingSpringSessionInViewFilter.java:29)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:75)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.util.ConfluenceErrorFilter.doFilter(ConfluenceErrorFilter.java:22)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.util.profiling.filters.ProfilingFilter.doFilter(ProfilingFilter.java:99)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.core.datetime.RequestTimeThreadLocalFilter.doFilter(RequestTimeThreadLocalFilter.java:35)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.util.RequestCacheThreadLocalFilter.doFilter(RequestCacheThreadLocalFilter.java:25)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.gzipfilter.GzipFilter.doFilterInternal(GzipFilter.java:81)
at com.atlassian.gzipfilter.GzipFilter.doFilter(GzipFilter.java:51)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.core.filters.cache.AbstractCachingFilter.doFilter(AbstractCachingFilter.java:33)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter$1.doFilter(DelegatingPluginFilter.java:66)
at com.atlassian.confluence.extra.webdav.servlet.filter.ReverseProxyFilter.doFilter(ReverseProxyFilter.java:427)
at com.atlassian.confluence.extra.webdav.servlet.filter.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:34)
at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter.doFilter(DelegatingPluginFilter.java:74)
at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:42)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:77)
at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:63)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.core.filters.encoding.AbstractEncodingFilter.doFilter(AbstractEncodingFilter.java:41)
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:31)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.core.filters.HeaderSanitisingFilter.doFilter(HeaderSanitisingFilter.java:44)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.atlassian.confluence.servlet.FourOhFourErrorLoggingFilter.doFilter(FourOhFourErrorLoggingFilter.java:65)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:852)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:619)

At 3:40, HTTP-8080-18 was busy with a similar stack trace. http-8080-15 started at about 5:10am, and was continuously busy on the same stuff until about 9:00am. A few minutes ago (around 10:20) HTTP-8080-4 has gotten busy on a similar task, and now CPU usage is steadily around 100% (of a max of about 180%), and 9:30, the thread still seemed to be busy on the same task. Doing a series of thread dumps at 1 min to 30 second intervals, is showing the same thread to still be busy with same task.

Grep atlassian-confluence.log for each of these agents revealed nothing, except no messages for each of them while they were busy:

2010-09-12 03:48:03,812 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 03:48:03,815 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 03:48:03,862 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 03:48:03,865 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 03:48:03,900 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 04:09:44,852 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 04:09:44,855 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 04:09:44,976 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 04:09:44,979 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 04:09:45,032 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 09:51:07,591 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 09:51:07,594 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD
2010-09-12 09:51:07,804 WARN [http-8080-15] [atlassian.confluence.themes.DefaultThemeManager] extractTheme Unable to find configured theme module: at.hansen.confluence.themes.topandleftnavigationITD:topandleftnavigationITD

Apache access log doesn't put an entry until the request is finished. But if it's reverse proxy has already timed out, the web access that started this thread busy could have been logged much earlier. Weeding out things that should be ok for ten minutes around 5:00am, leave 383 lines in the log, and none of jump out as being odd.

Perhaps enabling page profiling for a few hours will help catch what the URL is that is causing this.

Local Caches - Advanced view

Name Percent Used Effectiveness Objects / Size Hit / Miss / Expired Adjust Size Flush
Settings (Persistence) 26% 99% 265 / 1000 5854078 / 1206 / 0    
Spaces (by key) 45% 99% 45 / 100 5128794 / 171 / 0    
Content Objects 100% 93% 20000 / 20000 2311795 / 170465 / 72807    
Labels 100% 66% 5000 / 5000 832360 / 414799 / 198558    
Pages 100% 32% 10000 / 10000 308251 / 652046 / 3942    
Internationalisation Bean Factories 1% 99% 1 / 100 827606 / 17 / 0    
Inherited Content Permissons 100% 82% 10000 / 10000 504580 / 106347 / 47832    
Permission Set Collections in Content Entity Objects 100% 69% 10000 / 10000 318268 / 140985 / 22582    
UI Templates 31% 99% 62 / 200 239158 / 2309 / 426    
Label Content Mappings 46% 84% 7842 / 17000 78731 / 14040 / 0    
Space Permissions 18% 93% 366 / 2000 85593 / 5745 / 0    
Object Timestamps 1% 8% 14 / 1000 7536 / 82712 / 0    
Database Queries 41% 72% 12395 / 30000 55947 / 21302 / 0    
Page Children 96% 38% 11608 / 12000 21934 / 35237 / 0    
Hibernate Users 5% 98% 25 / 500 52851 / 668 / 0    
Spaces 4% 99% 47 / 1000 45299 / 58 / 0    
Attachment IDs 6% 81% 606 / 10000 23362 / 5233 / 0    
Decorators 52% 87% 523 / 1000 14174 / 2051 / 0    
Hibernate Groups 0% 99% 5 / 5000 15246 / 45 / 0    
Content Body Mappings 20% 47% 4143 / 20000 7215 / 7841 / 0    
Attachments 6% 86% 691 / 10000 10715 / 1690 / 0    
Content Bodies 20% 63% 4137 / 20000 7334 / 4137 / 0    
Hibernate User Properties 1% 99% 10 / 1000 10858 / 64 / 0    
Content Label Mappings 21% 6% 3675 / 17000 600 / 9258 / 0    
Comments 33% 4% 3642 / 11000 480 / 9130 / 0    
Content Attachments 45% 4% 3620 / 8000 425 / 8924 / 0    
Hibernate Membership 0% 97% 5 / 5000 7348 / 157 / 0    
Cluster Safety Numbers 0% 99% 1 / 1000 3200 / 1 / 0    
Object Properties 1% 13% 481 / 30000 271 / 1716 / 0    
Page Edit Activities for Heartbeat Tracking 0% 98% 9 / 5000 1927 / 24 / 0    
Content Permission Sets 4% 78% 40 / 1000 758 / 204 / 0    
Content Properties 1% 70% 505 / 45000 604 / 249 / 0    
Image Details 6% 9% 68 / 1000 63 / 595 / 0    
User Information By Username 0% 99% 4 / 1000 606 / 6 / 0    
Comment Relationships 11% 23% 119 / 1000 120 / 401 / 0    
User Authorized URLs 2% 18% 214 / 10000 75 / 338 / 0    
Content Links (Referral) 9% 60% 97 / 1000 221 / 145 / 0    
Permissions in Content Permission Sets 2% 41% 20 / 1000 128 / 184 / 0    
Hibernate User Groups (Group Side) 0% 43% 5 / 5000 125 / 163 / 0    
Content Permissions 2% 52% 20 / 1000 128 / 116 / 0    
Groups 0% 93% 5 / 1000 211 / 15 / 0    
Users 1% 65% 10 / 1000 139 / 74 / 0    
Content Links (Outgoing) 0% 77% 41 / 15000 153 / 45 / 0    
Links (External) 0% 35% 115 / 25000 63 / 117 / 0    
Content Links (Trackback) 0% 72% 38 / 21000 101 / 39 / 0    
Page Ancestors 0% 64% 28 / 12000 64 / 35 / 0    
Login Manager: Login attempts for unknown users 0% 15% 2 / 1000 12 / 65 / 0    
Number Of Registered Users 1% 76% 1 / 100 23 / 7 / 0    
Permissions 0% 0% 4 / 1000 0 / 28 / 0    
Hibernate User Repository 0% 38% 1 / 5000 8 / 13 / 0    
Remote Auth Tokens 0% 80% 0 / 5000 16 / 4 / 0    
Captchas 0% 18% 3 / 1000 3 / 13 / 0    
Hibernate Users (Read-Only) 0% 0% 3 / 5000 0 / 5 / 0    
cache.name.com.niclabs.confluence.mobile.user 0% 50% 1 / 1000 1 / 1 / 0    
Groups (OSUser) 0% 0% 0 / 1000 0 / 0 / 0    
LDAP Group Repository 0% 0% 0 / 5000 0 / 0 / 0    
Objects Published to All Cluster Members 0% 0% 0 / 1000 0 / 0 / 0    
Trusted Application Restrictions (Foreign Keys) 0% 0% 0 / 1000 0 / 0 / 0    
Attachment Versions 0% 0% 0 / 1000 0 / 0 / 0    
JIRA Issues 0% 0% 0 / 100 0 / 0 / 0    
Users (OSUser) 0% 0% 0 / 1000 0 / 0 / 0    
Hibernate-LDAP Users 0% 0% 0 / 5000 0 / 0 / 0    
Groups (Local Members) 0% 0% 0 / 1000 0 / 0 / 0    
User Group Mappings 0% 0% 0 / 1000 0 / 0 / 0    
LDAP User Groups (User Side) 0% 0% 0 / 5000 0 / 0 / 0    
Mail Error Queue (only flushable individually) 0% 0% 0 / 1000 0 / 0 / 0    
Locks 0% 0% 0 / 1000 0 / 0 / 0    
Connection 0% 0% 0 / 5000 0 / 0 / 0    
Users (External Mappings) 0% 0% 0 / 1000 0 / 0 / 0    
User Group Mappings (OSUser) 0% 0% 0 / 10000 0 / 0 / 0    
Hibernate Group Repository 0% 0% 0 / 5000 0 / 0 / 0    
Space Groups (Hibernate) 0% 0% 0 / 1000 0 / 0 / 0    
LDAP Groups 0% 0% 0 / 5000 0 / 0 / 0    
Content Permission Mappings 0% 0% 0 / 1000 0 / 0 / 0    
Users (OSUser Credentials) 0% 0% 0 / 10000 0 / 0 / 0    
LDAP Membership 0% 0% 0 / 5000 0 / 0 / 0    
Task Queue (only flushable individually) 0% 0% 0 / 1000 0 / 0 / 0    
User Group Mappings (OSUser Hibernate) 0% 0% 0 / 1000 0 / 0 / 0    
LDAP Users 0% 0% 0 / 5000 0 / 0 / 0    
LDAP Users (Read-Only) 0% 0% 0 / 5000 0 / 0 / 0    
Encryption Keys 0% 0% 0 / 1000 0 / 0 / 0    
Trusted Application Restrictions (Objects) 0% 0% 0 / 1000 0 / 0 / 0    
Space Groups 0% 0% 0 / 1000 0 / 0 / 0    
Users (External Groups) 0% 0% 0 / 1000 0 / 0 / 0    
Profile Providers Handles 0% 0% 0 / 10000 0 / 0 / 0    
Users (External Mappings) 0% 0% 0 / 1000 0 / 0 / 0    
Template Versions 0% 0% 0 / 1000 0 / 0 / 0    
Drafts 0% 0% 0 / 1000 0 / 0 / 0    
Settings 0% 0% 0 / 1000 0 / 0 / 0    
Deactivated Users 0% 0% 0 / 100000 0 / 0 / 0    
Trusted Applications 0% 0% 0 / 1000 0 / 0 / 0    
Groups (External Members) 0% 0% 0 / 1000 0 / 0 / 0    
Content Versions 0% 0% 0 / 1000 0 / 0 / 0    
Hibernate Keys 0% 0% 0 / 1000 0 / 0 / 0    
Space Group Permissions 0% 0% 0 / 1000 0 / 0 / 0    
LDAP User Repository 0% 0% 0 / 5000 0 / 0 / 0    
cache.name.com.atlassian.confluence.pages.AbstractPage.comments 0% 0% 0 / 3000 0 / 0 / 0    
WebDAV user session cache 0% 0% 0 / 1000 0 / 0 / 0    
Hibernate-LDAP Groups for Users (User Side) 0% 0% 0 / 5000 0 / 0 / 0    
Hot Referrers 0% 0% 0 / 1000 0 / 0 / 0    
Links (Trackback) 0% 0% 0 / 1000 0 / 0 / 0    
LDAP User Groups (Group Side) 0% 0% 0 / 5000 0 / 0 / 0    
Old Rss Macro 0% 0% 0 / 10000 0 / 0 / 0    
Users (Username) 0% 0% 0 / 1000 0 / 0 / 0    
Mail Queue (only flushable individually) 0% 0% 0 / 1000 0 / 0 / 0    
Bucket Property Set 0% 0% 0 / 10000 0 / 0 / 0    
Hibernate User Groups (User Side) 0% 0% 0 / 5000 0 / 0 / 0    
Groups (OSUser) 0% 0% 0 / 1000 0 / 0 / 0    
Layouts (Database) 0% 0% 0 / 1000 0 / 0 / 0    
Space Permissions 0% 0% 0 / 1000 0 / 0 / 0    

System information

Confluence Information
System Date Sunday, 12 Sep 2010
System Time 11:40:35
Uptime 13 hours, 27 minutes, 29 seconds
Confluence Version 3.3.1
Build Number 1923
Server Base Url http://www.bobsgear.com
Confluence Home /home/confluence.bobsgear/data
Server ID (SID):  
Support Entitlement Number 1503180
Daily XML Backup Disabled
Java Runtime Environment
Operating System Linux 2.6.18-164.11.1.el5xen
OS Architecture i386
Application Server Apache Tomcat/6.0.26
Servlet Version 2.5
Java Version 1.6.0_18
Java Vendor Sun Microsystems Inc.
JVM Version 1.0
JVM Vendor Sun Microsystems Inc.
JVM Implementation Version 16.0-b13
Java Runtime Java(TM) SE Runtime Environment
Java VM Java HotSpot(TM) Server VM
Java Runtime Arguments -Djava.util.logging.config.file=/home/confluence.bobsgear/current/conf/logging.properties -Xms1056m -Xmx1056m -XX:NewSize=930m -XX:+UseParallelOldGC -XX:MaxPermSize=156m -Djava.awt.headless=true -XX:CompileCommand=exclude,org/apache/velocity/runtime/directive/Foreach,render -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.endorsed.dirs=/home/confluence.bobsgear/current/endorsed -Dcatalina.base=/home/confluence.bobsgear/current -Dcatalina.home=/home/confluence.bobsgear/current -Djava.io.tmpdir=/home/confluence.bobsgear/current/temp
Application Server Working Directory /home/confluence.bobsgear/confluencewatchdog
Temp Directory /home/confluence.bobsgear/current/temp
User Name root
System Language en
System Timezone US/Pacific
System Favourite Colour Spindrift
Filesystem Encoding ANSI_X3.4-1968
Java VM Memory Statistics
Heap Memory             14 % Free  
Maximum Heap Size 866 MB
Total Allocated Memory 866 MB
Used Memory 742 MB
Free Allocated Memory 123 MB
Total Free Memory 123 MB
Permanent Generation Memory             47 % Free  
Maximum PermGen 156 MB
Used PermGen 82 MB
Database Information
Database name Microsoft SQL Server
Database version 09.00.4053
Database Dialect net.sf.hibernate.dialect.SQLServerDialect
Database Driver Name net.sourceforge.jtds.jdbc.Driver
Database Driver Version 1.2
Database Connection URL jdbc:jtds:
Database Connection Transaction Isolation Read committed
Database Latency 2
Confluence Usage
Total Spaces 47
Global Spaces 43
Personal Spaces 4
Content (All Versions) 41992
Content (Current Versions) 25871
Local Users 10
Local Groups 5
Search Index Size 55320
Modification
Modified  
Removed  

Plugins

Name Version Vendor Enabled or Disabled
Adaptavist Community Bubbles 1.6 Adaptavist.com Ltd Disabled
Adaptavist Content Formatting Macros 1.6.16 Adaptavist.com Ltd Enabled
Adaptavist Footnotes 1.1.6 Adaptavist.com Ltd Enabled
Adaptavist Theme Builder 4.1.3 Adaptavist.com Ltd Enabled
Advanced Macros 1.9 Atlassian Enabled
Apache HttpClient OSGi bundle 4.0 Apache Software Foundation Enabled
Apache HttpCore OSGi bundle 4.0 Apache Software Foundation Enabled
Atlassian Gadgets API 2.0.6 Atlassian Enabled
Atlassian Gadgets OAuth Service Provider Plugin 2.0.6 Atlassian Enabled
Atlassian Gadgets SPI 2.0.6 Atlassian Enabled
Atlassian OAuth API 1.0.12 Atlassian Enabled
Atlassian OAuth Consumer SAL SPI Implementation 1.0.12 Atlassian Enabled
Atlassian OAuth Consumer SPI 1.0.12 Atlassian Enabled
Atlassian OAuth Service Provider SAL SPI Implementation 1.0.12 Atlassian Enabled
Atlassian OAuth Service Provider SPI 1.0.12 Atlassian Enabled
Atlassian REST - Module Types 2.0.0 Atlassian Enabled
Atlassian Search Results Enhancer 0.3 Atlassian Enabled
Atlassian Template Renderer API 1.0.3 Atlassian Enabled
Atlassian Template Renderer Velocity 1.6 Plugin 1.0.3 Atlassian Enabled
Atlassian Templates Import Framework 0.10 Atlassian Enabled
Atlassian Templates: Default Package 0.3 Atlassian Enabled
Atlassian UI Plugin 3.0.5 Atlassian Pty Ltd Enabled
Attachment Extractors 1.1 Atlassian Pty Ltd Enabled
BND Library 0.0.255 aQute SARL http://www.aQute.biz

Enabled
Basic Macros 1.4 Atlassian Pty Ltd Enabled
Chart Plugin 1.15 Atlassian Enabled
Classic Left Navigation Theme 2.12 Atlassian Enabled
Clickr Theme 2.11 Atlassian Pty Ltd Enabled
Code Macro 1.5 Atlassian Pty Ltd Enabled
Compatibility Macros 1.6 Atlassian Pty Ltd Enabled
Confluence Activity Stream Plugin 3.3 Atlassian Enabled
Confluence Atlassian Plugin Repository 2.1.9 Adaptavist.com Ltd Enabled
Confluence Attachments Plugin 2.19 Atlassian Enabled
Confluence Blogging RPC Plugin 1.2.4 Atlassian Pty Ltd Enabled
Confluence Contributors Plugin 1.2.6 Atlassian Pty Ltd Enabled
Confluence Drag and Drop Plugin 1.0.8 Atlassian Enabled
Confluence HTML Macros 1.8.1 Atlassian Enabled
Confluence Legacy Web Resources 1.0 Atlassian Software Systems Pty Ltd Enabled
Confluence LinkBrowser 3.3.1 Atlassian Enabled
Confluence PDF Export 1.9 (unknown) Enabled
Confluence REST API 3.3.1 Atlassian Software Enabled
Confluence Remote API 3.3.1 Atlassian Software Systems Enabled
Confluence SAL Plugin 3.3.1 Atlassian Software Systems Enabled
Confluence Thread Dump Plugin 1.3 Atlassian Enabled
Confluence Usage Stats 0.13 Atlassian Disabled
Content Action Menu Sections 1.0 Atlassian Software Systems Enabled
Dashboard Actions 1.9 Atlassian Pty Ltd Enabled
Dashboard Macros 1.14 Atlassian Enabled
Documentation Theme 1.2 Atlassian Enabled
Dynamic Task List 2 Plugin 3.3 Atlassian Enabled
Easy Reader Theme 3.3.1 Atlassian Enabled
French language pack 1.22 Atlassian Software Systems Enabled
Gadgets Plugin 1.1.1 Atlassian Enabled
Gadgets Plugin SPI 1.1.1 Atlassian Enabled
German language pack 1.17 Atlassian Software Systems Enabled
Google Collections Bundle 1.0.0.rc1 Atlassian Pty Ltd Enabled
ICU4J 3.8.0.1 Atlassian Pty Ltd Enabled
IM Presence NG Plugin 2.6 Atlassian Pty Ltd Enabled
Information Macros 1.3 Atlassian Pty Ltd Enabled
JDOM DOM Processor 1.0.0 SpringSource Enabled
JIRA Macros 2.8.20 Atlassian Enabled
JSON Library 20070829.0.0.1 Atlassian Pty Ltd Enabled
JSR 305 Annotations 1.0 Atlassian Pty Ltd Enabled
Java Concurrency in Practice Annotations 1.0.0 SpringSource Enabled
Layout Macros 1.5 Atlassian Enabled
Linking Plugin 2.7.0 CustomWare Asia Pacific Enabled
Live Search Macros 2.12 Atlassian Enabled
Mail Page Plugin 1.11 (unknown) Disabled
Mini Confluence Remote API 1.0.0-3 NIC Labs Enabled
Move Comment Plugin 1.1 Adaptavist.com Enabled
Office Connector plugin 1.12 Atlassian Disabled
Page Tree 1.18 Atlassian Enabled
PopKong Plugin Suite 3.1.3 Burleson Technology Group, LLC Enabled
Profile Macros 1.0 Atlassian Software Systems Enabled
ROME, RSS and atOM utilitiEs for Java 1.0 Sun Microsystems Enabled
Shared Application Access Layer API 2.1.0 Atlassian Enabled
Social Bookmarking Plugin 1.3.2 Atlassian Enabled
Support Tools Plugin 1.1 Atlassian Enabled
Table of Contents Plugin 2.4.11 CustomWare Asia Pacific Enabled
Tabular Metadata 2.9 Atlassian Pty Ltd Enabled
TinyMCE Editor Plugin 3.3.1 Atlassian Enabled
UWC Importer Admin Panel 1.2.1 Atlassian Software Systems Enabled
User Lister 2.4.5 Atlassian Enabled
User Status 1.0 Atlassian Software Systems Enabled
WebDAV Plugin 2.4 Atlassian Pty Ltd Enabled
Widget Connector 1.3.3 Atlassian Enabled
atlassian-gadgets-shared-2.0.6.jar 0.0 (unknown) Disabled
confluence-imagesearchrenderer-plugin 1.2 Atlassian Enabled


License Details

Support Entitlement Number 1503180
Server ID (SID): BA75-R2B4-NVQ6-9CM8
Clustered false


System Properties

java.vm.version 16.0-b13
java.vendor.url http://java.sun.com/
sun.jnu.encoding ANSI_X3.4-1968
java.vm.info mixed mode
java.awt.headless true
user.dir /home/confluence.bobsgear/confluencewatchdog
sun.cpu.isalist  
java.awt.graphicsenv sun.awt.X11GraphicsEnvironment
sun.os.patch.level unknown
catalina.useNaming true
java.io.tmpdir /home/confluence.bobsgear/current/temp
user.home /root
java.awt.printerjob sun.print.PSPrinterJob
java.version 1.6.0_18
file.encoding.pkg sun.io
package.access sun.,org.apache.catalina.,org.apache.coyote.,org.apache.tomcat.,org.apache.jasper.,sun.beans.
java.vendor.url.bug http://java.sun.com/cgi-bin/bugreport.cgi
file.encoding ANSI_X3.4-1968
line.separator  
java.vm.specification.vendor Sun Microsystems Inc.
java.util.logging.manager org.apache.juli.ClassLoaderLogManager
tomcat.util.buf.StringCache.byte.enabled true
catalina.home /home/confluence.bobsgear/current
java.vm.vendor Sun Microsystems Inc.
java.class.path /home/confluence.bobsgear/current/bin/bootstrap.jar
sun.io.unicode.encoding UnicodeLittle
os.arch i386
user.name root
user.language en
java.runtime.version 1.6.0_18-b07
sun.boot.class.path /usr/java/jdk1.6.0_18/jre/lib/resources.jar
/usr/java/jdk1.6.0_18/jre/lib/rt.jar
/usr/java/jdk1.6.0_18/jre/lib/sunrsasign.jar
/usr/java/jdk1.6.0_18/jre/lib/jsse.jar
/usr/java/jdk1.6.0_18/jre/lib/jce.jar
/usr/java/jdk1.6.0_18/jre/lib/charsets.jar
/usr/java/jdk1.6.0_18/jre/classes
package.definition sun.,java.,org.apache.catalina.,org.apache.coyote.,org.apache.tomcat.,org.apache.jasper.
sun.cpu.endian little
sun.boot.library.path /usr/java/jdk1.6.0_18/jre/lib/i386
common.loader $
Unknown macro: {catalina.base}

/lib
$

/lib/*.jar
$

Unknown macro: {catalina.home}

/lib
$

/lib/*.jar

java.vm.name Java HotSpot(TM) Server VM
java.home /usr/java/jdk1.6.0_18/jre
java.endorsed.dirs /home/confluence.bobsgear/current/endorsed
sun.management.compiler HotSpot Tiered Compilers
java.naming.factory.initial org.apache.naming.java.javaURLContextFactory
java.runtime.name Java(TM) SE Runtime Environment
catalina.base /home/confluence.bobsgear/current
java.util.logging.config.file /home/confluence.bobsgear/current/conf/logging.properties
java.library.path /usr/java/jdk1.6.0_18/jre/lib/i386/server
/usr/java/jdk1.6.0_18/jre/lib/i386
/usr/java/jdk1.6.0_18/jre/../lib/i386
/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0/jre/lib/i386/server
/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0/jre/lib/i386
/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0/jre/../lib/i386
/usr/java/packages/lib/i386
/lib
/usr/lib
file.separator /
shared.loader  
java.specification.vendor Sun Microsystems Inc.
java.vm.specification.version 1.0
server.loader  
sun.java.launcher SUN_STANDARD
user.timezone US/Pacific
os.name Linux
path.separator :
java.ext.dirs /usr/java/jdk1.6.0_18/jre/lib/ext
/usr/java/packages/lib/ext
sun.arch.data.model 32
java.specification.name Java Platform API Specification
os.version 2.6.18-164.11.1.el5xen
user.country US
java.class.version 50.0
java.vendor Sun Microsystems Inc.
java.vm.specification.name Java Virtual Machine Specification
java.specification.version 1.6
java.naming.factory.url.pkgs org.apache.naming


Installed Languages

de (DE)
en (GB)
fr (FR)
Labels:
None
Enter labels to add to this page:
Please wait 
Looking for a label? Just start typing.