Stuck Running now requests

0
Hi guys We are running into a strange situation where we have a few processes under Metrics->Running that do not complete for multiple days.  I checked the logs and can only see the below error that seem to point to something timing out.  We literally have no other errors in the logs. Jan 30 16:02:17.977 - ERROR - Connector: (1/35) java.util.concurrent.TimeoutException: Futures timed out after [7 days] Jan 30 16:02:17.977 - ERROR - Connector: (2/35) #011at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219) Jan 30 16:02:17.977 - ERROR - Connector: (3/35) #011at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223) Jan 30 16:02:17.977 - ERROR - Connector: (4/35) #011at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:190) Jan 30 16:02:17.977 - ERROR - Connector: (5/35) #011at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53) Jan 30 16:02:17.977 - ERROR - Connector: (6/35) #011at scala.concurrent.Await$.result(package.scala:190) Jan 30 16:02:17.977 - ERROR - Connector: (7/35) #011at com.mendix.core.session.ActionDispatchingActorSystem.sendAction(ActionDispatching.scala:53) Jan 30 16:02:17.977 - ERROR - Connector: (8/35) #011at com.mendix.core.session.ActionDispatchingActorSystem.handleAction(ActionDispatching.scala:47) Jan 30 16:02:17.977 - ERROR - Connector: (9/35) #011at com.mendix.systemwideinterfaces.core.IMonitoredAction$class.monitor(IMonitoredAction.scala:32) Jan 30 16:02:17.977 - ERROR - Connector: (10/35) #011at com.mendix.webui.requesthandling.ClientRequestHandler$ClientMonitoredAction.monitor(ClientRequestHandler.scala:355) Jan 30 16:02:17.977 - ERROR - Connector: (11/35) #011at com.mendix.webui.requesthandling.ClientRequestHandler.handleRequest(ClientRequestHandler.scala:304) Jan 30 16:02:17.977 - ERROR - Connector: (12/35) #011at com.mendix.webui.requesthandling.ClientRequestHandler.handleActionWithSessionRequired(ClientRequestHandler.scala:235) Jan 30 16:02:17.977 - ERROR - Connector: (13/35) #011at com.mendix.webui.requesthandling.ClientRequestHandler.handleAction(ClientRequestHandler.scala:198) Jan 30 16:02:17.977 - ERROR - Connector: (14/35) #011at com.mendix.webui.requesthandling.ClientRequestHandler.liftedTree1$1(ClientRequestHandler.scala:95) Jan 30 16:02:17.977 - ERROR - Connector: (15/35) #011at com.mendix.webui.requesthandling.ClientRequestHandler.processRequest(ClientRequestHandler.scala:87) Jan 30 16:02:17.977 - ERROR - Connector: (16/35) #011at com.mendix.externalinterface.connector.MxRuntimeConnector$1.execute(MxRuntimeConnector.java:69) Jan 30 16:02:17.977 - ERROR - Connector: (17/35) #011at com.mendix.externalinterface.connector.MxRuntimeConnector$1.execute(MxRuntimeConnector.java:66) Jan 30 16:02:17.977 - ERROR - Connector: (18/35) #011at com.mendix.util.classloading.Runner.doRunUsingClassLoaderOf(Runner.java:36) Jan 30 16:02:17.977 - ERROR - Connector: (19/35) #011at com.mendix.externalinterface.connector.MxRuntimeConnector.processRequest(MxRuntimeConnector.java:72) Jan 30 16:02:17.978 - ERROR - Connector: (20/35) #011at com.mendix.core.impl.MxRuntimeImpl.processRequest(MxRuntimeImpl.java:742) Jan 30 16:02:17.978 - ERROR - Connector: (21/35) #011at com.mendix.m2ee.appcontainer.server.handler.RuntimeHandler.handle(RuntimeHandler.java:41) Jan 30 16:02:17.978 - ERROR - Connector: (22/35) #011at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:52) Jan 30 16:02:17.978 - ERROR - Connector: (23/35) #011at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) Jan 30 16:02:17.978 - ERROR - Connector: (24/35) #011at org.eclipse.jetty.server.Server.handle(Server.java:368) Jan 30 16:02:17.978 - ERROR - Connector: (25/35) #011at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) Jan 30 16:02:17.978 - ERROR - Connector: (26/35) #011at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) Jan 30 16:02:17.978 - ERROR - Connector: (27/35) #011at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) Jan 30 16:02:17.978 - ERROR - Connector: (28/35) #011at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) Jan 30 16:02:17.978 - ERROR - Connector: (29/35) #011at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) Jan 30 16:02:17.978 - ERROR - Connector: (30/35) #011at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) Jan 30 16:02:17.978 - ERROR - Connector: (31/35) #011at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628) Jan 30 16:02:17.978 - ERROR - Connector: (32/35) #011at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52) Jan 30 16:02:17.978 - ERROR - Connector: (33/35) #011at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) Jan 30 16:02:17.978 - ERROR - Connector: (34/35) #011at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) Jan 30 16:02:17.978 - ERROR - Connector: (35/35) #011at java.lang.Thread.run(Thread.java:748) Jan 30 16:02:17.980 - ERROR - Connector: (1/40) com.mendix.systemwideinterfaces.MendixRuntimeException: org.codehaus.jackson.JsonGenerationException: Can not write a field name, expecting a value Jan 30 16:02:17.980 - ERROR - Connector: (2/40) #011at com.mendix.util.classloading.Runner.doRunUsingClassLoaderOf(Runner.java:40) Jan 30 16:02:17.980 - ERROR - Connector: (3/40) Jan 30 16:02:17.981 - ERROR - Connector: (4/40) Caused by: org.codehaus.jackson.JsonGenerationException: Can not write a field name, expecting a value Jan 30 16:02:17.981 - ERROR - Connector: (5/40) #011at org.codehaus.jackson.impl.JsonGeneratorBase._reportError(JsonGeneratorBase.java:480) Jan 30 16:02:17.981 - ERROR - Connector: (6/40) #011at org.codehaus.jackson.impl.WriterBasedGenerator.writeFieldName(WriterBasedGenerator.java:195) Jan 30 16:02:17.981 - ERROR - Connector: (7/40) #011at com.mendix.webui.jsonserialization.JsonGeneratorWrapper$$anonfun$writeFieldName$1.apply(JsonGeneratorWrapper.scala:43) Jan 30 16:02:17.981 - ERROR - Connector: (8/40) #011at com.mendix.webui.jsonserialization.JsonGeneratorWrapper$$anonfun$writeFieldName$1.apply(JsonGeneratorWrapper.scala:43) Jan 30 16:02:17.981 - ERROR - Connector: (9/40) #011at scala.collection.immutable.List.foreach(List.scala:381) Jan 30 16:02:17.981 - ERROR - Connector: (10/40) #011at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:35) Jan 30 16:02:17.981 - ERROR - Connector: (11/40) #011at scala.collection.mutable.ListBuffer.foreach(ListBuffer.scala:45) Jan 30 16:02:17.981 - ERROR - Connector: (12/40) #011at com.mendix.webui.jsonserialization.JsonGeneratorWrapper.writeFieldName(JsonGeneratorWrapper.scala:43) Jan 30 16:02:17.981 - ERROR - Connector: (13/40) #011at com.mendix.webui.jsonserialization.ResultSerializer.writeException(ResultSerializer.scala:36) Jan 30 16:02:17.981 - ERROR - Connector: (14/40) #011at com.mendix.webui.requesthandling.ClientRequestHandler.logAndWriteException(ClientRequestHandler.scala:434) Jan 30 16:02:17.981 - ERROR - Connector: (15/40) #011at com.mendix.webui.requesthandling.ClientRequestHandler.processException(ClientRequestHandler.scala:426) Jan 30 16:02:17.981 - ERROR - Connector: (16/40) #011at com.mendix.webui.requesthandling.ClientRequestHandler.handleRequest(ClientRequestHandler.scala:280) Jan 30 16:02:17.981 - ERROR - Connector: (17/40) #011at com.mendix.webui.requesthandling.ClientRequestHandler.handleActionWithSessionRequired(ClientRequestHandler.scala:235) Jan 30 16:02:17.981 - ERROR - Connector: (18/40) #011at com.mendix.webui.requesthandling.ClientRequestHandler.handleAction(ClientRequestHandler.scala:198) Jan 30 16:02:17.981 - ERROR - Connector: (19/40) #011at com.mendix.webui.requesthandling.ClientRequestHandler.liftedTree1$1(ClientRequestHandler.scala:95) Jan 30 16:02:17.981 - ERROR - Connector: (20/40) #011at com.mendix.webui.requesthandling.ClientRequestHandler.processRequest(ClientRequestHandler.scala:87) Jan 30 16:02:17.981 - ERROR - Connector: (21/40) #011at com.mendix.externalinterface.connector.MxRuntimeConnector$1.execute(MxRuntimeConnector.java:69) Jan 30 16:02:17.981 - ERROR - Connector: (22/40) #011at com.mendix.externalinterface.connector.MxRuntimeConnector$1.execute(MxRuntimeConnector.java:66) Jan 30 16:02:17.981 - ERROR - Connector: (23/40) #011at com.mendix.util.classloading.Runner.doRunUsingClassLoaderOf(Runner.java:36) Jan 30 16:02:17.981 - ERROR - Connector: (24/40) #011at com.mendix.externalinterface.connector.MxRuntimeConnector.processRequest(MxRuntimeConnector.java:72) Jan 30 16:02:17.981 - ERROR - Connector: (25/40) #011at com.mendix.core.impl.MxRuntimeImpl.processRequest(MxRuntimeImpl.java:742) Jan 30 16:02:17.981 - ERROR - Connector: (26/40) #011at com.mendix.m2ee.appcontainer.server.handler.RuntimeHandler.handle(RuntimeHandler.java:41) Jan 30 16:02:17.981 - ERROR - Connector: (27/40) #011at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:52) Jan 30 16:02:17.981 - ERROR - Connector: (28/40) #011at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) Jan 30 16:02:17.981 - ERROR - Connector: (29/40) #011at org.eclipse.jetty.server.Server.handle(Server.java:368) Jan 30 16:02:17.982 - ERROR - Connector: (30/40) #011at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) Jan 30 16:02:17.982 - ERROR - Connector: (31/40) #011at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) Jan 30 16:02:17.982 - ERROR - Connector: (32/40) #011at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) Jan 30 16:02:17.982 - ERROR - Connector: (33/40) #011at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) Jan 30 16:02:17.982 - ERROR - Connector: (34/40) #011at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) Jan 30 16:02:17.982 - ERROR - Connector: (35/40) #011at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) Jan 30 16:02:17.982 - ERROR - Connector: (36/40) #011at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628) Jan 30 16:02:17.982 - ERROR - Connector: (37/40) #011at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52) Jan 30 16:02:17.982 - ERROR - Connector: (38/40) #011at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) Jan 30 16:02:17.982 - ERROR - Connector: (39/40) #011at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) Jan 30 16:02:17.982 - ERROR - Connector: (40/40) #011at java.lang.Thread.run(Thread.java:748) The process that is not completing is a calculation microflow for an attribute on an entity.  These microflows only read and cast the currentUser entry into an Account entity and comparing it against another Account entity entry.  I am not doing any updates in these microflows.  Is anything I am doing locking the database and causing some sort of contention on specific entries that is causing this?  Is it locking the entity I am calculating for because it is updating an attribute (even if it is for a  calculated attribute) and therefore potentially causing a DB contention issue?  I am thinking that because I am only doing a read that DB locks should not apply and should not cause any contention.  I also add screenshots of the microflows here with descriptions of each below the images:   Figure 1: Calculation flow used on an entity that checks whether a logged in account is a Case Manager (sub-flow logic screenshot can be seen below). Figure 2: Sub-flow that retrieves the logged in user account (as seen in Figure 1). Figure 3: Flow that checks whether a case is assigned to a logged in user. Any advice will be greatly appreciated as always. Gustav
asked
1 answers
0

Stuck microflows most of the time means your microflow is running in a loop or there is a deadlock on the database. Do you have a create and retrieve loop? You mention calculated fields, is there a combination with an event handler that causes the object to eternally refresh? Also double check if empty values are caught like no user session etc.

Regards,

Ronald

 

answered