8.2.6 on Windows Server 2012
A few days ago, we had an issue crop up where Powershell jobs in Visualcron started failing consistently. The most seemingly relevant error message we saw repeated was this:
Unhandled Exception: System.TimeoutException: The open operation did not complete within the allotted timeout of 00:01:00. The time allotted to this operation may have been a portion of a longer timeout. ---> System.TimeoutException: Open timed out after 00:01:00 while establishing a transport session to net.pipe://visualcronserver/TaskService. The time allotted to this operation may have been a portion of a longer timeout. ---> System.TimeoutException: Cannot connect to endpoint 'net.pipe://visualcronserver/TaskService' within the allotted timeout of 00:00:59.8500000. The server has likely reached the MaxConnections quota and is too busy to accept new connections. The time allotted to this operation may have been a portion of a longer timeout. ---> System.IO.PipeException: A pipe endpoint exists for '\\.\pipe\5f2891dd-9409-4bec-a501-866edbddf169', but the connect failed: All pipe instances are busy. (231, 0xe7)
--- End of inner exception stack trace ---
at System.ServiceModel.Channels.PipeConnectionInitiator.TryConnect(Uri remoteUri, String resolvedAddress, BackoffTimeoutHelper backoffHelper)
at System.ServiceModel.Channels.PipeConnectionInitiator.Connect(Uri remoteUri, TimeSpan timeout)
at System.ServiceModel.Channels.BufferedConnectionInitiator.Connect(Uri uri, TimeSpan timeout)
at System.ServiceModel.Channels.ConnectionPoolHelper.EstablishConnection(TimeSpan timeout)
--- End of inner exception stack trace ---
at System.ServiceModel.Channels.ConnectionPoolHelper.EstablishConnection(TimeSpan timeout)
at System.ServiceModel.Channels.ClientFramingDuplexSessionChannel.OnOpen(TimeSpan timeout)
--- End of inner exception stack trace ---
Server stack trace:
at System.ServiceModel.Channels.ClientFramingDuplexSessionChannel.OnOpen(TimeSpan timeout)
at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannel.OnOpen(TimeSpan timeout)
at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannel.CallOpenOnce.System.ServiceModel.Channels.ServiceChannel.ICallOnce.Call(ServiceChannel channel, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannel.CallOnceManager.CallOnce(TimeSpan timeout, CallOnceManager cascade)
at System.ServiceModel.Channels.ServiceChannel.EnsureOpened(TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)
Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at VisualCron.ITaskService.RequestTaskInfo(Int32 VCTaskPId)
at ve4UATSt8QlRwEsQQC.Y5AO27FgZ5FVgl3x4y.coeMhxKsm(String[] ) Exception in Task: Non zero exit code Exception in Task: Non zero exit code
Is this identifiable as a known issue?