Random resource connection loss with the app server

[Verestah]

Hello everyone,

I am reaching out to seek your assistance regarding an abnormal behavior I am experiencing. All of my resources on a server lose connection with the AppServer randomly. They are unable to reconnect and several error messages appear in the logs.

The resources manage to reconnect to the application server on their own after a certain period (between 15 and 45 minutes).

Here are the logs of one resource:

[2025-02-07 10:21:13Z] Listener failed : Unable to register with the database - The request channel timed out attempting to send after 00:01:00. Increase the timeout value passed to the call to Request or increase the SendTimeout value on the Binding. The time allotted to this operation may have been a portion of a longer timeout.
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:40Z] Will retry in 2 minutes
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:28Z] Server connection lost
[2025-02-07 10:21:40Z] Will retry in 2 minutes
[2025-02-07 10:23:59Z] Listener failed : failed to update resourcepc details on the database - System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'System.ServiceModel.Channels.ServiceChannel'.

Server stack trace: 
   at System.ServiceModel.Channels.CommunicationObject.ThrowIfDisposedOrNotOpen()
   at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
   at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
   at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]: 
   at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
   at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
   at BluePrism.AutomateAppCore.IServer.RefreshResourcePC(String name, ResourceDBStatus status, Int32 runningSessions, Int32 activeSessions)
   at Castle.Proxies.Invocations.IServer_RefreshResourcePC.InvokeMethodOnTarget()
   at Castle.DynamicProxy.AbstractInvocation.Proceed()
   at BluePrism.AutomateAppCore.ServerManager.Intercept(IInvocation invocation)
   at Castle.DynamicProxy.AbstractInvocation.Proceed()
   at BluePrism.AutomateAppCore.TcpListener.RefreshDBWithCurrentState()
[2025-02-07 10:24:03Z] Will retry in 2 minutes

Event logs of the server :

Thank you for your help and feedback to find the origin and cause of this issue.

[Jrwork]

@Verestah 

Hello, do the features stop working while the automation is running or before it starts up?

Changing the BluePrism Login Agent service to start late may help.

However, you should also open a ticket with BluePrism support and provide as much information as possible.

[Verestah]

Hi @Jrwork, thanks for your answer.

Features stop working for both cases, when an automation is running and when neither.

Yeah I should create a ticket.

[Piotr__Wieczerzak]

Hi, 

Can you suggest what was reason of issue?

It seems that I have similar problem at few VDIs after upgrading to Windows 11. Before everything was working good. Also not all VDIs after upgrade has problem.

Thank you 

Piotr

[Verestah]

Hi,

A little feedback after some discussions with the support.

They did not clearly identify the reason for this problem.
It may be a performance problem caused by the size of a certain table in the database, but I'm not convinced of the reason.

Furthermore, the problem hasn't recurred, so unfortunately there's no follow-up.

[Piotr__Wieczerzak]

Hi, 

so here is not working.

During login to server:

Login failed. The server instance cannot be referenced

BluePrism.Server.Domain.Models.BluePrismException: The server instance cannot be referenced
at BluePrism.AutomateAppCore.app._Closure$__._Lambda$__0-0()
at AutomateUI.frmApplication.btf(Object a, CancelEventArgs b)
at BluePrism.AutomateAppCore.ServerManager.OnConnectionPending()
at BluePrism.AutomateAppCore.ServerManager.RetryConnection(IInvocation a)
at BluePrism.AutomateAppCore.ServerManager.Intercept(IInvocation invocation)
at Castle.DynamicProxy.AbstractInvocation.Proceed()
at Castle.Proxies.IServerProxy.GetDependenciesStatus()
at AutomateUI.frmApplication.btp()
at AutomateUI.frmApplication.PerformPostLoginActions(String locale)
at AutomateUI.frmApplication.AttemptLogin(String locale, Func`3 loginMethod)

Or:

The following error has occurred:
The request channel timed out attempting to send after 00:00:00. Increase the timeout value passed to the call to Request or increase the SendTimeout value on the Binding. The time allotted to this operation may have been a portion of a longer timeout.

Also I checked event viewer:

Application: Automate.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.ObjectDisposedException

Server stack trace:
at System.ServiceModel.Channels.CommunicationObject.ThrowIfDisposedOrNotOpen()
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(System.Runtime.Remoting.Messaging.IMessage, System.Runtime.Remoting.Messaging.IMessage)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(System.Runtime.Remoting.Proxies.MessageData ByRef, Int32)
at BluePrism.AutomateAppCore.IServer.IsServer()
at Castle.Proxies.Invocations.IServer_IsServer.InvokeMethodOnTarget()
at Castle.DynamicProxy.AbstractInvocation.Proceed()
at BluePrism.AutomateAppCore.ServerManager.Intercept(Castle.DynamicProxy.IInvocation)
at Castle.DynamicProxy.AbstractInvocation.Proceed()
at Castle.Proxies.IServerProxy.IsServer()
at AutomateUI.BPApplication.Start(System.String[])
at Automate.Program.Main(System.String[])

and:

Faulting application name: Automate.exe, version: 7.3.1.11999, time stamp: 0x66718972
Faulting module name: KERNELBASE.dll, version: 10.0.26100.3775, time stamp: 0x6e2fc3bb
Exception code: 0xe0434352
Fault offset: 0x00000000000c933a
Faulting process id: 0x29C4
Faulting application start time: 0x1DBA9E999197D8D
Faulting application path: C:\Program Files\Blue Prism Limited\Blue Prism Automate\Automate.exe
Faulting module path: C:\WINDOWS\System32\KERNELBASE.dll
Report Id: 553a7197-05ad-4f79-92ac-72f30ba4059c
Faulting package full name:
Faulting package-relative application ID:

And :

AutomateUI.BPApplication
An unhandled exception occurred in Blue Prism:

System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'System.ServiceModel.Channels.ServiceChannel'.

Server stack trace:
at System.ServiceModel.Channels.CommunicationObject.ThrowIfDisposedOrNotOpen()
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at BluePrism.AutomateAppCore.IServer.IsServer()
at Castle.Proxies.Invocations.IServer_IsServer.InvokeMethodOnTarget()
at Castle.DynamicProxy.AbstractInvocation.Proceed()
at BluePrism.AutomateAppCore.ServerManager.Intercept(IInvocation invocation)
at Castle.DynamicProxy.AbstractInvocation.Proceed()
at Castle.Proxies.IServerProxy.IsServer()
at AutomateUI.BPApplication.Start(String[] args)
at Automate.Program.Main(String[] args)

Look like problem with .net Framework after upgrade to window 11.

I tried to reinstall it but does not help.

Best regards

Piotr Wieczerzak