topic Memory issues are a common… in Product Forum

Memory not cleaning up after object ends

CarlosPires — Tue, 05 Mar 2019 20:29:00 GMT

Hi everybody, We're having some issues with memory running my process. We've already implemented all the recommendations BP made in this article: http://portal.blueprism.com/customer-support/support-center#/path/1141009962. Also, we took in count the process solution design document, avoiding the use of child processes inside loop of the parent process. We're using objects inside loop of the main process. This process uses 2 applications, basically takes the info from one and paste it in the other, in the middle there're some validations and data conversions using some equivalence lists within excel. We've avoided using collections filtering. We attach and detach from the applications when needed. Both of the applications are web based and modeled with Google Chrome. We notice that the memory goes up particullarly when writing the new data onto the target system. When it finish writing there's no memory freeing up, It always goes up, and off course after sometime (around 30 cases), the process stops. For every case the memory rise up around 20~30 MB and doesn't release any of it. When the message "Automate.exe has stopped working" appears, the memory is around 1.3~1.4GB. We've run the process in debug mode and control room, but we get the same result all the time. Another thing we tried was reducing the application modeller from 250+ elements to around 120, using a lot of dynamic inputs. There's not a noticiable impact within the memory. We also tried using Firefox, and the result was the same. Anyone have some suggestions?

As long as the process is…

AmiBarrett — Tue, 05 Mar 2019 21:55:00 GMT

As long as the process is running, objects and the state of all of their contents will remain in memory. If they didn't, you'd need to constantly reattach, and having global data items would be unfeasible. The best thing I can suggest is to try and clear out data you no longer need as you go along, especially when it comes to collections. Suppose you have an action with a collection as an input, then the action spits out either another collection or something different entirely. As long as your input data isn't also being sent back out, you can use a calculation stage to empty it out before you reach the end stage on your action.

We already did that. We…

CarlosPires — Tue, 05 Mar 2019 22:43:00 GMT

We already did that. We clear all collections that are not sent as outputs at the end of every action. Also we modified the Collection Manipulation VBO, so it clears all incoming collections for every action.

If you have multiple actions…

AndreyKudinov — Wed, 06 Mar 2019 04:08:00 GMT

If you have multiple actions returning big collections, I'd also make them public and run the separate action to clean them up after collection is returned. It does not seem to be the problem in your case, although I can't be sure, but we noticed that even when process finishes with objects still containing big collections in memory, they don't seem to be garbage collected until that object is initialized for the next time, causing automate.exe process leaking memory after process ends. Cleaning up output collections and forcing GC seems to resolve it.

We've already made all…

CarlosPires — Wed, 06 Mar 2019 21:45:00 GMT

We've already made all possible optimizations we've found here. I'm starting to think there's some issue in how BP handles Chrome interactions and how those objects are being disposed. Are we the only ones with this problem around here?

Memory issues are a common…

david.l.morris — Thu, 07 Mar 2019 17:54:00 GMT

Memory issues are a common theme in Blue Prism issues, but I haven't encountered or seen others encounter your specific issue before. That doesn't mean others aren't having the issue. More and more people are expanding to use Chrome automation, so I guess it's possible you've found a problem many others will eventually run into. I don't personally have any knowledge of how it could be that garbage collection is handled differently for data that is written into Chrome, but I suppose it's possible. I think I'll try to reproduce this later on. I'll come back and reply again if I'm able to make it happen as well. Have you submitted a ticket to Blue Prism on this? I know you posted in the forum and Blue Prism support may peruse the forums, but the quickest way to get support for such an unusual problem is to submit to them directly. You'll probably want to let them see the problem occur if possible. It sounds like you know how to reproduce the issue so that's good at least.

Yes, I've already submitted…

CarlosPires — Tue, 12 Mar 2019 19:24:00 GMT

Yes, I've already submitted a ticket to Blue Prism. They're looking into it, It's taking a little bit more than what we were expecting. This issue is happening in more than one task, each of them developed by a different developer, using Chrome and everyone already implemented all the recommendations.

Carlos, we are also…

JayaPrakash — Fri, 15 Mar 2019 20:13:00 GMT

Carlos, we are also encountering same issue. Do you have any updates on this. Thanks in advance...

Hi Jaya, Not for now. BP…

CarlosPires — Mon, 18 Mar 2019 21:32:00 GMT

Hi Jaya, Not for now. BP support team has escalated the issue to the BP Product team. I'd suggest you to create a ticket and submit all evidence, so if this is a major issue related to the Chrome Extension they may diagnose it and help us all solving it. As a workaround we are executing our tasks limiting the number of cases per run and running them multiple times as needed. Regards, Carlos

Hello Carlos, My team is…

DevikaMurugesan — Tue, 19 Mar 2019 16:41:00 GMT

Hello Carlos, My team is facing the exact same problem and when we logged a ticket, we were advised that Chrome 72 is compatible only with Blue prism 6.2.4 version., so we were asked to upgrade., We are yet to do that., Are you on 6.4 or 6.4.2? Regards DV

Hi DV, Right now our…

CarlosPires — Tue, 19 Mar 2019 21:41:00 GMT

Hi DV, Right now our environments are on v6.4, I've tried upgrading BP to v6.4.1 and v6.4.2 in development environment, also downgrading to v6.3.1. For all tests I've installed the supported Google Chrome version and BP extension. Conclusion: In every test the memory issue persists, there's no noticeable improvement on memory management. BP support team told me the same as you, so I recorded videos and gather evidence of the error in all versions and send them back. Chrome elements recognition is not our issue, as far as you have the supported version of chrome installed within your BP version, that shouldn't be a problem. Regards, Carlos

Latest BP support answer: ""I…

CarlosPires — Thu, 21 Mar 2019 22:49:00 GMT

Latest BP support answer: ""I've received feedback from our Product Team on this issue. They've been able to reproduce the System.Out.Of.Memory exception with Chrome Processes and have confirmed that the root cause is due to a known issue (memory leak) in Blue Prism. The reference/tracking number for this issue is BG-2612. As the root cause is a memory leak in the BP product, there are no workarounds currently available. A permanent fix for this issue should be tentatively released as part of BP v6.5, which is slated to be generally available towards the end of April 2019."" Hope it helps some of you.

Hi Carles, Thank you very…

JayaPrakash — Fri, 22 Mar 2019 16:53:00 GMT

Hi Carles, Thank you very much for the update...It will be very helpful information for my team

Hello Carlos, Thank you for…

DevikaMurugesan — Wed, 27 Mar 2019 19:24:00 GMT

Hello Carlos, Thank you for the updates., Let's hope this 6.5 fixes the issue., My team is also looking at option to even stay away from Chrome browser and use IE11 instead., Regards, DV