Maximum number of records in a queue

[TimsySangal]

Hi All,

What is the maximum number of records that can be added to a queue. How is the performance impacted by adding a large number of records, if the collection rows are around 50000 and columns are 25? How can the performance be optimized?

------------------------------
Timsy Sangal
Consultant
Capgemini
------------------------------

[John__Carter]

It will probably be easier create items in batches rather than try to add them all at once. Exactly how many is difficult to say as it depends factors such as the amount of data in each item. And if you add them one at a time, although slower, it provides an opportunity to inspect/modify/classify/etc each item.

------------------------------
John Carter
Professional Services
Blue Prism
------------------------------

[robert.nicklin · Accepted solution]

Hi Timsy,

The answer to this question will largely depend on the size of your data, as John mentions, but there are a few changes to help you batch items more easily in more recent releases of Blue Prism.

In Blue Prism 6.7 we introduced a new parameter called Batch Size to the "Add to Queue" action in the Work Queues VBO. This effectively separates a collection provided to the Add to Queue item into batches based on the value defined by the user to avoid issues with timeouts if the collection in question is particularly large. If left blank, the default batch size used is 1000 items. From Blue Prism 6.9 onwards, we introduced some validation to recommend that the value provided by a user in the Batch Size parameter is between 1 and 25,000.

The enhancement provided in Blue Prism 6.7 was implemented under BG-3596, the release note for which reads:

A new input parameter called Batch Size has been added to the Add To Queue action, which enables users to add multiple items from a collection to a queue in batches, rather than all items at once. A value of 0 will process all items in one batch. If a value is not specified, a default batch size of 1000 will be used.

Hope this helps!

Regards,
Rob

------------------------------
Robert Nicklin
Senior Product Owner
Blue Prism
Warrington, England
------------------------------

[TimsySangal]

Thank you Robert.

This is very helpful. I will read up more on this and check how this works.

------------------------------
Timsy Sangal
Consultant
Capgemini
------------------------------