Let's say we want to report over a weeks work so the business knows whats been completed, whats pending...
one week
2000 completed
200 exceptions
2000 pending (excess from input files we have yet to work)
We were provided a reporting process template (from a consulting group) to pull completed, exception and pending items into three separate collections, merge them into one main collection, loop over this main collection to massage data as we need and then write the collection to an excel after.
This loop becomes terrible slow after we hit 2000ish items and we are always risking an out of memory crash error.
What is a better way to solve this reporting issue? I will take time to think/research on my own but would love it if there is a better way to report with a blueprism process (and not a database job).