Decipher Checkmark Group issue

[AlexandraBarban]

Hello,

I discovered a problem and I am not sure which is the cause. The problem is regarding the Decipher checkmark group - the values which were recognized in Decipher versus the values which arrive in BluePrism.

I worked with Decipher in two ways in the Data Verification step in order to retrieve the results.

Almost 50 documents have been uploaded in Decipher. I got two sets of results:

1. Results when annotator trains Decipher until recognizes the checkboxes fields in the data verification.
2. Results when checkboxes are selected manually from the dropdown by the annotator in case Decipher did not recognize itself the correct marked fields in the data verification. – this will be how the annotator will do in production.

For the first results set - my observation is that if the annotator is drawing the area until the Decipher selects the correct checkbox, then the value arrives correctly in Blue Prism and the checkboxes are not updated in a wrong way.

There have been situations when the checkbox was not recognized in any way. For this kind of situation/checkbox, the annotator selected it manually.

For the second results set – my observation is that for some cases, not all, there is some bug which manifests in the following way: in data verification, when Decipher initially recognizes the wrong fields and the annotator selects manually from the dropdown the correct values, the Decipher somehow returns back to its initial value/s incorrectly recognized. I observed this issue even if I just change documents pages, without updating any other field. Just go to the next page, return, and the checkbox was back set to the initial incorrect value. This whole thing in happening in the Data Verification.

It also happened for one single document, if I update the checkbox value and then save & submit, the value which arrives in BP is the initial incorrect value, recognized by Decipher initially. ☹

As I said, this bug is not always happening – there were many documents with checkboxes manually selected and the results does not return to the initial value, therefore the results are arriving correctly in Blue Prism.

In my DFD I used Checkmark Group as format and Assignable, Checkable as flags. Should I update it with something else? I also tried with "Checkmark" format, but it did not help.

If this happens in production, it will impact the whole process because the process could not recognize if the Decipher result is correct/incorrect.

Did you have such a case? If you did, how it was handled?

Thank you in advance!

------------------------------
Alexandra Barbanta
------------------------------

[BenLyons]

Hi Alexandra,

I've just worked through similar steps in my own environment and I think I've reproduced the behaviour.

Decipher's identified the checkbox group, but retrieving the incorrect result. I select the desired response from the dropdown, then add a new region for another field and the checkbox result reverts to the original response. There'll be a reason as to why Decipher's recapturing the field, but not necessarily a bug. Ultimately Decipher's found the region it believes it's been trained to recognise, but either done so incorrectly or retrieved the wrong result from the field. 

The correct way to resolve this is to update the region, as opposed to the field in the dropdown. If the region is incorrect, then it's best to delete it. If it's selecting the wrong result based on the checkbox selected, the configuration of the region will need to be amended to the correct checkboxes. So in the verification screen, selecting the box around all the checkboxes (adjusting size if needed) and reselecting each response and corresponding individual checkbox.

If the incorrect result is still being retrieved, hover over the region and you should see a % for each field completeness which may help identify why the incorrect value's being selected.

Alternatively, if you do just want to push it through, it should be the last part of the verification carried out. So check all other fields first, then before clicking submit, go through each of the incorrect checkbox results and select the one needed from the dropdown. This should retain the correct response, though it won't help improve the training or provide any rationale as to why the incorrect value was selected. If you want to be 100% sure before submitting, click save and return the batch. When reloading the batch the corrected values should be retained and ready for submission.

Give these a try and let me know how you get on.

Thanks

------------------------------
Ben Lyons
Senior Product Specialist - Decipher
Blue Prism
UK based
------------------------------