Machine Learning didn't enhance accuracy?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content
17-04-23 06:47 AM
Hi all,
We have set up ML for a Document Type that recently went to Production with a success rate of about 55% (55% of documents had all fields captured correctly by Decipher).
Our target threshold is 75%
We pushed 1000+ documents through manual verification with ML enabled. However, our first unattended run post ML is at a 52% success rate (lower than before ML was implemented)
Has anyone else experienced this, and how would you go about enhancing the accuracy?
Thanks!
------------------------------
Mohamed Saheb
------------------------------
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content
17-04-23 08:09 AM
Hi Mohamed,
What was your accuracy prior to adding the ML capture model?
Thanks
------------------------------
Ben Lyons
Senior Product Specialist - Decipher
Blue Prism
UK based
------------------------------
Principal Product Specialist - Decipher
SS&C Blue Prism
UK based
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content
17-04-23 08:49 AM
Hi Ben,
It was roughly 55% before enabling ML...
Thanks!
------------------------------
Mohamed Saheb
------------------------------
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content
17-04-23 08:53 AM
Hi Mohamed,
That indicates that the DFD configuration probably needs some work, the capture ML model won't be able to improve that. Ultimately it's working from the same set up as the default rules-based model.
I would suggested reading through our best practice guidance and seeing if that helps improve things.
Thanks
------------------------------
Ben Lyons
Senior Product Specialist - Decipher
Blue Prism
UK based
------------------------------
Principal Product Specialist - Decipher
SS&C Blue Prism
UK based
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content
17-04-23 09:22 AM
Thanks for the response, Ben.
We've spent quite a bit of time configuring the DFD. I've attached a snap of the target document type - we are reading some data fields within the red highlight ribbon.
One document will return 100% correct data. Another document might return blank fields throughout. And others will return incorrect fields. These documents are all bulk scanned (as a batch) into a folder which is then fed to Decipher so there is not much variance there.
Any further thoughts?
------------------------------
Mohamed Saheb
------------------------------
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content
17-04-23 09:32 AM
Hi Mohamed,
It would be difficult to comment without seeing the DFD. If you'd like some direct support for your use case, you may be entitled to some Expert Connect time. This would give you some time with our professional services team to work on your use case, this can be accessed via the Customer Support menu on the portal.
Check with your account manager what your entitlement is for Expert Connect.
Thanks
------------------------------
Ben Lyons
Senior Product Specialist - Decipher
Blue Prism
UK based
------------------------------
Principal Product Specialist - Decipher
SS&C Blue Prism
UK based
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content
15-05-23 08:15 PM
Hi Mohamed,
Do you have any improvement on this? Could you let us know what you did to improve?
------------------------------
Pranav
------------------------------
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content
17-05-23 06:57 AM
Hi Pranav,
We had a consultation with a Blue Prism expert regarding this but unfortunately he was unable to improve things either. I assume the document we're using is not suitable for the current version of Decipher.
AWS Textract handles this document like a breeze, but it's a premium product so the costs are premium too. If your document volumes are low then it would be worth checking out.
Good luck!
------------------------------
Mohamed Saheb
------------------------------
