topic Batch stuck in Waiting for Class Training in Product Forum

Batch stuck in Waiting for Class Training

FredericTaes1 — Sat, 12 Dec 2020 09:55:00 GMT

Hi,

I'm trying to test the classification capabilities of Decipher.
I prepared a batch of 53 documents that were sent to Decipher (as a training batch). After the OCR step, the batch enters the status "Waiting for Class Training". However, it has been in this state for more than an hour now, and I see no progress being made.
Is it a matter of having even more patience, or are there certain steps to be taken to actually start the classification training ?

------------------------------
Frederic Taes
RPA Consultant
RoboRana
------------------------------

RE: Batch stuck in Waiting for Class Training

LaurisKums — Mon, 14 Dec 2020 06:42:00 GMT

Hello,

Have you trained your classification model? Information can be found here, it sounds like you could have missed this step: "4. Update classification model". Make sure you mark the model for training after uploading the batches.

Best regards,
Lauris Kūms

------------------------------
Lauris Kums
------------------------------

RE: Batch stuck in Waiting for Class Training

FredericTaes1 — Mon, 14 Dec 2020 08:37:00 GMT

Hi Lauris,

it is exactly these steps that I have been following.
It is in step 3 (after pushing the documents from the amended process to Decipher), that the document batch remains in status "Waiting for class training".
I've tried by continuing to step 4 and 5, but the batch remains in the status and the documents do not arrive in the verification step.

------------------------------
Frederic Taes
RPA Consultant
RoboRana
------------------------------

RE: Batch stuck in Waiting for Class Training

zdenek.kabatek — Mon, 14 Dec 2020 21:33:00 GMT

Hi, Frederic,

when in status "Waiting for class training" these documents will never arrive in Document Verification step as these are meant only for classification training - so class verification. If your goal is to perform classification training then I recommend following (I experienced similar behavior several times and this is trial and error approach which worked, don't ask me why). Create a new document type from scratch and prepare it for classification training as specified here. Run just a few documents and perform the steps as described in help. The documents should move from waiting for class training to Completed class training.

Regards,

------------------------------
Zdeněk Kabátek
Head of Professional Services
NEOOPS
http://www.neoops.com/
Europe/Prague
------------------------------

RE: Batch stuck in Waiting for Class Training

FredericTaes1 — Fri, 15 Jan 2021 13:11:00 GMT

Hi Zdenek,

Unfortunately I'm still not able to get it working. It remains in status "Waiting for class training", even after restarting everything from scratch.

In the Classification Client, I'm getting the following errors:

2021-01-15 08:25:53.4603 [2028-12] INFO | Waiting for next batch...
2021-01-15 13:54:55.4299 [2028-12] ERROR | Exception occurred while signaling process heartbeat : System.IO.FileNotFoundException: Unable to find the specified file.
at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.MemoryMappedFiles.MemoryMappedFile.OpenCore(String mapName, HandleInheritability inheritability, Int32 desiredAccessRights, Boolean createOrOpen)
at System.IO.MemoryMappedFiles.MemoryMappedFile.OpenExisting(String mapName, MemoryMappedFileRights desiredAccessRights, HandleInheritability inheritability)
at SsiServerCommonUtils.IpcLockTracker.SignalProcessHeartBeat()
at SsiClassificationClient.ClassificationClient.DoWorkImpl(Object sender, DoWorkEventArgs e)
2021-01-15 13:54:55.4771 [2028-12] INFO | No batch available, try to perform class model training.
2021-01-15 13:54:56.3984 [2028-12] INFO | Check for classification model training...
2021-01-15 13:55:00.0245 [2028-12] WARN | Unable to lock class model with ID = 11551854-6432-429d-832a-cc37bf0ecb96 for training. Error message: Request failed for command 'LockClassificationModelForTraining' with error code '-347' and error message: 'The state of the specified classification model is not valid for this operation.'
2021-01-15 13:55:00.1493 [2028-12] INFO | No batch available for classification, perform retry...
2021-01-15 13:55:05.1741 [2028-12] INFO | Waiting for next batch...
2021-01-15 13:55:25.8409 [2028-12] ERROR | Exception occurred while signaling process heartbeat : System.IO.FileNotFoundException: Unable to find the specified file.

Unfortunately, this doesn't help a single bit. I don't know which missing file it's talking about, or why it cannot lock the model. Any suggestions ?

------------------------------
Frederic Taes
RPA Consultant
RoboRana
------------------------------

RE: Batch stuck in Waiting for Class Training

ramonnunez — Mon, 18 Jan 2021 19:39:00 GMT

When the batch is on this state is ready for batch classification. You must then click on the IDP the tab for Class Verification and then load the batch, see the Step #5 on the Decipher "Training Classification Models"
https://bpdocs.blueprism.com/decipher/user-guide/classification-model-training-guide.htm?Highlight=classification

------------------------------
Ramon Nunez
Customer Solutions Engineer
Blue Prism Software Inc
UTC
------------------------------

RE: Batch stuck in Waiting for Class Training

zdenek.kabatek — Tue, 19 Jan 2021 21:00:00 GMT

Hi, Frederic,

a workaround just to enable you to work with Decipher :). In your batch do you plan to use more than 1 document type? If you have mapping - 1 batch to 1 document type then in my opinion you don't need to perform classification and you can begin to use Decipher straight away. You just don't specify classification model in batch definition and it should work. At least I did it few times in my case. Of course, when your batch contains more document types (invoices, orders, etc.) then you need to perform classification and train the classification model. However, if it is not the case and your mapping is 1to1 go straight with data verification skipping the classification model. I can't say it is 100% safe but it will get you moving behind the point where you are stuck currently.

Regards,

------------------------------
Zdeněk Kabátek
Head of Professional Services
NEOOPS
http://www.neoops.com/
Europe/Prague
------------------------------

RE: Batch stuck in Waiting for Class Training

BenoitCayla — Mon, 01 Feb 2021 14:12:00 GMT

Hi Frederic,
I had this problem too ... and the solution was so obvious in my case 😞
I just had to swith on the classification option in the Admin panel / configuration / classification (yes, just a single option). That worked perfectly ...
As i remember this option is set to off by default. So quite logical in fact... the configuration said i don't want to manage classification, why training the classifier ? 😉
Hope that help.
NB: So obvious ... however i spent many hours to figure out the point 😄

------------------------------
Benoit Cayla
SC
BLUEPRISM
Europe/Paris
------------------------------

RE: Batch stuck in Waiting for Class Training

SandroSarango — Thu, 02 Dec 2021 08:32:00 GMT

HI Zdeněk. This works for me.
Thank you

------------------------------
Sandro Sarango
Lead Developer
AutomationBot
Europe/Paris
------------------------------

RE: Batch stuck in Waiting for Class Training

ShwetaYadav — Wed, 03 Aug 2022 08:44:00 GMT

Hi,

I am trying to train my classification model for a unique type of document. But it gets stuck at " in class training" stage forever. Any idea what is going wrong here??

RPA Developer

------------------------------
Shweta Yadav
------------------------------

RE: Batch stuck in Waiting for Class Training

Ben.Lyons1 — Thu, 04 Aug 2022 14:53:00 GMT

Hi Shweta,

The most likely cause of that is that you have already trained a batch on the classification model.

When training the model, you need to have all batches at the stage "Awaiting classification training" before enabling the classification model for training.

Thanks

------------------------------
Ben Lyons
Senior Product Specialist - Decipher
Blue Prism
UK based
------------------------------

RE: Batch stuck in Waiting for Class Training

ShwetaYadav — Mon, 08 Aug 2022 08:11:00 GMT

Alright Thanks Ben. I got your point.

In addition to this let say I have trained a document to capture specified fields and set the periodic training & training size for small set of 10 docs in the capture model.

Still when I push the same document at the 11th time - why do I have to re-indicate the field value that was already trained?? I am confused, does it require more training if so then how much training is required in that case or there is some other way to handle this?

Thanks
------------------------------
Shweta Yadav
------------------------------

RE: Batch stuck in Waiting for Class Training

Ben.Lyons1 — Mon, 08 Aug 2022 08:21:00 GMT

Hi Shweta,

10 is much too small of a number to train an effective ML capture model, and very likely unnecessary at this stage. Decipher has a primary ML engine that's always on and will probably do much better with learning on such a small number of documents.

I recommend reading through our best practice guidance to see how you can get the best out of Decipher.

Thanks

------------------------------
Ben Lyons
Senior Product Specialist - Decipher
Blue Prism
UK based
------------------------------

RE: Batch stuck in Waiting for Class Training

ShwetaYadav — Mon, 08 Aug 2022 11:15:00 GMT

Hi Ben,

Even After Disabling the ML model, I tried to simply push the document and verify the data, but every time i do that there is something wrong with any of the field specified in the DFD . I try to edit DFD restart the batch to re capture the data, but no luck.
Can you please advice.

Thanks

------------------------------
Shweta Yadav
------------------------------

RE: Batch stuck in Waiting for Class Training

Ben.Lyons1 — Mon, 08 Aug 2022 12:01:00 GMT

Hi Shweta,

You may need to delete your training data, as it will be impacted by all your previous training.

But again, I would recommend you read the best practice guidance first as it will help confirm if the training to date is in keeping with the recommended standards.

Thanks

------------------------------
Ben Lyons
Senior Product Specialist - Decipher
Blue Prism
UK based
------------------------------

RE: Batch stuck in Waiting for Class Training

ShwetaYadav — Tue, 09 Aug 2022 08:02:00 GMT

Hi Ben,

I deleted the training data and started from the fresh, also referred the same steps as mentioned in the best practices doc.

1. Like you suggested to focus on the DFD configuration adjustments and train the batch- restart to see if it captures what is expected, also added few regex patterns and tried to indicate manually on the field region which has to be extracted and submit the batch.

2. Again in the next push it appears to be as in the previous batch. I keep on training but its not ready to learn 😞

3. Also I tried to implement ML by enabling the same in the document type. (Same is the case with this too, changes not reflecting as expected. )

Thanks

------------------------------
Shweta Yadav
------------------------------

RE: Batch stuck in Waiting for Class Training

Ben.Lyons1 — Tue, 09 Aug 2022 09:53:00 GMT

Hi Shweta,

It sounds like you're doing everything right, but it's very hard to get a true feel for someone else's documents on this channel.

You may be entitled to some Expert Connect sessions, these can be requested via the customer support team. This would give you a chance to work directly with a Decipher expert on your use case.

Thanks

------------------------------
Ben Lyons
Senior Product Specialist - Decipher
Blue Prism
UK based
------------------------------

RE: Batch stuck in Waiting for Class Training

ShwetaYadav — Fri, 26 Aug 2022 04:40:00 GMT

Hi Ben,

I can now extract the data after following the suggested steps by the expert.
Now I am stuck on identifying of Document Type, my batch contains 5 types of document how to retrieve the document type from the queue items.

Can you please suggest.

Thanks

------------------------------
Shweta Yadav
------------------------------

RE: Batch stuck in Waiting for Class Training

Ben.Lyons1 — Fri, 26 Aug 2022 12:44:00 GMT

Hi Shweta,

If your classification model isn't working as you'd hoped, you have 2 options I can think of to improve.

If you can gather more document samples to train a new model with, ideally at least 50 of each document type. A more comprehensive model should produce better results.

Alternatively, if the confidence is close, you can reduce the threshold by document type (see the Document Type settings). For example, the classification confidence for document type A is above 80%. Change the threshold just for that document type.

If your document types are very similar, you may still struggle. For example if all 5 types are different invoice formats, they will likely contain a lot the same key fields e.g. invoice number, invoice total.

Thanks

------------------------------
Ben Lyons
Senior Product Specialist - Decipher
Blue Prism
UK based
------------------------------

RE: Batch stuck in Waiting for Class Training

ShwetaYadav — Mon, 29 Aug 2022 04:33:00 GMT

Hey Ben,

Hope you are doing good!!

I think I framed the question in a wrong way, Actually I am able to identify the document type in the Decipher tool.
But when I retrieve the extracted batch details using the Queue items, I might have same or different set of document types in a batch, what is the process to get the document type for the extracted data for each doc?

Mostly useful when trying to consolidate the batch data in a single report.

Thanks

------------------------------
Shweta Yadav
------------------------------