Human-in-the -Loop (HITL) combines the power of human intelligence with machine automation, allowing humans to review and correct results when accuracy or confidence scores fall below a threshold. HITL ensures high-quality outcomes and continuous improvement through human intervention and feedback.
This guide will walk you through the steps on how to enable Human-in-the-Loop (HITL) for your asset.
Set accuracy threshold
Users must have any one of the following policies to enable manual review, and set threshold limits:
- Administrator Policy
- Creator Policy
- Manager Policy
- In the Asset Monitor page, click
next to the specific asset you want to set a threshold on and select Settings.
- A window will appear.
- Click on an asset and enable Manual Review.
- Set the threshold limit for the accuracy of respective fields. This determines the minimum acceptable accuracy level required for each field to meet quality standards.
- Click on Next and ensure that the asset is activated. Then, click Submit.
Human-in-the-loop review
Users must have any one of the following policies to review transactions, verify and correct the fields that have fallen below the threshold settings:
- Administrator Policy
- Creator Policy
- Reviewer Policy
- If the accuracy falls below the set threshold, the document will appear in the HITL (Human-in-the-Loop) queue.
- In the Human-in-the-Loop page, select the document for review.
- By default, the Sort fields by need review toggle is enabled. This ensures that fields requiring review will appear at the top of the review section.
- To review and/or update a field, select the field and draw a bounding box on the document or manually edit the field value.
- Once the field is reviewed, you can tab out and the Review needed
icon disappears and is updated with the Reviewed
icon.
- Once you have reviewed the fields, click Submit to be directed to the Human in Loop transaction listing page or click Submit and Move Next to review the next transaction in the queue.
Activate an Asset