- Release Notes
- Getting started
- Notifications
- Projects
- Datasets
- Data Labeling
- About Data Labeling
- Managing Data Labels
- Using Data Labeling with human in the loop
- ML packages
- Out of the box packages
- Pipelines
- ML Skills
- ML Logs
- Document UnderstandingTM in AI Center
- AI Center API
- Licensing
- AI Solutions Templates
- How to
- Basic Troubleshooting Guide
Using Data Labeling with human in the loop
Data Labeling enables you to upload raw data, annotate text data in the labeling tool (for classification or entity recognition), and use the labeled data to train ML models. Apart from this, you can use data labeling for human validation on model outputs.
A common scenario is when you train an extractor or classifier model. When the model prediction falls below a set confidence threshold, that data can be sent to Action Center for human validation. The validated data can be used to retrain the model in order to improve confidence on subsequent model predictions.
You can use this sample workflow to test the human-in-the-loop sequences. This sample workflow uses the Email AI Template solution. For more information on how to configure and use Email AI Template, check the Configuring Email AI page.