Use Custom NER with continuous learning

Background information

This example is used to extract chemicals by the category mentioned in research papers. By following the procedure below you will extract the chemicals and categorize them as ABBREVIATION, FAMILY, FORMULA, IDENTIFIER, MULTIPLE, SYSTEMATIC, TRIVIAL and NO_CLASS.

Prerequisites

This procedure uses the Custom Named Entity Recognition package. For more information on how this package works and what it can be used for, see Custom Named Entity Recognition.

For this procedure, we have provided sample files as follows:

• Pre-labeled training dataset in CoNLL format. You can download it from here.
• Pre-labeled test dataset. You can download it from here.
• Sample workflow for extracting categories of chemicals mentioned in research papers. You can download it from here.
  Note: Make sure that the following variables are filled in in the sample file:

  • in_emailAdress - the email address to which the Action Center task will be assigned to
  • in_MLSkillEndpoint - public endpoint of the ML Skill
  • in_MLSkillAPIKey - API key of the ML Skill
  • in_labelStudioEndpoint - optional, to enable continuous labeling: provide import URL of a label studio project

Procedure

Follow the procedure below to extract chemicals by their category from research papers.

1. Import the sample dataset in UiPath® AI Center. To do so, go to the Datasets menu and upload the train and test folder from the sample.
2. Select the desired Custom NER package from ML Packages > Out of the Box Packages > UiPath Language Analysis and create it.
3. Go to the Pipelines menu and create a new full pipeline run for the package created in the previous step. Point to the training and the test dataset provided in the sample file.

   Once complete, the results of the pipeline are available under Artifacts. You can download the classification report to evaluate the test results.

4. Create a new ML Skill using the package generated by the pipeline run from the previous step and deploy it.
5. Once the skill is deployed, leverage it in the UiPath® Studio workflow provided. To enable capturing data with weak predictions, deploy a Label Studio instance and provide the instance URL and API key in the Label Studio activity in the workflow.

Getting started with Label Studio

To get started with Label Studio and export data to AI Center, follow the instructions below.

1. Install Label Studio on your local machine or cloud instance. To do so, follow the instructions from here.
2. Create a new project from the Named Entity Recognition Template and define your Label Names.
   
   

   

   
   
3. Make sure that the label names have no special characters or spaces. For example, instead of Set Date, use SetDate.
4. Make sure that the value of the <Text> tag is "$text".
   
   

   

   
   
5. Upload the data using the API from here.

   cURL request example:

   curl --location --request POST 'https://<label-studio-instance>/api/projects/<id>/import' \)\)
   --header 'Content-Type: application/json' \)\)
   --header 'Authorization: Token <Token>' \)\)
   --data-raw '[
       {
         "data": {
           "text": "<Text1>"
         },
       },
       {
         "data": {
           "text": "<Text2>"
          }
       }
   ]'

6. Annotate your data.
7. Export the data in CoNLL 2003 format and upload it to AI Center.
8. Provided the Label Studio instance URL and API key in the provided sample workflow in order to capture incorrect and low confidence predictions.