Get Text Completion Using AI21 Labs

UiPath.Bedrock.IntegrationService.Activities.TextCompletionUsingAi21labs

Description

Generates a text completion response based on a given prompt using AI21Labs.

Project compatibility

Windows | Cross-platform

Configuration

• Connection ID - The connection established in Integration Service. Access the drop-down menu to choose, add, or manage connections.

• Model - The model you want to use for the text completion generation.
• Prompt - The prompt to use for the text completion generation.

Manage Properties

Use the Manage Properties wizard to configure or use any of the object's standard or custom fields. You can select fields to add them to the activity canvas. The added standard or custom fields are available in the Properties panel (in Studio Desktop) or under Show additional options (in Studio Web).

Additional options

• Max tokens - The maximum number of tokens allowed for the prompt and generated answer. By default, this field is set to 200.
• Stop sequences - Sequences that cause the model to stop generating completion text.
• Temperature - The amount of randomness injected into the response. This field accepts ranges between 0 and 1. Use a temperature closer to 0 for analytical / multiple choice, and closer to 1 for creative and generative tasks. By default, this field is set to 0.
• Top P - A number between 0 and 1. The lower the number, the fewer tokens are used. By default, this field is set to 1.
• Count penalty - A penalty applied to tokens based on their frequency in the generated responses.
• Frequency penalty - A penalty applied to tokens that are frequently generated.
• Presence penalty - A penalty applied to tokens that are already present in the prompt.

Output

• Completion - Top generated text completion. Automatically generated output variable.
• Text completion response object - The full response object for the text completion. Automatically generated output variable.