Generate Text Completion

Description

Given a prompt and other inputs, generates a text completion response.

Project compatibility

Windows | Cross-platform

Configuration

• Connection ID - The connection established in Integration Service. Access the dropdown menu to choose, add, or manage connections.

• Prompt - The prompt you want to use for the text completion(s) generation, such as: "Write an email to a new sales lead". This field supports String type input.
• Model ID - The large language model (LLM) to utilize for the completion request. Select one of the available options: Bison-002, Bison-001, Unicorn-001.

Manage Properties

Use the Manage Properties wizard to configure or use any of the object's standard or custom fields. You can select fields to add them to the activity canvas. The added standard or custom fields are available in the Properties panel (in Studio Desktop) or under Show additional properties (in Studio Web).

Additional properties

• Max output tokens - The maximum number of tokens allowed for the prompt and generated answer. Fewer tokens are less expensive. Most models support a maximum of 1024 tokens. Default value is 1024.
• Temperature - A number between 0 and 1. Higher values like 0.8 make the output more random, while lower values like 0.2 make it more focused and deterministic. Default value is 0.8.
• Top p - A number between 0 and 1. The lower the number, the lesser the randomness of the result. Defaults to 0.8.
• Top k - A number between 1 and 40. The higher the number, the higher the diversity of generated text. Defaults to 40.

Output

• Text - The top generated text completion. Automatically generated output variable.
• Text completion - Automatically generated output variable.