Generate Text Completion

Description

Given a prompt and other inputs, generates a text completion response.

Project compatibility

Windows | Cross-platform

Configuration

Connection ID - The connection established in Integration Service. Access the drop-down menu to choose, add, or manage connections.
Prompt - The prompt you want to use for the text completion(s) generation, such as: "Write an email to a new sales lead". This field supports String type input.
Model ID - The large language model (LLM) to utilize for the completion request. Select one of the available options: Bison-002, Bison-001, Unicorn-001.

Manage Properties

Use the Manage Properties wizard to configure or use any of the object's standard or custom fields. You can select fields to add them to the activity canvas. The added standard or custom fields are available in the Properties panel (in Studio Desktop) or under Show additional options (in Studio Web).

Additional options

Max output tokens - The maximum number of tokens allowed for the prompt and generated answer. Fewer tokens are less expensive. Most models support a maximum of 1024 tokens. Default value is 1024.
Temperature - A number between 0 and 1. Higher values like 0.8 make the output more random, while lower values like 0.2 make it more focused and deterministic. Default value is 0.8.
Top p - A number between 0 and 1. The lower the number, the lesser the randomness of the result. Defaults to 0.8.
Top k - A number between 1 and 40. The higher the number, the higher the diversity of generated text. Defaults to 40.