Skip to main content

LLM Nodes

3. LLM Nodes

LLM nodes are designed to use large language models within SkyStudio workflows.

These nodes can be used to send workflow data to AI models, generate text, analyze content, perform classification, create structured outputs, and generate responses based on current information through web search.

LLM nodes generally do not require a credential connection. Model access is provided by SkyStudio, so users do not need to provide their own API keys.

The LLM section includes the OpenAI API Call, Anthropic API Call, and Claude Web Search nodes.

3.1. OpenAI API Call

The OpenAI API Call node is used to send requests to OpenAI models within a workflow and use the model-generated response in subsequent steps.

When configuring the node, select the Model to be used and define the content to be sent to the model in the Query field.

If required, you can add a System Prompt to define the model's role, behavior, and the rules it should follow when generating responses.

Additional tools that the model can use when needed can also be configured through the Tools field.

Data generated by previous nodes can be used as parameters within the Query or System Prompt.

3.2. Anthropic API Call

The Anthropic API Call node is used to send requests to Anthropic Claude models within a workflow.

Similar to the OpenAI API Call node, it is configured through the Model, System Prompt, Tools, and Query fields.

The response generated by the model can be passed to subsequent workflow nodes and used in other operations.

This node can be used for LLM-based operations such as text generation, analysis, summarization, classification, and processing data received from previous nodes.

The Claude Web Search node is used to generate responses based on current information by combining a Claude model with web search.

Unlike standard LLM nodes, the model can search the web when necessary and use the retrieved information when generating its response.

The model, query, and other supported model settings can be configured through the node.

The Claude Web Search node may require a credential connection to access the web search provider. In this case, a Credential connection required warning is displayed on the node.

3.4. Using System Prompt and Query

The System Prompt is used to define the model's role and operating rules within the workflow.

You can use this field to specify how the model should behave, the format in which it should generate responses, or the rules it should follow in specific situations.

The Query field defines the main request sent to the model and is the primary input required for LLM nodes to run.

In addition to fixed text, data generated by previous nodes can also be used in the System Prompt and Query fields.

To use data from a previous node, enter the / character in the relevant field and select from the available parameters.