LLM Node

The LLM Node processes text using large language models, enabling AI-powered text generation, analysis, and transformation.

Overview

Use LLM Nodes to:

• Generate responses to user queries
• Summarize or analyze text
• Extract structured data from unstructured text
• Transform content between formats

Configuration

Model Selection

Choose from available AI models:

• OpenAI GPT-4, GPT-3.5
• Anthropic Claude
• And more…

System Prompt

Define the AI’s behavior and context with a system prompt.

User Prompt

The main instruction or query for the AI to process. Use variables to inject dynamic data:

Summarize the following text: {{input.text}}

Temperature

Control randomness in responses:

• 0.0 - Deterministic, consistent outputs
• 1.0 - More creative, varied outputs

Output

The LLM Node outputs:

• response - The generated text response
• tokens_used - Number of tokens consumed

Best Practices

1. Be specific in your prompts for better results
2. Use lower temperature for factual tasks
3. Include examples in system prompts for complex formats
4. Test with sample inputs before deploying