DocumentationAPI Reference📓 Tutorials🧑‍🍳 Cookbook🤝 Integrations💜 Discord🎨 Studio (Waitlist)
Documentation

Generators

Generators are responsible for generating text after you give them a prompt. They are specific for each LLM technology (OpenAI, local, TGI and others).

GeneratorDescription
AmazonBedrockChatGeneratorEnables chat completion using models through Amazon Bedrock service.
AmazonBedrockGeneratorEnables text generation using models through Amazon Bedrock service.
AnthropicChatGeneratorThis component enables chat completions using Anthropic large language models (LLMs).
AnthropicGeneratorThis component enables text completions using Anthropic large language models (LLMs).
AzureOpenAIChatGeneratorEnables chat completion using OpenAI’s LLMs through Azure services.
AzureOpenAIGeneratorEnables text generation using OpenAI’s LLMs through Azure services.
CohereChatGeneratorEnables chat completion using Cohere's LLMs.
CohereGeneratorQueries the LLM using Cohere API.
GoogleAIGeminiChatGeneratorEnables chat completion using Google Gemini models.
GoogleAIGeminiGeneratorEnables text generation using Google Gemini models.
HuggingFaceAPIChatGeneratorEnables chat completion using various Hugging Face APIs.
HuggingFaceAPIGeneratorEnables text generation using various Hugging Face APIs.
HuggingFaceLocalChatGeneratorProvides an interface for chat completion using a Hugging Face model that runs locally.
HuggingFaceLocalGeneratorProvides an interface to generate text using a Hugging Face model that runs locally.
LlamaCppChatGeneratorEnables chat completion using an LLM running on Llama.cpp.
LlamaCppGeneratorGenerate text using an LLM running with Llama.cpp.
MistralChatGeneratorEnables chat completion using Mistral’s text generation models.
NvidiaGeneratorProvides an interface for generating text using LLMs self-hosted with NVIDIA NIM or models hosted on the NVIDIA API catalog.
OllamaChatGeneratorEnables chat completion using an LLM running on Ollama.
OllamaGeneratorProvides an interface to generate text using an LLM running on Ollama.
OpenAIChatGeneratorEnables chat completion using OpenAI’s large language models (LLMs).
OpenAIGeneratorEnables text generation using OpenAI's large language models (LLMs).
SagemakerGeneratorEnables text generation using LLMs deployed on Amazon Sagemaker.
VertexAICodeGeneratorEnables code generation using Google Vertex AI generative model.
VertexAIGeminiChatGeneratorEnables chat completion using Google Gemini models with GCP Vertex AI.
VertexAIGeminiGeneratorEnables text generation using Google Gemini models with GCP Vertex AI.
VertexAIImageCaptionerEnables text generation using Google Vertex AI imagetext generative model.
VertexAIImageGeneratorEnables image generation using Google Vertex AI generative model.
VertexAIImageQAEnables text generation (image captioning) using Google Vertex AI generative models.
VertexAITextGeneratorEnables text generation using Google Vertex AI generative models.

Related Links

See the parameters details in our API reference: