DocumentationAPI Reference📓 Tutorials🧑‍🍳 Cookbook🤝 Integrations💜 Discord

Generators

Generators are responsible for generating text after you give them a prompt. They are specific for each LLM technology (OpenAI, local, TGI and others).

GeneratorDescription
AmazonBedrockChatGeneratorEnables chat completion using models through Amazon Bedrock service.
AmazonBedrockGeneratorEnables text generation using models through Amazon Bedrock service.
AzureOpenAIChatGeneratorEnables chat completion using OpenAI’s LLMs through Azure services.
AzureOpenAIGeneratorEnables text generation using OpenAI’s LLMs through Azure services.
CohereChatGeneratorEnables chat completion using Cohere's LLMs.
CohereGeneratorQueries the LLM using Cohere API.
GradientGeneratorEnables text generation with LLMs deployed on the Gradient AI platform.
GoogleAIGeminiChatGeneratorEnables chat completion using Google Gemini models.
GoogleAIGeminiGeneratorEnables text generation using Google Gemini models.
HuggingFaceTGIChatGeneratorEnables chat completion using Hugging Face Hub-hosted chat LLMs.
HuggingFaceTGIGeneratorEnables text generation using Hugging Face Hub-hosted non-chat LLMs.
HuggingFaceLocalChatGeneratorProvides an interface for chat completion using a Hugging Face model that runs locally.
HuggingFaceLocalGeneratorProvides an interface to generate text using a Hugging Face model that runs locally.
LlamaCppGeneratorGenerate text using an LLM running with Llama.cpp.
MistralChatGeneratorEnables chat completion using Mistral’s text generation models.
OllamaChatGeneratorEnables chat completion using an LLM running on Ollama.
OllamaGeneratorProvides an interface to generate text using an LLM running on Ollama.
OpenAIChatGeneratorEnables chat completion using OpenAI’s large language models (LLMs).
OpenAIGeneratorEnables text generation using OpenAI's large language models (LLMs).
SagemakerGeneratorEnables text generation using LLMs deployed on Amazon Sagemaker.
VertexAICodeGeneratorEnables code generation using Google Vertex AI generative model.
VertexAIGeminiChatGeneratorEnables chat completion using Google Gemini models with GCP Vertex AI.
VertexAIGeminiGeneratorEnables text generation using Google Gemini models with GCP Vertex AI.
VertexAIImageCaptionerEnables text generation using Google Vertex AI imagetext generative model.
VertexAIImageGeneratorEnables image generation using Google Vertex AI generative model.
VertexAIImageQAEnables text generation (image captioning) using Google Vertex AI generative models.
VertexAITextGeneratorEnables text generation using Google Vertex AI generative models.

Related Links

See the parameters details in our API reference: