Generators
Generators are responsible for generating text after you give them a prompt. They are specific for each LLM technology (OpenAI, local, TGI and others).
Generator | Description | Streaming Support |
---|---|---|
AmazonBedrockChatGenerator | Enables chat completion using models through Amazon Bedrock service. | β |
AmazonBedrockGenerator | Enables text generation using models through Amazon Bedrock service. | β |
AnthropicChatGenerator | This component enables chat completions using Anthropic large language models (LLMs). | β |
AnthropicVertexChatGenerator | This component enables chat completions using AnthropicVertex API. | β |
AnthropicGenerator | This component enables text completions using Anthropic large language models (LLMs). | β |
AzureOpenAIChatGenerator | Enables chat completion using OpenAIβs LLMs through Azure services. | β |
AzureOpenAIGenerator | Enables text generation using OpenAIβs LLMs through Azure services. | β |
CohereChatGenerator | Enables chat completion using Cohere's LLMs. | β |
CohereGenerator | Queries the LLM using Cohere API. | β |
DALLEImageGenerator | Generate images using OpenAI's DALL-E model. | β |
FallbackChatGenerator | A ChatGenerator wrapper that tries multiple Chat Generators sequentially until one succeeds. | β |
GoogleAIGeminiChatGenerator | Enables chat completion using Google Gemini models. This integration will be deprecated soon. We recommend using GoogleGenAIChatGenerator integration instead. | β |
GoogleAIGeminiGenerator | Enables text generation using Google Gemini models. This integration will be deprecated soon. We recommend using GoogleGenAIChatGenerator integration instead. | β |
GoogleGenAIChatGenerator | Enables chat completion using Google Gemini models through Google Gen AI SDK. | β |
HuggingFaceAPIChatGenerator | Enables chat completion using various Hugging Face APIs. | β |
HuggingFaceAPIGenerator | Enables text generation using various Hugging Face APIs. | β |
HuggingFaceLocalChatGenerator | Provides an interface for chat completion using a Hugging Face model that runs locally. | β |
HuggingFaceLocalGenerator | Provides an interface to generate text using a Hugging Face model that runs locally. | β |
LlamaCppChatGenerator | Enables chat completion using an LLM running on Llama.cpp. | β |
LlamaCppGenerator | Generate text using an LLM running with Llama.cpp. | β |
LlamaStackChatGenerator | Enables chat completions using an LLM model made available via Llama Stack server | β |
MetaLlamaChatGenerator | Enables chat completion with any model hosted available with Meta Llama API. | β |
MistralChatGenerator | Enables chat completion using Mistralβs text generation models. | β |
NvidiaChatGenerator | Enables chat completion using Nvidia-hosted models. | β |
NvidiaGenerator | Provides an interface for generating text using LLMs self-hosted with NVIDIA NIM or models hosted on the NVIDIA API catalog. | β |
OllamaChatGenerator | Enables chat completion using an LLM running on Ollama. | β |
OllamaGenerator | Provides an interface to generate text using an LLM running on Ollama. | β |
OpenAIChatGenerator | Enables chat completion using OpenAIβs large language models (LLMs). | β |
OpenAIGenerator | Enables text generation using OpenAI's large language models (LLMs). | β |
OpenRouterChatGenerator | Enables chat completion with any model hosted on OpenRouter. | β |
SagemakerGenerator | Enables text generation using LLMs deployed on Amazon Sagemaker. | β |
STACKITChatGenerator | Enables chat completions using the STACKIT API. | β |
VertexAICodeGenerator | Enables code generation using Google Vertex AI generative model. | β |
VertexAIGeminiChatGenerator | Enables chat completion using Google Gemini models with GCP Vertex AI. This integration will be deprecated soon. We recommend using GoogleGenAIChatGenerator integration instead. | β |
VertexAIGeminiGenerator | Enables text generation using Google Gemini models with GCP Vertex AI. This integration will be deprecated soon. We recommend using GoogleGenAIChatGenerator integration instead. | β |
VertexAIImageCaptioner | Enables text generation using Google Vertex AI imagetext generative model. | β |
VertexAIImageGenerator | Enables image generation using Google Vertex AI generative model. | β |
VertexAIImageQA | Enables text generation (image captioning) using Google Vertex AI generative models. | β |
VertexAITextGenerator | Enables text generation using Google Vertex AI generative models. | β |
WatsonxGenerator | Enables text generation with IBM Watsonx models. | β |
WatsonxChatGenerator | Enables chat completions with IBM Watsonx models. | β |
Updated about 17 hours ago