Generators

Generator	Description	Streaming Support
AmazonBedrockChatGenerator	Enables chat completion using models through Amazon Bedrock service.	✅
AmazonBedrockGenerator	Enables text generation using models through Amazon Bedrock service.	✅
AnthropicChatGenerator	This component enables chat completions using Anthropic large language models (LLMs).	✅
AnthropicGenerator	This component enables text completions using Anthropic large language models (LLMs).	✅
AzureOpenAIChatGenerator	Enables chat completion using OpenAI’s LLMs through Azure services.	✅
AzureOpenAIGenerator	Enables text generation using OpenAI’s LLMs through Azure services.	✅
CohereChatGenerator	Enables chat completion using Cohere's LLMs.	✅
CohereGenerator	Queries the LLM using Cohere API.	✅
GoogleAIGeminiChatGenerator	Enables chat completion using Google Gemini models.	✅
GoogleAIGeminiGenerator	Enables text generation using Google Gemini models.	✅
HuggingFaceAPIChatGenerator	Enables chat completion using various Hugging Face APIs.	✅
HuggingFaceAPIGenerator	Enables text generation using various Hugging Face APIs.	✅
HuggingFaceLocalChatGenerator	Provides an interface for chat completion using a Hugging Face model that runs locally.	✅
HuggingFaceLocalGenerator	Provides an interface to generate text using a Hugging Face model that runs locally.	✅
LlamaCppChatGenerator	Enables chat completion using an LLM running on Llama.cpp.	❌
LlamaCppGenerator	Generate text using an LLM running with Llama.cpp.	❌
MistralChatGenerator	Enables chat completion using Mistral’s text generation models.	✅
NvidiaGenerator	Provides an interface for generating text using LLMs self-hosted with NVIDIA NIM or models hosted on the NVIDIA API catalog.	❌
OllamaChatGenerator	Enables chat completion using an LLM running on Ollama.	✅
OllamaGenerator	Provides an interface to generate text using an LLM running on Ollama.	✅
OpenAIChatGenerator	Enables chat completion using OpenAI’s large language models (LLMs).	✅
OpenAIGenerator	Enables text generation using OpenAI's large language models (LLMs).	✅
SagemakerGenerator	Enables text generation using LLMs deployed on Amazon Sagemaker.	❌
VertexAICodeGenerator	Enables code generation using Google Vertex AI generative model.	❌
VertexAIGeminiChatGenerator	Enables chat completion using Google Gemini models with GCP Vertex AI.	✅
VertexAIGeminiGenerator	Enables text generation using Google Gemini models with GCP Vertex AI.	✅
VertexAIImageCaptioner	Enables text generation using Google Vertex AI `imagetext` generative model.	❌
VertexAIImageGenerator	Enables image generation using Google Vertex AI generative model.	❌
VertexAIImageQA	Enables text generation (image captioning) using Google Vertex AI generative models.	❌
VertexAITextGenerator	Enables text generation using Google Vertex AI generative models.	❌