Generators
Generators are responsible for generating text after you give them a prompt. They are specific for each LLM technology (OpenAI, local, TGI and others).
| Generator | Description |
|---|---|
| AmazonBedrockChatGenerator | Enables chat completion using models through Amazon Bedrock service. |
| AmazonBedrockGenerator | Enables text generation using models through Amazon Bedrock service. |
| AnthropicChatGenerator | This component enables chat completions using Anthropic large language models (LLMs). |
| AnthropicGenerator | This component enables text completions using Anthropic large language models (LLMs). |
| AzureOpenAIChatGenerator | Enables chat completion using OpenAI’s LLMs through Azure services. |
| AzureOpenAIGenerator | Enables text generation using OpenAI’s LLMs through Azure services. |
| CohereChatGenerator | Enables chat completion using Cohere's LLMs. |
| CohereGenerator | Queries the LLM using Cohere API. |
| GradientGenerator | Enables text generation with LLMs deployed on the Gradient AI platform. |
| GoogleAIGeminiChatGenerator | Enables chat completion using Google Gemini models. |
| GoogleAIGeminiGenerator | Enables text generation using Google Gemini models. |
| HuggingFaceAPIChatGenerator | Enables chat completion using various Hugging Face APIs. |
| HuggingFaceAPIGenerator | Enables text generation using various Hugging Face APIs. |
| HuggingFaceTGIChatGenerator | Enables chat completion using Hugging Face Hub-hosted chat LLMs. This component is deprecated and will be removed in Haystack 2.3.0. |
| HuggingFaceTGIGenerator | Enables text generation using Hugging Face Hub-hosted non-chat LLMs. This component is deprecated and will be removed in Haystack 2.3.0. |
| HuggingFaceLocalChatGenerator | Provides an interface for chat completion using a Hugging Face model that runs locally. |
| HuggingFaceLocalGenerator | Provides an interface to generate text using a Hugging Face model that runs locally. |
| LlamaCppChatGenerator | Enables chat completion using an LLM running on Llama.cpp. |
| LlamaCppGenerator | Generate text using an LLM running with Llama.cpp. |
| MistralChatGenerator | Enables chat completion using Mistral’s text generation models. |
| NvidiaGenerator | Provides an interface for generating text using LLMs self-hosted with NVIDIA NIM or models hosted on the NVIDIA API catalog. |
| OllamaChatGenerator | Enables chat completion using an LLM running on Ollama. |
| OllamaGenerator | Provides an interface to generate text using an LLM running on Ollama. |
| OpenAIChatGenerator | Enables chat completion using OpenAI’s large language models (LLMs). |
| OpenAIGenerator | Enables text generation using OpenAI's large language models (LLMs). |
| SagemakerGenerator | Enables text generation using LLMs deployed on Amazon Sagemaker. |
| VertexAICodeGenerator | Enables code generation using Google Vertex AI generative model. |
| VertexAIGeminiChatGenerator | Enables chat completion using Google Gemini models with GCP Vertex AI. |
| VertexAIGeminiGenerator | Enables text generation using Google Gemini models with GCP Vertex AI. |
| VertexAIImageCaptioner | Enables text generation using Google Vertex AI imagetext generative model. |
| VertexAIImageGenerator | Enables image generation using Google Vertex AI generative model. |
| VertexAIImageQA | Enables text generation (image captioning) using Google Vertex AI generative models. |
| VertexAITextGenerator | Enables text generation using Google Vertex AI generative models. |
Updated 5 months ago