Generators
Generators are responsible for generating text after you give them a prompt. They are specific for each LLM technology (OpenAI, local, TGI and others).
Generator | Description |
---|---|
AmazonBedrockChatGenerator | Enables chat completion using models through Amazon Bedrock service. |
AmazonBedrockGenerator | Enables text generation using models through Amazon Bedrock service. |
AnthropicChatGenerator | This component enables chat completions using Anthropic large language models (LLMs). |
AnthropicGenerator | This component enables text completions using Anthropic large language models (LLMs). |
AzureOpenAIChatGenerator | Enables chat completion using OpenAI’s LLMs through Azure services. |
AzureOpenAIGenerator | Enables text generation using OpenAI’s LLMs through Azure services. |
CohereChatGenerator | Enables chat completion using Cohere's LLMs. |
CohereGenerator | Queries the LLM using Cohere API. |
GoogleAIGeminiChatGenerator | Enables chat completion using Google Gemini models. |
GoogleAIGeminiGenerator | Enables text generation using Google Gemini models. |
HuggingFaceAPIChatGenerator | Enables chat completion using various Hugging Face APIs. |
HuggingFaceAPIGenerator | Enables text generation using various Hugging Face APIs. |
HuggingFaceLocalChatGenerator | Provides an interface for chat completion using a Hugging Face model that runs locally. |
HuggingFaceLocalGenerator | Provides an interface to generate text using a Hugging Face model that runs locally. |
LlamaCppChatGenerator | Enables chat completion using an LLM running on Llama.cpp. |
LlamaCppGenerator | Generate text using an LLM running with Llama.cpp. |
MistralChatGenerator | Enables chat completion using Mistral’s text generation models. |
NvidiaGenerator | Provides an interface for generating text using LLMs self-hosted with NVIDIA NIM or models hosted on the NVIDIA API catalog. |
OllamaChatGenerator | Enables chat completion using an LLM running on Ollama. |
OllamaGenerator | Provides an interface to generate text using an LLM running on Ollama. |
OpenAIChatGenerator | Enables chat completion using OpenAI’s large language models (LLMs). |
OpenAIGenerator | Enables text generation using OpenAI's large language models (LLMs). |
SagemakerGenerator | Enables text generation using LLMs deployed on Amazon Sagemaker. |
VertexAICodeGenerator | Enables code generation using Google Vertex AI generative model. |
VertexAIGeminiChatGenerator | Enables chat completion using Google Gemini models with GCP Vertex AI. |
VertexAIGeminiGenerator | Enables text generation using Google Gemini models with GCP Vertex AI. |
VertexAIImageCaptioner | Enables text generation using Google Vertex AI imagetext generative model. |
VertexAIImageGenerator | Enables image generation using Google Vertex AI generative model. |
VertexAIImageQA | Enables text generation (image captioning) using Google Vertex AI generative models. |
VertexAITextGenerator | Enables text generation using Google Vertex AI generative models. |
Updated 3 months ago