Enabling GPU Acceleration

The Transformer models used in Haystack are designed to be run on GPU-accelerated hardware. The steps for GPU acceleration setup depend on the environment that you're working in.

Enabling the GPU in Linux

1. Ensure that you have a fitting version of NVIDIA CUDA installed. To learn how to install CUDA, see the NVIDIA CUDA Guide for Linux.

2. Run the nvidia-smiin the command line to check if the GPU is enabled. If the GPU is enabled, the output shows a list of available GPUs and their memory usage:
   

Enabling the GPU in Colab

1. In your Colab environment, select Runtime>Change Runtime type.

2. Choose Hardware accelerator>GPU.
3. To check if the GPU is enabled, run:

%%bash

nvidia-smi

The output should show the GPUs available and their usage.