OpenShift
Learn how to deploy your applications running Haystack pipelines using OpenShift.
Introduction
OpenShift by Red Hat is a platform that helps create and manage applications built on top of Kubernetes. It can be used to build, update, launch, and oversee applications running Haystack pipelines. A developer sandbox is available, ideal for getting familiar with the platform and building prototypes that can be smoothly moved to production using a public cloud, private network, hybrid cloud, or edge computing.
Prerequisites
The fastest way to deploy a Haystack pipeline is to deploy an OpenShift application that runs Hayhooks. Before starting, make sure to have the following prerequisites:
- Access to an OpenShift project. Follow RedHat's instructions to create one and start experimenting immediately.
- Hayhooks are installed. Run
pip install hayhooks
and make sure it works by runninghayhooks --version
. Read more about Hayhooks in our docs. - You can optionally install the OpenShift command-line utility
oc
. Follow the installation instructions for your platform and make sure it works by runningoc—h
.
Creating a Hayhooks Application
In this guide, we’ll be using the oc
command line, but you can achieve the same by interacting with the user interface offered by the OpenShift console.
-
The first step is to log into your OpenShift account using
oc
. From the top-right corner of your OpenShift console, click on your username and open the menu. Click Copy login command and follow the instructions. -
The console will show you the exact command to run in your terminal to log in. It’s something like the following:
oc login --token=<your-token> --server=https://<your-server-url>:6443
-
Assuming you already have a project (it’s the case for the developer sandbox), create an application running the Hayhooks Docker image available on Docker Hub:
Note how you can pass environment variables that your application will use at runtime. In this case, we disable Haystack’s internal telemetry and set an OpenAI key that will be used by the pipelines we’ll eventually deploy in Hayhooks.oc new-app deepset/hayhooks:main -e HAYSTACK_TELEMETRY_ENABLED=false -e OPENAI_API_KEY=$OPENAI_API_KEY
-
To make sure you make the most out of OpenShift's ability to manage the lifecycle of the application, you can set a liveness probe:
oc set probe deployment/hayhooks --liveness --get-url=http://:1416/status
-
Finally, you can expose our Hayhooks instance to the public Internet:
oc expose service/hayhooks
-
You can get the public address that was assigned to your application by running:
oc status
In the output, look for something like this:
In project <your-project-name> on server https://<your-server-url>:6443 http://hayhooks-XXX.openshiftapps.com to pod port 1416-tcp (svc/hayhooks)
-
http://hayhooks-XXX.openshiftapps.com
will be the public URL serving your Hayhooks instance. At this point, you can query Hayhooks status by running:hayhooks --server http://hayhooks-XXX.openshiftapps.com status
-
Lastly, deploy your pipeline as usual:
hayhooks --server http://hayhooks-XXX.openshiftapps.com deploy your_pipeline.yaml
Updated 9 months ago