Zep Memory

Zep is long-term memory store for LLM applications. It stores, summarizes, embeds, indexes, and enriches LLM app / chatbot histories, and exposes them via simple, low-latency APIs.

Guide to Deploy Zep to Render

You can easily deploy Zep to cloud services like Render, Flyio. If you prefer to test it locally, you can also spin up a docker container by following their quick guide.

In this example, we are going to deploy to Render.

1. Head over to Zep Repo and click Deploy to Render

2. This will bring you to Render's Blueprint page and simply click Create New Resources

3. When the deployment is done, you should see 3 applications created on your dashboard

4. Simply click the first one called zep and copy the deployed URL

Guide to Deploy Zep to Digital Ocean (via Docker)

1. Clone the Repo

git clone https://github.com/getzep/zep.git
cd zep
nano .env

2. Add IN your OpenAI API Key in.ENV

ZEP_OPENAI_API_KEY=

docker-compose up -d --build

3. Allow firewall access to port 8000

sudo ufw allow from any to any port 8000 proto tcp
ufw status numbered

If using Digital ocean separate firewall from dashboard, make sure port 8000 is added there too

Use in Flowise UI

1. Back to Flowise application, simply create a new canvas or use one of the template from marketplace. In this example, we are going to use Simple Conversational Chain

2. Replace Buffer Memory with Zep Memory. Then replace the Base URL with the Zep URL you have copied above

3. Save the chatflow and test it out to see if conversations are remembered.

4. Now try clearing the chat history, you should see that it is now unable to remember the previous conversations.

Zep Authentication

Zep allows you to secure your instance using JWT authentication. We'll be using the zepcli command line utility here.

1. Generate a secret and the JWT token

After downloaded the ZepCLI:

On Linux or MacOS

./zepcli -i

On Windows

zepcli.exe -i

You will first get your SECRET Token:

Then you will get JWT Token:

2. Configure Auth environment variables

Set the following environment variables in your Zep server environment:

ZEP_AUTH_REQUIRED=true
ZEP_AUTH_SECRET=<the secret you generated above>

3. Configure Credential on Flowise

Add a new credential for Zep, and put in the JWT Token in the API Key field:

4. Use the created credential on Zep node

In the Zep node Connect Credential, select the credential you have just created. And that's it!