Ollama
Ollama
See the Ollama documentation on how to set up a self-hosted Ollama API endpoint (e.g. using ollama serve
).
Environment variables:
OLLAMA_API_ENDPOINT
: the endpoint for the Ollama API
Model-specific environment variables:
As described in the model-specific environment variables of the environment variables document section, you can set model-specific environment variables for different models in Ollama by appending the model name to the environment variable name. For example, if "model_name": "prompto_model"
is specified in the prompt_dict
, the following model-specific environment variables can be used:
OLLAMA_API_ENDPOINT_prompto_model
Required environment variables:
For any given prompt_dict
, the following environment variables are required:
- One of
OLLAMA_API_ENDPOINT
orOLLAMA_API_ENDPOINT_model_name