litellm
as an engine.
engine
is the LiteLLM engine created based on the LiteLLM handler with the CREATE ML_ENGINE
statement.
model
is the one of the models supported by LiteLLM. See the complete list of the supported providers and models here.
provider/model_name
. For example, ollama/llama2
or openai/gpt-4o
.base_url
is an optional parameter that stores the base URL for accessing models.
api_key
stores the API key of the provider whose model is used.
prompt_template
stores the instructions to the model.