How to Use Agents
Agents enable conversation with data, including structured and unstructured data connected to MindsDB.
CREATE AGENT
Syntax
Here is the syntax for creating an agent:
It creates an agent that uses the defined model and has access to the connected data.
model
This parameter defines the underlying language model.
The available models and providers include the following.
Anthropic
Anthropic
Available models:
- claude-3-opus-20240229
- claude-3-sonnet-20240229
- claude-3-haiku-20240307
- claude-2.1
- claude-2.0
- claude-instant-1.2
Google
Available models:
- gemini-2.5-pro-preview-03-25
- gemini-2.0-flash
- gemini-2.0-flash-lite
- gemini-1.5-flash
- gemini-1.5-flash-8b
- gemini-1.5-pro
Ollama
Ollama
Available models:
- gemma
- llama2
- mistral
- mixtral
- llava
- neural-chat
- codellama
- dolphin-mixtral
- qwen
- llama2-uncensored
- mistral-openorca
- deepseek-coder
- nous-hermes2
- phi
- orca-mini
- dolphin-mistral
- wizard-vicuna-uncensored
- vicuna
- tinydolphin
- llama2-chinese
- openhermes
- zephyr
- nomic-embed-text
- tinyllama
- openchat
- wizardcoder
- phind-codellama
- starcoder
- yi
- orca2
- falcon
- starcoder2
- wizard-math
- dolphin-phi
- nous-hermes
- starling-lm
- stable-code
- medllama2
- bakllava
- codeup
- wizardlm-uncensored
- solar
- everythinglm
- sqlcoder
- nous-hermes2-mixtral
- stable-beluga
- yarn-mistral
- samantha-mistral
- stablelm2
- meditron
- stablelm-zephyr
- magicoder
- yarn-llama2
- wizard-vicuna
- llama-pro
- deepseek-llm
- codebooga
- mistrallite
- dolphincoder
- nexusraven
- open-orca-platypus2
- all-minilm
- goliath
- notux
- alfred
- megadolphin
- xwinlm
- wizardlm
- duckdb-nsql
- notus
OpenAI
OpenAI
Available models:
- gpt-3.5-turbo
- gpt-3.5-turbo-16k
- gpt-3.5-turbo-instruct
- gpt-4
- gpt-4-32k
- gpt-4-1106-preview
- gpt-4-0125-preview
- gpt-4.1
- gpt-4.1-mini
- gpt-4o
- o4-mini
- o3-mini
- o1-mini
Nvidia NIM
Nvidia NIM
Available models:
- microsoft/phi-3-mini-4k-instruct
- mistralai/mistral-7b-instruct-v0.2
- writer/palmyra-med-70b
- mistralai/mistral-large
- mistralai/codestral-22b-instruct-v0.1
- nvidia/llama3-chatqa-1.5-70b
- upstage/solar-10.7b-instruct
- google/gemma-2-9b-it
- adept/fuyu-8b
- google/gemma-2b
- databricks/dbrx-instruct
- meta/llama-3_1-8b-instruct
- microsoft/phi-3-medium-128k-instruct
- 01-ai/yi-large
- nvidia/neva-22b
- meta/llama-3_1-70b-instruct
- google/codegemma-7b
- google/recurrentgemma-2b
- google/gemma-2-27b-it
- deepseek-ai/deepseek-coder-6.7b-instruct
- mediatek/breeze-7b-instruct
- microsoft/kosmos-2
- microsoft/phi-3-mini-128k-instruct
- nvidia/llama3-chatqa-1.5-8b
- writer/palmyra-med-70b-32k
- google/deplot
- meta/llama-3_1-405b-instruct
- aisingapore/sea-lion-7b-instruct
- liuhaotian/llava-v1.6-mistral-7b
- microsoft/phi-3-small-8k-instruct
- meta/codellama-70b
- liuhaotian/llava-v1.6-34b
- nv-mistralai/mistral-nemo-12b-instruct
- microsoft/phi-3-medium-4k-instruct
- seallms/seallm-7b-v2.5
- mistralai/mixtral-8x7b-instruct-v0.1
- mistralai/mistral-7b-instruct-v0.3
- google/paligemma
- google/gemma-7b
- mistralai/mixtral-8x22b-instruct-v0.1
- google/codegemma-1.1-7b
- nvidia/nemotron-4-340b-instruct
- meta/llama3-70b-instruct
- microsoft/phi-3-small-128k-instruct
- ibm/granite-8b-code-instruct
- meta/llama3-8b-instruct
- snowflake/arctic
- microsoft/phi-3-vision-128k-instruct
- meta/llama2-70b
- ibm/granite-34b-code-instruct
Writer
Writer
Available models:
- palmyra-x5
- palmyra-x4
Users can define the model for the agent choosing one of the following options.
Option 1. Use the model
parameter to define the specification.
Option 2. Define the default model in the MindsDB configuration file.
You can define the default models in the Settings of the MindsDB Editor GUI.
Note that if you define default_llm
in the configuration file, you do not need to provide the model
parameter when creating an agent. If provide both, then the values from the model
parameter are used.
The model specification includes:
-
provider
It is a required parameter. It defines the model provider. -
model_name
It is a required parameter. It defines the model name as specified by the provider. -
api_key
The API key is required to access the model. Users can provide it either in thisapi_key
parameter, or using environment variables. -
base_url
It is an optional parameter, which defaults tohttps://api.openai.com/v1/
. It is a required parameter when using theazure_openai
provider. It is the root URL used to send API requests. -
api_version
It is an optional parameter. It is a required parameter when using theazure_openai
provider. It defines the API version.
data
This parameter stores data connected to the agent, including knowledge bases and data sources connected to MindsDB.
The following parameters store the list of connected data.
-
knowledge_bases
stores the list of knowledge bases to be used by the agent. -
tables
stores the list of tables from data sources connected to MindsDB.
prompt_template
This parameter stores instructions for the agent.
It is recommended to provide data description of the data sources listed in the knowledge_bases
and tables
parameters to help the agent locate relevant data for answering questions.
SELECT FROM AGENT
Syntax
Query an agent to generate responses to questions.
DROP AGENT
Syntax
Here is the syntax for deleting an agent: