Hugging Face Inference API
This documentation describes the integration of MindsDB with Hugging Face Inference API. The integration allows for the deployment of Hugging Face models through Inference API within MindsDB, providing the models with access to data from various data sources.
Prerequisites
Before proceeding, ensure the following prerequisites are met:
- Install MindsDB locally via Docker or Docker Desktop.
- To use Hugging Face Inference API within MindsDB, install the required dependencies following this instruction.
- Obtain the API key for Hugging Face Inference API required to deploy and use Hugging Face models through Inference API within MindsDB. Generate tokens in the
Settings -> Access Tokens
tab of the Hugging Face account.
Setup
Create an AI engine from the Hugging Face Inference API handler.
Create a model using huggingface_api_engine
as an engine.
The following parameters are supported in the USING
clause of the CREATE MODEL
statement:
Parameter | Required | Description |
---|---|---|
engine | Yes | It is the name of the ML engine created with the CREATE ML_ENGINE statement. |
task | Only if model_name is not provided | It describes a task to be performed. |
model_name | Only if task is not provided | It specifies a model to be used. |
input_column | Yes | It is the name of the column that stores input to the model. |
endpoint | No | It defines the endpoint to use for API calls. If not specified, the hosted Inference API from Hugging Face will be used. |
options | No | It is a JSON object containing additional options to pass to the API call. More information about the available options for each task can be found here. |
parameters | No | It is a JSON object containing additional parameters to pass to the API call. More information about the available parameters for each task can be found here. |
context_column | Only if task is question-answering | It is used for the question-answering task to provide context to the question. |
input_column2 | Only if task is sentence-similarity | It is used for the sentence-similarity task to provide the second input sentence for comparison. |
candidate_labels | Only if task is zero-shot-classification | It is used for the zero-shot-classification task to classify input data according to provided labels. |
Usage
The following usage examples utilize huggingface_api_engine
to create a model with the CREATE MODEL
statement.
Create a model to classify input text as spam or ham.
Query the model to get predictions.
Here is the output:
Find more quick examples below:
Next Steps
Follow this link to see more use case examples.
Was this page helpful?