Deploy

Search…
Deploy
MLOps and deployment related functions in PyCaret
predict_model
This function generates the label using a trained model.  When data is None, it predicts label and score on the holdout set. 
Hold-out predictions
# load dataset
from pycaret.datasets import get_data
diabetes = get_data('diabetes')
​
# init setup
from pycaret.classification import *
clf1 = setup(data = diabetes, target = 'Class variable')
​
# create a model
xgboost = create_model('xgboost')
​
# predict on hold-out
predict_model(xgboost)
Output from predict_model(xgboost)
Unseen data predictions
# load dataset
from pycaret.datasets import get_data
diabetes = get_data('diabetes')
​
# init setup
from pycaret.classification import *
clf1 = setup(data = diabetes, target = 'Class variable')
​
# create a model
xgboost = create_model('xgboost')
​
# predict on new data
new_data = diabetes.copy()
new_data.drop('Class variable', axis = 1, inplace = True)
predict_model(xgboost, data = new_data)
Output from predict_model(xgboost, data=new_data)
Probability by class
NOTE: This is only applicable for the Classification use-cases. 
# load dataset
from pycaret.datasets import get_data
diabetes = get_data('diabetes')
​
# init setup
from pycaret.classification import *
clf1 = setup(data = diabetes, target = 'Class variable')
​
# create a model
xgboost = create_model('xgboost')
​
# predict on new data
new_data = diabetes.copy()
new_data.drop('Class variable', axis = 1, inplace = True)
predict_model(xgboost, raw_score = True, data = new_data)
Output from predict_model(xgboost, raw_score = True, data = new_data)
Setting probability threshold
NOTE: This is only applicable for the Classification use-cases (binary only).
The threshold for converting predicted probability to the class labels. Unless this parameter is set, it will default to the value set during model creation. If that wasn’t set, the default will be 0.5 for all classifiers. Only applicable for binary classification.
# load dataset
from pycaret.datasets import get_data
diabetes = get_data('diabetes')
​
# init setup
from pycaret.classification import *
clf1 = setup(data = diabetes, target = 'Class variable')
​
# create a model
xgboost = create_model('xgboost')
​
# probability threshold 0.3
predict_model(xgboost, probability_threshold = 0.3)
Output from predict_model(xgboost, probability_threshold = 0.3)
Comparison between different thresholds on the hold-out data
probability threshold = 0.5 vs. probability threshold = 0.3
Monitor data drift
An interactive drift report can be generated by using drift_report parameter.
# load dataset
from pycaret.datasets import get_data
diabetes = get_data('diabetes')
​
# init setup
from pycaret.classification import *
clf1 = setup(data = diabetes, target = 'Class variable')
​
# create a model
xgboost = create_model('xgboost')
​
# predict on new data
predict_model(xgboost, drift_report = True)
Output from predict_model(xgboost, drift_report = True)
Drift Report (1/N)
Drift Report (2/N)
Drift Report (3/N)
finalize_model
This function trains a given model on the entire dataset including the hold-out set.
# load dataset
from pycaret.datasets import get_data
diabetes = get_data('diabetes')
​
# init setup
from pycaret.classification import *
clf1 = setup(data = diabetes, target = 'Class variable')
​
# create a model
rf = create_model('rf')
​
# finalize a model
finalize_model(rf)
Output from finalize_model(rf)
This function doesn't change any parameter of the model. It only refits on the entire dataset including the hold-out set.
deploy_model
This function deploys the entire ML pipeline on the cloud.
# load dataset
from pycaret.datasets import get_data
diabetes = get_data('diabetes')
​
# init setup
from pycaret.classification import *
clf1 = setup(data = diabetes, target = 'Class variable')
​
# create a model
lr = create_model('lr')
​
# finalize a model
final_lr = finalize_model(lr)
​
# deploy a model
deploy_model(final_lr, model_name = 'lr_aws', platform = 'aws', authentication = { 'bucket'  : 'pycaret-test' })
Output from deploy_model(...)
AWS
Before deploying a model to an AWS S3 (‘aws’), environment variables must be configured using the command-line interface. To configure AWS environment variables, type aws configure in your python command line. The following information is required which can be generated using the Identity and Access Management (IAM) portal of your amazon console account:
AWS Access Key ID
AWS Secret Key Access
Default Region Name (can be seen under Global settings on your AWS console)
Default output format (must be left blank)
GCP
To deploy a model on Google Cloud Platform ('gcp'), the project must be created using the command-line or GCP console. Once the project is created, you must create a service account and download the service account key as a JSON file to set environment variables in your local environment.
Learn more about it: https://cloud.google.com/docs/authentication/production​
Azure
To deploy a model on Microsoft Azure ('azure'), environment variables for the connection string must be set in your local environment. Go to settings of storage account on Azure portal to access the connection string required.
AZURE_STORAGE_CONNECTION_STRING (required as environment variable)
Learn more about it: https://docs.microsoft.com/en-us/azure/storage/blobs/storage-quickstart-blobs-python?toc=%2Fpython%2Fazure%2FTOC.json​
save_model
This function saves the transformation pipeline and a trained model object into the current working directory as a pickle file for later use.
# load dataset
from pycaret.datasets import get_data
diabetes = get_data('diabetes')
​
# init setup
from pycaret.classification import *
clf1 = setup(data = diabetes, target = 'Class variable')
​
# create a model
dt = create_model('dt')
​
# save pipeline
save_model(dt, 'dt_pipeline')
Output from save_model(dt, 'dt_pipeline')
load_model
This function loads a previously saved pipeline.
# load dataset
from pycaret.datasets import get_data
diabetes = get_data('diabetes')
​
# init setup
from pycaret.classification import *
clf1 = setup(data = diabetes, target = 'Class variable')
​
# create a model
dt = create_model('dt')
​
# save pipeline
save_model(dt, 'dt_pipeline')
​
# load pipeline
load_model('dt_pipeline')
Output from load_model('dt_pipeline')
save_config
This function saves all the global variables to a pickle file, allowing to later resume without rerunning the setup function.
# load dataset
from pycaret.datasets import get_data
diabetes = get_data('diabetes')
​
# init setup
from pycaret.classification import *
clf1 = setup(data = diabetes, target = 'Class variable')
​
# save config
save_config('my_config')
load_config
This function loads global variables from a pickle file into the Python environment.
from pycaret.classification import load_config
load_config('my_config')
convert_model
This function transpiles the trained machine learning model's decision function in different programming languages such as Python, C, Java, Go, C#, etc. It is very useful if you want to deploy models into environments where you can't install your normal Python stack to support model inference.
# load dataset
from pycaret.datasets import get_data
juice = get_data('juice')
​
# init setup
from pycaret.classification import *
exp_name = setup(data = juice,  target = 'Purchase')
​
# train a model
lr = create_model('lr')
​
# convert a model
convert_model(lr, 'java')
Output from convert_model(lr, 'java')
Video:
create_api
This function takes an input model and creates a POST API for inference. It only creates the API and doesn't run it automatically. To run the API, you must run the Python file using !python.
# load dataset
from pycaret.datasets import get_data
juice = get_data('juice')
​
# init setup
from pycaret.classification import *
exp_name = setup(data = juice,  target = 'Purchase')
​
# train a model
lr = create_model('lr')
​
# create api
create_api(lr, 'lr_api')
​
# run api
!python lr_api.py
Output from create_api(lr, 'lr_api')
Once you initialize API with the !python command. You can see the server on localhost:8000/docs.
FastAPI server hosted on localhost
Video:
create_docker
This function creates a Dockerfile and requirements.txt for productionalizing API end-point.
# load dataset
from pycaret.datasets import get_data
juice = get_data('juice')
​
# init setup
from pycaret.classification import *
exp_name = setup(data = juice,  target = 'Purchase')
​
# train a model
lr = create_model('lr')
​
# create api
create_api(lr, 'lr_api')
​
# create docker
create_docker('lr_api')
Output from create_docker('lr_api')
You can see two files are created for you. 
%load requirements.txt
%load DockerFile
Video:
create_app
This function creates a basic gradio app for inference. It will later be expanded for other app types such Streamlit.
# load dataset
from pycaret.datasets import get_data
juice = get_data('juice')
​
# init setup
from pycaret.classification import *
exp_name = setup(data = juice,  target = 'Purchase')
​
# train a model
lr = create_model('lr')
​
# create app
create_app(lr)
Output from create_app(lr)
Video:
​
Analyze
Others
Last modified 7mo ago
Export as PDF
Copy link
Edit on GitHub
On this page
predict_model
Hold-out predictions
Unseen data predictions
Probability by class
Setting probability threshold
Monitor data drift
finalize_model
deploy_model
AWS
GCP
Azure
save_model
load_model
save_config
load_config
convert_model
create_api
create_docker
create_app