Other setup parameters

All other setup related parameters

Required Parameters

There are only two required parameters in the setup function.

PARAMETERS

data: dataframe-like = None
Data set with shape (n_samples, n_features), where n_samples is the number of samples and n_features is the number of features. If data is not a pandas dataframe, it's converted to one using default column names.
data_func: Callable[[], DATAFRAME_LIKE] = None
The function that generate data (the dataframe-like input). This is useful when the dataset is large, and you need parallel operations such as compare_models. It can avoid broadcasting large dataset from driver to workers. Notice one and only one of data and data_func must be set.
target: float, int, str or sequence, default = -1
If int or str, respectively index or name of the target column in data. The default value selects the last column in the dataset. If sequence, it should have shape (n_samples,).
index: bool, int, str or sequence, default = False
Handle indices in the data dataframe.
- If False: Reset to RangeIndex.
- If True: Keep the provided index.
- If int: Position of the column to use as index.
- If str: Name of the column to use as index.
- If sequence: Array with shape=(n_samples,) to use as index.

Experiment Logging

PARAMETERS

log_experiment: bool or str or BaseLogger or list of str or BaseLogger, default = False A (list of) PyCaret BaseLogger or str (one of mlflow, wandb, comet_ml, or dagshub) corresponding to a logger to determine which experiment loggers to use. Setting to True will use just MLFlow.
experiment_name: str, default = None
Name of the experiment for logging. Ignored when log_experiment = False.
experiment_custom_tags: dict, default = None Dictionary of tag_name: String -> value: (String, but will be string-ified if not) passed to the mlflow.set_tags to add new custom tags for the experiment.
log_plots: bool or list, default = False
When set to True, certain plots are logged automatically in the MLFlow server. To change the type of plots to be logged, pass a list containing plot IDs. Refer to documentation of plot_model. Ignored when log_experiment = False.
log_profile: bool, default = False
When set to True, data profile is logged on the MLflow server as a html file.
Ignored when log_experiment = False
log_data: bool, default = False When set to True, train and test dataset are logged as a CSV file.

Example

# load dataset
from pycaret.datasets import get_data
data = get_data('diabetes')

# init setup
from pycaret.classification import *
clf1 = setup(data, target = 'Class variable', log_experiment = True, experiment_name = 'diabetes1')

# model training
best_model = compare_models()

To initialize MLflow server you must run the following command from within the notebook or from the command line. Once the server is initialized, you can track your experiment on https://localhost:5000.

# init server
!mlflow ui

Configure MLflow tracking server

When no backend is configured Data is stored locally at the provided file (or ./mlruns if empty). To configure the backend use mlflow.set_tracking_uri before executing the setup function.

An empty string, or a local file path, prefixed with file:/. Data is stored locally at the provided file (or ./mlruns if empty).
An HTTP URI like https://my-tracking-server:5000.
A Databricks workspace, provided as the string “databricks” or, to use a Databricks CLI profile, “databricks://<profileName>”.

# set tracking uri 
import mlflow 
mlflow.set_tracking_uri('file:/c:/users/mlflow-server')

# load dataset
from pycaret.datasets import get_data
data = get_data('diabetes')

# init setup
from pycaret.classification import *
clf1 = setup(data, target = 'Class variable', log_experiment = True, experiment_name = 'diabetes1')

PyCaret on Databricks

When using PyCaret on Databricks experiment_name parameter in the setup must include complete path to storage. See example below on how to log experiments when using Databricks:

# load dataset
from pycaret.datasets import get_data
data = get_data('diabetes')

# init setup
from pycaret.classification import *
clf1 = setup(data, target = 'Class variable', log_experiment = True, experiment_name = '/Users/username@domain.com/experiment-name-here')

Model Selection

Following parameters in the setup can be used for setting parameters for model selection process. These are not related to data preprocessing but can influence your model selection process.

PARAMETERS

train_size: float, default = 0.7 The proportion of the dataset to be used for training and validation.
test_data: dataframe-like or None, default = None
If not None, test_data is used as a hold-out set and train_size parameter is ignored. The columns in the data and test_data must match.
data_split_shuffle: bool, default = True When set to False, prevents shuffling of rows during train_test_split.
data_split_stratify: bool or list, default = True Controls stratification during the train_test_split. When set to True, it will stratify by target column. To stratify on any other columns, pass a list of column names. Ignored when data_split_shuffle is False.
fold_strategy: str or scikit-learn CV generator object, default = ‘stratifiedkfold’ Choice of cross-validation strategy. Possible values are:
- ‘kfold’
- ‘stratifiedkfold’
- ‘groupkfold’
- ‘timeseries’
- a custom CV generator object compatible with scikit-learn.
- For groupkfold, column name must be passed in fold_groups parameter. Example: setup(fold_strategy="groupkfold", fold_groups="COLUMN_NAME")
fold: int, default = 10 The number of folds to be used in cross-validation. Must be at least 2. This is a global setting that can be over-written at the function level by using the fold parameter. Ignored when fold_strategy is a custom object.
fold_shuffle: bool, default = False Controls the shuffle parameter of CV. Only applicable when fold_strategy is kfold or stratifiedkfold. Ignored when fold_strategy is a custom object.
fold_groups: str or array-like, with shape (n_samples,), default = None
Optional group labels when ‘GroupKFold’ is used for the cross-validation. It takes an array with shape (n_samples, ) where n_samples is the number of rows in the training dataset. When the string is passed, it is interpreted as the column name in the dataset containing group labels.

Other Parameters

Following parameters in the setup can be used for controlling other experiment settings such as using GPU for training or setting verbosity of the experiment. They do not affect the data in any way.

PARAMETERS

n_jobs: int, default = -1 The number of jobs to run in parallel (for functions that support parallel processing) -1 means using all processors. To run all functions on single processor set n_jobs = None
use_gpu: bool or str, default = False When set to True, it will use GPU for training with algorithms that support it and fall back to CPU if they are unavailable. When set to force it will only use GPU-enabled algorithms and raise exceptions when they are unavailable. When False all algorithms are trained using CPU only. GPU enabled algorithms:
- Extreme Gradient Boosting, requires no further installation
- CatBoost Classifier, requires no further installation (GPU training is only enabled when data > 50,000 rows)
session_id: int, default = None Controls the randomness of the experiment. It is equivalent to random_state in scikit-learn. When None, a pseudo-random number is generated. This can be used for later reproducibility of the entire experiment.
verbose: bool, default = True When set to False, Information grid is not printed.
profile: bool, default = False When set to True, an interactive EDA report is displayed.
profile_kwargs: dict, default = {} (empty dict) Dictionary of arguments passed to the ProfileReport method used to create the EDA report. Ignored if profile is False.
custom_pipeline: list of (str, transformer), dict or Pipeline, default = None
Additional custom transformers. If passed, they are applied to the pipeline last, after all the build-in transformers.
custom_pipeline_position: int, default = -1 Position of the custom pipeline in the overall preprocessing pipeline. The default value adds the custom pipeline last.
preprocess: bool, default = True When set to False, no transformations are applied except for train_test_split and custom transformations passed in custom_pipeline parameter. Data must be ready for modeling (no missing values, no dates, categorical data encoding) when preprocess is set to False.
system_log: bool or str or logging.Logger, default = True
Whether to save the system logging file (as logs.log). If the input is a string, use that as the path to the logging file. If the input already is a logger object, use that one instead.
memory: str, bool or Memory, default=True
Used to cache the fitted transformers of the pipeline.
- If False: No caching is performed.
- If True: A default temp directory is used.
- If str: Path to the caching directory.

PreviousFeature Selection NextFunctions

Last updated 2 years ago

Was this helpful?

# load dataset from pycaret.datasets import get_data data = get_data('diabetes') # init setup from pycaret.classification import * clf1 = setup(data, target = 'Class variable', log_experiment = True, experiment_name = 'diabetes1') # model training best_model = compare_models()

# set tracking uri import mlflow mlflow.set_tracking_uri('file:/c:/users/mlflow-server') # load dataset from pycaret.datasets import get_data data = get_data('diabetes') # init setup from pycaret.classification import * clf1 = setup(data, target = 'Class variable', log_experiment = True, experiment_name = 'diabetes1')