Last updated: 15 Feb 2023
PyCaret is an open-source, low-code machine learning library in Python that automates machine learning workflows. It is an end-to-end machine learning and model management tool that exponentially speeds up the experiment cycle and makes you more productive.
Compared with the other open-source machine learning libraries, PyCaret is an alternate low-code library that can be used to replace hundreds of lines of code with a few lines only. This makes experiments exponentially fast and efficient. PyCaret is essentially a Python wrapper around several machine learning libraries and frameworks, such as scikit-learn, XGBoost, LightGBM, CatBoost, spaCy, Optuna, Hyperopt, Ray, and a few more.
The design and simplicity of PyCaret are inspired by the emerging role of citizen data scientists, a term first used by Gartner. Citizen Data Scientists are power users who can perform both simple and moderately sophisticated analytical tasks that would previously have required more technical expertise.
PyCaret is tested and supported on the following 64-bit systems:
You can install PyCaret with Python's pip package manager:
pip install pycaret
PyCaret's default installation will not install all the extra dependencies automatically. For that you will have to install the full version:
pip install pycaret[full]
or depending on your use-case you may install one of the following variant:
pip install pycaret[analysis]
pip install pycaret[models]
pip install pycaret[tuner]
pip install pycaret[mlops]
pip install pycaret[parallel]
pip install pycaret[test]
# check installed version (must be >3.0)
import pycaret
pycaret.__version__
'3.0.0'
PyCaret's Regression Module is a supervised machine learning module that is used for estimating the relationships between a dependent variable (often called the outcome variable, or target) and one or more independent variables (often called features, predictors, or covariates).
The objective of regression is to predict continuous values such as predicting sales amount, predicting quantity, predicting temperature, etc. Regression module provides several pre-processing features to preprocess the data for modeling through the setup function.
PyCaret's regression module has many preprocessing capabilities and it coems with over 25 ready-to-use algorithms and several plots to analyze the performance of trained models.
A typical workflow in PyCaret Regression module consist of the following 5 steps in this order:
### load sample dataset from pycaret dataset module
from pycaret.datasets import get_data
data = get_data('insurance')
age | sex | bmi | children | smoker | region | charges | |
---|---|---|---|---|---|---|---|
0 | 19 | female | 27.900 | 0 | yes | southwest | 16884.92400 |
1 | 18 | male | 33.770 | 1 | no | southeast | 1725.55230 |
2 | 28 | male | 33.000 | 3 | no | southeast | 4449.46200 |
3 | 33 | male | 22.705 | 0 | no | northwest | 21984.47061 |
4 | 32 | male | 28.880 | 0 | no | northwest | 3866.85520 |
The setup
function initializes the training environment and creates the transformation pipeline. Setup function must be called before executing any other function in PyCaret. It only has two required parameters i.e. data
and target
. All the other parameters are optional.
# import pycaret regression and init setup
from pycaret.regression import *
s = setup(data, target = 'charges', session_id = 123)
Description | Value | |
---|---|---|
0 | Session id | 123 |
1 | Target | charges |
2 | Target type | Regression |
3 | Original data shape | (1338, 7) |
4 | Transformed data shape | (1338, 10) |
5 | Transformed train set shape | (936, 10) |
6 | Transformed test set shape | (402, 10) |
7 | Ordinal features | 2 |
8 | Numeric features | 3 |
9 | Categorical features | 3 |
10 | Preprocess | True |
11 | Imputation type | simple |
12 | Numeric imputation | mean |
13 | Categorical imputation | mode |
14 | Maximum one-hot encoding | 25 |
15 | Encoding method | None |
16 | Fold Generator | KFold |
17 | Fold Number | 10 |
18 | CPU Jobs | -1 |
19 | Use GPU | False |
20 | Log Experiment | False |
21 | Experiment Name | reg-default-name |
22 | USI | 9f1c |
Once the setup has been successfully executed it shows the information grid containing experiment level information.
session_id
is passed, a random number is automatically generated that is distributed to all functions.PyCaret has two set of API's that you can work with. (1) Functional (as seen above) and (2) Object Oriented API.
With Object Oriented API instead of executing functions directly you will import a class and execute methods of class.
# import RegressionExperiment and init the class
from pycaret.regression import RegressionExperiment
exp = RegressionExperiment()
# check the type of exp
type(exp)
pycaret.regression.oop.RegressionExperiment
# init setup on exp
exp.setup(data, target = 'charges', session_id = 123)
Description | Value | |
---|---|---|
0 | Session id | 123 |
1 | Target | charges |
2 | Target type | Regression |
3 | Original data shape | (1338, 7) |
4 | Transformed data shape | (1338, 10) |
5 | Transformed train set shape | (936, 10) |
6 | Transformed test set shape | (402, 10) |
7 | Ordinal features | 2 |
8 | Numeric features | 3 |
9 | Categorical features | 3 |
10 | Preprocess | True |
11 | Imputation type | simple |
12 | Numeric imputation | mean |
13 | Categorical imputation | mode |
14 | Maximum one-hot encoding | 25 |
15 | Encoding method | None |
16 | Fold Generator | KFold |
17 | Fold Number | 10 |
18 | CPU Jobs | -1 |
19 | Use GPU | False |
20 | Log Experiment | False |
21 | Experiment Name | reg-default-name |
22 | USI | 063d |
<pycaret.regression.oop.RegressionExperiment at 0x1697e9336a0>
You can use any of the two method i.e. Functional or OOP and even switch back and forth between two set of API's. The choice of method will not impact the results and has been tested for consistency. ___
The compare_models
function trains and evaluates the performance of all the estimators available in the model library using cross-validation. The output of this function is a scoring grid with average cross-validated scores. Metrics evaluated during CV can be accessed using the get_metrics
function. Custom metrics can be added or removed using add_metric
and remove_metric
function.
# compare baseline models
best = compare_models()
Model | MAE | MSE | RMSE | R2 | RMSLE | MAPE | TT (Sec) | |
---|---|---|---|---|---|---|---|---|
gbr | Gradient Boosting Regressor | 2701.9919 | 23548657.1177 | 4832.9329 | 0.8320 | 0.4447 | 0.3137 | 0.0570 |
rf | Random Forest Regressor | 2771.4583 | 25416502.3827 | 5028.6343 | 0.8172 | 0.4690 | 0.3303 | 0.0690 |
catboost | CatBoost Regressor | 2899.3783 | 25762701.9552 | 5057.5721 | 0.8163 | 0.4815 | 0.3522 | 0.0800 |
lightgbm | Light Gradient Boosting Machine | 2992.1828 | 25521038.3331 | 5042.0978 | 0.8149 | 0.5378 | 0.3751 | 0.1890 |
et | Extra Trees Regressor | 2833.3624 | 28427844.2412 | 5305.6516 | 0.7991 | 0.4877 | 0.3363 | 0.0710 |
ada | AdaBoost Regressor | 4316.0568 | 29220505.6498 | 5398.4561 | 0.7903 | 0.6368 | 0.7394 | 0.0420 |
xgboost | Extreme Gradient Boosting | 3443.6091 | 32824626.4000 | 5711.2140 | 0.7626 | 0.6224 | 0.4469 | 0.0420 |
llar | Lasso Least Angle Regression | 4298.6038 | 38369142.0849 | 6174.9424 | 0.7309 | 0.5786 | 0.4424 | 0.0400 |
ridge | Ridge Regression | 4317.6984 | 38396435.9578 | 6177.2329 | 0.7306 | 0.5891 | 0.4459 | 0.0380 |
br | Bayesian Ridge | 4311.2349 | 38391950.0874 | 6176.8896 | 0.7306 | 0.5910 | 0.4447 | 0.0400 |
lar | Least Angle Regression | 4303.5559 | 38388058.4578 | 6176.5920 | 0.7306 | 0.5949 | 0.4433 | 0.0340 |
lasso | Lasso Regression | 4303.7697 | 38386797.6709 | 6176.4824 | 0.7306 | 0.5952 | 0.4434 | 0.0340 |
lr | Linear Regression | 4303.5559 | 38388058.4578 | 6176.5920 | 0.7306 | 0.5949 | 0.4433 | 0.8830 |
huber | Huber Regressor | 3463.2216 | 48801106.4612 | 6963.9984 | 0.6544 | 0.4927 | 0.2212 | 0.0440 |
dt | Decision Tree Regressor | 3383.4916 | 47823199.0729 | 6895.7016 | 0.6497 | 0.5602 | 0.4013 | 0.0390 |
omp | Orthogonal Matching Pursuit | 5754.7769 | 57503207.7233 | 7566.7086 | 0.5997 | 0.7418 | 0.8990 | 0.0430 |
par | Passive Aggressive Regressor | 4537.0122 | 67346309.9218 | 8142.7826 | 0.5422 | 0.5276 | 0.3207 | 0.0420 |
en | Elastic Net | 7372.5238 | 90450782.5713 | 9468.3193 | 0.3792 | 0.7342 | 0.9184 | 0.0390 |
knn | K Neighbors Regressor | 8007.7997 | 131387268.8000 | 11425.3695 | 0.0859 | 0.8535 | 0.9232 | 0.0430 |
dummy | Dummy Regressor | 9192.5418 | 148516792.8000 | 12132.4733 | -0.0175 | 1.0154 | 1.5637 | 0.0410 |
Processing: 0%| | 0/85 [00:00<?, ?it/s]
# compare models using OOP
# exp.compare_models()
Model | MAE | MSE | RMSE | R2 | RMSLE | MAPE | TT (Sec) | |
---|---|---|---|---|---|---|---|---|
gbr | Gradient Boosting Regressor | 2701.9919 | 23548657.1177 | 4832.9329 | 0.8320 | 0.4447 | 0.3137 | 0.0540 |
rf | Random Forest Regressor | 2771.4583 | 25416502.3827 | 5028.6343 | 0.8172 | 0.4690 | 0.3303 | 0.0710 |
catboost | CatBoost Regressor | 2899.3783 | 25762701.9552 | 5057.5721 | 0.8163 | 0.4815 | 0.3522 | 0.0370 |
lightgbm | Light Gradient Boosting Machine | 2992.1828 | 25521038.3331 | 5042.0978 | 0.8149 | 0.5378 | 0.3751 | 0.0470 |
et | Extra Trees Regressor | 2833.3624 | 28427844.2412 | 5305.6516 | 0.7991 | 0.4877 | 0.3363 | 0.0730 |
ada | AdaBoost Regressor | 4316.0568 | 29220505.6498 | 5398.4561 | 0.7903 | 0.6368 | 0.7394 | 0.0430 |
xgboost | Extreme Gradient Boosting | 3443.6091 | 32824626.4000 | 5711.2140 | 0.7626 | 0.6224 | 0.4469 | 0.0390 |
llar | Lasso Least Angle Regression | 4298.6038 | 38369142.0849 | 6174.9424 | 0.7309 | 0.5786 | 0.4424 | 0.0460 |
ridge | Ridge Regression | 4317.6984 | 38396435.9578 | 6177.2329 | 0.7306 | 0.5891 | 0.4459 | 0.0400 |
br | Bayesian Ridge | 4311.2349 | 38391950.0874 | 6176.8896 | 0.7306 | 0.5910 | 0.4447 | 0.0400 |
lar | Least Angle Regression | 4303.5559 | 38388058.4578 | 6176.5920 | 0.7306 | 0.5949 | 0.4433 | 0.0360 |
lasso | Lasso Regression | 4303.7697 | 38386797.6709 | 6176.4824 | 0.7306 | 0.5952 | 0.4434 | 0.0360 |
lr | Linear Regression | 4303.5559 | 38388058.4578 | 6176.5920 | 0.7306 | 0.5949 | 0.4433 | 0.0420 |
huber | Huber Regressor | 3463.2216 | 48801106.4612 | 6963.9984 | 0.6544 | 0.4927 | 0.2212 | 0.0460 |
dt | Decision Tree Regressor | 3383.4916 | 47823199.0729 | 6895.7016 | 0.6497 | 0.5602 | 0.4013 | 0.0390 |
omp | Orthogonal Matching Pursuit | 5754.7769 | 57503207.7233 | 7566.7086 | 0.5997 | 0.7418 | 0.8990 | 0.0420 |
par | Passive Aggressive Regressor | 4537.0122 | 67346309.9218 | 8142.7826 | 0.5422 | 0.5276 | 0.3207 | 0.0440 |
en | Elastic Net | 7372.5238 | 90450782.5713 | 9468.3193 | 0.3792 | 0.7342 | 0.9184 | 0.0460 |
knn | K Neighbors Regressor | 8007.7997 | 131387268.8000 | 11425.3695 | 0.0859 | 0.8535 | 0.9232 | 0.0430 |
dummy | Dummy Regressor | 9192.5418 | 148516792.8000 | 12132.4733 | -0.0175 | 1.0154 | 1.5637 | 0.0440 |
Processing: 0%| | 0/85 [00:00<?, ?it/s]
GradientBoostingRegressor(random_state=123)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
GradientBoostingRegressor(random_state=123)
Notice that the output between functional and OOP API is consistent. Rest of the functions in this notebook will only be shown using functional API only.
The plot_model
function is used to analyze the performance of a trained model on the test set. It may require re-training the model in certain cases.
# plot residuals
plot_model(best, plot = 'residuals')
# plot error
plot_model(best, plot = 'error')
# plot feature importance
plot_model(best, plot = 'feature')
# check docstring to see available plots
# help(plot_model)
An alternate to plot_model
function is evaluate_model
. It can only be used in Notebook since it uses ipywidget
.
evaluate_model(best)
interactive(children=(ToggleButtons(description='Plot Type:', icons=('',), options=(('Pipeline Plot', 'pipelin…
The predict_model
function returns prediction_label
as new column to the input dataframe. When data is None
(default), it uses the test set (created during the setup function) for scoring.
# predict on test set
holdout_pred = predict_model(best)
Model | MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|---|
0 | Gradient Boosting Regressor | 2392.5661 | 17148355.3169 | 4141.0573 | 0.8800 | 0.3928 | 0.2875 |
# show predictions df
holdout_pred.head()
age | sex | bmi | children | smoker | region | charges | prediction_label | |
---|---|---|---|---|---|---|---|---|
936 | 49 | female | 42.680000 | 2 | no | southeast | 9800.888672 | 10681.513104 |
937 | 32 | male | 37.334999 | 1 | no | northeast | 4667.607422 | 8043.453463 |
938 | 27 | female | 31.400000 | 0 | yes | southwest | 34838.871094 | 36153.097686 |
939 | 35 | male | 24.129999 | 1 | no | northwest | 5125.215820 | 7435.516853 |
940 | 60 | male | 25.740000 | 0 | no | southeast | 12142.578125 | 14676.544334 |
The same function works for predicting the labels on unseen dataset. Let's create a copy of original data and drop the charges
. We can then use the new data frame without labels for scoring.
# copy data and drop charges
new_data = data.copy()
new_data.drop('charges', axis=1, inplace=True)
new_data.head()
age | sex | bmi | children | smoker | region | |
---|---|---|---|---|---|---|
0 | 19 | female | 27.900 | 0 | yes | southwest |
1 | 18 | male | 33.770 | 1 | no | southeast |
2 | 28 | male | 33.000 | 3 | no | southeast |
3 | 33 | male | 22.705 | 0 | no | northwest |
4 | 32 | male | 28.880 | 0 | no | northwest |
# predict model on new_data
predictions = predict_model(best, data = new_data)
predictions.head()
age | sex | bmi | children | smoker | region | prediction_label | |
---|---|---|---|---|---|---|---|
0 | 19 | female | 27.900000 | 0 | yes | southwest | 18464.334448 |
1 | 18 | male | 33.770000 | 1 | no | southeast | 4020.345384 |
2 | 28 | male | 33.000000 | 3 | no | southeast | 6555.388388 |
3 | 33 | male | 22.705000 | 0 | no | northwest | 9627.045725 |
4 | 32 | male | 28.879999 | 0 | no | northwest | 3325.531292 |
Finally, you can save the entire pipeline on disk for later use, using pycaret's save_model
function.
# save pipeline
save_model(best, 'my_first_pipeline')
Transformation Pipeline and Model Successfully Saved
(Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))), ('ordinal_encoding', TransformerW... handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))), ('onehot_encoding', TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))), ('trained_model', GradientBoostingRegressor(random_state=123))]), 'my_first_pipeline.pkl')
# load pipeline
loaded_best_pipeline = load_model('my_first_pipeline')
loaded_best_pipeline
Transformation Pipeline and Model Successfully Loaded
Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))), ('ordinal_encoding', TransformerW... handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))), ('onehot_encoding', TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))), ('trained_model', GradientBoostingRegressor(random_state=123))])In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))), ('ordinal_encoding', TransformerW... handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))), ('onehot_encoding', TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))), ('trained_model', GradientBoostingRegressor(random_state=123))])
TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())
SimpleImputer()
SimpleImputer()
TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))
SimpleImputer(strategy='most_frequent')
SimpleImputer(strategy='most_frequent')
TransformerWrapper(include=['sex', 'smoker'], transformer=OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))
OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}])
OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}])
TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))
OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True)
OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True)
GradientBoostingRegressor(random_state=123)
The setup
function initializes the experiment in PyCaret and creates the transformation pipeline based on all the parameters passed in the function. Setup function must be called before executing any other function. It takes two required parameters: data
and target
. All the other parameters are optional and are used for configuring data preprocessing pipeline.
s = setup(data, target = 'charges', session_id = 123)
Description | Value | |
---|---|---|
0 | Session id | 123 |
1 | Target | charges |
2 | Target type | Regression |
3 | Original data shape | (1338, 7) |
4 | Transformed data shape | (1338, 10) |
5 | Transformed train set shape | (936, 10) |
6 | Transformed test set shape | (402, 10) |
7 | Ordinal features | 2 |
8 | Numeric features | 3 |
9 | Categorical features | 3 |
10 | Preprocess | True |
11 | Imputation type | simple |
12 | Numeric imputation | mean |
13 | Categorical imputation | mode |
14 | Maximum one-hot encoding | 25 |
15 | Encoding method | None |
16 | Fold Generator | KFold |
17 | Fold Number | 10 |
18 | CPU Jobs | -1 |
19 | Use GPU | False |
20 | Log Experiment | False |
21 | Experiment Name | reg-default-name |
22 | USI | 02ce |
To access all the variables created by the setup function such as transformed dataset, random_state, etc. you can use get_config
method.
# check all available config
get_config()
{'USI', 'X', 'X_test', 'X_test_transformed', 'X_train', 'X_train_transformed', 'X_transformed', '_available_plots', '_ml_usecase', 'data', 'dataset', 'dataset_transformed', 'exp_id', 'exp_name_log', 'fold_generator', 'fold_groups_param', 'fold_shuffle_param', 'gpu_n_jobs_param', 'gpu_param', 'html_param', 'idx', 'is_multiclass', 'log_plots_param', 'logging_param', 'memory', 'n_jobs_param', 'pipeline', 'seed', 'target_param', 'test', 'test_transformed', 'train', 'train_transformed', 'transform_target_param', 'variable_and_property_keys', 'variables', 'y', 'y_test', 'y_test_transformed', 'y_train', 'y_train_transformed', 'y_transformed'}
# lets access X_train_transformed
get_config('X_train_transformed')
age | sex | bmi | children | smoker | region_northeast | region_southwest | region_southeast | region_northwest | |
---|---|---|---|---|---|---|---|---|---|
0 | 36.0 | 1.0 | 27.549999 | 3.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 |
1 | 60.0 | 0.0 | 35.099998 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 |
2 | 30.0 | 1.0 | 31.570000 | 3.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 |
3 | 49.0 | 1.0 | 25.600000 | 2.0 | 1.0 | 0.0 | 1.0 | 0.0 | 0.0 |
4 | 26.0 | 1.0 | 32.900002 | 2.0 | 1.0 | 0.0 | 1.0 | 0.0 | 0.0 |
... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
931 | 37.0 | 1.0 | 22.705000 | 3.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 |
932 | 20.0 | 0.0 | 31.920000 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 |
933 | 19.0 | 0.0 | 28.400000 | 1.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 |
934 | 18.0 | 1.0 | 23.084999 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 |
935 | 53.0 | 0.0 | 36.860001 | 3.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 |
936 rows × 9 columns
# another example: let's access seed
print("The current seed is: {}".format(get_config('seed')))
# now lets change it using set_config
set_config('seed', 786)
print("The new seed is: {}".format(get_config('seed')))
The current seed is: 123 The new seed is: 786
All the preprocessing configurations and experiment settings/parameters are passed into the setup
function. To see all available parameters, check the docstring:
# help(setup)
# init setup with normalize = True
s = setup(data, target = 'charges', session_id = 123,
normalize = True, normalize_method = 'minmax')
Description | Value | |
---|---|---|
0 | Session id | 123 |
1 | Target | charges |
2 | Target type | Regression |
3 | Original data shape | (1338, 7) |
4 | Transformed data shape | (1338, 10) |
5 | Transformed train set shape | (936, 10) |
6 | Transformed test set shape | (402, 10) |
7 | Ordinal features | 2 |
8 | Numeric features | 3 |
9 | Categorical features | 3 |
10 | Preprocess | True |
11 | Imputation type | simple |
12 | Numeric imputation | mean |
13 | Categorical imputation | mode |
14 | Maximum one-hot encoding | 25 |
15 | Encoding method | None |
16 | Normalize | True |
17 | Normalize method | minmax |
18 | Fold Generator | KFold |
19 | Fold Number | 10 |
20 | CPU Jobs | -1 |
21 | Use GPU | False |
22 | Log Experiment | False |
23 | Experiment Name | reg-default-name |
24 | USI | 3dce |
# lets check the X_train_transformed to see effect of params passed
get_config('X_train_transformed')['age'].hist()
<AxesSubplot:>
Notice that all the values are between 0 and 1 - that is because we passed normalize=True
in the setup
function. If you don't remember how it compares to actual data, no problem - we can also access non-transformed values using get_config
and then compare. See below and notice the range of values on x-axis and compare it with histogram above.
get_config('X_train')['age'].hist()
<AxesSubplot:>
The compare_models
function trains and evaluates the performance of all estimators available in the model library using cross-validation. The output of this function is a scoring grid with average cross-validated scores. Metrics evaluated during CV can be accessed using the get_metrics
function. Custom metrics can be added or removed using add_metric
and remove_metric
function.
best = compare_models()
Model | MAE | MSE | RMSE | R2 | RMSLE | MAPE | TT (Sec) | |
---|---|---|---|---|---|---|---|---|
gbr | Gradient Boosting Regressor | 2701.9135 | 23548622.1598 | 4832.9291 | 0.8320 | 0.4447 | 0.3137 | 0.0620 |
rf | Random Forest Regressor | 2772.9195 | 25409792.9692 | 5028.1973 | 0.8173 | 0.4687 | 0.3298 | 0.0750 |
catboost | CatBoost Regressor | 2899.4825 | 25762752.2096 | 5057.5778 | 0.8163 | 0.4815 | 0.3522 | 0.0430 |
lightgbm | Light Gradient Boosting Machine | 3001.8884 | 25547324.5813 | 5044.5767 | 0.8147 | 0.5445 | 0.3784 | 0.0520 |
et | Extra Trees Regressor | 2833.3624 | 28427844.2412 | 5305.6516 | 0.7991 | 0.4877 | 0.3363 | 0.0800 |
ada | AdaBoost Regressor | 4175.5916 | 28401799.0579 | 5321.7006 | 0.7976 | 0.6263 | 0.7144 | 0.0490 |
xgboost | Extreme Gradient Boosting | 3439.8892 | 32826514.4000 | 5711.7335 | 0.7626 | 0.6221 | 0.4465 | 0.0450 |
llar | Lasso Least Angle Regression | 4298.6038 | 38369142.0849 | 6174.9424 | 0.7309 | 0.5786 | 0.4424 | 0.0360 |
ridge | Ridge Regression | 4296.0642 | 38392999.7849 | 6176.6160 | 0.7308 | 0.5710 | 0.4397 | 0.0390 |
br | Bayesian Ridge | 4300.6286 | 38387539.9069 | 6176.4192 | 0.7307 | 0.5881 | 0.4419 | 0.0500 |
lasso | Lasso Regression | 4302.2469 | 38386534.5553 | 6176.4463 | 0.7306 | 0.5913 | 0.4430 | 0.0410 |
lar | Least Angle Regression | 4303.5559 | 38388058.4578 | 6176.5920 | 0.7306 | 0.5949 | 0.4433 | 0.0390 |
lr | Linear Regression | 4312.6186 | 38452749.8007 | 6182.4796 | 0.7298 | 0.6285 | 0.4460 | 0.0380 |
knn | K Neighbors Regressor | 3778.4582 | 38143971.2000 | 6165.0463 | 0.7277 | 0.5027 | 0.3690 | 0.0400 |
par | Passive Aggressive Regressor | 3536.1733 | 48501878.1363 | 6940.1967 | 0.6566 | 0.4785 | 0.2154 | 0.0430 |
huber | Huber Regressor | 3461.7327 | 49057640.5613 | 6981.8576 | 0.6528 | 0.4815 | 0.2188 | 0.0450 |
dt | Decision Tree Regressor | 3399.1402 | 48100203.3847 | 6915.2984 | 0.6476 | 0.5629 | 0.4052 | 0.0410 |
omp | Orthogonal Matching Pursuit | 5754.7769 | 57503207.7233 | 7566.7086 | 0.5997 | 0.7418 | 0.8990 | 0.0440 |
en | Elastic Net | 7571.4598 | 104738034.4707 | 10182.3291 | 0.2846 | 0.8954 | 1.2888 | 0.0380 |
dummy | Dummy Regressor | 9192.5418 | 148516792.8000 | 12132.4733 | -0.0175 | 1.0154 | 1.5637 | 0.0420 |
Processing: 0%| | 0/85 [00:00<?, ?it/s]
compare_models
by default uses all the estimators in model library (all except models with Turbo=False
) . To see all available models you can use the function models()
# check available models
models()
Name | Reference | Turbo | |
---|---|---|---|
ID | |||
lr | Linear Regression | sklearn.linear_model._base.LinearRegression | True |
lasso | Lasso Regression | sklearn.linear_model._coordinate_descent.Lasso | True |
ridge | Ridge Regression | sklearn.linear_model._ridge.Ridge | True |
en | Elastic Net | sklearn.linear_model._coordinate_descent.Elast... | True |
lar | Least Angle Regression | sklearn.linear_model._least_angle.Lars | True |
llar | Lasso Least Angle Regression | sklearn.linear_model._least_angle.LassoLars | True |
omp | Orthogonal Matching Pursuit | sklearn.linear_model._omp.OrthogonalMatchingPu... | True |
br | Bayesian Ridge | sklearn.linear_model._bayes.BayesianRidge | True |
ard | Automatic Relevance Determination | sklearn.linear_model._bayes.ARDRegression | False |
par | Passive Aggressive Regressor | sklearn.linear_model._passive_aggressive.Passi... | True |
ransac | Random Sample Consensus | sklearn.linear_model._ransac.RANSACRegressor | False |
tr | TheilSen Regressor | sklearn.linear_model._theil_sen.TheilSenRegressor | False |
huber | Huber Regressor | sklearn.linear_model._huber.HuberRegressor | True |
kr | Kernel Ridge | sklearn.kernel_ridge.KernelRidge | False |
svm | Support Vector Regression | sklearn.svm._classes.SVR | False |
knn | K Neighbors Regressor | sklearn.neighbors._regression.KNeighborsRegressor | True |
dt | Decision Tree Regressor | sklearn.tree._classes.DecisionTreeRegressor | True |
rf | Random Forest Regressor | sklearn.ensemble._forest.RandomForestRegressor | True |
et | Extra Trees Regressor | sklearn.ensemble._forest.ExtraTreesRegressor | True |
ada | AdaBoost Regressor | sklearn.ensemble._weight_boosting.AdaBoostRegr... | True |
gbr | Gradient Boosting Regressor | sklearn.ensemble._gb.GradientBoostingRegressor | True |
mlp | MLP Regressor | sklearn.neural_network._multilayer_perceptron.... | False |
xgboost | Extreme Gradient Boosting | xgboost.sklearn.XGBRegressor | True |
lightgbm | Light Gradient Boosting Machine | lightgbm.sklearn.LGBMRegressor | True |
catboost | CatBoost Regressor | catboost.core.CatBoostRegressor | True |
dummy | Dummy Regressor | sklearn.dummy.DummyRegressor | True |
You can use the include
and exclude
parameter in the compare_models
to train only select model or exclude specific models from training by passing the model id's in exclude
parameter.
compare_tree_models = compare_models(include = ['dt', 'rf', 'et', 'gbr', 'xgboost', 'lightgbm', 'catboost'])
Model | MAE | MSE | RMSE | R2 | RMSLE | MAPE | TT (Sec) | |
---|---|---|---|---|---|---|---|---|
gbr | Gradient Boosting Regressor | 2701.9135 | 23548622.1598 | 4832.9291 | 0.8320 | 0.4447 | 0.3137 | 0.0640 |
rf | Random Forest Regressor | 2772.9195 | 25409792.9692 | 5028.1973 | 0.8173 | 0.4687 | 0.3298 | 0.0750 |
catboost | CatBoost Regressor | 2899.4825 | 25762752.2096 | 5057.5778 | 0.8163 | 0.4815 | 0.3522 | 0.0460 |
lightgbm | Light Gradient Boosting Machine | 3001.8884 | 25547324.5813 | 5044.5767 | 0.8147 | 0.5445 | 0.3784 | 0.0480 |
et | Extra Trees Regressor | 2833.3624 | 28427844.2412 | 5305.6516 | 0.7991 | 0.4877 | 0.3363 | 0.0760 |
xgboost | Extreme Gradient Boosting | 3439.8892 | 32826514.4000 | 5711.7335 | 0.7626 | 0.6221 | 0.4465 | 0.0420 |
dt | Decision Tree Regressor | 3399.1402 | 48100203.3847 | 6915.2984 | 0.6476 | 0.5629 | 0.4052 | 0.0410 |
Processing: 0%| | 0/33 [00:00<?, ?it/s]
compare_tree_models
GradientBoostingRegressor(random_state=123)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
GradientBoostingRegressor(random_state=123)
The function above has return trained model object as an output. The scoring grid is only displayed and not returned. If you need access to the scoring grid you can use pull
function to access the dataframe.
compare_tree_models_results = pull()
compare_tree_models_results
Model | MAE | MSE | RMSE | R2 | RMSLE | MAPE | TT (Sec) | |
---|---|---|---|---|---|---|---|---|
gbr | Gradient Boosting Regressor | 2701.9135 | 2.354862e+07 | 4832.9291 | 0.8320 | 0.4447 | 0.3137 | 0.064 |
rf | Random Forest Regressor | 2772.9195 | 2.540979e+07 | 5028.1973 | 0.8173 | 0.4687 | 0.3298 | 0.075 |
catboost | CatBoost Regressor | 2899.4825 | 2.576275e+07 | 5057.5778 | 0.8163 | 0.4815 | 0.3522 | 0.046 |
lightgbm | Light Gradient Boosting Machine | 3001.8884 | 2.554732e+07 | 5044.5767 | 0.8147 | 0.5445 | 0.3784 | 0.048 |
et | Extra Trees Regressor | 2833.3624 | 2.842784e+07 | 5305.6516 | 0.7991 | 0.4877 | 0.3363 | 0.076 |
xgboost | Extreme Gradient Boosting | 3439.8892 | 3.282651e+07 | 5711.7335 | 0.7626 | 0.6221 | 0.4465 | 0.042 |
dt | Decision Tree Regressor | 3399.1402 | 4.810020e+07 | 6915.2984 | 0.6476 | 0.5629 | 0.4052 | 0.041 |
By default compare_models
return the single best performing model based on the metric defined in the sort
parameter. Let's change our code to return 3 top models based on MAE
.
best_mae_models_top3 = compare_models(sort = 'MAE', n_select = 3)
Model | MAE | MSE | RMSE | R2 | RMSLE | MAPE | TT (Sec) | |
---|---|---|---|---|---|---|---|---|
gbr | Gradient Boosting Regressor | 2701.9135 | 23548622.1598 | 4832.9291 | 0.8320 | 0.4447 | 0.3137 | 0.0640 |
rf | Random Forest Regressor | 2772.9195 | 25409792.9692 | 5028.1973 | 0.8173 | 0.4687 | 0.3298 | 0.0800 |
et | Extra Trees Regressor | 2833.3624 | 28427844.2412 | 5305.6516 | 0.7991 | 0.4877 | 0.3363 | 0.0800 |
catboost | CatBoost Regressor | 2899.4825 | 25762752.2096 | 5057.5778 | 0.8163 | 0.4815 | 0.3522 | 0.0420 |
lightgbm | Light Gradient Boosting Machine | 3001.8884 | 25547324.5813 | 5044.5767 | 0.8147 | 0.5445 | 0.3784 | 0.0500 |
dt | Decision Tree Regressor | 3399.1402 | 48100203.3847 | 6915.2984 | 0.6476 | 0.5629 | 0.4052 | 0.0430 |
xgboost | Extreme Gradient Boosting | 3439.8892 | 32826514.4000 | 5711.7335 | 0.7626 | 0.6221 | 0.4465 | 0.0530 |
huber | Huber Regressor | 3461.7327 | 49057640.5613 | 6981.8576 | 0.6528 | 0.4815 | 0.2188 | 0.0490 |
par | Passive Aggressive Regressor | 3536.1733 | 48501878.1363 | 6940.1967 | 0.6566 | 0.4785 | 0.2154 | 0.0480 |
knn | K Neighbors Regressor | 3778.4582 | 38143971.2000 | 6165.0463 | 0.7277 | 0.5027 | 0.3690 | 0.0470 |
ada | AdaBoost Regressor | 4175.5916 | 28401799.0579 | 5321.7006 | 0.7976 | 0.6263 | 0.7144 | 0.0470 |
ridge | Ridge Regression | 4296.0642 | 38392999.7849 | 6176.6160 | 0.7308 | 0.5710 | 0.4397 | 0.0420 |
llar | Lasso Least Angle Regression | 4298.6038 | 38369142.0849 | 6174.9424 | 0.7309 | 0.5786 | 0.4424 | 0.0450 |
br | Bayesian Ridge | 4300.6286 | 38387539.9069 | 6176.4192 | 0.7307 | 0.5881 | 0.4419 | 0.0480 |
lasso | Lasso Regression | 4302.2469 | 38386534.5553 | 6176.4463 | 0.7306 | 0.5913 | 0.4430 | 0.0430 |
lar | Least Angle Regression | 4303.5559 | 38388058.4578 | 6176.5920 | 0.7306 | 0.5949 | 0.4433 | 0.0420 |
lr | Linear Regression | 4312.6186 | 38452749.8007 | 6182.4796 | 0.7298 | 0.6285 | 0.4460 | 0.0430 |
omp | Orthogonal Matching Pursuit | 5754.7769 | 57503207.7233 | 7566.7086 | 0.5997 | 0.7418 | 0.8990 | 0.0460 |
en | Elastic Net | 7571.4598 | 104738034.4707 | 10182.3291 | 0.2846 | 0.8954 | 1.2888 | 0.0450 |
dummy | Dummy Regressor | 9192.5418 | 148516792.8000 | 12132.4733 | -0.0175 | 1.0154 | 1.5637 | 0.0400 |
Processing: 0%| | 0/87 [00:00<?, ?it/s]
# list of top 3 models by MAE
best_mae_models_top3
[GradientBoostingRegressor(random_state=123), RandomForestRegressor(n_jobs=-1, random_state=123), ExtraTreesRegressor(n_jobs=-1, random_state=123)]
Some other parameters that you might find very useful in compare_models
are:
You can check the docstring of the function for more info.
# help(compare_models)
PyCaret integrates with many different type of experiment loggers (default = 'mlflow'). To turn on experiment tracking in PyCaret you can set log_experiment
and experiment_name
parameter. It will automatically track all the metrics, hyperparameters, and artifacts based on the defined logger.
# from pycaret.regression import *
# s = setup(data, target = 'charges', log_experiment='mlflow', experiment_name='insurance_experiment')
# compare models
# best = compare_models()
# start mlflow server on localhost:5000
# !mlflow ui
By default PyCaret uses MLFlow
logger that can be changed using log_experiment
parameter. Following loggers are available:
- mlflow
- wandb
- comet_ml
- dagshub
Other logging related parameters that you may find useful are:
For more information check out the docstring of the setup
function.
# help(setup)
The create_model
function trains and evaluates the performance of a given estimator using cross-validation. The output of this function is a scoring grid with CV scores by fold. Metrics evaluated during CV can be accessed using the get_metrics
function. Custom metrics can be added or removed using add_metric
and remove_metric
function. All the available models can be accessed using the models
function.
# check all the available models
models()
Name | Reference | Turbo | |
---|---|---|---|
ID | |||
lr | Linear Regression | sklearn.linear_model._base.LinearRegression | True |
lasso | Lasso Regression | sklearn.linear_model._coordinate_descent.Lasso | True |
ridge | Ridge Regression | sklearn.linear_model._ridge.Ridge | True |
en | Elastic Net | sklearn.linear_model._coordinate_descent.Elast... | True |
lar | Least Angle Regression | sklearn.linear_model._least_angle.Lars | True |
llar | Lasso Least Angle Regression | sklearn.linear_model._least_angle.LassoLars | True |
omp | Orthogonal Matching Pursuit | sklearn.linear_model._omp.OrthogonalMatchingPu... | True |
br | Bayesian Ridge | sklearn.linear_model._bayes.BayesianRidge | True |
ard | Automatic Relevance Determination | sklearn.linear_model._bayes.ARDRegression | False |
par | Passive Aggressive Regressor | sklearn.linear_model._passive_aggressive.Passi... | True |
ransac | Random Sample Consensus | sklearn.linear_model._ransac.RANSACRegressor | False |
tr | TheilSen Regressor | sklearn.linear_model._theil_sen.TheilSenRegressor | False |
huber | Huber Regressor | sklearn.linear_model._huber.HuberRegressor | True |
kr | Kernel Ridge | sklearn.kernel_ridge.KernelRidge | False |
svm | Support Vector Regression | sklearn.svm._classes.SVR | False |
knn | K Neighbors Regressor | sklearn.neighbors._regression.KNeighborsRegressor | True |
dt | Decision Tree Regressor | sklearn.tree._classes.DecisionTreeRegressor | True |
rf | Random Forest Regressor | sklearn.ensemble._forest.RandomForestRegressor | True |
et | Extra Trees Regressor | sklearn.ensemble._forest.ExtraTreesRegressor | True |
ada | AdaBoost Regressor | sklearn.ensemble._weight_boosting.AdaBoostRegr... | True |
gbr | Gradient Boosting Regressor | sklearn.ensemble._gb.GradientBoostingRegressor | True |
mlp | MLP Regressor | sklearn.neural_network._multilayer_perceptron.... | False |
xgboost | Extreme Gradient Boosting | xgboost.sklearn.XGBRegressor | True |
lightgbm | Light Gradient Boosting Machine | lightgbm.sklearn.LGBMRegressor | True |
catboost | CatBoost Regressor | catboost.core.CatBoostRegressor | True |
dummy | Dummy Regressor | sklearn.dummy.DummyRegressor | True |
# train linear regression with default fold=10
lr = create_model('lr')
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 4221.7662 | 33767244.1606 | 5810.9590 | 0.7983 | 0.4864 | 0.4323 |
1 | 4529.8902 | 43625181.5268 | 6604.9361 | 0.7463 | 0.5543 | 0.4301 |
2 | 3958.4660 | 32631291.9087 | 5712.3806 | 0.5868 | 1.0240 | 0.4630 |
3 | 3725.8887 | 26679679.2570 | 5165.2376 | 0.7772 | 0.4979 | 0.5219 |
4 | 4437.1204 | 43552381.4341 | 6599.4228 | 0.6761 | 0.5731 | 0.3768 |
5 | 4115.6340 | 35844995.0079 | 5987.0690 | 0.7694 | 0.5381 | 0.4131 |
6 | 4098.0868 | 39631320.0598 | 6295.3411 | 0.7303 | 0.5745 | 0.4266 |
7 | 4850.1058 | 46175035.2997 | 6795.2215 | 0.7461 | 0.5706 | 0.3959 |
8 | 4621.0616 | 40681916.3737 | 6378.2377 | 0.7372 | 0.7032 | 0.5225 |
9 | 4568.1661 | 41938452.9786 | 6475.9905 | 0.7299 | 0.7626 | 0.4780 |
Mean | 4312.6186 | 38452749.8007 | 6182.4796 | 0.7298 | 0.6285 | 0.4460 |
Std | 327.8412 | 5763256.3224 | 479.2660 | 0.0569 | 0.1550 | 0.0470 |
Processing: 0%| | 0/4 [00:00<?, ?it/s]
The function above has return trained model object as an output. The scoring grid is only displayed and not returned. If you need access to the scoring grid you can use pull
function to access the dataframe.
lr_results = pull()
print(type(lr_results))
lr_results
<class 'pandas.core.frame.DataFrame'>
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 4221.7662 | 3.376724e+07 | 5810.9590 | 0.7983 | 0.4864 | 0.4323 |
1 | 4529.8902 | 4.362518e+07 | 6604.9361 | 0.7463 | 0.5543 | 0.4301 |
2 | 3958.4660 | 3.263129e+07 | 5712.3806 | 0.5868 | 1.0240 | 0.4630 |
3 | 3725.8887 | 2.667968e+07 | 5165.2376 | 0.7772 | 0.4979 | 0.5219 |
4 | 4437.1204 | 4.355238e+07 | 6599.4228 | 0.6761 | 0.5731 | 0.3768 |
5 | 4115.6340 | 3.584500e+07 | 5987.0690 | 0.7694 | 0.5381 | 0.4131 |
6 | 4098.0868 | 3.963132e+07 | 6295.3411 | 0.7303 | 0.5745 | 0.4266 |
7 | 4850.1058 | 4.617504e+07 | 6795.2215 | 0.7461 | 0.5706 | 0.3959 |
8 | 4621.0616 | 4.068192e+07 | 6378.2377 | 0.7372 | 0.7032 | 0.5225 |
9 | 4568.1661 | 4.193845e+07 | 6475.9905 | 0.7299 | 0.7626 | 0.4780 |
Mean | 4312.6186 | 3.845275e+07 | 6182.4796 | 0.7298 | 0.6285 | 0.4460 |
Std | 327.8412 | 5.763256e+06 | 479.2660 | 0.0569 | 0.1550 | 0.0470 |
# train linear regression with fold=3
lr = create_model('lr', fold=3)
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 4170.7537 | 35338831.9346 | 5944.6473 | 0.7482 | 0.6562 | 0.4578 |
1 | 4285.8970 | 39763353.6903 | 6305.8190 | 0.7176 | 0.5406 | 0.4443 |
2 | 4511.4189 | 40766553.9170 | 6384.8691 | 0.7492 | 0.6160 | 0.4383 |
Mean | 4322.6899 | 38622913.1806 | 6211.7785 | 0.7383 | 0.6043 | 0.4468 |
Std | 141.4885 | 2358035.1845 | 191.6273 | 0.0147 | 0.0479 | 0.0082 |
Processing: 0%| | 0/4 [00:00<?, ?it/s]
# train linear regression with specific model parameters
create_model('lr', fit_intercept = False)
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 4222.9616 | 33775764.3432 | 5811.6920 | 0.7983 | 0.4879 | 0.4328 |
1 | 4522.5819 | 43620030.5192 | 6604.5462 | 0.7464 | 0.5473 | 0.4216 |
2 | 3853.0378 | 31981107.9602 | 5655.1842 | 0.5951 | 0.7108 | 0.4398 |
3 | 3707.7705 | 26513348.5760 | 5149.1114 | 0.7786 | 0.4891 | 0.5164 |
4 | 4484.2122 | 43828444.1000 | 6620.3054 | 0.6740 | 0.5761 | 0.3847 |
5 | 4113.6222 | 35882341.9810 | 5990.1871 | 0.7692 | 0.5464 | 0.4130 |
6 | 4098.0868 | 39631320.0598 | 6295.3411 | 0.7303 | 0.5745 | 0.4266 |
7 | 4833.7747 | 45739275.7172 | 6763.0818 | 0.7485 | 0.5887 | 0.3967 |
8 | 4621.0616 | 40681916.3737 | 6378.2377 | 0.7372 | 0.7032 | 0.5225 |
9 | 4578.4499 | 42227034.9476 | 6498.2332 | 0.7280 | 0.7252 | 0.4793 |
Mean | 4303.5559 | 38388058.4578 | 6176.5920 | 0.7306 | 0.5949 | 0.4433 |
Std | 343.6324 | 5849500.5628 | 487.6160 | 0.0553 | 0.0838 | 0.0451 |
Processing: 0%| | 0/4 [00:00<?, ?it/s]
LinearRegression(fit_intercept=False, n_jobs=-1)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
LinearRegression(fit_intercept=False, n_jobs=-1)
# train lr and return train score as well alongwith CV
create_model('lr', return_train_score=True)
MAE | MSE | RMSE | R2 | RMSLE | MAPE | ||
---|---|---|---|---|---|---|---|
Split | Fold | ||||||
CV-Train | 0 | 4267.4267 | 38159913.7820 | 6177.3711 | 0.7384 | 0.5750 | 0.4421 |
1 | 4234.8525 | 37077265.7216 | 6089.1104 | 0.7449 | 0.7474 | 0.4442 | |
2 | 4416.2453 | 38462804.3733 | 6201.8388 | 0.7518 | 0.6981 | 0.4727 | |
3 | 4389.0411 | 38983678.6037 | 6243.6911 | 0.7417 | 0.5697 | 0.4495 | |
4 | 4212.7173 | 37111422.3767 | 6091.9145 | 0.7520 | 0.6824 | 0.4295 | |
5 | 4288.5643 | 37909700.1619 | 6157.0854 | 0.7426 | 0.5880 | 0.4443 | |
6 | 4271.9909 | 37519682.3513 | 6125.3312 | 0.7469 | 0.5497 | 0.4331 | |
7 | 4164.1720 | 36878048.6417 | 6072.7299 | 0.7440 | 0.5818 | 0.4213 | |
8 | 4234.1460 | 37404224.4784 | 6115.8993 | 0.7462 | 0.5896 | 0.4291 | |
9 | 4230.4127 | 37247244.0624 | 6103.0520 | 0.7472 | 0.5590 | 0.4312 | |
CV-Val | 0 | 4221.7662 | 33767244.1606 | 5810.9590 | 0.7983 | 0.4864 | 0.4323 |
1 | 4529.8902 | 43625181.5268 | 6604.9361 | 0.7463 | 0.5543 | 0.4301 | |
2 | 3958.4660 | 32631291.9087 | 5712.3806 | 0.5868 | 1.0240 | 0.4630 | |
3 | 3725.8887 | 26679679.2570 | 5165.2376 | 0.7772 | 0.4979 | 0.5219 | |
4 | 4437.1204 | 43552381.4341 | 6599.4228 | 0.6761 | 0.5731 | 0.3768 | |
5 | 4115.6340 | 35844995.0079 | 5987.0690 | 0.7694 | 0.5381 | 0.4131 | |
6 | 4098.0868 | 39631320.0598 | 6295.3411 | 0.7303 | 0.5745 | 0.4266 | |
7 | 4850.1058 | 46175035.2997 | 6795.2215 | 0.7461 | 0.5706 | 0.3959 | |
8 | 4621.0616 | 40681916.3737 | 6378.2377 | 0.7372 | 0.7032 | 0.5225 | |
9 | 4568.1661 | 41938452.9786 | 6475.9905 | 0.7299 | 0.7626 | 0.4780 | |
CV-Train | Mean | 4270.9569 | 37675398.4553 | 6137.8024 | 0.7456 | 0.6141 | 0.4397 |
Std | 73.8061 | 649149.8242 | 52.7300 | 0.0040 | 0.0652 | 0.0138 | |
CV-Val | Mean | 4312.6186 | 38452749.8007 | 6182.4796 | 0.7298 | 0.6285 | 0.4460 |
Std | 327.8412 | 5763256.3224 | 479.2660 | 0.0569 | 0.1550 | 0.0470 | |
Train | nan | 4200.4677 | 37762351.2375 | 6145.1079 | 0.7451 | 0.6739 | 0.4178 |
Processing: 0%| | 0/4 [00:00<?, ?it/s]
LinearRegression(n_jobs=-1)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
LinearRegression(n_jobs=-1)
Some other parameters that you might find very useful in create_model
are:
You can check the docstring of the function for more info.
# help(create_model)
The tune_model
function tunes the hyperparameters of the model. The output of this function is a scoring grid with cross-validated scores by fold. The best model is selected based on the metric defined in optimize parameter. Metrics evaluated during cross-validation can be accessed using the get_metrics
function. Custom metrics can be added or removed using add_metric
and remove_metric
function.
# train a dt model with default params
dt = create_model('dt')
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 3244.6173 | 45002914.9978 | 6708.4212 | 0.7312 | 0.5884 | 0.4883 |
1 | 3106.2611 | 45435728.7536 | 6740.6030 | 0.7358 | 0.5389 | 0.3271 |
2 | 3646.2662 | 54445682.2627 | 7378.7318 | 0.3107 | 0.6475 | 0.4752 |
3 | 3267.9250 | 45463401.7749 | 6742.6554 | 0.6204 | 0.5751 | 0.4339 |
4 | 4344.7470 | 65261429.3013 | 8078.4546 | 0.5146 | 0.7261 | 0.6008 |
5 | 3497.9281 | 42984919.0254 | 6556.2885 | 0.7235 | 0.4614 | 0.3208 |
6 | 3596.2637 | 53600704.7298 | 7321.2502 | 0.6353 | 0.5284 | 0.4126 |
7 | 2804.7493 | 37461859.8541 | 6120.6094 | 0.7940 | 0.4737 | 0.1787 |
8 | 3080.1801 | 42102090.8846 | 6488.6124 | 0.7281 | 0.5168 | 0.4537 |
9 | 3402.4641 | 49243302.2625 | 7017.3572 | 0.6828 | 0.5725 | 0.3613 |
Mean | 3399.1402 | 48100203.3847 | 6915.2984 | 0.6476 | 0.5629 | 0.4052 |
Std | 398.2185 | 7518631.1992 | 528.0642 | 0.1348 | 0.0754 | 0.1094 |
Processing: 0%| | 0/4 [00:00<?, ?it/s]
# tune hyperparameters of dt
tuned_dt = tune_model(dt)
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 1745.0008 | 18073621.2534 | 4251.3082 | 0.8920 | 0.3408 | 0.1390 |
1 | 2380.2671 | 33969297.4978 | 5828.3186 | 0.8025 | 0.4803 | 0.1491 |
2 | 2005.5481 | 23477540.5275 | 4845.3628 | 0.7027 | 0.4742 | 0.1604 |
3 | 1986.9419 | 22156779.8636 | 4707.0989 | 0.8150 | 0.3731 | 0.1550 |
4 | 2255.0797 | 28517151.4384 | 5340.1453 | 0.7879 | 0.4832 | 0.1465 |
5 | 1961.7810 | 20794913.6607 | 4560.1440 | 0.8662 | 0.3653 | 0.1287 |
6 | 1649.9559 | 20053618.6090 | 4478.1267 | 0.8635 | 0.3315 | 0.1164 |
7 | 2049.2066 | 26281892.4673 | 5126.5868 | 0.8555 | 0.4653 | 0.1298 |
8 | 1991.8599 | 23667668.4391 | 4864.9428 | 0.8471 | 0.3865 | 0.1452 |
9 | 2159.0994 | 26013111.3580 | 5100.3050 | 0.8324 | 0.4242 | 0.1459 |
Mean | 2018.4740 | 24300559.5115 | 4910.2339 | 0.8265 | 0.4124 | 0.1416 |
Std | 205.7361 | 4392006.1282 | 436.0762 | 0.0511 | 0.0570 | 0.0126 |
Processing: 0%| | 0/7 [00:00<?, ?it/s]
Fitting 10 folds for each of 10 candidates, totalling 100 fits
Metric to optimize can be defined in optimize
parameter (default = 'Accuracy'). Also, a custom tuned grid can be passed with custom_grid
parameter.
dt
DecisionTreeRegressor(random_state=123)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
DecisionTreeRegressor(random_state=123)
# define tuning grid
dt_grid = {'max_depth' : [None, 2, 4, 6, 8, 10, 12]}
# tune model with custom grid and metric = MAE
tuned_dt = tune_model(dt, custom_grid = dt_grid, optimize = 'MAE')
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 2862.1689 | 20651854.5440 | 4544.4312 | 0.8767 | 0.4291 | 0.3378 |
1 | 2985.5485 | 29278808.6736 | 5410.9896 | 0.8298 | 0.4471 | 0.3012 |
2 | 2843.3673 | 23854320.1238 | 4884.0885 | 0.6980 | 0.4900 | 0.3620 |
3 | 2868.1258 | 20204282.7199 | 4494.9174 | 0.8313 | 0.4597 | 0.4100 |
4 | 3153.2150 | 26237222.1432 | 5122.2282 | 0.8049 | 0.4801 | 0.3419 |
5 | 2735.1828 | 17885888.8292 | 4229.1712 | 0.8849 | 0.3806 | 0.2917 |
6 | 2606.7286 | 20086199.5553 | 4481.7630 | 0.8633 | 0.4124 | 0.3367 |
7 | 2831.0258 | 24114233.9138 | 4910.6246 | 0.8674 | 0.4664 | 0.3333 |
8 | 2663.4574 | 19629791.0490 | 4430.5520 | 0.8732 | 0.4288 | 0.3656 |
9 | 2788.2505 | 24885036.6072 | 4988.4904 | 0.8397 | 0.4771 | 0.3403 |
Mean | 2833.7071 | 22682763.8159 | 4749.7256 | 0.8369 | 0.4471 | 0.3421 |
Std | 148.1600 | 3372742.1687 | 350.5288 | 0.0522 | 0.0326 | 0.0315 |
Processing: 0%| | 0/7 [00:00<?, ?it/s]
Fitting 10 folds for each of 7 candidates, totalling 70 fits
# to access the tuner object you can set return_tuner = True
tuned_dt, tuner = tune_model(dt, return_tuner=True)
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 1745.0008 | 18073621.2534 | 4251.3082 | 0.8920 | 0.3408 | 0.1390 |
1 | 2380.2671 | 33969297.4978 | 5828.3186 | 0.8025 | 0.4803 | 0.1491 |
2 | 2005.5481 | 23477540.5275 | 4845.3628 | 0.7027 | 0.4742 | 0.1604 |
3 | 1986.9419 | 22156779.8636 | 4707.0989 | 0.8150 | 0.3731 | 0.1550 |
4 | 2255.0797 | 28517151.4384 | 5340.1453 | 0.7879 | 0.4832 | 0.1465 |
5 | 1961.7810 | 20794913.6607 | 4560.1440 | 0.8662 | 0.3653 | 0.1287 |
6 | 1649.9559 | 20053618.6090 | 4478.1267 | 0.8635 | 0.3315 | 0.1164 |
7 | 2049.2066 | 26281892.4673 | 5126.5868 | 0.8555 | 0.4653 | 0.1298 |
8 | 1991.8599 | 23667668.4391 | 4864.9428 | 0.8471 | 0.3865 | 0.1452 |
9 | 2159.0994 | 26013111.3580 | 5100.3050 | 0.8324 | 0.4242 | 0.1459 |
Mean | 2018.4740 | 24300559.5115 | 4910.2339 | 0.8265 | 0.4124 | 0.1416 |
Std | 205.7361 | 4392006.1282 | 436.0762 | 0.0511 | 0.0570 | 0.0126 |
Processing: 0%| | 0/7 [00:00<?, ?it/s]
Fitting 10 folds for each of 10 candidates, totalling 100 fits
# model object
tuned_dt
DecisionTreeRegressor(criterion='absolute_error', max_depth=6, max_features=1.0, min_impurity_decrease=0.002, min_samples_leaf=5, min_samples_split=5, random_state=123)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
DecisionTreeRegressor(criterion='absolute_error', max_depth=6, max_features=1.0, min_impurity_decrease=0.002, min_samples_leaf=5, min_samples_split=5, random_state=123)
# tuner object
tuner
RandomizedSearchCV(cv=KFold(n_splits=10, random_state=None, shuffle=False), estimator=Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], tra... 7, 8, 9, 10, 11, 12, 13, 14, 15, 16], 'actual_estimator__max_features': [1.0, 'sqrt', 'log2'], 'actual_estimator__min_impurity_decrease': [0, 0.0001, 0.001, 0.01, 0.0002, 0.002, 0.02, 0.0005, 0.005, 0.05, 0.1, 0.2, 0.3, 0.4, 0.5], 'actual_estimator__min_samples_leaf': [2, 3, 4, 5, 6], 'actual_estimator__min_samples_split': [2, 5, 7, 9, 10]}, random_state=123, refit=False, scoring='r2', verbose=1)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
RandomizedSearchCV(cv=KFold(n_splits=10, random_state=None, shuffle=False), estimator=Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], tra... 7, 8, 9, 10, 11, 12, 13, 14, 15, 16], 'actual_estimator__max_features': [1.0, 'sqrt', 'log2'], 'actual_estimator__min_impurity_decrease': [0, 0.0001, 0.001, 0.01, 0.0002, 0.002, 0.02, 0.0005, 0.005, 0.05, 0.1, 0.2, 0.3, 0.4, 0.5], 'actual_estimator__min_samples_leaf': [2, 3, 4, 5, 6], 'actual_estimator__min_samples_split': [2, 5, 7, 9, 10]}, random_state=123, refit=False, scoring='r2', verbose=1)
Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))), ('ordinal_encoding', TransformerW... 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))), ('onehot_encoding', TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))), ('normalize', TransformerWrapper(transformer=MinMaxScaler())), ('actual_estimator', DecisionTreeRegressor(random_state=123))])
TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())
SimpleImputer()
SimpleImputer()
TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))
SimpleImputer(strategy='most_frequent')
SimpleImputer(strategy='most_frequent')
TransformerWrapper(include=['sex', 'smoker'], transformer=OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))
OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}])
OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}])
TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))
OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True)
OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True)
TransformerWrapper(transformer=MinMaxScaler())
MinMaxScaler()
MinMaxScaler()
DecisionTreeRegressor(random_state=123)
The default search algorithm is RandomizedSearchCV
from sklearn
. This can be changed by using search_library
and search_algorithm
parameter.
# tune dt using optuna
tuned_dt = tune_model(dt, search_library = 'optuna')
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 1780.4708 | 18661626.9065 | 4319.9105 | 0.8885 | 0.3492 | 0.1282 |
1 | 2378.8326 | 34060507.0214 | 5836.1380 | 0.8020 | 0.4405 | 0.1317 |
2 | 1914.8876 | 23340496.9688 | 4831.2004 | 0.7045 | 0.4900 | 0.1479 |
3 | 1965.2661 | 22365357.2218 | 4729.2026 | 0.8133 | 0.3707 | 0.1321 |
4 | 2391.0387 | 30760382.6717 | 5546.2043 | 0.7712 | 0.5373 | 0.1991 |
5 | 1906.3528 | 20367865.5342 | 4513.0772 | 0.8690 | 0.3184 | 0.1080 |
6 | 1729.7143 | 21351600.2575 | 4620.7792 | 0.8547 | 0.3387 | 0.1147 |
7 | 2039.0614 | 26615466.7325 | 5159.0180 | 0.8536 | 0.4689 | 0.1314 |
8 | 1927.4966 | 22598678.1282 | 4753.8067 | 0.8540 | 0.3663 | 0.1316 |
9 | 2195.4010 | 27341573.0667 | 5228.9170 | 0.8239 | 0.4443 | 0.1612 |
Mean | 2022.8522 | 24746355.4509 | 4953.8254 | 0.8235 | 0.4124 | 0.1386 |
Std | 217.8612 | 4616581.4311 | 453.8386 | 0.0516 | 0.0698 | 0.0246 |
Processing: 0%| | 0/7 [00:00<?, ?it/s]
[I 2023-02-15 14:21:58,040] Searching the best hyperparameters using 936 samples... [I 2023-02-15 14:22:16,050] Finished hyperparemeter search!
For more details on all available search_library
and search_algorithm
please check the docstring. Some other parameters that you might find very useful in tune_model
are:
You can check the docstring of the function for more info.
# help(tune_model)
The ensemble_model
function ensembles a given estimator. The output of this function is a scoring grid with CV scores by fold. Metrics evaluated during CV can be accessed using the get_metrics
function. Custom metrics can be added or removed using add_metric
and remove_metric
function.
# ensemble with bagging
ensemble_model(dt, method = 'Bagging')
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 2591.8970 | 23266281.4574 | 4823.5134 | 0.8610 | 0.4637 | 0.2976 |
1 | 2863.6017 | 30202461.8149 | 5495.6766 | 0.8244 | 0.4882 | 0.3053 |
2 | 2736.5380 | 24936511.9328 | 4993.6472 | 0.6843 | 0.5148 | 0.3293 |
3 | 2945.2626 | 27479881.3264 | 5242.1256 | 0.7705 | 0.5164 | 0.4187 |
4 | 3075.1990 | 30901342.4317 | 5558.8976 | 0.7702 | 0.5670 | 0.3906 |
5 | 2866.8198 | 25117097.4494 | 5011.6961 | 0.8384 | 0.3711 | 0.2607 |
6 | 2568.9545 | 22780849.6859 | 4772.9288 | 0.8450 | 0.3730 | 0.2717 |
7 | 2639.4091 | 26044331.1073 | 5103.3647 | 0.8568 | 0.4710 | 0.2506 |
8 | 2364.6343 | 19889092.4425 | 4459.7189 | 0.8715 | 0.4108 | 0.3040 |
9 | 2820.2231 | 31860942.5716 | 5644.5498 | 0.7948 | 0.4605 | 0.2805 |
Mean | 2747.2539 | 26247879.2220 | 5110.6119 | 0.8117 | 0.4636 | 0.3109 |
Std | 198.4899 | 3670176.0781 | 359.8965 | 0.0547 | 0.0603 | 0.0521 |
Processing: 0%| | 0/6 [00:00<?, ?it/s]
BaggingRegressor(base_estimator=DecisionTreeRegressor(random_state=123), random_state=123)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
BaggingRegressor(base_estimator=DecisionTreeRegressor(random_state=123), random_state=123)
DecisionTreeRegressor(random_state=123)
DecisionTreeRegressor(random_state=123)
# ensemble with boosting
ensemble_model(dt, method = 'Boosting')
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 2054.7669 | 26692081.4248 | 5166.4380 | 0.8406 | 0.4131 | 0.1936 |
1 | 1991.3291 | 27836623.8370 | 5276.0424 | 0.8381 | 0.3933 | 0.1198 |
2 | 2577.5202 | 34350249.6820 | 5860.9086 | 0.5651 | 0.5748 | 0.3238 |
3 | 2408.3449 | 30508533.2842 | 5523.4530 | 0.7453 | 0.5172 | 0.3788 |
4 | 2564.6923 | 31138720.3012 | 5580.2079 | 0.7684 | 0.5678 | 0.3023 |
5 | 3145.5626 | 39513518.5950 | 6285.9779 | 0.7458 | 0.4481 | 0.2825 |
6 | 2069.4535 | 27352438.4443 | 5229.9559 | 0.8139 | 0.3412 | 0.1427 |
7 | 2125.2695 | 26494689.4475 | 5147.2992 | 0.8543 | 0.4403 | 0.1571 |
8 | 2053.8316 | 21762810.2356 | 4665.0627 | 0.8594 | 0.3307 | 0.1743 |
9 | 2440.6761 | 29911998.0044 | 5469.1862 | 0.8073 | 0.4988 | 0.2361 |
Mean | 2343.1447 | 29556166.3256 | 5420.4532 | 0.7838 | 0.4525 | 0.2311 |
Std | 342.7342 | 4602124.0816 | 418.1548 | 0.0833 | 0.0819 | 0.0827 |
Processing: 0%| | 0/6 [00:00<?, ?it/s]
AdaBoostRegressor(base_estimator=DecisionTreeRegressor(random_state=123), n_estimators=10, random_state=123)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
AdaBoostRegressor(base_estimator=DecisionTreeRegressor(random_state=123), n_estimators=10, random_state=123)
DecisionTreeRegressor(random_state=123)
DecisionTreeRegressor(random_state=123)
Some other parameters that you might find very useful in ensemble_model
are:
You can check the docstring of the function for more info.
# help(ensemble_model)
The blend_models
function trains a VotingRegressor
for select models passed in the estimator_list
parameter. The output of this function is a scoring grid with CV scores by fold. Metrics evaluated during CV can be accessed using the get_metrics
function. Custom metrics can be added or removed using add_metric
and remove_metric
function.
# top 3 models based on mae
best_mae_models_top3
[GradientBoostingRegressor(random_state=123), RandomForestRegressor(n_jobs=-1, random_state=123), ExtraTreesRegressor(n_jobs=-1, random_state=123)]
# blend top 3 models
blend_models(best_mae_models_top3)
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 2720.8934 | 22050841.6103 | 4695.8324 | 0.8683 | 0.4637 | 0.3425 |
1 | 2865.4018 | 30821460.9279 | 5551.7079 | 0.8208 | 0.4535 | 0.2800 |
2 | 2581.6067 | 22252661.3019 | 4717.2727 | 0.7183 | 0.5463 | 0.3794 |
3 | 2810.2333 | 21734211.3564 | 4661.9965 | 0.8185 | 0.4864 | 0.3873 |
4 | 3070.0103 | 30740150.2464 | 5544.3801 | 0.7714 | 0.5469 | 0.3679 |
5 | 2854.7097 | 22065332.3136 | 4697.3750 | 0.8581 | 0.3771 | 0.2778 |
6 | 2450.8238 | 20209907.9911 | 4495.5431 | 0.8625 | 0.3740 | 0.2901 |
7 | 2595.2491 | 23563676.7364 | 4854.2432 | 0.8704 | 0.3997 | 0.2334 |
8 | 2262.9477 | 18038706.9975 | 4247.1999 | 0.8835 | 0.3846 | 0.2937 |
9 | 2947.5441 | 28438703.1674 | 5332.7951 | 0.8168 | 0.5125 | 0.3660 |
Mean | 2715.9420 | 23991565.2649 | 4879.8346 | 0.8289 | 0.4545 | 0.3218 |
Std | 231.8660 | 4212892.9107 | 422.8235 | 0.0491 | 0.0647 | 0.0504 |
Processing: 0%| | 0/6 [00:00<?, ?it/s]
VotingRegressor(estimators=[('Gradient Boosting Regressor', GradientBoostingRegressor(random_state=123)), ('Random Forest Regressor', RandomForestRegressor(n_jobs=-1, random_state=123)), ('Extra Trees Regressor', ExtraTreesRegressor(n_jobs=-1, random_state=123))], n_jobs=-1)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
VotingRegressor(estimators=[('Gradient Boosting Regressor', GradientBoostingRegressor(random_state=123)), ('Random Forest Regressor', RandomForestRegressor(n_jobs=-1, random_state=123)), ('Extra Trees Regressor', ExtraTreesRegressor(n_jobs=-1, random_state=123))], n_jobs=-1)
GradientBoostingRegressor(random_state=123)
RandomForestRegressor(n_jobs=-1, random_state=123)
ExtraTreesRegressor(n_jobs=-1, random_state=123)
Some other parameters that you might find very useful in blend_models
are:
You can check the docstring of the function for more info.
# help(blend_models)
The stack_models
function trains a meta-model over select estimators passed in the estimator_list parameter. The output of this function is a scoring grid with CV scores by fold. Metrics evaluated during CV can be accessed using the get_metrics
function. Custom metrics can be added or removed using add_metric
and remove_metric
function.
# stack models
stack_models(best_mae_models_top3)
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 2609.6884 | 19941923.0191 | 4465.6380 | 0.8809 | 0.4388 | 0.3216 |
1 | 2980.4083 | 31017277.7854 | 5569.3157 | 0.8197 | 0.4751 | 0.2922 |
2 | 2546.1494 | 22498470.1082 | 4743.2552 | 0.7151 | 0.4924 | 0.2973 |
3 | 2847.5662 | 21076820.8684 | 4590.9499 | 0.8240 | 0.4727 | 0.3775 |
4 | 2921.5377 | 28163259.1669 | 5306.9067 | 0.7905 | 0.5215 | 0.3215 |
5 | 2677.5306 | 19787391.3140 | 4448.3021 | 0.8727 | 0.3998 | 0.2686 |
6 | 2369.6118 | 20267877.6270 | 4501.9860 | 0.8621 | 0.3340 | 0.2382 |
7 | 2693.0703 | 24841785.8067 | 4984.1535 | 0.8634 | 0.4340 | 0.2560 |
8 | 2229.6840 | 17762684.4081 | 4214.5800 | 0.8853 | 0.3765 | 0.2832 |
9 | 3001.6387 | 27582761.2165 | 5251.9293 | 0.8223 | 0.5155 | 0.3513 |
Mean | 2687.6885 | 23294025.1320 | 4807.7016 | 0.8336 | 0.4460 | 0.3007 |
Std | 245.2930 | 4159112.4380 | 424.2995 | 0.0494 | 0.0582 | 0.0408 |
Processing: 0%| | 0/6 [00:00<?, ?it/s]
StackingRegressor(cv=5, estimators=[('Gradient Boosting Regressor', GradientBoostingRegressor(random_state=123)), ('Random Forest Regressor', RandomForestRegressor(n_jobs=-1, random_state=123)), ('Extra Trees Regressor', ExtraTreesRegressor(n_jobs=-1, random_state=123))], final_estimator=LinearRegression(n_jobs=-1), n_jobs=-1, passthrough=True)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
StackingRegressor(cv=5, estimators=[('Gradient Boosting Regressor', GradientBoostingRegressor(random_state=123)), ('Random Forest Regressor', RandomForestRegressor(n_jobs=-1, random_state=123)), ('Extra Trees Regressor', ExtraTreesRegressor(n_jobs=-1, random_state=123))], final_estimator=LinearRegression(n_jobs=-1), n_jobs=-1, passthrough=True)
GradientBoostingRegressor(random_state=123)
RandomForestRegressor(n_jobs=-1, random_state=123)
ExtraTreesRegressor(n_jobs=-1, random_state=123)
LinearRegression(n_jobs=-1)
Some other parameters that you might find very useful in stack_models
are:
You can check the docstring of the function for more info.
# help(stack_models)
The plot_model
function analyzes the performance of a trained model on the hold-out set. It may require re-training the model in certain cases.
# plot residuals
plot_model(best, plot = 'residuals')
# to control the scale of plot
plot_model(best, plot = 'residuals', scale = 2)
# to save the plot
plot_model(best, plot = 'residuals', save=True)
'Residuals.png'
Some other parameters that you might find very useful in plot_model
are:
You can check the docstring of the function for more info.
# help(plot_model)
The interpret_model
function analyzes the predictions generated from a trained model. Most plots in this function are implemented based on the SHAP (Shapley Additive exPlanations). For more info on this, please see https://shap.readthedocs.io/en/latest/
# train lightgbm model
lightgbm = create_model('lightgbm')
MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|
Fold | ||||||
0 | 2896.4964 | 23611929.4013 | 4859.2108 | 0.8590 | 0.5993 | 0.3808 |
1 | 3075.9419 | 30047230.7486 | 5481.5354 | 0.8253 | 0.4622 | 0.3295 |
2 | 3096.0185 | 27757739.1878 | 5268.5614 | 0.6486 | 0.6159 | 0.4550 |
3 | 3347.3144 | 26993115.8247 | 5195.4900 | 0.7746 | 0.8106 | 0.5509 |
4 | 3263.7660 | 29391206.7843 | 5421.3658 | 0.7814 | 0.5628 | 0.3846 |
5 | 2922.5372 | 21672554.7596 | 4655.3791 | 0.8606 | 0.4170 | 0.2881 |
6 | 2733.8071 | 21012815.3865 | 4583.9738 | 0.8570 | 0.3991 | 0.3139 |
7 | 2865.5796 | 25843408.7132 | 5083.6413 | 0.8579 | 0.5027 | 0.2995 |
8 | 2715.5680 | 21671018.5929 | 4655.2141 | 0.8600 | 0.5233 | 0.4192 |
9 | 3101.8547 | 27472226.4139 | 5241.3955 | 0.8230 | 0.5521 | 0.3621 |
Mean | 3001.8884 | 25547324.5813 | 5044.5767 | 0.8147 | 0.5445 | 0.3784 |
Std | 200.5163 | 3164504.0885 | 315.5478 | 0.0635 | 0.1121 | 0.0765 |
Processing: 0%| | 0/4 [00:00<?, ?it/s]
# interpret summary model
interpret_model(lightgbm, plot = 'summary')
# reason plot for test set observation 1
interpret_model(lightgbm, plot = 'reason', observation = 1)
Some other parameters that you might find very useful in interpret_model
are:
You can check the docstring of the function for more info.
# help(interpret_model)
This function returns the leaderboard of all models trained in the current setup.
# get leaderboard
lb = get_leaderboard()
lb
Processing: 0%| | 0/67 [00:00<?, ?it/s]
Model Name | Model | MAE | MSE | RMSE | R2 | RMSLE | MAPE | |
---|---|---|---|---|---|---|---|---|
Index | ||||||||
0 | Linear Regression | (TransformerWrapper(include=['age', 'bmi', 'ch... | 4312.6186 | 3.845275e+07 | 6182.4796 | 0.7298 | 0.6285 | 0.4460 |
1 | Lasso Regression | (TransformerWrapper(include=['age', 'bmi', 'ch... | 4302.2469 | 3.838653e+07 | 6176.4463 | 0.7306 | 0.5913 | 0.4430 |
2 | Ridge Regression | (TransformerWrapper(include=['age', 'bmi', 'ch... | 4296.0642 | 3.839300e+07 | 6176.6160 | 0.7308 | 0.5710 | 0.4397 |
3 | Elastic Net | (TransformerWrapper(include=['age', 'bmi', 'ch... | 7571.4598 | 1.047380e+08 | 10182.3291 | 0.2846 | 0.8954 | 1.2888 |
4 | Least Angle Regression | (TransformerWrapper(include=['age', 'bmi', 'ch... | 4303.5559 | 3.838806e+07 | 6176.5920 | 0.7306 | 0.5949 | 0.4433 |
... | ... | ... | ... | ... | ... | ... | ... | ... |
61 | Decision Tree Regressor | (TransformerWrapper(include=['age', 'bmi', 'ch... | 2343.1447 | 2.955617e+07 | 5420.4532 | 0.7838 | 0.4525 | 0.2311 |
62 | Voting Regressor | (TransformerWrapper(include=['age', 'bmi', 'ch... | 2715.9420 | 2.399157e+07 | 4879.8346 | 0.8289 | 0.4545 | 0.3218 |
63 | Stacking Regressor | (TransformerWrapper(include=['age', 'bmi', 'ch... | 2687.6885 | 2.329403e+07 | 4807.7016 | 0.8336 | 0.4460 | 0.3007 |
64 | Stacking Regressor | (TransformerWrapper(include=['age', 'bmi', 'ch... | 2687.6885 | 2.329403e+07 | 4807.7016 | 0.8336 | 0.4460 | 0.3007 |
65 | Light Gradient Boosting Machine | (TransformerWrapper(include=['age', 'bmi', 'ch... | 3001.8884 | 2.554732e+07 | 5044.5767 | 0.8147 | 0.5445 | 0.3784 |
66 rows × 8 columns
# select the best model based on MAE
lb.sort_values(by='MAE', ascending=True)['Model'].iloc[0]
Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))), ('ordinal_encoding', TransformerW... 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))), ('onehot_encoding', TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))), ('normalize', TransformerWrapper(transformer=MinMaxScaler())), ['trained_model', LinearRegression(n_jobs=-1)]])In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))), ('ordinal_encoding', TransformerW... 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))), ('onehot_encoding', TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))), ('normalize', TransformerWrapper(transformer=MinMaxScaler())), ['trained_model', LinearRegression(n_jobs=-1)]])
TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())
SimpleImputer()
SimpleImputer()
TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))
SimpleImputer(strategy='most_frequent')
SimpleImputer(strategy='most_frequent')
TransformerWrapper(include=['sex', 'smoker'], transformer=OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))
OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}])
OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}])
TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))
OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True)
OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True)
TransformerWrapper(transformer=MinMaxScaler())
MinMaxScaler()
MinMaxScaler()
LinearRegression(n_jobs=-1)
Some other parameters that you might find very useful in get_leaderboard
are:
You can check the docstring of the function for more info.
# help(get_leaderboard)
This function returns the best model out of all trained models in the current setup based on the optimize parameter. Metrics evaluated can be accessed using the get_metrics
function.
# find best model based on CV metrics
automl()
DecisionTreeRegressor(max_depth=4, random_state=123)In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
DecisionTreeRegressor(max_depth=4, random_state=123)
The dashboard function generates the interactive dashboard for a trained model. The dashboard is implemented using ExplainerDashboard
. For more information check out Explainer Dashboard.
# dashboard function
dashboard(dt, display_format ='inline')
Generating self.shap_explainer = shap.TreeExplainer(model) Building ExplainerDashboard.. The explainer object has no decision_trees property. so setting decision_trees=False... Warning: calculating shap interaction values can be slow! Pass shap_interaction=False to remove interactions tab. Generating layout... Calculating shap values... Calculating predictions... Calculating residuals... Calculating absolute residuals... Calculating shap interaction values... Reminder: TreeShap computational complexity is O(TLD^2), where T is the number of trees, L is the maximum number of leaves in any tree and D the maximal depth of any tree. So reducing these will speed up the calculation. Calculating dependencies... Calculating importances... Reminder: you can store the explainer (including calculated dependencies) with explainer.dump('explainer.joblib') and reload with e.g. ClassifierExplainer.from_file('explainer.joblib') Registering callbacks... Starting ExplainerDashboard inline (terminate it with ExplainerDashboard.terminate(8050))
This function creates a basic gradio app for inference.
# create gradio app
create_app(best)
Running on local URL: http://127.0.0.1:7860 To create a public link, set `share=True` in `launch()`.
This function takes an input model and creates a POST API for inference.
# create api
create_api(best, api_name = 'my_first_api')
API successfully created. This function only creates a POST API, it doesn't run it automatically. To run your API, please run this command --> !python my_first_api.py
# !python my_first_api.py
# check out the .py file created with this magic command
# %load my_first_api.py
This function creates a Dockerfile
and requirements.txt
for productionalizing API end-point.
create_docker('my_first_api')
Writing requirements.txt Writing Dockerfile Dockerfile and requirements.txt successfully created. To build image you have to run --> !docker image build -f "Dockerfile" -t IMAGE_NAME:IMAGE_TAG .
# check out the DockerFile file created with this magic command
# %load DockerFile
# check out the requirements file created with this magic command
# %load requirements.txt
This function trains a given model on the entire dataset including the hold-out set.
final_best = finalize_model(best)
final_best
Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))), ('ordinal_encoding', TransformerW... 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))), ('onehot_encoding', TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))), ('normalize', TransformerWrapper(transformer=MinMaxScaler())), ('actual_estimator', GradientBoostingRegressor(random_state=123))])In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))), ('ordinal_encoding', TransformerW... 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))), ('onehot_encoding', TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))), ('normalize', TransformerWrapper(transformer=MinMaxScaler())), ('actual_estimator', GradientBoostingRegressor(random_state=123))])
TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())
SimpleImputer()
SimpleImputer()
TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))
SimpleImputer(strategy='most_frequent')
SimpleImputer(strategy='most_frequent')
TransformerWrapper(include=['sex', 'smoker'], transformer=OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))
OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}])
OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}])
TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))
OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True)
OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True)
TransformerWrapper(transformer=MinMaxScaler())
MinMaxScaler()
MinMaxScaler()
GradientBoostingRegressor(random_state=123)
This function transpiles the trained machine learning model's decision function in different programming languages such as Python, C, Java, Go, C#, etc. It is very useful if you want to deploy models into environments where you can't install your normal Python stack to support model inference.
# transpiles learned function to java
print(convert_model(dt, language = 'java'))
public class Model { public static double score(double[] input) { double var0; if (input[4] <= 0.5) { if (input[0] <= 0.554347813129425) { if (input[3] <= 0.10000000149011612) { if (input[0] <= 0.31521739065647125) { if (input[0] <= 0.09782608598470688) { if (input[2] <= 0.39116452634334564) { if (input[0] <= 0.0326086962595582) { if (input[1] <= 0.5) { if (input[5] <= 0.5) { if (input[8] <= 0.5) { if (input[0] <= 0.010869565419852734) { if (input[2] <= 0.19418424367904663) { var0 = 1607.5101318359375; } else { var0 = 1615.7667236328125; } } else { if (input[2] <= 0.16314832866191864) { if (input[2] <= 0.07786941900849342) { if (input[2] <= 0.03872498869895935) { var0 = 1727.7850341796875; } else { var0 = 1728.89697265625; } } else { var0 = 1731.677001953125; } } else { if (input[2] <= 0.2791835367679596) { var0 = 1737.3759765625; } else { var0 = 1743.2139892578125; } } } } else { if (input[2] <= 0.2709352597594261) { var0 = 2117.3388671875; } else { var0 = 2128.43115234375; } } } else { if (input[2] <= 0.2749195843935013) { var0 = 2196.47314453125; } else { if (input[2] <= 0.34530963003635406) { var0 = 2200.830810546875; } else { if (input[2] <= 0.3745281547307968) { var0 = 2203.471923828125; } else { var0 = 2203.73583984375; } } } } } else { if (input[6] <= 0.5) { if (input[7] <= 0.5) { if (input[8] <= 0.5) { if (input[2] <= 0.28421637415885925) { if (input[2] <= 0.21781067550182343) { if (input[2] <= 0.1846078261733055) { if (input[2] <= 0.1739829108119011) { var0 = 1704.568115234375; } else { var0 = 1704.7001953125; } } else { var0 = 1705.62451171875; } } else { var0 = 1708.0013427734375; } } else { var0 = 1712.22705078125; } } else { if (input[2] <= 0.19788897037506104) { if (input[2] <= 0.07835869677364826) { var0 = 1621.3402099609375; } else { if (input[2] <= 0.15007686614990234) { var0 = 1627.282470703125; } else { var0 = 1628.470947265625; } } } else { if (input[2] <= 0.3466377407312393) { if (input[2] <= 0.27624770253896713) { if (input[2] <= 0.23906050622463226) { var0 = 1632.0362548828125; } else { var0 = 1632.564453125; } } else { var0 = 1635.733642578125; } } else { var0 = 1639.5631103515625; } } } } else { if (input[2] <= 0.2756884768605232) { var0 = 1121.8739013671875; } else { var0 = 1131.506591796875; } } } else { if (input[2] <= 0.205088771879673) { if (input[2] <= 0.09045151993632317) { var0 = 1241.56494140625; } else { if (input[2] <= 0.10303367301821709) { var0 = 1242.260009765625; } else { var0 = 1242.8160400390625; } } } else { if (input[2] <= 0.35607434809207916) { if (input[2] <= 0.3169299513101578) { var0 = 1252.406982421875; } else { var0 = 1253.93603515625; } } else { var0 = 1256.2989501953125; } } } } } else { if (input[2] <= 0.19362502545118332) { if (input[8] <= 0.5) { var0 = 2731.912109375; } else { var0 = 2527.818603515625; } } else { if (input[2] <= 0.3713127076625824) { if (input[1] <= 0.5) { if (input[2] <= 0.3487347811460495) { if (input[0] <= 0.0652173925191164) { var0 = 2257.475341796875; } else { if (input[2] <= 0.24842720478773117) { var0 = 2150.468994140625; } else { if (input[6] <= 0.5) { if (input[2] <= 0.3248986005783081) { var0 = 2155.681396484375; } else { var0 = 2156.751708984375; } } else { var0 = 2154.361083984375; } } } } else { var0 = 1875.343994140625; } } else { if (input[7] <= 0.5) { if (input[2] <= 0.3386690616607666) { if (input[2] <= 0.3240597993135452) { if (input[2] <= 0.3028099983930588) { if (input[5] <= 0.5) { var0 = 2045.685302734375; } else { if (input[2] <= 0.2762477248907089) { var0 = 2102.2646484375; } else { var0 = 2104.11328125; } } } else { var0 = 1967.022705078125; } } else { var0 = 2250.835205078125; } } else { var0 = 1906.3582763671875; } } else { var0 = 1664.9996337890625; } } } else { var0 = 2459.72021484375; } } } } else { if (input[2] <= 0.3982944041490555) { var0 = 16586.498046875; } else { if (input[0] <= 0.0326086962595582) { if (input[6] <= 0.5) { if (input[2] <= 0.6337200701236725) { if (input[2] <= 0.5986298620700836) { if (input[2] <= 0.4802180528640747) { if (input[2] <= 0.4670068174600601) { if (input[5] <= 0.5) { var0 = 1622.1884765625; } else { if (input[2] <= 0.439605712890625) { var0 = 2205.980712890625; } else { var0 = 2207.697509765625; } } } else { var0 = 11482.634765625; } } else { if (input[1] <= 0.5) { if (input[0] <= 0.010869565419852734) { if (input[2] <= 0.5786382555961609) { var0 = 1629.83349609375; } else { var0 = 1631.6683349609375; } } else { if (input[2] <= 0.5325737297534943) { var0 = 2134.901611328125; } else { var0 = 2136.88232421875; } } } else { if (input[8] <= 0.5) { if (input[2] <= 0.5325038284063339) { if (input[2] <= 0.48790712654590607) { var0 = 1137.010986328125; } else { var0 = 1137.4697265625; } } else { var0 = 1141.445068359375; } } else { var0 = 1646.4296875; } } } } else { if (input[5] <= 0.5) { var0 = 7882.429626464844; } else { var0 = 12890.0576171875; } } } else { if (input[2] <= 0.6678316295146942) { if (input[5] <= 0.5) { if (input[2] <= 0.6493778228759766) { var0 = 1633.9617919921875; } else { var0 = 1634.5733642578125; } } else { var0 = 2217.46923828125; } } else { if (input[2] <= 0.7062770128250122) { var0 = 1146.796630859375; } else { var0 = 1149.3958740234375; } } } } else { if (input[2] <= 0.4525373727083206) { var0 = 1748.7740478515625; } else { var0 = 23082.955078125; } } } else { if (input[1] <= 0.5) { if (input[8] <= 0.5) { if (input[0] <= 0.05434782616794109) { if (input[2] <= 0.435201957821846) { var0 = 1877.929443359375; } else { var0 = 1880.487060546875; } } else { if (input[0] <= 0.07608695700764656) { if (input[6] <= 0.5) { var0 = 2026.97412109375; } else { var0 = 2020.177001953125; } } else { var0 = 2166.73193359375; } } } else { if (input[2] <= 0.4754648357629776) { var0 = 2261.56884765625; } else { var0 = 2404.73388671875; } } } else { if (input[7] <= 0.5) { if (input[6] <= 0.5) { if (input[0] <= 0.07608695700764656) { if (input[5] <= 0.5) { var0 = 1909.5274658203125; } else { var0 = 1984.4532470703125; } } else { if (input[8] <= 0.5) { var0 = 2254.796630859375; } else { var0 = 2055.324951171875; } } } else { if (input[2] <= 0.5168460607528687) { var0 = 1526.31201171875; } else { var0 = 1682.5970458984375; } } } else { if (input[0] <= 0.05434782616794109) { var0 = 1391.5286865234375; } else { if (input[2] <= 0.541730672121048) { var0 = 1532.4697265625; } else { var0 = 1534.304443359375; } } } } } } } } else { if (input[1] <= 0.5) { if (input[0] <= 0.16304347664117813) { if (input[2] <= 0.5949951112270355) { if (input[2] <= 0.19299592077732086) { if (input[7] <= 0.5) { var0 = 2457.501953125; } else { var0 = 25081.767578125; } } else { if (input[6] <= 0.5) { if (input[7] <= 0.5) { if (input[5] <= 0.5) { if (input[0] <= 0.14130434393882751) { if (input[0] <= 0.1195652149617672) { var0 = 2690.11376953125; } else { if (input[2] <= 0.28687261790037155) { var0 = 2842.7607421875; } else { if (input[2] <= 0.4143715798854828) { var0 = 2850.683837890625; } else { var0 = 2855.4375; } } } } else { var0 = 3021.80908203125; } } else { if (input[0] <= 0.14130434393882751) { if (input[0] <= 0.1195652149617672) { var0 = 2899.4892578125; } else { if (input[2] <= 0.2549978941679001) { var0 = 3044.21337890625; } else { var0 = 3046.06201171875; } } } else { var0 = 3213.6220703125; } } } else { if (input[2] <= 0.39256255328655243) { var0 = 2464.618896484375; } else { var0 = 2473.333984375; } } } else { if (input[0] <= 0.14130434393882751) { if (input[2] <= 0.30714383721351624) { var0 = 18955.220703125; } else { if (input[2] <= 0.3882286995649338) { var0 = 13126.677734375; } else { var0 = 10795.9375; } } } else { var0 = 2632.991943359375; } } } } else { var0 = 17878.900390625; } } else { if (input[0] <= 0.25) { if (input[6] <= 0.5) { if (input[0] <= 0.18478260934352875) { if (input[8] <= 0.5) { var0 = 3385.399169921875; } else { if (input[2] <= 0.4077310189604759) { if (input[2] <= 0.1567174419760704) { var0 = 3176.28759765625; } else { var0 = 3176.81591796875; } } else { var0 = 3201.2451171875; } } } else { if (input[7] <= 0.5) { if (input[0] <= 0.20652173459529877) { if (input[2] <= 0.1819515898823738) { var0 = 3353.47021484375; } else { var0 = 3558.620361328125; } } else { if (input[2] <= 0.379840612411499) { if (input[5] <= 0.5) { var0 = 3736.464599609375; } else { var0 = 3732.625; } } else { var0 = 3556.92236328125; } } } else { if (input[2] <= 0.48944494128227234) { var0 = 3171.614990234375; } else { var0 = 3366.669677734375; } } } } else { if (input[0] <= 0.20652173459529877) { var0 = 2974.1259765625; } else { if (input[2] <= 0.35747236013412476) { var0 = 3161.4541015625; } else { var0 = 3172.01806640625; } } } } else { if (input[5] <= 0.5) { if (input[8] <= 0.5) { if (input[0] <= 0.29347825050354004) { if (input[2] <= 0.3088214546442032) { var0 = 3757.8447265625; } else { var0 = 3761.2919921875; } } else { if (input[2] <= 0.5088773369789124) { var0 = 3972.9248046875; } else { if (input[6] <= 0.5) { var0 = 3994.177734375; } else { var0 = 3989.841064453125; } } } } else { if (input[0] <= 0.29347825050354004) { var0 = 4134.08251953125; } else { var0 = 4357.04345703125; } } } else { if (input[0] <= 0.27173912525177) { var0 = 4137.5224609375; } else { if (input[2] <= 0.251013558357954) { var0 = 4544.23486328125; } else { var0 = 4347.0234375; } } } } } } else { if (input[0] <= 0.20652173459529877) { if (input[0] <= 0.14130434393882751) { if (input[2] <= 0.24311476945877075) { if (input[2] <= 0.19390463829040527) { var0 = 2352.968505859375; } else { if (input[2] <= 0.20585765689611435) { var0 = 2395.171630859375; } else { var0 = 2396.095947265625; } } } else { if (input[0] <= 0.1195652149617672) { if (input[2] <= 0.5709492415189743) { if (input[2] <= 0.3556549698114395) { var0 = 1815.8758544921875; } else { var0 = 1824.285400390625; } } else { var0 = 1837.2818603515625; } } else { if (input[2] <= 0.47868023812770844) { if (input[6] <= 0.5) { var0 = 1981.5819091796875; } else { var0 = 1977.81494140625; } } else { var0 = 1986.933349609375; } } } } else { if (input[5] <= 0.5) { if (input[8] <= 0.5) { if (input[0] <= 0.18478260934352875) { if (input[0] <= 0.16304347664117813) { var0 = 2137.653564453125; } else { if (input[7] <= 0.5) { var0 = 2302.300048828125; } else { var0 = 2322.621826171875; } } } else { if (input[2] <= 0.2791835442185402) { var0 = 2483.736083984375; } else { if (input[2] <= 0.4129735231399536) { var0 = 2494.02197265625; } else { var0 = 2497.038330078125; } } } } else { if (input[0] <= 0.16304347664117813) { var0 = 2534.393798828125; } else { if (input[2] <= 0.21117013040930033) { var0 = 2680.94921875; } else { var0 = 2699.568359375; } } } } else { if (input[0] <= 0.16304347664117813) { if (input[2] <= 0.3240597993135452) { var0 = 2721.32080078125; } else { var0 = 2727.39501953125; } } else { if (input[2] <= 0.3054662346839905) { var0 = 3070.80859375; } else { var0 = 2897.323486328125; } } } } } else { if (input[0] <= 0.25) { if (input[0] <= 0.22826086729764938) { if (input[2] <= 0.45687122642993927) { var0 = 3062.50830078125; } else { var0 = 3268.8466796875; } } else { if (input[7] <= 0.5) { var0 = 2866.091064453125; } else { var0 = 2867.11962890625; } } } else { if (input[2] <= 0.170977171510458) { var0 = 3260.198974609375; } else { if (input[0] <= 0.27173912525177) { var0 = 3645.08935546875; } else { if (input[8] <= 0.5) { var0 = 3857.75927734375; } else { var0 = 3866.855224609375; } } } } } } } } else { if (input[2] <= 0.17160630971193314) { var0 = 21984.470703125; } else { if (input[2] <= 0.5073395222425461) { if (input[0] <= 0.489130437374115) { if (input[2] <= 0.35942958295345306) { if (input[0] <= 0.3586956560611725) { if (input[2] <= 0.24674957990646362) { var0 = 4992.37646484375; } else { var0 = 4415.15869140625; } } else { if (input[0] <= 0.42391303181648254) { if (input[6] <= 0.5) { if (input[0] <= 0.4021739065647125) { if (input[2] <= 0.2935131788253784) { if (input[2] <= 0.2709352374076843) { var0 = 5227.98876953125; } else { var0 = 5267.818359375; } } else { var0 = 5469.0068359375; } } else { var0 = 5028.146484375; } } else { var0 = 4883.8662109375; } } else { if (input[0] <= 0.45652173459529877) { var0 = 5383.5361328125; } else { var0 = 5415.6611328125; } } } } else { if (input[0] <= 0.33695653080940247) { var0 = 3704.3544921875; } else { if (input[1] <= 0.5) { var0 = 4889.03662109375; } else { if (input[7] <= 0.5) { if (input[0] <= 0.4021739065647125) { if (input[2] <= 0.4549838900566101) { var0 = 4402.23291015625; } else { var0 = 4518.826171875; } } else { var0 = 4646.7587890625; } } else { if (input[0] <= 0.3695652186870575) { var0 = 3935.179931640625; } else { var0 = 4399.73095703125; } } } } } } else { if (input[5] <= 0.5) { if (input[8] <= 0.5) { if (input[2] <= 0.4406542330980301) { if (input[0] <= 0.532608687877655) { if (input[1] <= 0.5) { if (input[6] <= 0.5) { var0 = 6185.32080078125; } else { var0 = 6186.126953125; } } else { var0 = 5969.72314453125; } } else { var0 = 6250.43505859375; } } else { if (input[7] <= 0.5) { var0 = 5979.73095703125; } else { var0 = 5699.83740234375; } } } else { if (input[2] <= 0.4276527017354965) { var0 = 6358.7763671875; } else { var0 = 6571.0244140625; } } } else { var0 = 7325.04833984375; } } } else { if (input[0] <= 0.43478260934352875) { if (input[8] <= 0.5) { if (input[7] <= 0.5) { var0 = 12404.87890625; } else { var0 = 19214.705078125; } } else { var0 = 4320.41064453125; } } else { if (input[0] <= 0.510869562625885) { if (input[2] <= 0.6970501244068146) { if (input[0] <= 0.489130437374115) { var0 = 5438.7490234375; } else { var0 = 5709.16455078125; } } else { if (input[5] <= 0.5) { var0 = 5662.22509765625; } else { var0 = 5757.41357421875; } } } else { var0 = 6474.01318359375; } } } } } } else { if (input[5] <= 0.5) { if (input[0] <= 0.44565217196941376) { if (input[6] <= 0.5) { if (input[3] <= 0.30000000447034836) { if (input[0] <= 0.0326086962595582) { if (input[0] <= 0.010869565419852734) { if (input[1] <= 0.5) { if (input[2] <= 0.3879490941762924) { var0 = 2201.09716796875; } else { var0 = 2219.445068359375; } } else { if (input[2] <= 0.32797424495220184) { var0 = 1711.02685546875; } else { if (input[2] <= 0.49405843019485474) { var0 = 1725.55224609375; } else { var0 = 1727.5400390625; } } } } else { if (input[1] <= 0.5) { if (input[2] <= 0.33468475192785263) { if (input[2] <= 0.23374806344509125) { if (input[2] <= 0.21648257225751877) { var0 = 2709.11181640625; } else { var0 = 2709.243896484375; } } else { var0 = 2710.82861328125; } } else { var0 = 2719.27978515625; } } else { var0 = 2221.564453125; } } } else { if (input[0] <= 0.0652173925191164) { if (input[2] <= 0.4763735383749008) { var0 = 2362.22900390625; } else { var0 = 27724.2890625; } } else { if (input[8] <= 0.5) { if (input[2] <= 0.6170836985111237) { if (input[2] <= 0.4094785153865814) { if (input[2] <= 0.2341674491763115) { if (input[0] <= 0.2499999925494194) { var0 = 3561.888916015625; } else { var0 = 17626.240234375; } } else { if (input[0] <= 0.4021739065647125) { if (input[0] <= 0.20652174204587936) { var0 = 2902.906494140625; } else { if (input[0] <= 0.29347825050354004) { if (input[0] <= 0.260869562625885) { var0 = 3947.4130859375; } else { var0 = 4350.51416015625; } } else { if (input[2] <= 0.28952884674072266) { var0 = 5002.78271484375; } else { if (input[2] <= 0.33873896300792694) { if (input[2] <= 0.31105828285217285) { var0 = 4747.052734375; } else { var0 = 4779.6025390625; } } else { var0 = 4562.84228515625; } } } } } else { if (input[2] <= 0.3633440434932709) { var0 = 5974.384765625; } else { var0 = 5976.8310546875; } } } } else { if (input[0] <= 0.31521739065647125) { if (input[1] <= 0.5) { var0 = 18218.162109375; } else { var0 = 18963.171875; } } else { var0 = 5245.22705078125; } } } else { if (input[2] <= 0.8231511116027832) { if (input[0] <= 0.260869562625885) { if (input[2] <= 0.6632181704044342) { var0 = 3471.40966796875; } else { var0 = 3238.435791015625; } } else { var0 = 3875.734130859375; } } else { var0 = 2438.05517578125; } } } else { if (input[0] <= 0.32608695328235626) { if (input[0] <= 0.18478260934352875) { if (input[0] <= 0.1304347775876522) { if (input[0] <= 0.09782608598470688) { if (input[2] <= 0.3639032244682312) { var0 = 2639.04296875; } else { var0 = 2643.2685546875; } } else { var0 = 2789.057373046875; } } else { if (input[0] <= 0.16304347664117813) { var0 = 3594.1708984375; } else { var0 = 3292.52978515625; } } } else { if (input[0] <= 0.2391304299235344) { if (input[2] <= 0.32937224209308624) { var0 = 4133.6416015625; } else { var0 = 3956.071533203125; } } else { if (input[2] <= 0.28156013786792755) { if (input[0] <= 0.27173912525177) { var0 = 4032.24072265625; } else { var0 = 4239.892578125; } } else { if (input[2] <= 0.32671603560447693) { if (input[1] <= 0.5) { var0 = 4527.18310546875; } else { var0 = 4454.40283203125; } } else { if (input[2] <= 0.4024185240268707) { var0 = 4243.58984375; } else { var0 = 4462.7216796875; } } } } } } else { if (input[0] <= 0.41304346919059753) { if (input[2] <= 0.14874876383692026) { var0 = 5116.50048828125; } else { if (input[2] <= 0.5033551603555679) { if (input[1] <= 0.5) { var0 = 5385.337890625; } else { if (input[2] <= 0.434293270111084) { var0 = 5373.3642578125; } else { var0 = 5377.4580078125; } } } else { var0 = 5630.4580078125; } } } else { if (input[1] <= 0.5) { var0 = 6373.55712890625; } else { var0 = 5855.90234375; } } } } } } } else { if (input[0] <= 0.0326086962595582) { if (input[2] <= 0.27701660990715027) { if (input[2] <= 0.20033551007509232) { if (input[7] <= 0.5) { var0 = 2803.69775390625; } else { var0 = 11884.048828125; } } else { var0 = 2304.002197265625; } } else { if (input[1] <= 0.5) { var0 = 24059.6796875; } else { var0 = 22493.66015625; } } } else { if (input[7] <= 0.5) { if (input[0] <= 0.1195652149617672) { if (input[2] <= 0.45687122642993927) { if (input[2] <= 0.3107786774635315) { var0 = 14426.07421875; } else { var0 = 26018.951171875; } } else { var0 = 3579.82861328125; } } else { if (input[2] <= 0.4595274478197098) { if (input[0] <= 0.22826086729764938) { if (input[2] <= 0.3838249295949936) { if (input[1] <= 0.5) { if (input[2] <= 0.2855444774031639) { var0 = 4719.736328125; } else { var0 = 4618.080078125; } } else { var0 = 4877.98095703125; } } else { if (input[0] <= 0.18478260934352875) { var0 = 3877.30419921875; } else { var0 = 4058.71240234375; } } } else { if (input[2] <= 0.40507476031780243) { if (input[0] <= 0.25) { var0 = 18157.876953125; } else { if (input[0] <= 0.3586956560611725) { if (input[0] <= 0.29347826540470123) { var0 = 5693.4306640625; } else { var0 = 5261.46923828125; } } else { if (input[1] <= 0.5) { if (input[2] <= 0.18992029130458832) { var0 = 6933.2421875; } else { if (input[2] <= 0.33999715745449066) { var0 = 7281.50537109375; } else { var0 = 7537.1640625; } } } else { if (input[3] <= 0.5000000149011612) { if (input[0] <= 0.42391303181648254) { if (input[2] <= 0.26163844764232635) { var0 = 6198.751953125; } else { var0 = 6203.90185546875; } } else { if (input[2] <= 0.3280441462993622) { var0 = 6455.86279296875; } else { var0 = 6457.84326171875; } } } else { if (input[0] <= 0.4021739065647125) { var0 = 6548.19482421875; } else { var0 = 6796.86328125; } } } } } } else { if (input[2] <= 0.4369495362043381) { if (input[2] <= 0.4223402440547943) { var0 = 4433.3876953125; } else { var0 = 4433.916015625; } } else { var0 = 5327.400390625; } } } } else { if (input[2] <= 0.48210540413856506) { var0 = 19442.353515625; } else { if (input[0] <= 0.3586956560611725) { var0 = 5989.5234375; } else { var0 = 5729.00537109375; } } } } } else { if (input[0] <= 0.31521739065647125) { if (input[0] <= 0.16304347291588783) { if (input[1] <= 0.5) { if (input[0] <= 0.08695651963353157) { if (input[2] <= 0.2803019508719444) { var0 = 3180.510009765625; } else { var0 = 3056.38818359375; } } else { var0 = 3500.6123046875; } } else { var0 = 2566.470703125; } } else { if (input[0] <= 0.25) { if (input[0] <= 0.22826086729764938) { if (input[2] <= 0.3618062138557434) { var0 = 4340.44091796875; } else { var0 = 4449.4619140625; } } else { var0 = 4058.1162109375; } } else { if (input[2] <= 0.5786383152008057) { if (input[1] <= 0.5) { var0 = 4949.7587890625; } else { var0 = 4837.58251953125; } } else { if (input[1] <= 0.5) { var0 = 4753.63671875; } else { if (input[0] <= 0.29347825050354004) { if (input[2] <= 0.6847476363182068) { var0 = 4463.205078125; } else { var0 = 4266.166015625; } } else { var0 = 4686.388671875; } } } } } } else { if (input[3] <= 0.7000000178813934) { if (input[3] <= 0.5000000149011612) { if (input[0] <= 0.3804347813129425) { var0 = 5846.91748046875; } else { var0 = 5584.3056640625; } } else { if (input[0] <= 0.3804347813129425) { var0 = 6184.29931640625; } else { var0 = 6435.62353515625; } } } else { if (input[0] <= 0.3586956560611725) { var0 = 6653.78857421875; } else { var0 = 7243.8134765625; } } } } } } } else { if (input[0] <= 0.22826086729764938) { if (input[3] <= 0.30000000447034836) { if (input[0] <= 0.10869564861059189) { if (input[1] <= 0.5) { if (input[0] <= 0.04347826074808836) { var0 = 2331.51904296875; } else { var0 = 2597.779052734375; } } else { if (input[0] <= 0.0326086962595582) { if (input[2] <= 0.21906888112425804) { var0 = 1832.093994140625; } else { var0 = 1842.51904296875; } } else { if (input[0] <= 0.05434782616794109) { var0 = 1964.780029296875; } else { var0 = 2103.080078125; } } } } else { if (input[2] <= 0.09744159504771233) { var0 = 3378.909912109375; } else { if (input[1] <= 0.5) { var0 = 3208.787109375; } else { var0 = 3277.160888671875; } } } } else { if (input[3] <= 0.800000011920929) { if (input[0] <= 0.1195652149617672) { if (input[1] <= 0.5) { var0 = 2913.569091796875; } else { if (input[2] <= 0.4735075682401657) { var0 = 3591.47998046875; } else { var0 = 3443.06396484375; } } } else { if (input[3] <= 0.5000000149011612) { if (input[0] <= 0.18478260934352875) { var0 = 3484.3310546875; } else { if (input[0] <= 0.20652173459529877) { var0 = 3693.427978515625; } else { var0 = 3847.674072265625; } } } else { if (input[1] <= 0.5) { if (input[2] <= 0.29036764055490494) { var0 = 4391.65185546875; } else { var0 = 4234.9267578125; } } else { if (input[0] <= 0.17391303926706314) { var0 = 3906.126953125; } else { var0 = 4260.744140625; } } } } } else { if (input[0] <= 0.18478260189294815) { if (input[0] <= 0.09782608412206173) { if (input[2] <= 0.44694532454013824) { var0 = 4687.796875; } else { var0 = 4830.6298828125; } } else { var0 = 5080.09619140625; } } else { var0 = 5615.369140625; } } } } else { if (input[3] <= 0.30000000447034836) { if (input[0] <= 0.32608695328235626) { if (input[2] <= 0.40919890999794006) { var0 = 3659.345947265625; } else { if (input[2] <= 0.42317909002304077) { var0 = 4076.4970703125; } else { var0 = 4149.73583984375; } } } else { if (input[2] <= 0.38962671160697937) { if (input[0] <= 0.3586956560611725) { var0 = 5003.85302734375; } else { if (input[2] <= 0.3351041376590729) { var0 = 4746.34423828125; } else { var0 = 4751.06982421875; } } } else { if (input[0] <= 0.4021739065647125) { if (input[0] <= 0.3586956560611725) { var0 = 5012.47119140625; } else { if (input[2] <= 0.44974131882190704) { var0 = 5240.76513671875; } else { var0 = 5246.046875; } } } else { var0 = 5488.26220703125; } } } } else { if (input[0] <= 0.31521739065647125) { if (input[3] <= 0.5000000149011612) { if (input[2] <= 0.22046690434217453) { var0 = 4931.64697265625; } else { var0 = 4934.705078125; } } else { if (input[0] <= 0.25) { var0 = 5708.8671875; } else { if (input[2] <= 0.39242272078990936) { var0 = 5253.52392578125; } else { var0 = 5325.65087890625; } } } } else { if (input[3] <= 0.9000000059604645) { if (input[0] <= 0.33695653080940247) { if (input[3] <= 0.7000000178813934) { var0 = 5972.3779296875; } else { var0 = 6059.1728515625; } } else { if (input[0] <= 0.3586956560611725) { var0 = 6196.4482421875; } else { if (input[0] <= 0.3913043439388275) { var0 = 6414.17822265625; } else { var0 = 6311.9521484375; } } } } else { var0 = 6666.2431640625; } } } } } } else { if (input[2] <= 0.6286872029304504) { if (input[3] <= 0.7000000178813934) { if (input[7] <= 0.5) { if (input[0] <= 0.532608687877655) { if (input[3] <= 0.5000000149011612) { if (input[2] <= 0.46232347190380096) { if (input[1] <= 0.5) { if (input[2] <= 0.4304487258195877) { if (input[0] <= 0.510869562625885) { if (input[3] <= 0.30000000447034836) { var0 = 7153.5537109375; } else { if (input[2] <= 0.3439815193414688) { var0 = 7201.70068359375; } else { var0 = 7209.49169921875; } } } else { var0 = 7050.64208984375; } } else { var0 = 6238.2978515625; } } else { if (input[0] <= 0.510869562625885) { if (input[3] <= 0.30000000447034836) { if (input[0] <= 0.46739131212234497) { var0 = 6123.56884765625; } else { if (input[2] <= 0.32958196103572845) { var0 = 6664.68603515625; } else { if (input[6] <= 0.5) { var0 = 6393.603515625; } else { var0 = 6282.23486328125; } } } } else { if (input[6] <= 0.5) { var0 = 6710.19189453125; } else { var0 = 6600.36083984375; } } } else { var0 = 6940.90966796875; } } } else { if (input[1] <= 0.5) { if (input[6] <= 0.5) { var0 = 7443.64306640625; } else { var0 = 7371.77197265625; } } else { if (input[8] <= 0.5) { var0 = 7160.09423828125; } else { if (input[2] <= 0.5259331315755844) { var0 = 7261.7412109375; } else { var0 = 7265.70263671875; } } } } } else { if (input[2] <= 0.4623234272003174) { if (input[2] <= 0.3866908550262451) { var0 = 8059.67919921875; } else { var0 = 7954.51708984375; } } else { if (input[2] <= 0.5000698268413544) { var0 = 7418.52197265625; } else { var0 = 7196.8671875; } } } } else { if (input[2] <= 0.4145812392234802) { if (input[1] <= 0.5) { var0 = 8310.8388671875; } else { var0 = 8410.046875; } } else { if (input[8] <= 0.5) { var0 = 7441.5009765625; } else { var0 = 7727.25341796875; } } } } else { if (input[0] <= 0.46739131212234497) { var0 = 23563.015625; } else { if (input[3] <= 0.30000000447034836) { if (input[0] <= 0.510869562625885) { if (input[0] <= 0.489130437374115) { var0 = 6500.23583984375; } else { var0 = 6781.35400390625; } } else { if (input[2] <= 0.3941003382205963) { var0 = 7046.72216796875; } else { var0 = 7345.7265625; } } } else { if (input[2] <= 0.49405843019485474) { if (input[0] <= 0.5) { var0 = 7682.669921875; } else { var0 = 7640.30908203125; } } else { if (input[2] <= 0.5524954497814178) { var0 = 7160.330078125; } else { var0 = 7162.01220703125; } } } } } } else { if (input[2] <= 0.3532783091068268) { if (input[2] <= 0.22032713145017624) { var0 = 8582.302734375; } else { if (input[6] <= 0.5) { var0 = 14478.330078125; } else { var0 = 15828.8212890625; } } } else { if (input[6] <= 0.5) { if (input[7] <= 0.5) { var0 = 8162.71630859375; } else { var0 = 8596.828125; } } else { var0 = 7512.26708984375; } } } } else { var0 = 28476.734375; } } } else { if (input[0] <= 0.3804347813129425) { if (input[0] <= 0.33695653080940247) { if (input[0] <= 0.25) { if (input[2] <= 0.2403886392712593) { if (input[3] <= 0.5000000149011612) { if (input[2] <= 0.20851389318704605) { var0 = 22395.744140625; } else { if (input[1] <= 0.5) { var0 = 23288.927734375; } else { var0 = 23241.474609375; } } } else { var0 = 5209.57861328125; } } else { if (input[2] <= 0.35460641980171204) { if (input[0] <= 0.07608695328235626) { var0 = 11272.3310546875; } else { if (input[2] <= 0.2682790160179138) { var0 = 3309.79248046875; } else { if (input[0] <= 0.19565217196941376) { if (input[2] <= 0.3214035779237747) { var0 = 4661.2861328125; } else { var0 = 4564.19140625; } } else { if (input[1] <= 0.5) { var0 = 4337.7353515625; } else { if (input[2] <= 0.3160911202430725) { var0 = 4435.09423828125; } else { var0 = 4438.26318359375; } } } } } } else { if (input[0] <= 0.10869565233588219) { if (input[2] <= 0.3758562505245209) { var0 = 4915.06005859375; } else { if (input[0] <= 0.043478261679410934) { if (input[3] <= 0.5000000149011612) { var0 = 3393.3564453125; } else { var0 = 3481.867919921875; } } else { var0 = 3925.75830078125; } } } else { if (input[2] <= 0.3718719035387039) { if (input[3] <= 0.5000000074505806) { var0 = 20277.806640625; } else { var0 = 24671.6640625; } } else { if (input[2] <= 0.41038723289966583) { var0 = 16796.412109375; } else { if (input[3] <= 0.5000000074505806) { var0 = 18903.4921875; } else { var0 = 17128.42578125; } } } } } } } else { if (input[3] <= 0.5000000149011612) { if (input[0] <= 0.29347825050354004) { if (input[2] <= 0.29218506813049316) { if (input[1] <= 0.5) { var0 = 4718.20361328125; } else { var0 = 4441.21337890625; } } else { var0 = 5031.26953125; } } else { if (input[2] <= 0.2802320569753647) { var0 = 5354.07470703125; } else { var0 = 5148.552734375; } } } else { if (input[0] <= 0.27173912525177) { var0 = 5428.7275390625; } else { if (input[2] <= 0.43562139570713043) { var0 = 6799.4580078125; } else { if (input[2] <= 0.5564797818660736) { var0 = 6551.75; } else { var0 = 6334.34375; } } } } } } else { if (input[0] <= 0.3586956560611725) { var0 = 27375.904296875; } else { if (input[2] <= 0.39046552032232285) { var0 = 6402.29150390625; } else { if (input[3] <= 0.6000000089406967) { var0 = 24915.046875; } else { var0 = 19496.71875; } } } } } else { if (input[0] <= 0.489130437374115) { if (input[2] <= 0.2377324029803276) { if (input[2] <= 0.17398293316364288) { if (input[2] <= 0.04382776468992233) { var0 = 6640.544921875; } else { if (input[0] <= 0.4021739065647125) { var0 = 7228.2158203125; } else { if (input[0] <= 0.42391303181648254) { var0 = 6985.5068359375; } else { if (input[1] <= 0.5) { var0 = 7133.90234375; } else { var0 = 7173.35986328125; } } } } } else { var0 = 8252.2841796875; } } else { if (input[2] <= 0.3107786625623703) { if (input[2] <= 0.30413807928562164) { if (input[1] <= 0.5) { var0 = 6555.0703125; } else { var0 = 6746.74267578125; } } else { var0 = 7144.86279296875; } } else { if (input[2] <= 0.3253879100084305) { var0 = 6067.126953125; } else { if (input[3] <= 0.5000000149011612) { if (input[3] <= 0.30000000447034836) { var0 = 6600.2060546875; } else { var0 = 6406.41064453125; } } else { var0 = 6748.59130859375; } } } } } else { if (input[2] <= 0.16867046803236008) { var0 = 13725.4716796875; } else { if (input[3] <= 0.5000000149011612) { if (input[2] <= 0.2297637164592743) { var0 = 6858.4794921875; } else { if (input[2] <= 0.3585907518863678) { var0 = 7729.6455078125; } else { if (input[2] <= 0.5710890144109726) { var0 = 7639.41748046875; } else { var0 = 7650.77392578125; } } } } else { if (input[3] <= 0.800000011920929) { if (input[1] <= 0.5) { var0 = 8538.2880859375; } else { var0 = 8606.2177734375; } } else { var0 = 9222.40234375; } } } } } } } } else { if (input[0] <= 0.8804347813129425) { if (input[0] <= 0.72826087474823) { if (input[7] <= 0.5) { if (input[2] <= 0.2027820348739624) { if (input[0] <= 0.6630434989929199) { if (input[3] <= 0.10000000149011612) { if (input[0] <= 0.6304347813129425) { if (input[2] <= 0.10624909773468971) { var0 = 7526.70654296875; } else { var0 = 7222.7861328125; } } else { var0 = 8269.0439453125; } } else { if (input[0] <= 0.5760869383811951) { var0 = 8302.5361328125; } else { if (input[8] <= 0.5) { if (input[5] <= 0.5) { var0 = 8539.6708984375; } else { if (input[2] <= 0.1341395080089569) { var0 = 8627.541015625; } else { var0 = 8604.4833984375; } } } else { var0 = 8428.0693359375; } } } } else { if (input[2] <= 0.16070178151130676) { if (input[2] <= 0.1423877701163292) { if (input[2] <= 0.11561580002307892) { var0 = 9264.796875; } else { var0 = 9182.169921875; } } else { var0 = 8688.8583984375; } } else { if (input[3] <= 0.30000000447034836) { var0 = 9566.9912109375; } else { var0 = 10156.783203125; } } } } else { if (input[2] <= 0.20676637440919876) { var0 = 26236.580078125; } else { if (input[2] <= 0.36257512867450714) { if (input[2] <= 0.34740664064884186) { if (input[0] <= 0.5760869383811951) { if (input[6] <= 0.5) { if (input[2] <= 0.25366976112127304) { var0 = 7518.025390625; } else { var0 = 7419.47802734375; } } else { if (input[1] <= 0.5) { if (input[2] <= 0.2749894708395004) { if (input[2] <= 0.24003910273313522) { var0 = 7623.51806640625; } else { var0 = 7624.6298828125; } } else { var0 = 7626.9931640625; } } else { var0 = 7726.85400390625; } } } else { if (input[0] <= 0.5978260636329651) { if (input[6] <= 0.5) { var0 = 28340.189453125; } else { var0 = 9101.7978515625; } } else { if (input[2] <= 0.23954980820417404) { if (input[2] <= 0.22577938437461853) { if (input[5] <= 0.5) { var0 = 11520.099609375; } else { var0 = 8534.671875; } } else { var0 = 30284.642578125; } } else { if (input[3] <= 0.10000000149011612) { if (input[8] <= 0.5) { if (input[0] <= 0.70652174949646) { if (input[0] <= 0.6521739065647125) { var0 = 24603.048828125; } else { var0 = 25656.576171875; } } else { var0 = 8782.46875; } } else { if (input[2] <= 0.28687261044979095) { var0 = 8827.2099609375; } else { var0 = 8026.66650390625; } } } else { if (input[3] <= 0.7000000178813934) { if (input[0] <= 0.6847826242446899) { if (input[8] <= 0.5) { if (input[0] <= 0.6630434989929199) { if (input[2] <= 0.2935131937265396) { var0 = 9447.25; } else { var0 = 9447.3828125; } } else { var0 = 9282.48046875; } } else { if (input[3] <= 0.4000000134110451) { var0 = 9249.4951171875; } else { var0 = 9301.8935546875; } } } else { if (input[2] <= 0.29218506813049316) { if (input[6] <= 0.5) { var0 = 10106.1337890625; } else { var0 = 9861.025390625; } } else { if (input[0] <= 0.70652174949646) { var0 = 9617.662109375; } else { var0 = 9957.7216796875; } } } } else { if (input[0] <= 0.6413043737411499) { var0 = 10407.0859375; } else { var0 = 11015.1748046875; } } } } } } } else { if (input[3] <= 0.20000000298023224) { var0 = 21232.181640625; } else { var0 = 32108.662109375; } } } else { if (input[0] <= 0.6195652186870575) { if (input[3] <= 0.30000000447034836) { if (input[0] <= 0.5978260636329651) { if (input[8] <= 0.5) { if (input[1] <= 0.5) { if (input[2] <= 0.48608967661857605) { var0 = 7345.083984375; } else { var0 = 7348.14208984375; } } else { if (input[2] <= 0.4231790751218796) { var0 = 7441.05322265625; } else { if (input[2] <= 0.5574583858251572) { var0 = 7445.91796875; } else { var0 = 7448.40380859375; } } } } else { if (input[2] <= 0.5471829473972321) { var0 = 7731.85791015625; } else { var0 = 8023.13525390625; } } } else { var0 = 8334.4580078125; } } else { if (input[5] <= 0.5) { if (input[3] <= 0.5000000149011612) { if (input[0] <= 0.5978260636329651) { if (input[2] <= 0.4094085991382599) { if (input[1] <= 0.5) { var0 = 8520.0263671875; } else { var0 = 8413.462890625; } } else { var0 = 8116.26904296875; } } else { if (input[2] <= 0.5164965689182281) { var0 = 8825.0859375; } else { var0 = 8733.2294921875; } } } else { var0 = 9414.919921875; } } else { if (input[0] <= 0.5978260636329651) { var0 = 9704.66796875; } else { var0 = 9432.92578125; } } } } else { if (input[2] <= 0.4475744217634201) { if (input[3] <= 0.800000011920929) { if (input[3] <= 0.30000000447034836) { if (input[0] <= 0.6630434989929199) { if (input[0] <= 0.6413043737411499) { if (input[2] <= 0.42877109348773956) { var0 = 8551.3466796875; } else { var0 = 8062.76416015625; } } else { if (input[5] <= 0.5) { var0 = 8765.2490234375; } else { var0 = 8964.060546875; } } } else { if (input[3] <= 0.10000000149011612) { if (input[0] <= 0.695652186870575) { var0 = 8988.1591796875; } else { var0 = 9174.1357421875; } } else { if (input[0] <= 0.6847826242446899) { if (input[1] <= 0.5) { var0 = 9778.34765625; } else { if (input[2] <= 0.38515305519104004) { var0 = 9288.0263671875; } else { var0 = 9290.1396484375; } } } else { if (input[1] <= 0.5) { var0 = 9910.359375; } else { var0 = 9964.0595703125; } } } } } else { if (input[2] <= 0.38235704600811005) { if (input[0] <= 0.6413043737411499) { var0 = 9620.3310546875; } else { var0 = 8968.330078125; } } else { if (input[8] <= 0.5) { if (input[2] <= 0.4231790453195572) { if (input[1] <= 0.5) { var0 = 10118.423828125; } else { var0 = 10141.1357421875; } } else { var0 = 10043.2490234375; } } else { var0 = 10269.4599609375; } } } } else { var0 = 11552.904296875; } } else { if (input[0] <= 0.6630434989929199) { if (input[3] <= 0.4000000134110451) { if (input[6] <= 0.5) { if (input[0] <= 0.6413043737411499) { var0 = 20878.78515625; } else { if (input[5] <= 0.5) { var0 = 28468.919921875; } else { var0 = 26392.259765625; } } } else { var0 = 8068.18505859375; } } else { if (input[3] <= 0.7000000178813934) { if (input[1] <= 0.5) { var0 = 10115.0087890625; } else { var0 = 9563.029296875; } } else { var0 = 10736.87109375; } } } else { if (input[1] <= 0.5) { if (input[3] <= 0.30000000447034836) { if (input[2] <= 0.48210540413856506) { var0 = 9866.3046875; } else { if (input[2] <= 0.5601845234632492) { var0 = 9872.701171875; } else { if (input[2] <= 0.6504962742328644) { var0 = 9880.068359375; } else { var0 = 9875.6806640625; } } } } else { if (input[5] <= 0.5) { var0 = 10848.134765625; } else { var0 = 10370.912109375; } } } else { if (input[3] <= 0.10000000149011612) { if (input[0] <= 0.70652174949646) { var0 = 8457.818359375; } else { var0 = 8798.5927734375; } } else { var0 = 9391.345703125; } } } } } } } } } else { if (input[3] <= 0.5000000149011612) { if (input[0] <= 0.5760869383811951) { if (input[2] <= 0.3987137973308563) { if (input[2] <= 0.2818397507071495) { var0 = 8211.1005859375; } else { var0 = 8219.2041015625; } } else { if (input[2] <= 0.46176426112651825) { var0 = 7633.720703125; } else { if (input[2] <= 0.5417307168245316) { var0 = 7147.47265625; } else { var0 = 7152.67138671875; } } } } else { if (input[0] <= 0.5978260636329651) { if (input[3] <= 0.20000000298023224) { var0 = 17929.302734375; } else { if (input[2] <= 0.4371591955423355) { if (input[2] <= 0.3187473565340042) { var0 = 8515.7587890625; } else { var0 = 8516.8291015625; } } else { var0 = 8527.5322265625; } } } else { if (input[0] <= 0.6847826242446899) { if (input[3] <= 0.30000000447034836) { if (input[1] <= 0.5) { if (input[0] <= 0.6195652186870575) { if (input[2] <= 0.3894868642091751) { if (input[2] <= 0.3095204383134842) { var0 = 8232.638671875; } else { var0 = 8233.09765625; } } else { var0 = 8240.58984375; } } else { if (input[3] <= 0.10000000149011612) { if (input[0] <= 0.6630434989929199) { if (input[2] <= 0.4310079514980316) { var0 = 8280.623046875; } else { var0 = 8283.6806640625; } } else { var0 = 8601.3291015625; } } else { if (input[0] <= 0.6413043737411499) { var0 = 8569.861328125; } else { var0 = 8871.1513671875; } } } } else { if (input[0] <= 0.6630434989929199) { if (input[2] <= 0.7554872035980225) { if (input[3] <= 0.10000000149011612) { if (input[2] <= 0.5063609778881073) { var0 = 7789.634765625; } else { var0 = 7804.16064453125; } } else { var0 = 7742.10986328125; } } else { var0 = 8083.919921875; } } else { if (input[2] <= 0.5463441610336304) { var0 = 8124.408203125; } else { var0 = 8125.78466796875; } } } } else { if (input[2] <= 0.5878651440143585) { if (input[0] <= 0.6630434989929199) { var0 = 8978.185546875; } else { var0 = 9304.7021484375; } } else { var0 = 8347.1640625; } } } else { if (input[1] <= 0.5) { if (input[3] <= 0.10000000149011612) { var0 = 9283.5615234375; } else { if (input[3] <= 0.30000000447034836) { var0 = 9877.607421875; } else { var0 = 10107.220703125; } } } else { if (input[3] <= 0.10000000149011612) { var0 = 8442.6669921875; } else { if (input[2] <= 0.658604770898819) { if (input[2] <= 0.452537402510643) { var0 = 9377.904296875; } else { var0 = 9386.1611328125; } } else { var0 = 9058.73046875; } } } } } } } else { if (input[0] <= 0.6847826242446899) { if (input[2] <= 0.15420101583003998) { var0 = 8605.361328125; } else { if (input[2] <= 0.621697187423706) { if (input[3] <= 0.800000011920929) { var0 = 10381.478515625; } else { var0 = 9788.8662109375; } } else { var0 = 10977.2060546875; } } } else { var0 = 19749.3828125; } } } } else { if (input[2] <= 0.5788480043411255) { if (input[2] <= 0.28169994056224823) { if (input[2] <= 0.2777855098247528) { if (input[7] <= 0.5) { if (input[3] <= 0.10000000149011612) { if (input[0] <= 0.804347813129425) { if (input[2] <= 0.18992029875516891) { if (input[8] <= 0.5) { var0 = 10197.7724609375; } else { var0 = 9991.0380859375; } } else { if (input[1] <= 0.5) { var0 = 10355.640625; } else { var0 = 10422.9169921875; } } } else { if (input[0] <= 0.8369565010070801) { if (input[6] <= 0.5) { if (input[8] <= 0.5) { var0 = 11165.41796875; } else { var0 = 11454.021484375; } } else { var0 = 10577.0869140625; } } else { if (input[6] <= 0.5) { if (input[2] <= 0.09695229306817055) { var0 = 11534.873046875; } else { if (input[8] <= 0.5) { if (input[1] <= 0.5) { var0 = 12029.287109375; } else { var0 = 11931.125; } } else { var0 = 11830.607421875; } } } else { var0 = 11345.5185546875; } } } } else { if (input[5] <= 0.5) { if (input[0] <= 0.77173912525177) { if (input[1] <= 0.5) { if (input[8] <= 0.5) { var0 = 11150.7802734375; } else { var0 = 10942.1318359375; } } else { var0 = 10065.4130859375; } } else { if (input[0] <= 0.804347813129425) { var0 = 12479.708984375; } else { if (input[0] <= 0.8369565010070801) { var0 = 12044.341796875; } else { var0 = 12032.326171875; } } } } else { if (input[3] <= 0.30000000447034836) { var0 = 25517.11328125; } else { if (input[0] <= 0.782608687877655) { var0 = 11244.376953125; } else { var0 = 13047.33203125; } } } } } else { if (input[0] <= 0.760869562625885) { var0 = 27117.994140625; } else { if (input[2] <= 0.18341952562332153) { if (input[3] <= 0.20000000298023224) { var0 = 11833.7822265625; } else { var0 = 11013.7119140625; } } else { if (input[3] <= 0.30000000447034836) { var0 = 22192.4375; } else { var0 = 12629.166015625; } } } } } else { var0 = 35160.1328125; } } else { if (input[6] <= 0.5) { if (input[2] <= 0.3917936384677887) { if (input[2] <= 0.3386690616607666) { if (input[0] <= 0.8586956262588501) { if (input[8] <= 0.5) { if (input[2] <= 0.3360128253698349) { if (input[2] <= 0.3162309229373932) { var0 = 11554.2236328125; } else { if (input[2] <= 0.3253879100084305) { var0 = 11657.71875; } else { if (input[2] <= 0.33202849328517914) { var0 = 11658.115234375; } else { var0 = 11658.37890625; } } } } else { var0 = 12096.6513671875; } } else { if (input[1] <= 0.5) { if (input[0] <= 0.79347825050354) { var0 = 11305.9345703125; } else { var0 = 11082.5771484375; } } else { var0 = 10594.501953125; } } } else { if (input[1] <= 0.5) { if (input[2] <= 0.30413809418678284) { var0 = 12222.8984375; } else { var0 = 12224.3505859375; } } else { var0 = 11735.87890625; } } } else { if (input[7] <= 0.5) { if (input[1] <= 0.5) { if (input[3] <= 0.10000000149011612) { var0 = 11286.5390625; } else { var0 = 10797.3359375; } } else { if (input[0] <= 0.79347825050354) { if (input[0] <= 0.77173912525177) { var0 = 10072.0546875; } else { var0 = 10231.5; } } else { var0 = 10796.3505859375; } } } else { var0 = 9487.64453125; } } } else { if (input[2] <= 0.41304346919059753) { if (input[2] <= 0.4048650562763214) { if (input[2] <= 0.3971060812473297) { var0 = 23045.56640625; } else { if (input[2] <= 0.4022088199853897) { var0 = 10461.9794921875; } else { var0 = 10338.931640625; } } } else { var0 = 27346.04296875; } } else { if (input[0] <= 0.79347825050354) { if (input[3] <= 0.10000000149011612) { if (input[2] <= 0.4714105427265167) { var0 = 9722.76953125; } else { var0 = 9140.951171875; } } else { if (input[3] <= 0.4000000134110451) { if (input[5] <= 0.5) { if (input[1] <= 0.5) { if (input[7] <= 0.5) { var0 = 10959.6943359375; } else { var0 = 10928.8486328125; } } else { var0 = 10825.25390625; } } else { var0 = 11512.4052734375; } } else { if (input[1] <= 0.5) { var0 = 12495.291015625; } else { if (input[2] <= 0.4382776618003845) { var0 = 11488.3173828125; } else { var0 = 11289.109375; } } } } } else { if (input[2] <= 0.4586886018514633) { if (input[2] <= 0.45204806327819824) { if (input[3] <= 0.30000000447034836) { if (input[0] <= 0.8260869383811951) { if (input[2] <= 0.4394659101963043) { var0 = 11879.1044921875; } else { var0 = 10807.486328125; } } else { if (input[5] <= 0.5) { if (input[2] <= 0.42227034270763397) { var0 = 11842.6240234375; } else { var0 = 11946.6259765625; } } else { var0 = 12430.953125; } } } else { if (input[0] <= 0.8152173757553101) { var0 = 12268.6318359375; } else { if (input[2] <= 0.42632459104061127) { var0 = 13607.369140625; } else { var0 = 13430.2646484375; } } } } else { var0 = 20781.48828125; } } else { if (input[3] <= 0.30000000447034836) { if (input[8] <= 0.5) { if (input[2] <= 0.503914400935173) { var0 = 10594.2255859375; } else { if (input[0] <= 0.8369565010070801) { var0 = 11394.0654296875; } else { var0 = 11363.283203125; } } } else { if (input[1] <= 0.5) { if (input[2] <= 0.5073395222425461) { var0 = 12231.61328125; } else { var0 = 12235.8388671875; } } else { if (input[2] <= 0.475464791059494) { var0 = 11945.1328125; } else { if (input[2] <= 0.48608967661857605) { var0 = 11356.6611328125; } else { var0 = 11743.9345703125; } } } } } else { if (input[0] <= 0.8152173757553101) { if (input[8] <= 0.5) { var0 = 11987.16796875; } else { var0 = 12269.6884765625; } } else { if (input[2] <= 0.5336920768022537) { if (input[8] <= 0.5) { if (input[5] <= 0.5) { var0 = 12949.1552734375; } else { var0 = 13224.056640625; } } else { var0 = 12643.3779296875; } } else { var0 = 12265.5068359375; } } } } } } } } else { if (input[0] <= 0.75) { if (input[3] <= 0.30000000447034836) { if (input[2] <= 0.47909966111183167) { if (input[1] <= 0.5) { var0 = 9625.919921875; } else { var0 = 9724.5302734375; } } else { if (input[1] <= 0.5) { var0 = 9634.5380859375; } else { var0 = 9144.5654296875; } } } else { var0 = 10806.8388671875; } } else { if (input[3] <= 0.10000000149011612) { if (input[0] <= 0.8152173757553101) { if (input[1] <= 0.5) { if (input[2] <= 0.4749055951833725) { var0 = 10704.4697265625; } else { var0 = 10713.6435546875; } } else { var0 = 9850.431640625; } } else { if (input[2] <= 0.32392002642154694) { if (input[2] <= 0.30294980108737946) { var0 = 11073.17578125; } else { var0 = 10965.4462890625; } } else { if (input[1] <= 0.5) { if (input[2] <= 0.33650214970111847) { var0 = 11455.2802734375; } else { if (input[2] <= 0.39801476895809174) { var0 = 11842.4423828125; } else { var0 = 11848.140625; } } } else { var0 = 11362.7548828125; } } } } else { if (input[0] <= 0.77173912525177) { if (input[1] <= 0.5) { var0 = 11163.568359375; } else { var0 = 11253.4208984375; } } else { if (input[3] <= 0.5000000149011612) { if (input[3] <= 0.30000000447034836) { var0 = 11674.1298828125; } else { var0 = 11881.3583984375; } } else { if (input[0] <= 0.804347813129425) { var0 = 12105.3203125; } else { var0 = 12363.546875; } } } } } } } } else { if (input[2] <= 0.5891933143138885) { if (input[0] <= 0.77173912525177) { var0 = 33471.97265625; } else { var0 = 30063.580078125; } } else { if (input[2] <= 0.5984901487827301) { var0 = 20462.998046875; } else { if (input[0] <= 0.8586956262588501) { if (input[2] <= 0.7205368280410767) { if (input[5] <= 0.5) { if (input[2] <= 0.6632181704044342) { if (input[1] <= 0.5) { var0 = 10579.7109375; } else { if (input[0] <= 0.760869562625885) { var0 = 10325.2060546875; } else { var0 = 10450.5517578125; } } } else { var0 = 9504.310546875; } } else { if (input[2] <= 0.6388228535652161) { var0 = 11396.900390625; } else { var0 = 11566.30078125; } } } else { if (input[7] <= 0.5) { var0 = 11576.1298828125; } else { var0 = 12592.5341796875; } } } else { if (input[2] <= 0.801621675491333) { if (input[2] <= 0.6616803705692291) { var0 = 11856.4111328125; } else { var0 = 24227.337890625; } } else { var0 = 11381.3251953125; } } } } } } } else { if (input[3] <= 0.7000000178813934) { if (input[3] <= 0.10000000149011612) { if (input[0] <= 0.9239130616188049) { if (input[1] <= 0.5) { if (input[2] <= 0.26163844764232635) { if (input[2] <= 0.2271074876189232) { if (input[5] <= 0.5) { var0 = 13012.208984375; } else { var0 = 13204.2861328125; } } else { var0 = 28923.13671875; } } else { if (input[5] <= 0.5) { if (input[2] <= 0.3525793105363846) { var0 = 12233.828125; } else { if (input[2] <= 0.4588284194469452) { var0 = 12622.1796875; } else { var0 = 12644.5888671875; } } } else { if (input[2] <= 0.2855444848537445) { var0 = 12815.4453125; } else { if (input[2] <= 0.41835591197013855) { var0 = 13217.0947265625; } else { var0 = 13228.8466796875; } } } } } else { if (input[2] <= 0.2749195992946625) { var0 = 12323.935546875; } else { if (input[2] <= 0.3439815044403076) { var0 = 30259.99609375; } else { if (input[2] <= 0.46707673370838165) { var0 = 12731.0; } else { var0 = 21797.0; } } } } } else { if (input[0] <= 0.967391312122345) { if (input[1] <= 0.5) { if (input[6] <= 0.5) { if (input[0] <= 0.945652186870575) { if (input[5] <= 0.5) { var0 = 13415.0380859375; } else { if (input[2] <= 0.33999717980623245) { var0 = 13616.3583984375; } else { var0 = 13635.6376953125; } } } else { if (input[8] <= 0.5) { var0 = 14043.4765625; } else { var0 = 13844.796875; } } } else { if (input[2] <= 0.4721095860004425) { var0 = 13041.9208984375; } else { var0 = 13470.8603515625; } } } else { if (input[0] <= 0.945652186870575) { if (input[5] <= 0.5) { if (input[8] <= 0.5) { if (input[7] <= 0.5) { var0 = 12574.048828125; } else { var0 = 12557.60546875; } } else { var0 = 12950.0712890625; } } else { var0 = 13143.3369140625; } } else { if (input[5] <= 0.5) { if (input[8] <= 0.5) { if (input[6] <= 0.5) { var0 = 12981.345703125; } else { var0 = 12957.1181640625; } } else { var0 = 13352.099609375; } } else { var0 = 13555.0048828125; } } } } else { if (input[1] <= 0.5) { if (input[0] <= 0.989130437374115) { if (input[2] <= 0.3409757614135742) { if (input[2] <= 0.20320142060518265) { var0 = 14451.8349609375; } else { if (input[2] <= 0.24702918529510498) { var0 = 14254.6083984375; } else { var0 = 14256.1923828125; } } } else { if (input[2] <= 0.4895847290754318) { var0 = 13880.94921875; } else { var0 = 13887.96875; } } } else { if (input[5] <= 0.5) { if (input[8] <= 0.5) { if (input[6] <= 0.5) { var0 = 14313.8466796875; } else { var0 = 14319.03125; } } else { var0 = 14692.6689453125; } } else { var0 = 14901.5166015625; } } } else { if (input[0] <= 0.989130437374115) { if (input[5] <= 0.5) { if (input[7] <= 0.5) { var0 = 13393.755859375; } else { var0 = 13405.390625; } } else { if (input[2] <= 0.48343348503112793) { var0 = 13974.455078125; } else { var0 = 13981.8505859375; } } } else { if (input[5] <= 0.5) { if (input[8] <= 0.5) { if (input[2] <= 0.5780790746212006) { var0 = 13822.802734375; } else { var0 = 13831.115234375; } } else { var0 = 14210.5361328125; } } else { var0 = 14410.931640625; } } } } } } else { if (input[2] <= 0.47923943400382996) { if (input[0] <= 0.945652186870575) { if (input[3] <= 0.30000000447034836) { if (input[2] <= 0.2542988657951355) { var0 = 13112.6044921875; } else { var0 = 12333.828125; } } else { if (input[7] <= 0.5) { if (input[2] <= 0.434293270111084) { if (input[2] <= 0.35181036591529846) { var0 = 14382.708984375; } else { if (input[6] <= 0.5) { var0 = 14119.6201171875; } else { var0 = 14007.2216796875; } } } else { var0 = 14590.6318359375; } } else { if (input[3] <= 0.5000000149011612) { var0 = 12925.8857421875; } else { if (input[0] <= 0.9021739363670349) { if (input[2] <= 0.30644480884075165) { var0 = 14001.1337890625; } else { var0 = 14001.287109375; } } else { var0 = 13919.8232421875; } } } } } else { if (input[2] <= 0.3959876745939255) { if (input[2] <= 0.23304906487464905) { if (input[2] <= 0.17796728014945984) { var0 = 14349.8544921875; } else { var0 = 30166.619140625; } } else { if (input[3] <= 0.5000000149011612) { if (input[3] <= 0.30000000447034836) { var0 = 13937.666015625; } else { if (input[2] <= 0.31406402587890625) { var0 = 14988.431640625; } else { var0 = 15019.759765625; } } } else { var0 = 16455.70703125; } } } else { var0 = 27000.984375; } } } else { if (input[2] <= 0.5638193488121033) { if (input[0] <= 0.967391312122345) { if (input[2] <= 0.5210400521755219) { var0 = 36910.609375; } else { if (input[0] <= 0.945652186870575) { if (input[6] <= 0.5) { var0 = 28287.8984375; } else { var0 = 27941.287109375; } } else { var0 = 31620.001953125; } } } else { var0 = 14474.6748046875; } } else { if (input[6] <= 0.5) { if (input[3] <= 0.30000000447034836) { var0 = 14418.2802734375; } else { if (input[2] <= 0.6401509642601013) { var0 = 15230.32421875; } else { var0 = 15555.1884765625; } } } else { var0 = 12347.171875; } } } } } else { var0 = 36580.28125; } } } } else { if (input[2] <= 0.36893609166145325) { if (input[0] <= 0.5) { if (input[2] <= 0.17398294061422348) { if (input[0] <= 0.45652173459529877) { if (input[0] <= 0.18478260934352875) { if (input[0] <= 0.0326086962595582) { if (input[0] <= 0.010869565419852734) { var0 = 13747.8720703125; } else { var0 = 13844.505859375; } } else { if (input[2] <= 0.12218648567795753) { if (input[3] <= 0.20000000298023224) { var0 = 14571.890625; } else { var0 = 14455.64453125; } } else { if (input[8] <= 0.5) { var0 = 15359.1044921875; } else { var0 = 14711.744140625; } } } } else { if (input[2] <= 0.04781208001077175) { var0 = 15006.5791015625; } else { if (input[6] <= 0.5) { if (input[2] <= 0.07703059166669846) { var0 = 16776.3046875; } else { var0 = 16420.494140625; } } else { var0 = 15820.69921875; } } } } else { var0 = 19444.265625; } } else { if (input[0] <= 0.0326086962595582) { if (input[5] <= 0.5) { if (input[6] <= 0.5) { if (input[8] <= 0.5) { var0 = 18223.451171875; } else { if (input[1] <= 0.5) { if (input[2] <= 0.32937224209308624) { var0 = 17468.984375; } else { var0 = 17748.505859375; } } else { var0 = 17352.6796875; } } } else { if (input[1] <= 0.5) { if (input[2] <= 0.3155319094657898) { var0 = 16884.923828125; } else { var0 = 17081.080078125; } } else { var0 = 16297.845703125; } } } else { var0 = 15518.1806640625; } } else { if (input[0] <= 0.43478260934352875) { if (input[2] <= 0.21515446156263351) { if (input[0] <= 0.15217391215264797) { var0 = 26125.673828125; } else { if (input[7] <= 0.5) { var0 = 18765.875; } else { var0 = 19361.998046875; } } } else { if (input[2] <= 0.23018310964107513) { if (input[7] <= 0.5) { if (input[1] <= 0.5) { var0 = 17496.306640625; } else { var0 = 17904.52734375; } } else { var0 = 16577.779296875; } } else { if (input[0] <= 0.1304347775876522) { if (input[0] <= 0.08695651963353157) { if (input[0] <= 0.05434782616794109) { var0 = 17560.37890625; } else { var0 = 17942.10546875; } } else { var0 = 18328.23828125; } } else { if (input[3] <= 0.7000000178813934) { if (input[5] <= 0.5) { if (input[2] <= 0.32937227189540863) { if (input[0] <= 0.3586956560611725) { if (input[0] <= 0.21739130467176437) { var0 = 18310.7421875; } else { if (input[2] <= 0.31720952689647675) { if (input[0] <= 0.30434782803058624) { if (input[1] <= 0.5) { var0 = 19107.779296875; } else { var0 = 19199.943359375; } } else { if (input[6] <= 0.5) { var0 = 18972.494140625; } else { var0 = 19040.876953125; } } } else { var0 = 19521.96875; } } } else { if (input[7] <= 0.5) { var0 = 20234.85546875; } else { var0 = 19539.2421875; } } } else { if (input[8] <= 0.5) { if (input[2] <= 0.3618062138557434) { if (input[3] <= 0.4000000134110451) { var0 = 19719.6953125; } else { var0 = 19933.45703125; } } else { var0 = 19350.369140625; } } else { var0 = 20745.98828125; } } } else { if (input[3] <= 0.30000000447034836) { var0 = 20296.86328125; } else { var0 = 20984.09375; } } } else { var0 = 21472.478515625; } } } } } else { if (input[3] <= 0.10000000149011612) { var0 = 20149.322265625; } else { if (input[2] <= 0.34384170174598694) { if (input[6] <= 0.5) { var0 = 21659.9296875; } else { var0 = 21082.16015625; } } else { var0 = 22462.04296875; } } } } } } else { if (input[0] <= 0.8152173757553101) { if (input[2] <= 0.3049768954515457) { if (input[0] <= 0.6195652186870575) { if (input[8] <= 0.5) { if (input[2] <= 0.20103450864553452) { if (input[0] <= 0.554347813129425) { if (input[2] <= 0.1367957405745983) { var0 = 19798.0546875; } else { var0 = 19964.74609375; } } else { var0 = 19594.810546875; } } else { var0 = 19515.541015625; } } else { if (input[0] <= 0.532608687877655) { var0 = 21348.705078125; } else { if (input[3] <= 0.30000000447034836) { if (input[2] <= 0.23640429228544235) { var0 = 21677.283203125; } else { var0 = 21774.322265625; } } else { var0 = 21880.8203125; } } } } else { if (input[3] <= 0.30000000447034836) { if (input[8] <= 0.5) { if (input[1] <= 0.5) { if (input[7] <= 0.5) { var0 = 23401.306640625; } else { var0 = 23244.791015625; } } else { var0 = 21978.677734375; } } else { var0 = 24393.623046875; } } else { if (input[2] <= 0.241437129676342) { if (input[0] <= 0.77173912525177) { if (input[3] <= 0.5000000149011612) { var0 = 24667.419921875; } else { if (input[0] <= 0.75) { var0 = 24869.8359375; } else { var0 = 24873.384765625; } } } else { var0 = 25382.296875; } } else { if (input[0] <= 0.6630434989929199) { if (input[8] <= 0.5) { var0 = 24180.93359375; } else { var0 = 24535.69921875; } } else { if (input[8] <= 0.5) { var0 = 23306.546875; } else { var0 = 23807.240234375; } } } } } } else { if (input[2] <= 0.3075632154941559) { var0 = 37829.72265625; } else { if (input[8] <= 0.5) { if (input[3] <= 0.4000000134110451) { if (input[0] <= 0.5760869681835175) { var0 = 22144.03125; } else { if (input[0] <= 0.6413043737411499) { var0 = 23065.419921875; } else { var0 = 23568.271484375; } } } else { var0 = 25309.48828125; } } else { if (input[0] <= 0.5760869681835175) { var0 = 32787.45703125; } else { var0 = 24915.220703125; } } } } } else { if (input[2] <= 0.22955402731895447) { if (input[8] <= 0.5) { if (input[2] <= 0.18341952562332153) { var0 = 27037.9140625; } else { var0 = 26926.513671875; } } else { var0 = 25678.779296875; } } else { if (input[0] <= 0.8695652186870575) { if (input[7] <= 0.5) { var0 = 27218.4375; } else { var0 = 27533.912109375; } } else { if (input[2] <= 0.2732419818639755) { var0 = 27808.724609375; } else { if (input[0] <= 0.9130434989929199) { var0 = 30184.9375; } else { if (input[5] <= 0.5) { if (input[0] <= 0.989130437374115) { if (input[0] <= 0.95652174949646) { var0 = 28868.6640625; } else { var0 = 28950.46875; } } else { var0 = 29330.982421875; } } else { var0 = 29523.166015625; } } } } } } } } else { if (input[0] <= 0.70652174949646) { if (input[0] <= 0.18478260934352875) { if (input[2] <= 0.5255836248397827) { if (input[2] <= 0.38850829005241394) { if (input[1] <= 0.5) { if (input[2] <= 0.3717321306467056) { var0 = 33307.55078125; } else { if (input[8] <= 0.5) { var0 = 33900.65234375; } else { var0 = 33907.546875; } } } else { var0 = 32548.33984375; } } else { if (input[0] <= 0.05434782709926367) { if (input[8] <= 0.5) { if (input[7] <= 0.5) { if (input[5] <= 0.5) { if (input[2] <= 0.5042639076709747) { var0 = 34779.61328125; } else { var0 = 34828.65234375; } } else { var0 = 34617.83984375; } } else { if (input[2] <= 0.43562139570713043) { var0 = 34303.16796875; } else { var0 = 34439.85546875; } } } else { var0 = 33750.29296875; } } else { if (input[5] <= 0.5) { if (input[0] <= 0.1304347850382328) { if (input[1] <= 0.5) { var0 = 35595.58984375; } else { var0 = 35585.57421875; } } else { var0 = 36085.21875; } } else { var0 = 34254.0546875; } } } } else { if (input[2] <= 0.7939325869083405) { if (input[2] <= 0.7180203795433044) { if (input[2] <= 0.6065986156463623) { if (input[2] <= 0.5740248262882233) { if (input[0] <= 0.0652173925191164) { var0 = 37465.34375; } else { var0 = 37484.44921875; } } else { var0 = 37165.1640625; } } else { if (input[2] <= 0.6816720366477966) { if (input[0] <= 0.08695652149617672) { var0 = 38344.56640625; } else { var0 = 38126.24609375; } } else { var0 = 38792.6875; } } } else { if (input[3] <= 0.10000000149011612) { var0 = 39722.74609375; } else { var0 = 40904.19921875; } } } else { if (input[3] <= 0.30000000447034836) { var0 = 44501.3984375; } else { var0 = 42112.234375; } } } } else { if (input[2] <= 0.5186634659767151) { if (input[0] <= 0.44565217196941376) { if (input[3] <= 0.10000000149011612) { if (input[0] <= 0.22826086729764938) { var0 = 34672.1484375; } else { if (input[6] <= 0.5) { if (input[7] <= 0.5) { var0 = 37270.15234375; } else { var0 = 37742.57421875; } } else { if (input[1] <= 0.5) { var0 = 37079.37109375; } else { if (input[0] <= 0.29347826540470123) { var0 = 36197.69921875; } else { var0 = 35491.640625; } } } } } else { if (input[2] <= 0.39843417704105377) { var0 = 43943.875; } else { if (input[2] <= 0.4528169482946396) { var0 = 37701.875; } else { if (input[2] <= 0.4847616106271744) { if (input[8] <= 0.5) { var0 = 40182.24609375; } else { var0 = 39983.42578125; } } else { if (input[5] <= 0.5) { if (input[3] <= 0.4000000134110451) { var0 = 38709.17578125; } else { var0 = 38746.35546875; } } else { var0 = 39047.28515625; } } } } } } else { if (input[0] <= 0.6847826242446899) { if (input[2] <= 0.4509296864271164) { if (input[3] <= 0.5000000149011612) { if (input[5] <= 0.5) { if (input[3] <= 0.30000000447034836) { if (input[2] <= 0.38815879821777344) { var0 = 39725.51953125; } else { var0 = 39727.61328125; } } else { var0 = 40003.33203125; } } else { if (input[0] <= 0.52173912525177) { var0 = 39125.33203125; } else { var0 = 39556.49609375; } } } else { if (input[7] <= 0.5) { var0 = 40720.55078125; } else { var0 = 40941.28515625; } } } else { if (input[3] <= 0.10000000149011612) { var0 = 40974.1640625; } else { var0 = 41034.22265625; } } } else { if (input[6] <= 0.5) { if (input[2] <= 0.42632459104061127) { var0 = 41097.16015625; } else { var0 = 41919.09765625; } } else { var0 = 42856.83984375; } } } } else { if (input[1] <= 0.5) { if (input[0] <= 0.42391304671764374) { if (input[0] <= 0.27173912525177) { var0 = 40932.4296875; } else { if (input[8] <= 0.5) { var0 = 58571.07421875; } else { var0 = 55135.40234375; } } } else { if (input[2] <= 0.574024885892868) { if (input[0] <= 0.6195652186870575) { var0 = 42111.6640625; } else { var0 = 42969.8515625; } } else { if (input[2] <= 0.6064588129520416) { var0 = 48885.13671875; } else { if (input[2] <= 0.7401090264320374) { if (input[0] <= 0.54347825050354) { var0 = 43896.375; } else { var0 = 42983.45703125; } } else { var0 = 45863.203125; } } } } } else { if (input[0] <= 0.2391304299235344) { if (input[3] <= 0.10000000149011612) { var0 = 39611.7578125; } else { var0 = 51194.55859375; } } else { if (input[0] <= 0.42391303181648254) { if (input[2] <= 0.5340415835380554) { var0 = 36950.2578125; } else { if (input[3] <= 0.30000000447034836) { if (input[7] <= 0.5) { var0 = 39774.27734375; } else { var0 = 39871.703125; } } else { if (input[0] <= 0.27173912525177) { var0 = 39241.44140625; } else { var0 = 38711.0; } } } } else { if (input[2] <= 0.6586047112941742) { if (input[2] <= 0.5325038433074951) { var0 = 40273.64453125; } else { if (input[3] <= 0.10000000149011612) { var0 = 41676.08203125; } else { if (input[3] <= 0.5000000149011612) { if (input[3] <= 0.30000000447034836) { var0 = 42211.13671875; } else { var0 = 42560.4296875; } } else { if (input[0] <= 0.4891304224729538) { var0 = 41949.2421875; } else { var0 = 42124.515625; } } } } } else { var0 = 46151.125; } } } } } } } else { if (input[3] <= 0.5000000149011612) { if (input[0] <= 0.8369565010070801) { if (input[2] <= 0.6463022232055664) { if (input[2] <= 0.4048650711774826) { var0 = 41999.51953125; } else { if (input[2] <= 0.4953865110874176) { if (input[5] <= 0.5) { if (input[8] <= 0.5) { var0 = 43813.8671875; } else { var0 = 43921.18359375; } } else { var0 = 43254.41796875; } } else { if (input[5] <= 0.5) { if (input[0] <= 0.760869562625885) { var0 = 44400.40625; } else { var0 = 44423.8046875; } } else { var0 = 44641.19921875; } } } } else { if (input[0] <= 0.72826087474823) { var0 = 47462.89453125; } else { var0 = 47269.85546875; } } } else { if (input[2] <= 0.4420522451400757) { if (input[7] <= 0.5) { if (input[0] <= 0.989130437374115) { var0 = 47305.3046875; } else { var0 = 47291.0546875; } } else { var0 = 45008.95703125; } } else { if (input[2] <= 0.4620438665151596) { var0 = 52590.828125; } else { if (input[2] <= 0.5459946095943451) { if (input[2] <= 0.5278903543949127) { if (input[0] <= 0.989130437374115) { var0 = 47055.53125; } else { var0 = 46889.26171875; } } else { var0 = 47403.87890625; } } else { if (input[7] <= 0.5) { if (input[0] <= 0.9239130616188049) { if (input[2] <= 0.6016356647014618) { var0 = 47896.79296875; } else { var0 = 48173.359375; } } else { if (input[3] <= 0.10000000149011612) { var0 = 48824.44921875; } else { var0 = 48517.5625; } } } else { if (input[0] <= 0.9021739363670349) { if (input[2] <= 0.6939745247364044) { var0 = 48970.24609375; } else { var0 = 48675.51953125; } } else { var0 = 48673.55859375; } } } } } } } else { if (input[0] <= 0.75) { var0 = 60021.3984375; } else { if (input[2] <= 0.6122605502605438) { if (input[0] <= 0.9347826242446899) { if (input[1] <= 0.5) { var0 = 46661.44140625; } else { var0 = 46130.52734375; } } else { var0 = 46718.1640625; } } else { var0 = 48549.1796875; } } } } } } return var0; } }
This function deploys the entire ML pipeline on the cloud.
AWS: When deploying model on AWS S3, environment variables must be configured using the command-line interface. To configure AWS environment variables, type aws configure
in terminal. The following information is required which can be generated using the Identity and Access Management (IAM) portal of your amazon console account:
GCP: To deploy a model on Google Cloud Platform ('gcp'), the project must be created using the command-line or GCP console. Once the project is created, you must create a service account and download the service account key as a JSON file to set environment variables in your local environment. Learn more about it: https://cloud.google.com/docs/authentication/production
Azure: To deploy a model on Microsoft Azure ('azure'), environment variables for the connection string must be set in your local environment. Go to settings of storage account on Azure portal to access the connection string required. AZURE_STORAGE_CONNECTION_STRING (required as environment variable) Learn more about it: https://docs.microsoft.com/en-us/azure/storage/blobs/storage-quickstart-blobs-python?toc=%2Fpython%2Fazure%2FTOC.json
# deploy model on aws s3
# deploy_model(best, model_name = 'my_first_platform_on_aws',
# platform = 'aws', authentication = {'bucket' : 'pycaret-test'})
# load model from aws s3
# loaded_from_aws = load_model(model_name = 'my_first_platform_on_aws', platform = 'aws',
# authentication = {'bucket' : 'pycaret-test'})
# loaded_from_aws
This function saves the transformation pipeline and a trained model object into the current working directory as a pickle file for later use.
# save model
save_model(best, 'my_first_model')
Transformation Pipeline and Model Successfully Saved
(Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))), ('ordinal_encoding', TransformerW... 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))), ('onehot_encoding', TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))), ('normalize', TransformerWrapper(transformer=MinMaxScaler())), ('trained_model', GradientBoostingRegressor(random_state=123))]), 'my_first_model.pkl')
# load model
loaded_from_disk = load_model('my_first_model')
loaded_from_disk
Transformation Pipeline and Model Successfully Loaded
Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))), ('ordinal_encoding', TransformerW... 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))), ('onehot_encoding', TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))), ('normalize', TransformerWrapper(transformer=MinMaxScaler())), ('trained_model', GradientBoostingRegressor(random_state=123))])In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
Pipeline(memory=FastMemory(location=C:\Users\owner\AppData\Local\Temp\joblib), steps=[('numerical_imputer', TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())), ('categorical_imputer', TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))), ('ordinal_encoding', TransformerW... 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))), ('onehot_encoding', TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))), ('normalize', TransformerWrapper(transformer=MinMaxScaler())), ('trained_model', GradientBoostingRegressor(random_state=123))])
TransformerWrapper(include=['age', 'bmi', 'children'], transformer=SimpleImputer())
SimpleImputer()
SimpleImputer()
TransformerWrapper(include=['sex', 'smoker', 'region'], transformer=SimpleImputer(strategy='most_frequent'))
SimpleImputer(strategy='most_frequent')
SimpleImputer(strategy='most_frequent')
TransformerWrapper(include=['sex', 'smoker'], transformer=OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}]))
OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}])
OrdinalEncoder(cols=['sex', 'smoker'], handle_missing='return_nan', mapping=[{'col': 'sex', 'mapping': {nan: -1, 'female': 0, 'male': 1}}, {'col': 'smoker', 'mapping': {nan: -1, 'no': 0, 'yes': 1}}])
TransformerWrapper(include=['region'], transformer=OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True))
OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True)
OneHotEncoder(cols=['region'], handle_missing='return_nan', use_cat_names=True)
TransformerWrapper(transformer=MinMaxScaler())
MinMaxScaler()
MinMaxScaler()
GradientBoostingRegressor(random_state=123)
This function saves all the experiment variables on disk, allowing to later resume without rerunning the setup function.
# save experiment
save_experiment('my_experiment')
# load experiment from disk
exp_from_disk = load_experiment('my_experiment', data=data)
Description | Value | |
---|---|---|
0 | Session id | 123 |
1 | Target | charges |
2 | Target type | Regression |
3 | Original data shape | (1338, 7) |
4 | Transformed data shape | (1338, 10) |
5 | Transformed train set shape | (936, 10) |
6 | Transformed test set shape | (402, 10) |
7 | Ordinal features | 2 |
8 | Numeric features | 3 |
9 | Categorical features | 3 |
10 | Preprocess | True |
11 | Imputation type | simple |
12 | Numeric imputation | mean |
13 | Categorical imputation | mode |
14 | Maximum one-hot encoding | 25 |
15 | Encoding method | None |
16 | Normalize | True |
17 | Normalize method | minmax |
18 | Fold Generator | KFold |
19 | Fold Number | 10 |
20 | CPU Jobs | -1 |
21 | Use GPU | False |
22 | Log Experiment | False |
23 | Experiment Name | reg-default-name |
24 | USI | 7443 |