How to save scikit-learn MULTIPLE classifier models with python pickle library (or any efficient others) [duplicate]

Question

In general, we could use pickle to save ONE classifier model. Is there a way to save MULTIPLE classifier models in one pickle? If yes, how could we save the model and retrieve it later?

For instance, (the minimum working example)

from sklearn import model_selection
from sklearn.linear_model import LogisticRegression
from sklearn.tree import DecisionTreeClassifier
from numpy.random import rand, randint 

models = []
models.append(('LogisticReg', LogisticRegression(random_state=123)))
models.append(('DecisionTree', DecisionTreeClassifier(random_state=123)))
# evaluate each model in turn
results_all = []
names = []
dict_method_score = {}
scoring = 'f1'

X = rand(8, 4)
Y = randint(2, size=8)

print("Method: Average (Standard Deviation)\n")
for name, model in models:
    kfold = model_selection.KFold(n_splits=2, random_state=999)
    cv_results = model_selection.cross_val_score(model, X, Y, cv=kfold, scoring=scoring)
    results_all.append(cv_results)
    names.append(name)
    dict_method_score[name] = (cv_results.mean(), cv_results.std())
    print("{:s}: {:.3f} ({:.3f})".format(name, cv_results.mean(), cv_results.std()))

Purpose: Change some hyperparameters (say n_splits in cross validation) using the same setup and retrieve the model later.

Thanks for the additional info. I was thinking to save the "model". But as what @RyanWalker has suggested, essentially those are just objects. — udothemath
– udothemath, Commented Oct 23, 2017 at 12:59

Ryan Walker · Accepted Answer · 2017-10-22 15:42:41Z

15

You can save multiple objects into the same pickle:

with open("models.pckl", "wb") as f:
    for model in models:
         pickle.dump(model, f)

You can then load back your models into memory one at a time:

models = []
with open("models.pckl", "rb") as f:
    while True:
        try:
            models.append(pickle.load(f))
        except EOFError:
            break

answered Oct 22, 2017 at 15:42

Ryan Walker

3,2861 gold badge26 silver badges29 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

udothemath Over a year ago

Thanks for the nice and clean response.

Collectives™ on Stack Overflow

How to save scikit-learn MULTIPLE classifier models with python pickle library (or any efficient others) [duplicate]

1 Answer 1

1 Comment

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Linked

Related