Running self defined function shows "AttributeError: 'module' object has no attribute "

Question

I defined a class for feature union. The python 2.7 complain "AttributeError: 'module' object has no attribute "TextTransformer". The code can be runned on Kaggle's platform but cannot run on my local ipython.

from sklearn.base import BaseEstimator, TransformerMixin
class TextTransformer(BaseEstimator, TransformerMixin):
    def __init__(self, key):
        self.key = key
    def fit(self, x, y=None):
        return self
    def transform(self, data_dict):
        return data_dict[self.key].apply(str)

rfr = RandomForestRegressor()
tfidf = TfidfVectorizer()
tsvd = TruncatedSVD(n_components=10)
clf = pipeline.Pipeline([
    ('union', FeatureUnion(
                transformer_list = [
                    ('txt1', pipeline.Pipeline([('s1', TextTransformer(key='search_term')), ('tfidf1', tfidf), ('tsvd1', tsvd)])),
                    ('txt2', pipeline.Pipeline([('s2', TextTransformer(key='product_title')), ('tfidf2', tfidf), ('tsvd2', tsvd)])),
                    ('txt3', pipeline.Pipeline([('s3', TextTransformer(key='product_description')), ('tfidf3', tfidf), ('tsvd3', tsvd)])),
                    ('txt4', pipeline.Pipeline([('s4', TextTransformer(key='brand')), ('tfidf4', tfidf), ('tsvd4', tsvd)]))
                    ],
                transformer_weights = {
                    'txt1': 0.5,
                    'txt2': 0.25,
                    'txt3': 0.25,
                    'txt4': 0.5
                    },
            n_jobs = -1
            )), 
    ('rfr', rfr)])
param_grid = {'rfr__max_features': [10], 'rfr__max_depth': [20]}
model = grid_search.GridSearchCV(estimator = clf, param_grid = param_grid,n_jobs = -1, cv = 10)         
model.fit(X_train, y_train)

B. Chappet · Accepted Answer · 2016-02-20 10:33:04Z

1

You probably forgot some import. Try this, it is working for me.

from sklearn.base import TransformerMixin
from sklearn.ensemble  import  RandomForestRegressor
from sklearn.feature_extraction import *
from sklearn.feature_extraction.text import *
from sklearn.decomposition import  *
from sklearn.pipeline import *
from sklearn.grid_search import *

class TextTransformer(TransformerMixin):
    def __init__(self, key):
        self.key = key

    def fit(self, x, y=None):
        return self

    def transform(self, data_dict):
        return data_dict[self.key].apply(str)

rfr = RandomForestRegressor()
tfidf = TfidfVectorizer()
tsvd = TruncatedSVD(n_components=10)
clf = Pipeline([
    ('union', FeatureUnion(
                transformer_list = [
                    ('txt1', Pipeline([('s1', TextTransformer(key='search_term')), ('tfidf1', tfidf), ('tsvd1', tsvd)])),
                    ('txt2', Pipeline([('s2', TextTransformer(key='product_title')), ('tfidf2', tfidf), ('tsvd2', tsvd)])),
                    ('txt3', Pipeline([('s3', TextTransformer(key='product_description')), ('tfidf3', tfidf), ('tsvd3', tsvd)])),
                    ('txt4', Pipeline([('s4', TextTransformer(key='brand')), ('tfidf4', tfidf), ('tsvd4', tsvd)]))
                    ],
                transformer_weights = {
                    'txt1': 0.5,
                    'txt2': 0.25,
                    'txt3': 0.25,
                    'txt4': 0.5
                    },
            n_jobs = -1
            )), 
    ('rfr', rfr)])
param_grid = {'rfr__max_features': [10], 'rfr__max_depth': [20]}
model = GridSearchCV(estimator = clf, param_grid = param_grid,n_jobs = -1, cv = 10)         
model.fit(X_train, y_train)

answered Feb 20, 2016 at 10:33

B. Chappet

111 bronze badge

Sign up to request clarification or add additional context in comments.

3 Comments

eriee Over a year ago

Thank you for answering. But I have those imports. The error doesn't show on the ipython notebook but on the console panel. And ipython gives no response after running the code.

B. Chappet Over a year ago

Sorry I misunderstood your error. I think you forgot to extend BaseEstimator. You should try with : class TextTransformer(BaseEstimator,TransformerMixin)

eriee Over a year ago

Also, the original code has the baseEstimator.. But I still have the errors. Do you run the script successfully on ipython?

Collectives™ on Stack Overflow

Running self defined function shows "AttributeError: 'module' object has no attribute "

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related