Myujth

I've put standardScaler on the pipeline, and
the results of CV_mlpregressor.predict(x_test), are weird. I think i must have to bring the values back from the standardScaler, but still can't figure how.

pipe_MLPRegressor = Pipeline([('scaler', StandardScaler()),
 ('MLPRegressor', MLPRegressor(random_state = 42))])


grid_params_MLPRegressor = [
 'MLPRegressor__solver': ['lbfgs'],
 'MLPRegressor__max_iter': [100,200,300,500],
 'MLPRegressor__activation' : ['relu','logistic','tanh'],
 'MLPRegressor__hidden_layer_sizes':[(2,), (4,),(2,2),(4,4),(4,2),(10,10),(2,2,2)],
]


CV_mlpregressor = GridSearchCV (estimator = pipe_MLPRegressor,
 param_grid = grid_params_MLPRegressor,
 cv = 5,return_train_score=True, verbose=0)

CV_mlpregressor.fit(x_train, y_train)

CV_mlpregressor.predict(x_test)

The Results:

array([ 2.67564153e+04, 1.90010572e+04, 9.62702942e+04, 3.98791931e+04,
 1.48889808e+03, 7.08980726e+03, 3.86311279e+02, 7.05602301e+04,
 4.06858486e+03, 4.29186303e+04, 3.86701735e+03, 6.30228075e+04,
 6.78276925e+04, -5.91956287e+02, -7.37680434e+02, 3.07485001e+04,
 4.81417953e+03, 5.18697686e+03, 1.61221952e+04, 1.33794944e+04,
 -1.48375101e+03, 1.80891807e+04, 1.39740243e+04, 6.57156849e+04,
 3.32962481e+04, 5.71332087e+05, 1.79130092e+03, 5.25642370e+04,
 2.08111172e+04, 4.31060127e+04])

Thanks in advance.

@Lian, I think you are doing everything in the correct way. Please check your data. I did an experiment with sklearn dataset and this works as expected.

from sklearn.preprocessing import StandardScaler
from sklearn.neural_network import MLPRegressor
from sklearn.pipeline import Pipeline
from sklearn.model_selection import GridSearchCV
from sklearn.datasets import load_boston
from sklearn.model_selection import train_test_split
import numpy as np

x,y = load_boston(return_X_y=True)


xtrain, xtest, ytrain, ytest = train_test_split(x,y, random_state=6784)

pipe_MLPRegressor = Pipeline([('scaler', StandardScaler()),
 ('MLPRegressor', MLPRegressor(random_state = 42))])
grid_params_MLPRegressor = [
 'MLPRegressor__solver': ['lbfgs'],
 'MLPRegressor__max_iter': [100,200,300,500],
 'MLPRegressor__activation' : ['relu','logistic','tanh'],
 'MLPRegressor__hidden_layer_sizes':[(2,), (4,),(2,2),(4,4),(4,2),(10,10),(2,
2,2)],]


CV_mlpregressor = GridSearchCV (estimator = pipe_MLPRegressor,
 param_grid = grid_params_MLPRegressor,
 cv = 5,return_train_score=True, verbose=0)

CV_mlpregressor.fit(xtrain, ytrain)

ypred=CV_mlpregressor.predict(xtest)

print np.c_[ytest, ypred]

This prints

array([[ 29.9 , 30.79749986],
 [ 22.5 , 24.52180656],
 [ 22.6 , 18.9567779 ],
 [ 28.7 , 22.17189123],
 [ 13.8 , 19.16797811],
 [ 21.2 , 24.63527335],
 [ 11.3 , 13.58962076],
 [ 23. , 18.33693455],
 [ 12.7 , 15.52294714],
 [ 23.3 , 26.65083451],
 [ 25.3 , 24.04219813],
 [ 22.6 , 19.81454969],
 [ 36.2 , 22.16994764],
 [ 17.9 , 11.1221789 ],
 [ 18.5 , 17.84162452],
 [ 16.8 , 22.99832673],
 [ 20.3 , 20.22598426],
 [ 23.9 , 26.80997945],
 [ 17.6 , 16.08188321],
 [ 23.2 , 18.5995955 ],
 [ 48.3 , 43.37911488],
 [ 19.1 , 22.36379857],