Databases
StackOverflow2013
Postsdbo
POneural networks regression using pybrain
Body
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POneural networks regression using pybrain
    text
    copied!<p>I need to solve a regression problem with a feed forward network and I've been trying to use PyBrain to do it. Since there are no examples of regression on pybrain's reference, I tried to adapt it's classification example for regression instead, but with no success (The classification example can be found here: <a href="http://pybrain.org/docs/tutorial/fnn.html" rel="noreferrer">http://pybrain.org/docs/tutorial/fnn.html</a>). Following is my code:</p> <p>This first function converts my data in numpy array form to a pybrain SupervisedDataset. I use the SupervisedDataset because according to pybrain's reference it is the dataset to use when the problem is regression. The parameters are an array with the feature vectors (data) and their expected output (values):</p> <pre class="lang-py prettyprint-override"><code>def convertDataNeuralNetwork(data, values): fulldata = SupervisedDataSet(data.shape[1], 1) for d, v in zip(data, values): fulldata.addSample(d, v) return fulldata </code></pre> <p>Next, is the function to run the regression. train_data and train_values are the train feature vectors and their expected output, test_data and test_values are the test feature vectors and their expected output:</p> <pre class="lang-py prettyprint-override"><code>regressionTrain = convertDataNeuralNetwork(train_data, train_values) regressionTest = convertDataNeuralNetwork(test_data, test_values) fnn = FeedForwardNetwork() inLayer = LinearLayer(regressionTrain.indim) hiddenLayer = LinearLayer(5) outLayer = GaussianLayer(regressionTrain.outdim) fnn.addInputModule(inLayer) fnn.addModule(hiddenLayer) fnn.addOutputModule(outLayer) in_to_hidden = FullConnection(inLayer, hiddenLayer) hidden_to_out = FullConnection(hiddenLayer, outLayer) fnn.addConnection(in_to_hidden) fnn.addConnection(hidden_to_out) fnn.sortModules() trainer = BackpropTrainer(fnn, dataset=regressionTrain, momentum=0.1, verbose=True, weightdecay=0.01) for i in range(10): trainer.trainEpochs(5) res = trainer.testOnClassData(dataset=regressionTest ) print res </code></pre> <p>when I print res, all it's values are 0. I've tried to use the buildNetwork function as a shortcut to build the network, but it didn't work as well. I've also tried different kinds of layers and different number of nodes in the hidden layer, with no luck.</p> <p>Does somebody have any idea of what I am doing wrong? Also, some pybrain regression examples would really help! I couldn't find any when I looked.</p> <p>Thanks in advance</p>
 

Querying!

 
Guidance
An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload