Randomly select points from the -interval and the corresponding (noisy) target values. Train the linear model with exact interpolation and default width ( ) on these training points. Measure the mean squared error (MSE) between the original function (without noise) and the predictions of the linear model on the whole -interval. Repeat the experiment at least 20 times for every value of to obtain a more reliable estimate of the true MSE. Plot the MSE and the standard error of the MSE (with error bars) as a function of the number of basis functions .
Set the number of basis functions to the lowest value with which you still obtain a reliably good prediction. Manually select good positions for the RBF centers (explain how you chose them!) and train the weights. Plot the prediction of the network and the target curve in one figure.
Use the same RBF centers as in b). Now change the width of the RBF and investigate how the prediction changes. Plot the MSE as a function of the RBF width and plot the predictions of the network when the width is either too small or to wide. Explain what you find.