Assignment 1 Performance Learning for Linear Prediction

Machine Learning and Adaptive Systems
(ECE656)
Computer Assignment 1 (Performance Learning for Linear Prediction- Due March
1, 2022)
The purpose of this computer assignment is to show how performance learning can be
used to estimate the unknown parameters of a linear predictor directly from the data.
You can MATLAB toolboxes on any other software for this assignment.
1. Download 3-years worth of historical data associated with the daily closing price of a
particular stock index (e.g., APPLE) from one of the financial sites e.g.,
http://finance.yahoo.com/. Use 1/3 of the data for training and the rest for validation
and testing.
2. Consider your data as a time series that could be modeled using a linear
autoregressive (AR) model of the form,
where N is the order of the AR process, e(n) is the driving input which is assumed to
be a zero mean white Gaussian random process with variance σ2
e , and ai’ s are the
model parameters that need to be estimated via the training.
3. Choose N=3 i.e. a 3rd order AR model and using an appropriate learning rule covered
in class, devise a scheme to estimate the parameters a1, a2 and a3 directly from the
data. Present the plot of the learning curve of your algorithm. Check the validity of
your results by comparing them with those of the Wiener-Hopf solution using w*
=
Rxx-1 Rxd. Comment on the convergence behavior and accuracy (i.e. misadjustment vs
speed) of the learning.
4. Study the effects of step size µ on the results. Choose µ= 10-4 and 10-5 and compare
the results.
5. Validate the performance of your stock price predictor,
on the validation data set by determining the MSE of the estimates i.e
∑=
= −
N
n
y n y n
N 1
2 ( ( ) ˆ( )) 1
ε and distribution of the error. How reliable is your predictor?
What are the issues with this predictor?
6. Test the behavior of this adaptive predictor on the testing data and comment on the
performance.
7. Provide your results and thorough discussions on your results in a brief report.
Note: Please follow the posted guidelines for preparing good reports.
( ) ( 1) ( 2) ... ( ) ( ) y n = a1 y n − + a2 y n − + aN y n − N + e n
ˆ( ) ( 1) ( 2) ... ( ) y n = a1 y n − + a2 y n − + aN y n − N