p. 1 of 1
EE 660 Homework Week 6
1. AML Problem 2.24 (page 75), except
Replace part (a) with:
(a.1) For a single given dataset, give an expression for (AML
notation).
(a.2) Find analytically; express your answer in simplest form.
For parts (b) and (c), obtain by direct numerical computation, not by
adding bias and var.
2. AML Problem 4.4 (a)-(c), plus additional parts (i)-(iii) below.
For part (c), assume both and are given as functions of x, and you
can express your answer in terms of them; and define
.
(i) In Fig. 4.3(a), set σ" = 0.5, and traverse the horizontal line from N ≈ 60 to N ≈
130. Explain why ℋ-. transitions from overfit to good fit (relative to ℋ").
(ii) Also in Fig. 4.3(a), set N = 100, and traverse the vertical line from σ" = 0 to
σ" = 2. Explain why ℋ-. transitions from good fit to overfit (relative to ℋ").
(iii) In Fig. 4.3(b), set N ≈ 75, and traverse the vertical line from Q3 = 0 to Q3 =
100. Explain the behavior.
Reading
Regularization (AML perspective)
AML 4.2 (pp. 126-137).
Problems on reading
4. AML Exercise 4.5 (p. 131).
g(D)
( x)
g ( x)
ΕD E{ out}
g10 ( x) f ( x)
Eout g10 ( ) = Εx,y g10 ⎡ ( x) − y( x) ⎣ ⎤
⎦
2
{ }
