000
001
002
003
004
005
006
007
008
009
010
011
012
013
014
015
016
017
018
019
020
021
022
023
024
025
026
027
028
029
030
031
032
033
034
035
036
037
038
039
040
041
042
043
044
045
046
047
048
049
050
051
052
053
054
055
056
057
058
059
ece, Deep Learning – Assignment 2
Submit by Sept. , pm
tldr: Perform binary classification on the spirals dataset using a multi-layer
perceptron. You must generate the data yourself.
Problem Statement Consider a set of examples with two classes and distributions as
in Figure 1. Given the vector x ∈ R
2
infer its target class t ∈ {0, 1}. As a model
use a multi-layer perceptron f which returns an estimate for the conditional
density p(t = 1 | x):
f : R
2 → [0, 1] (1)
parametrisized by some set of values θ. All of the examples in the training set
should be classified correctedly (i.e. p(t = 1 | x) > 0.5 if and only if t = 1).
Impose an L
2 penalty on the set of parameters. Produce one plot. Show the
examples and the boundary corresponding to p(t = 1 | x) = 0.5. The plot must be
of suitable visual quality. It may be difficult to to find an appropriate functional
form for f, write a few sentences discussing your various attempts.
−10 −5 0 5 10
−15
−10
−5
0
5
10
15
Spirals
Figure 1: Sample spiral data.
