Question: Consider the problem of separating N data points into positive and negative examples using a linear separator. Clearly, this can always be done for N = 2 points on a line of dimension d = 1, regardless of how the points are labelled or where they are located (unless the points are in the same place).

a. Show that it can always be done for N = 3 points on a plane of dimension d = 2, unless they are collinear.

b. Show that it cannot always be done for N = 4 points on a plane of dimension d = 2.

c. Show that it can always be done for N = 4 points in a space of dimension d = 3, unless they are coplanar.

d. Show that it cannot always be done for N = 5 points in a space of dimension d = 3.

e. The ambitious student may wish to prove that N points in general position (but not N + 1 are linearly separable in a space of dimension N - 1. From this it follows that the VC dimension (see Chapter 18) of linear halfspaces in dimension N - 1 is N.