Question 1: Short answer
mediumAI-checkedLinear Models & RegularizationA design matrix has (2-norm) condition number , the ratio of its largest to smallest singular value. You solve least squares through the normal equations, i.e. you form and solve with . What is the condition number of ?