Question 1: Short answer
mediumAI-checkedLearning TheoryFor a single classifier you are 95% sure that its test error is within of its true error. You now evaluate 20 classifiers on the same test set and, for simplicity, treat their 20 results as independent. What is the probability that at least one of them gets a misleading score (outside its interval)?