Our model predicts which people have Covid-19. The model correctly predicts 100 people who have Covid-19, but it misses 50 people who have the illness and falsely predicts that 10 people have the illness when they don't. What is the precision of the model?
Intro to ML: Evaluation (Part 1)

Quiz
•
Computers
•
University
•
Medium

Josiah Wang
Used 15+ times
FREE Resource
10 questions
Show all answers
1.
MULTIPLE CHOICE QUESTION
1 min • 1 pt
91%
66%
Not enough information
Answer explanation
The precision of a model is calculated as the number of true positives (100 in this case) divided by the sum of true positives and false positives (100+10). This gives us 100/110 = 0.909, which is approximately 91%. Therefore, the correct answer is 91%.
2.
MULTIPLE CHOICE QUESTION
1 min • 1 pt
A diagnostic test is used to identify individuals with a certain disease. The test correctly identifies 120 individuals with the disease, but fails to identify 30 individuals who actually have it, and incorrectly identifies 15 individuals as having the disease. What is the recall of the test?
80%
75%
Not enough information
Answer explanation
Recall is calculated as true positives divided by the sum of true positives and false negatives. Here, recall = 120 / (120 + 30) = 120 / 150 = 0.8 or 80%. Thus, the correct answer is 80%.
3.
MULTIPLE CHOICE QUESTION
1 min • 1 pt
If we predict True for every observation, what will our model recall be?
Not enough information
0%
100%
Answer explanation
The recall of a model is calculated as the number of true positives divided by the sum of true positives and false negatives. If we predict True for every observation, there will be no false negatives, hence the recall will be 100%. This is because we are correctly identifying all positive cases, even though we may also be incorrectly identifying some negative cases as positive.
4.
MULTIPLE CHOICE QUESTION
1 min • 1 pt
Which of the following do we use a test set for?
We use it to evaluate new features that we could add to our model
We use it for hyper-parameter tuning
We use it for held-out performance evaluation
None of the above
Answer explanation
The test set is used for held-out performance evaluation. This means it is used to assess the performance of a model on unseen data, providing an unbiased evaluation of the final model fit. It is not used for hyper-parameter tuning or evaluating new features for the model.
5.
MULTIPLE CHOICE QUESTION
1 min • 1 pt
When is cross validation particularly helpful?
When we have a small dataset
When we have a large dataset
When we are particularly constrained on computational resources
Answer explanation
Cross validation is particularly helpful when we have a small dataset because it allows us to maximize the use of limited data for both training and validation. By dividing the dataset into multiple folds and iteratively training and validating on different subsets, we can obtain a more accurate estimate of the model's performance and reduce the risk of overfitting.
6.
MULTIPLE CHOICE QUESTION
1 min • 1 pt
Which of the following does an F1 score depend on?
TP, FP, FN
TP, TN, FP, TN
TN, FP, TP
TP, FN
Answer explanation
The F1 score is a measure of a test's accuracy and it depends on True Positive (TP), False Positive (FP), and False Negative (FN). It is the harmonic mean of precision and recall, where precision is TP/(TP+FP) and recall is TP/(TP+FN). Therefore, the correct answer is 'TP, FP, FN'.
7.
MULTIPLE CHOICE QUESTION
1 min • 1 pt
Which of the following could you use to evaluate performance on a regression task?
Precision
Recall
Accuracy
MSE
Answer explanation
MSE, or Mean Squared Error, is the correct choice for evaluating performance on a regression task. It measures the average of the squares of the errors—that is, the average squared difference between the estimated values and the actual value. Precision, Recall, and Accuracy are metrics used for classification tasks, not regression tasks.
Create a free account and access millions of resources
Similar Resources on Quizizz
15 questions
Analytical IS-Sesi 1 sd 4

Quiz
•
University
10 questions
AFP Midtvejsevaluering

Quiz
•
University
13 questions
Machine Learning

Quiz
•
9th Grade - University
10 questions
Gradient Descent Method

Quiz
•
University
15 questions
Lesson 3: Human Factors as HCI Theories

Quiz
•
University
15 questions
Applying AI Techniques

Quiz
•
University
15 questions
AIML

Quiz
•
University
15 questions
Classification Quiz

Quiz
•
University
Popular Resources on Quizizz
20 questions
math review

Quiz
•
4th Grade
20 questions
Math Review - Grade 6

Quiz
•
6th Grade
20 questions
Reading Comprehension

Quiz
•
5th Grade
20 questions
Types of Credit

Quiz
•
9th - 12th Grade
20 questions
Taxes

Quiz
•
9th - 12th Grade
10 questions
Human Body Systems and Functions

Interactive video
•
6th - 8th Grade
19 questions
Math Review

Quiz
•
3rd Grade
45 questions
7th Grade Math EOG Review

Quiz
•
7th Grade
Discover more resources for Computers
20 questions
Summer

Quiz
•
KG - University
6 questions
Railroad Operations and Classifications Quiz

Quiz
•
University
47 questions
2nd Semester 2025 Map Final

Quiz
•
KG - University
43 questions
Science 5th Grade EOG Review #3

Quiz
•
KG - University
24 questions
Cartoon Characters

Quiz
•
KG - University
9 questions
What is your personality?

Quiz
•
University
10 questions
El Presente

Quiz
•
1st Grade - University
32 questions
NC Biology EOC Review : Heredity, Genetics, Biotechnology

Quiz
•
KG - University