Question 1: Short answer
hardAI-checkedEvaluation MetricsA part-of-speech tagger with three tags has this confusion matrix (rows: true tag, columns: predicted tag):
| NN | VB | ADJ | |
|---|---|---|---|
| NN | 25 | 5 | 1 |
| VB | 2 | 15 | 12 |
| ADJ | 1 | 6 | 0 |
Compute the macro-F1 score as the plain average of the three per-class F1 scores. ADJ has precision and recall 0; count its F1 as 0.