Skip to content
ml-recall

#entity-level-evaluation

1 question from NLP Tasks

Timed test

1 question · 1 min · score and explanations at the end

Take a test
Q 1 / 1Score 0 / 0

Question 1: Short answer

hardAI-checkedNLP Tasks

Gold and predicted BIO tags for a 12-token sentence:

Token Gold Predicted
Ada B-PER B-PER
Lovelace I-PER O
met O O
the O O
Royal B-ORG B-ORG
Astronomical I-ORG I-ORG
Society I-ORG I-ORG
in O O
London B-LOC O
and O O
Hyde B-LOC B-PER
Park I-LOC I-PER

Entities count as correct only if both the span and the type match exactly. What is the entity-level F1 score?

a number between 0 and 1, e.g. 0.42