A records clerk must point at the filing date already written in a…

Question

A records clerk must point at the filing date already written in a short passage. One score requires the span to match gold characters exactly; another gives partial credit when the words mostly overlap. How should they pick?

Accepted Answer

Use exact match when the clerk needs the span character-for-character; use token-overlap or F1 when a near-miss wording still helps. — The filing date is already in the passage. Use exact match when the clerk needs those characters. Use token-overlap or F1 when a near-miss still helps. A summary n-gram and a politeness rank do not measure the span.

Answer

Always prefer exact match and ignore overlap, because partial credit never informs extractive QA.

Answer

Score the date with a summary overlap number, because any short answer is a summary.

Answer

Skip both span scores and rank models by how polite the date sounds.

A records clerk must point at the filing date already written in a short passage. One score requires the span to match gold characters exactly; another gives partial credit when the words mostly overlap. How should they pick?

Short Explanation

Full Explanation