Can Humans (Reliably) Perform Alignment

• 45 document/abstract pairs from ZiffDavis corpus (product reviews)

  • Abstracts ~ 6 sentences, 128 words
  • Documents ~ 65 sentences, 1500 words

• Manually annotated word-to-word and phrase-to-phrase alignments