SemEval-2016 task 12: Clinical TempEval

Steven Bethard, Wei Te Chen, James Pustejovsky, Guergana Savova, Leon Derczynski, Marc Verhagen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

101 Scopus citations

Abstract

Clinical TempEval 2016 evaluated temporal information extraction systems on the clinical domain. Nine sub-tasks were included, covering problems in time expression identification, event expression identification and temporal relation identification. Participant systems were trained and evaluated on a corpus of clinical and pathology notes from the Mayo Clinic, annotated with an extension of TimeML for the clinical domain. 14 teams submitted a total of 40 system runs, with the best systems achieving near-human performance on identifying events and times. On identifying temporal relations, there was a gap between the best systems and human performance, but the gap was less than half the gap of Clinical TempEval 2015.

Original languageEnglish (US)
Title of host publicationSemEval 2016 - 10th International Workshop on Semantic Evaluation, Proceedings
PublisherAssociation for Computational Linguistics (ACL)
Pages1052-1062
Number of pages11
ISBN (Electronic)9781941643952
DOIs
StatePublished - 2016
Externally publishedYes
Event10th International Workshop on Semantic Evaluation, SemEval 2016 - San Diego, United States
Duration: Jun 16 2016Jun 17 2016

Publication series

NameSemEval 2016 - 10th International Workshop on Semantic Evaluation, Proceedings

Conference

Conference10th International Workshop on Semantic Evaluation, SemEval 2016
Country/TerritoryUnited States
CitySan Diego
Period6/16/166/17/16

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computational Theory and Mathematics
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'SemEval-2016 task 12: Clinical TempEval'. Together they form a unique fingerprint.

Cite this