TY - GEN
T1 - SemEval-2016 task 12
T2 - 10th International Workshop on Semantic Evaluation, SemEval 2016
AU - Bethard, Steven
AU - Chen, Wei Te
AU - Pustejovsky, James
AU - Savova, Guergana
AU - Derczynski, Leon
AU - Verhagen, Marc
N1 - Funding Information:
The project described was supported in part by R01LM010090 (THYME) from the National Library Of Medicine. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Publisher Copyright:
© 2016 Association for Computational Linguistics.
PY - 2016
Y1 - 2016
N2 - Clinical TempEval 2016 evaluated temporal information extraction systems on the clinical domain. Nine sub-tasks were included, covering problems in time expression identification, event expression identification and temporal relation identification. Participant systems were trained and evaluated on a corpus of clinical and pathology notes from the Mayo Clinic, annotated with an extension of TimeML for the clinical domain. 14 teams submitted a total of 40 system runs, with the best systems achieving near-human performance on identifying events and times. On identifying temporal relations, there was a gap between the best systems and human performance, but the gap was less than half the gap of Clinical TempEval 2015.
AB - Clinical TempEval 2016 evaluated temporal information extraction systems on the clinical domain. Nine sub-tasks were included, covering problems in time expression identification, event expression identification and temporal relation identification. Participant systems were trained and evaluated on a corpus of clinical and pathology notes from the Mayo Clinic, annotated with an extension of TimeML for the clinical domain. 14 teams submitted a total of 40 system runs, with the best systems achieving near-human performance on identifying events and times. On identifying temporal relations, there was a gap between the best systems and human performance, but the gap was less than half the gap of Clinical TempEval 2015.
UR - http://www.scopus.com/inward/record.url?scp=85031911690&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85031911690&partnerID=8YFLogxK
U2 - 10.18653/v1/s16-1165
DO - 10.18653/v1/s16-1165
M3 - Conference contribution
AN - SCOPUS:85031911690
T3 - SemEval 2016 - 10th International Workshop on Semantic Evaluation, Proceedings
SP - 1052
EP - 1062
BT - SemEval 2016 - 10th International Workshop on Semantic Evaluation, Proceedings
PB - Association for Computational Linguistics (ACL)
Y2 - 16 June 2016 through 17 June 2016
ER -