TY - GEN
T1 - End-to-end clinical temporal information extraction with multi-head attention
AU - Miller, Timothy
AU - Bethard, Steven
AU - Dligach, Dmitriy
AU - Savova, Guergana
N1 - Publisher Copyright:
© 2023 Association for Computational Linguistics.
PY - 2023
Y1 - 2023
N2 - Understanding temporal relationships in text from electronic health records can be valuable for many important downstream clinical applications. Since Clinical TempEval 2017, there has been little work on end-to-end systems for temporal relation extraction, with most work focused on the setting where gold standard events and time expressions are given. In this work, we make use of a novel multi-headed attention mechanism on top of a pre-trained transformer encoder to allow the learning process to attend to multiple aspects of the contextualized embeddings. Our system achieves state of the art results on the THYME corpus by a wide margin, in both the in-domain and cross-domain settings.
AB - Understanding temporal relationships in text from electronic health records can be valuable for many important downstream clinical applications. Since Clinical TempEval 2017, there has been little work on end-to-end systems for temporal relation extraction, with most work focused on the setting where gold standard events and time expressions are given. In this work, we make use of a novel multi-headed attention mechanism on top of a pre-trained transformer encoder to allow the learning process to attend to multiple aspects of the contextualized embeddings. Our system achieves state of the art results on the THYME corpus by a wide margin, in both the in-domain and cross-domain settings.
UR - http://www.scopus.com/inward/record.url?scp=85174485048&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85174485048&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85174485048
T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics
SP - 313
EP - 319
BT - BioNLP 2023 - BioNLP and BioNLP-ST, Proceedings of the Workshop
A2 - Demner-fushman, Dina
A2 - Ananiadou, Sophia
A2 - Cohen, Kevin
PB - Association for Computational Linguistics (ACL)
T2 - 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks, BioNLP 2023
Y2 - 13 July 2023
ER -