SemEval 2018 Task 6: Parsing Time Normalizations

Egoitz Laparra; Dongfang Xu; Steven Bethard; Ahmed S. Elsayed; Martha Palmer

doi:10.18653/v1/s18-1011

SemEval 2018 Task 6: Parsing Time Normalizations

Egoitz Laparra
, Dongfang Xu
, Steven Bethard
, Ahmed S. Elsayed
, Martha Palmer

Information, School of

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

27 Scopus citations

Abstract

This paper presents the outcomes of the Parsing Time Normalization shared task held within SemEval-2018. The aim of the task is to parse time expressions into the compositional semantic graphs of the Semantically Compositional Annotation of Time Expressions (SCATE) schema, which allows the representation of a wider variety of time expressions than previous approaches. Two tracks were included, one to evaluate the parsing of individual components of the produced graphs, in a classic information extraction way, and another one to evaluate the quality of the time intervals resulting from the interpretation of those graphs. Though 40 participants registered for the task, only one team submitted output, achieving 0.55 F1 in Track 1 (parsing) and 0.70 F1 in Track 2 (intervals).

Original language	English (US)
Title of host publication	NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop
Editors	Marianna Apidianaki, Marianna Apidianaki, Saif M. Mohammad, Jonathan May, Ekaterina Shutova, Steven Bethard, Marine Carpuat
Publisher	Association for Computational Linguistics (ACL)
Pages	88-96
Number of pages	9
ISBN (Electronic)	9781948087209
DOIs	https://doi.org/10.18653/v1/s18-1011
State	Published - 2018
Event	12th International Workshop on Semantic Evaluation, SemEval 2018, co-located with the 16th Annual Conference of the North American Chapter of the - New Orleans, United States Duration: Jun 5 2018 → Jun 6 2018

Publication series

Name	NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop

Conference

Conference	12th International Workshop on Semantic Evaluation, SemEval 2018, co-located with the 16th Annual Conference of the North American Chapter of the
Country/Territory	United States
City	New Orleans
Period	6/5/18 → 6/6/18

ASJC Scopus subject areas

Computational Theory and Mathematics
Language and Linguistics
Linguistics and Language

Access to Document

10.18653/v1/s18-1011

Cite this

Laparra, E., Xu, D., Bethard, S., Elsayed, A. S., & Palmer, M. (2018). SemEval 2018 Task 6: Parsing Time Normalizations. In M. Apidianaki, M. Apidianaki, S. M. Mohammad, J. May, E. Shutova, S. Bethard, & M. Carpuat (Eds.), NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop (pp. 88-96). (NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/s18-1011

SemEval 2018 Task 6: Parsing Time Normalizations. / Laparra, Egoitz; Xu, Dongfang; Bethard, Steven et al.
NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop. ed. / Marianna Apidianaki; Marianna Apidianaki; Saif M. Mohammad; Jonathan May; Ekaterina Shutova; Steven Bethard; Marine Carpuat. Association for Computational Linguistics (ACL), 2018. p. 88-96 (NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Laparra, E, Xu, D, Bethard, S, Elsayed, AS & Palmer, M 2018, SemEval 2018 Task 6: Parsing Time Normalizations. in M Apidianaki, M Apidianaki, SM Mohammad, J May, E Shutova, S Bethard & M Carpuat (eds), NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop. NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop, Association for Computational Linguistics (ACL), pp. 88-96, 12th International Workshop on Semantic Evaluation, SemEval 2018, co-located with the 16th Annual Conference of the North American Chapter of the, New Orleans, United States, 6/5/18. https://doi.org/10.18653/v1/s18-1011

Laparra E, Xu D, Bethard S, Elsayed AS, Palmer M. SemEval 2018 Task 6: Parsing Time Normalizations. In Apidianaki M, Apidianaki M, Mohammad SM, May J, Shutova E, Bethard S, Carpuat M, editors, NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop. Association for Computational Linguistics (ACL). 2018. p. 88-96. (NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop). doi: 10.18653/v1/s18-1011

Laparra, Egoitz ; Xu, Dongfang ; Bethard, Steven et al. / SemEval 2018 Task 6 : Parsing Time Normalizations. NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop. editor / Marianna Apidianaki ; Marianna Apidianaki ; Saif M. Mohammad ; Jonathan May ; Ekaterina Shutova ; Steven Bethard ; Marine Carpuat. Association for Computational Linguistics (ACL), 2018. pp. 88-96 (NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop).

@inproceedings{27ef03b33b354921a49554124eb0826d,

title = "SemEval 2018 Task 6: Parsing Time Normalizations",

abstract = "This paper presents the outcomes of the Parsing Time Normalization shared task held within SemEval-2018. The aim of the task is to parse time expressions into the compositional semantic graphs of the Semantically Compositional Annotation of Time Expressions (SCATE) schema, which allows the representation of a wider variety of time expressions than previous approaches. Two tracks were included, one to evaluate the parsing of individual components of the produced graphs, in a classic information extraction way, and another one to evaluate the quality of the time intervals resulting from the interpretation of those graphs. Though 40 participants registered for the task, only one team submitted output, achieving 0.55 F1 in Track 1 (parsing) and 0.70 F1 in Track 2 (intervals).",

author = "Egoitz Laparra and Dongfang Xu and Steven Bethard and Elsayed, \{Ahmed S.\} and Martha Palmer",

note = "Publisher Copyright: {\textcopyright} 2018 Association for Computational Linguistics; 12th International Workshop on Semantic Evaluation, SemEval 2018, co-located with the 16th Annual Conference of the North American Chapter of the ; Conference date: 05-06-2018 Through 06-06-2018",

year = "2018",

doi = "10.18653/v1/s18-1011",

language = "English (US)",

series = "NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop",

publisher = "Association for Computational Linguistics (ACL)",

pages = "88--96",

editor = "Marianna Apidianaki and Marianna Apidianaki and Mohammad, \{Saif M.\} and Jonathan May and Ekaterina Shutova and Steven Bethard and Marine Carpuat",

booktitle = "NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop",

}

TY - GEN

T1 - SemEval 2018 Task 6

T2 - 12th International Workshop on Semantic Evaluation, SemEval 2018, co-located with the 16th Annual Conference of the North American Chapter of the

AU - Laparra, Egoitz

AU - Xu, Dongfang

AU - Bethard, Steven

AU - Elsayed, Ahmed S.

AU - Palmer, Martha

PY - 2018

Y1 - 2018

N2 - This paper presents the outcomes of the Parsing Time Normalization shared task held within SemEval-2018. The aim of the task is to parse time expressions into the compositional semantic graphs of the Semantically Compositional Annotation of Time Expressions (SCATE) schema, which allows the representation of a wider variety of time expressions than previous approaches. Two tracks were included, one to evaluate the parsing of individual components of the produced graphs, in a classic information extraction way, and another one to evaluate the quality of the time intervals resulting from the interpretation of those graphs. Though 40 participants registered for the task, only one team submitted output, achieving 0.55 F1 in Track 1 (parsing) and 0.70 F1 in Track 2 (intervals).

AB - This paper presents the outcomes of the Parsing Time Normalization shared task held within SemEval-2018. The aim of the task is to parse time expressions into the compositional semantic graphs of the Semantically Compositional Annotation of Time Expressions (SCATE) schema, which allows the representation of a wider variety of time expressions than previous approaches. Two tracks were included, one to evaluate the parsing of individual components of the produced graphs, in a classic information extraction way, and another one to evaluate the quality of the time intervals resulting from the interpretation of those graphs. Though 40 participants registered for the task, only one team submitted output, achieving 0.55 F1 in Track 1 (parsing) and 0.70 F1 in Track 2 (intervals).

UR - https://www.scopus.com/pages/publications/85122303117

UR - https://www.scopus.com/pages/publications/85122303117#tab=citedBy

U2 - 10.18653/v1/s18-1011

DO - 10.18653/v1/s18-1011

M3 - Conference contribution

AN - SCOPUS:85122303117

T3 - NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop

SP - 88

EP - 96

BT - NAACL HLT 2018 - International Workshop on Semantic Evaluation, SemEval 2018 - Proceedings of the 12th Workshop

A2 - Apidianaki, Marianna

A2 - Mohammad, Saif M.

A2 - May, Jonathan

A2 - Shutova, Ekaterina

A2 - Bethard, Steven

A2 - Carpuat, Marine

PB - Association for Computational Linguistics (ACL)

Y2 - 5 June 2018 through 6 June 2018

ER -

SemEval 2018 Task 6: Parsing Time Normalizations

Abstract

Publication series

Conference

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this