Overview for the First Shared Task on Language Identification in Code-Switched Data

Thamar Solorio; Elizabeth Blair; Suraj Maharjan; Steven Bethard; Mona Diab; Mahmoud Gohneim; Abdelati Hawwari; Fahad AlGhamdi; Julia Hirschberg; Alison Chang; Pascale Fung

Overview for the First Shared Task on Language Identification in Code-Switched Data

Thamar Solorio, Elizabeth Blair, Suraj Maharjan, Steven Bethard, Mona Diab, Mahmoud Gohneim, Abdelati Hawwari, Fahad AlGhamdi, Julia Hirschberg, Alison Chang, Pascale Fung

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

200 Scopus citations

Abstract

We present an overview of the first shared task on language identification on codeswitched data. The shared task included code-switched data from four language pairs: Modern Standard Arabic-Dialectal Arabic (MSA-DA), Mandarin-English (MAN-EN), Nepali-English (NEP-EN), and Spanish-English (SPA-EN). A total of seven teams participated in the task and submitted 42 system runs. The evaluation showed that language identification at the token level is more difficult when the languages present are closely related, as in the case of MSA-DA, where the prediction performance was the lowest among all language pairs. In contrast, the language pairs with the higest F-measure where SPA-EN and NEP-EN. The task made evident that language identification in code-switched data is still far from solved and warrants further research.

Original language	English (US)
Title of host publication	1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings
Editors	Mona Diab, Julia Hirschberg, Pascale Fung, Thamar Solorio
Publisher	Association for Computational Linguistics (ACL)
Pages	62-72
Number of pages	11
ISBN (Electronic)	9781937284961
State	Published - 2014
Externally published	Yes
Event	1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Doha, Qatar Duration: Oct 25 2014 → …

Publication series

Name	1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings

Conference

Conference	1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014
Country/Territory	Qatar
City	Doha
Period	10/25/14 → …

ASJC Scopus subject areas

Computational Theory and Mathematics
Language and Linguistics
Linguistics and Language

Cite this

Solorio, T., Blair, E., Maharjan, S., Bethard, S., Diab, M., Gohneim, M., Hawwari, A., AlGhamdi, F., Hirschberg, J., Chang, A., & Fung, P. (2014). Overview for the First Shared Task on Language Identification in Code-Switched Data. In M. Diab, J. Hirschberg, P. Fung, & T. Solorio (Eds.), 1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings (pp. 62-72). (1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings). Association for Computational Linguistics (ACL).

Overview for the First Shared Task on Language Identification in Code-Switched Data. / Solorio, Thamar; Blair, Elizabeth; Maharjan, Suraj et al.
1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings. ed. / Mona Diab; Julia Hirschberg; Pascale Fung; Thamar Solorio. Association for Computational Linguistics (ACL), 2014. p. 62-72 (1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Solorio, T, Blair, E, Maharjan, S, Bethard, S, Diab, M, Gohneim, M, Hawwari, A, AlGhamdi, F, Hirschberg, J, Chang, A & Fung, P 2014, Overview for the First Shared Task on Language Identification in Code-Switched Data. in M Diab, J Hirschberg, P Fung & T Solorio (eds), 1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings. 1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings, Association for Computational Linguistics (ACL), pp. 62-72, 1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, Doha, Qatar, 10/25/14.

Solorio T, Blair E, Maharjan S, Bethard S, Diab M, Gohneim M et al. Overview for the First Shared Task on Language Identification in Code-Switched Data. In Diab M, Hirschberg J, Fung P, Solorio T, editors, 1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings. Association for Computational Linguistics (ACL). 2014. p. 62-72. (1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings).

Solorio, Thamar ; Blair, Elizabeth ; Maharjan, Suraj et al. / Overview for the First Shared Task on Language Identification in Code-Switched Data. 1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings. editor / Mona Diab ; Julia Hirschberg ; Pascale Fung ; Thamar Solorio. Association for Computational Linguistics (ACL), 2014. pp. 62-72 (1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings).

@inproceedings{57ef2145e09641bbadce9e75db31fff1,

title = "Overview for the First Shared Task on Language Identification in Code-Switched Data",

abstract = "We present an overview of the first shared task on language identification on codeswitched data. The shared task included code-switched data from four language pairs: Modern Standard Arabic-Dialectal Arabic (MSA-DA), Mandarin-English (MAN-EN), Nepali-English (NEP-EN), and Spanish-English (SPA-EN). A total of seven teams participated in the task and submitted 42 system runs. The evaluation showed that language identification at the token level is more difficult when the languages present are closely related, as in the case of MSA-DA, where the prediction performance was the lowest among all language pairs. In contrast, the language pairs with the higest F-measure where SPA-EN and NEP-EN. The task made evident that language identification in code-switched data is still far from solved and warrants further research.",

author = "Thamar Solorio and Elizabeth Blair and Suraj Maharjan and Steven Bethard and Mona Diab and Mahmoud Gohneim and Abdelati Hawwari and Fahad AlGhamdi and Julia Hirschberg and Alison Chang and Pascale Fung",

note = "Publisher Copyright: {\textcopyright} 2014 Association for Computational Linguistics; 1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 ; Conference date: 25-10-2014",

year = "2014",

language = "English (US)",

series = "1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings",

publisher = "Association for Computational Linguistics (ACL)",

pages = "62--72",

editor = "Mona Diab and Julia Hirschberg and Pascale Fung and Thamar Solorio",

booktitle = "1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings",

}

TY - GEN

T1 - Overview for the First Shared Task on Language Identification in Code-Switched Data

AU - Solorio, Thamar

AU - Blair, Elizabeth

AU - Maharjan, Suraj

AU - Bethard, Steven

AU - Diab, Mona

AU - Gohneim, Mahmoud

AU - Hawwari, Abdelati

AU - AlGhamdi, Fahad

AU - Hirschberg, Julia

AU - Chang, Alison

AU - Fung, Pascale

PY - 2014

Y1 - 2014

N2 - We present an overview of the first shared task on language identification on codeswitched data. The shared task included code-switched data from four language pairs: Modern Standard Arabic-Dialectal Arabic (MSA-DA), Mandarin-English (MAN-EN), Nepali-English (NEP-EN), and Spanish-English (SPA-EN). A total of seven teams participated in the task and submitted 42 system runs. The evaluation showed that language identification at the token level is more difficult when the languages present are closely related, as in the case of MSA-DA, where the prediction performance was the lowest among all language pairs. In contrast, the language pairs with the higest F-measure where SPA-EN and NEP-EN. The task made evident that language identification in code-switched data is still far from solved and warrants further research.

AB - We present an overview of the first shared task on language identification on codeswitched data. The shared task included code-switched data from four language pairs: Modern Standard Arabic-Dialectal Arabic (MSA-DA), Mandarin-English (MAN-EN), Nepali-English (NEP-EN), and Spanish-English (SPA-EN). A total of seven teams participated in the task and submitted 42 system runs. The evaluation showed that language identification at the token level is more difficult when the languages present are closely related, as in the case of MSA-DA, where the prediction performance was the lowest among all language pairs. In contrast, the language pairs with the higest F-measure where SPA-EN and NEP-EN. The task made evident that language identification in code-switched data is still far from solved and warrants further research.

UR - http://www.scopus.com/inward/record.url?scp=85122045297&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85122045297&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85122045297

T3 - 1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings

SP - 62

EP - 72

BT - 1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 - Proceedings

A2 - Diab, Mona

A2 - Hirschberg, Julia

A2 - Fung, Pascale

A2 - Solorio, Thamar

PB - Association for Computational Linguistics (ACL)

T2 - 1st Workshop on Computational Approaches to Code Switching, Switching 2014 at the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014

Y2 - 25 October 2014

ER -

Overview for the First Shared Task on Language Identification in Code-Switched Data

Abstract

Publication series

Conference

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this