TY - GEN
T1 - Transformer-based cynical expression detection in a corpus of Spanish YouTube reviews
AU - González-López, Samuel
AU - Bethard, Steven
N1 - Publisher Copyright:
© 2023 Association for Computational Linguistics.
PY - 2023
Y1 - 2023
N2 - Consumers of services and products exhibit a wide range of behaviors on social networks when they are dissatisfied. In this paper, we consider three types of cynical expressions – negative feelings, specific reasons, and attitude of being right – and annotate a corpus of 3189 comments in Spanish on car analysis channels from YouTube. We evaluate both token classification and text classification settings for this problem, and compare performance of different pre-trained models including BETO, SpanBERTa, Multilingual Bert, and RoBERTuito. The results show that models achieve performance above 0.8 F1 for all types of cynical expressions in the text classification setting, but achieve lower performance (around 0.6-0.7 F1) for the harder token classification setting.
AB - Consumers of services and products exhibit a wide range of behaviors on social networks when they are dissatisfied. In this paper, we consider three types of cynical expressions – negative feelings, specific reasons, and attitude of being right – and annotate a corpus of 3189 comments in Spanish on car analysis channels from YouTube. We evaluate both token classification and text classification settings for this problem, and compare performance of different pre-trained models including BETO, SpanBERTa, Multilingual Bert, and RoBERTuito. The results show that models achieve performance above 0.8 F1 for all types of cynical expressions in the text classification setting, but achieve lower performance (around 0.6-0.7 F1) for the harder token classification setting.
UR - http://www.scopus.com/inward/record.url?scp=85174855289&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85174855289&partnerID=8YFLogxK
U2 - 10.18653/v1/2023.wassa-1.18
DO - 10.18653/v1/2023.wassa-1.18
M3 - Conference contribution
AN - SCOPUS:85174855289
T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics
SP - 194
EP - 201
BT - WASSA 2023 - 13th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, Proceedings of the Workshop
A2 - Barnes, Jeremy
A2 - De Clercq, Orphee
A2 - Klinger, Roman
PB - Association for Computational Linguistics (ACL)
T2 - 13th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, WASSA 2023
Y2 - 14 July 2023
ER -