TY - GEN
T1 - Analyzing Large Language Models' Capability in Location Prediction
AU - Xiao, Zhaomin
AU - Huang, Yan
AU - Blanco, Eduardo
N1 - Publisher Copyright:
© 2024 ELRA Language Resource Association: CC BY-NC 4.0.
PY - 2024
Y1 - 2024
N2 - In this paper, we investigate and evaluate large language models' capability in location prediction. We present experimental results with four models-FLAN-T5, FLAN-UL2, FLAN-Alpaca, and ChatGPT-in various instruction finetuning and exemplar settings. We analyze whether taking into account the context-tweets published before and after the tweet mentioning a location-is beneficial. Additionally, we conduct an ablation study to explore whether instruction modification is beneficial. Lastly, our qualitative analysis sheds light on the errors made by the best-performing model.
AB - In this paper, we investigate and evaluate large language models' capability in location prediction. We present experimental results with four models-FLAN-T5, FLAN-UL2, FLAN-Alpaca, and ChatGPT-in various instruction finetuning and exemplar settings. We analyze whether taking into account the context-tweets published before and after the tweet mentioning a location-is beneficial. Additionally, we conduct an ablation study to explore whether instruction modification is beneficial. Lastly, our qualitative analysis sheds light on the errors made by the best-performing model.
KW - Large Language Models
KW - Location Prediction
UR - https://www.scopus.com/pages/publications/85195947245
UR - https://www.scopus.com/pages/publications/85195947245#tab=citedBy
M3 - Conference contribution
AN - SCOPUS:85195947245
T3 - 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC-COLING 2024 - Main Conference Proceedings
SP - 951
EP - 958
BT - 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC-COLING 2024 - Main Conference Proceedings
A2 - Calzolari, Nicoletta
A2 - Kan, Min-Yen
A2 - Hoste, Veronique
A2 - Lenci, Alessandro
A2 - Sakti, Sakriani
A2 - Xue, Nianwen
PB - European Language Resources Association (ELRA)
T2 - Joint 30th International Conference on Computational Linguistics and 14th International Conference on Language Resources and Evaluation, LREC-COLING 2024
Y2 - 20 May 2024 through 25 May 2024
ER -